当前位置:网站首页>Alibaba cloud video cloud real-time subtitle technology helps hero League S10 global finals

Alibaba cloud video cloud real-time subtitle technology helps hero League S10 global finals

2020-11-10 17:24:03 Alicloud video cloud

The annual global finals of the League of heroes came to an end in Shanghai ,DWG To overcome SN Get the League of Heroes S10 World Finals champion ,LCK Back to the top three years later , Congratulations DWG.

file

As the top stream of E-sports 《 Hero alliance 》 Global finals , since 9 Since its opening in January , E-sports fans focus on the live game platform , In order to better provide spectators with the experience of watching the game , Alicloud video cloud and launch of real-time voice subtitle system , And the application of a well-known domestic game live platform .

This technology is developed by Alibaba cloud video cloud technology team and Dharma academy speech recognition and NLP Team work together to complete the research and development , In the form of real-time voice subtitles S10 In the competition . More precisely , Real time subtitle technology for this live game scene , Alicloud video cloud is the first successful pioneer to launch , according to the understanding of , Even around the world , It is almost the first successful attempt of real-time subtitle technology in game scenes . so , It's also the first time it's been used in the League of Heroes S10 In top events , It's the first live game experience .

stay S10 Live , The scene importance of this real-time subtitle technology lies in two aspects : First of all , Thoroughly improve the existing live experience problems , Extends the possibilities of the scene , For example, for those who can't listen to the competition directly 、 Or the noisy environment makes it hard to hear 、 Or the speaker's language is not standard, which makes it difficult to understand 、 And those who have difficulty hearing , They can use real-time subtitles to help understand , Resolve ambiguity , So it expands the online audience . second , Real time subtitles can make video distribution more professional , Improve the professionalism of live broadcast platform for scene production capacity , Especially for some special terms of E-sports , It allows entry-level users to understand the word , From the word meaning , From Yi Ming word , So as to enhance the experience of live game , Guide more pan E-sports audiences .

 A platform with real-time voice subtitles S10 live broadcast

In the field of live games , The output core of this technology is , Specific speech recognition for specific game scenes , And real-time display in the live stream , Let the audience at the distribution end can use the word 、 The sound 、 Draw multi-dimensional information to understand the video content . For the future live game industry , It opened a new way to play live games , Let live real-time speech recognition technology help large-scale game distribution better , It has more dimensional and extensible value for the whole industry .

In the practice of the technical scheme of the project , The core research and development link and the difficulty of overcoming lie in two aspects :1. The accuracy of speech recognition ;2. word 、 The sound 、 Draw three in real time and in sync , And then synthesize and show . In these two aspects , The video cloud and the Dharma academy cooperate as a whole and attack separately . Dharma academy mainly solves the accuracy of speech recognition , Training models through specific game scenarios , Improve accuracy ; Alicloud video cloud provides full link solutions , Access the live stream of customers 、 Voice separation of live stream 、 Call Dharma Hall's speech recognition to get subtitles 、 Then the words, sounds and pictures are synchronized 、 Composite display , Finally distribute .

 Technical scheme diagram

For real-time subtitle Technology , Alibaba cloud's video cloud team has accumulated for a long time , At first , What video cloud realizes is the function of inserting subtitles in real time , Later, the real-time voice subtitle was gradually realized , There is an essential difference between it and real-time subtitle insertion , namely , Real time voice subtitle is a subtitle stream , At the same time, it has a certain timeliness , Real time is needed 、 Synchronization of words, sounds and pictures , And the display time mechanism is different .

Long before the development of live game scenes , Alibaba cloud video cloud has successfully developed global express (AliExpress) Real time subtitle project of overseas e-commerce live broadcast ,AliExpress As “ Taobao International ” Cross border e-commerce platform , Its real-time subtitles and videos are translated by Alibaba cloud , Multi lingual subtitle display , It is also the world's first multi language e-commerce live real-time translation system jointly built by video cloud and Dharma Academy .

To be precise , At present ,S10 The real-time subtitle technology of the competition , The mature real-time voice subtitle scheme of Alibaba cloud video guide station is used to provide this function ,S10 After the support is over , The following more live game scenes can be more widely reused this voice subtitle live broadcast scheme , Including Youku 、B standing 、 Tiktok 、 Kwai, this video platform .

In the future, live broadcast of large-scale E-sports Events , Alicloud video cloud to real-time subtitle Technology 、 Real time voice technology , And there's a new technological space to think about :1、 The accuracy of speech recognition needs to be further improved ;2、 It can also be used for real-time translation in application scenarios , Make sure it's distributed across countries ;3、 Achieve lower latency , At present, it is RTMP Delay [3-5s], In fact, we can do better RTS Delay [1-2s], This greatly improves the online experience .

Compared with live games 、 E-commerce live broadcast 、 Or real-time voice subtitles for other live scenes , It is consistent in the nature of technical logic , It's the synchronization of subtitles 、 Synthesis and presentation , however , Different scenes , The model of speech recognition is completely different , For example, e-commerce has professional terms for e-commerce , Games have game terms , There are also some field slang , therefore , Specific speech recognition model training is needed to complete . future , For real-time subtitles 【 Support live voice subtitle live 】 Technology research and development , Alibaba cloud video cloud has further technology upgrade planning direction : One side , Make the user's access more flexible , Subtitle model configuration and subtitle style display are more convenient ; On the other hand , Support more specific scenarios , Improve the speech recognition rate of specific scene , In this way, it can be reused in more concrete scenes .

Through alicloud video cloud real-time subtitle Technology , More outsiders are relaxed get To S10 Description of the event commentary , Understand the various heroes of the Alliance , Feel the charm of E-sports culture .

Alicloud video cloud will have more scenes 、 More dimensions to explore technology , Driving the future of new content and new interaction , To bring you more video cloud experience .

file

Ali cloud video cloud technology official account for the video cloud industry and technology trends , make “ New content ”、“ New interaction ”.

版权声明
本文为[Alicloud video cloud]所创,转载请带上原文链接,感谢