当前位置:网站首页>How to use webrtc to realize low latency live broadcast of tsingsee Qingxi video intelligent analysis platform based on cloud side end architecture?

How to use webrtc to realize low latency live broadcast of tsingsee Qingxi video intelligent analysis platform based on cloud side end architecture?

2020-12-08 10:07:05 osc_ inj0cicw

at present TSINGSEE Qingxi video cloud edge architecture video intelligent analysis platform has realized low latency live video , The lowest live delay protocol during our test period should be ws-FLV、RTMP It's agreed , The optimal delay of testing can reach 1s about . At present, most domestic manufacturers are using RTMP, It is relative to the HLS Optimized on the server .RTMP The server will no longer slice , Instead, each frame is forwarded separately ,CDN Distribution latency is very small .

GBS4.png

The picture above is the national standard video platform EasyGBS Output video stream playback interface , It can output video streams of three different protocols , among FLV In low delay live broadcast in the use of more common , meanwhile RTMP Low latency can also be achieved , If you are interested, you can study .

And for the increasingly high requirements of live video , We already need to explore solutions with lower latency ,webrtc It happens to be a new way for the development of this technology , This is also TSINGSEE Qingxi video R & D team is constantly testing webrtc The value of .

During the test , We found the standard WebRTC There will be various restrictions in the access process , For example, it doesn't support the common audio in live broadcasting AAC Coding and 44.1k Sampling rate , Other does not support video B frame 、H265 Equal coding characteristics , many slice The code will also display in weak network , also WebRTC The process of establishing a union takes too long , It will affect the second on experience . Regarding this , We're also looking for more efficient 、 More compatible protocol access , So that webrtc For live video .

106.png

standard WebRTC Advantages of access :

standard WebRTC Access in addition to HTTP Out of union building request , All in line WebRTC standard .
Standard terminal for easy access .
Rapid prototyping .

standard WebRTC Disadvantages of access :

It takes a long time to establish a joint venture , Use HTTP In case of 5RTT, choose HTTPS It will be longer .
Media must be encrypted for transmission .
There are restrictions on audio and video , It needs to transcode on the server .

be based on webrtc Full module access scheme , Use webrtc All modules of , Through the modification of some modules , Realize low latency live broadcast function . The advantages of this scheme are very attractive , After years of development , It's very mature , Very stable , At the same time, it provides a complete solution , Include NACK、jitterbuffer、NetEQ Etc. can be directly used for low latency live broadcast .

105.png

But its disadvantages are also obvious , As shown in the figure above WebRTC The overall architecture , It's a collection from 、 Rendering 、 A complete end-to-end solution for codec to network transmission , It is very invasive to the existing streaming end and playback end , High complexity .RTC There are differences between technology stack and live broadcast technology stack , He doesn't support B frame 、265 Other characteristics . stay QOS Strategic ,WebRTC The native application scenario of is call , Its basic strategy is to delay better than picture quality , This strategy doesn't necessarily hold true in live broadcast . Bag size : all webrtc Add all modules to APP in , Increase package size at least 3M.

The development demand of low delay live broadcast technology is more and more obvious , It can not only enhance the user experience , It can also bring more convenient operation for the operation and maintenance of live video , meanwhile , Low latency live broadcast technology can also support more business forms . Regarding this ,TSINGSEE Qingxi video R & D team is still in the process of testing ,5G After the arrival , Network environment will be better and better , Low latency live broadcasting technology will become a technical direction of the live broadcasting industry in the future .

 Cloud edge end .png

If you're right TSINGSEE Qingxi video R & D team on webrtc More interested in the development of , You can read our previous related blogs :Visual Studio 2017 build by oneself WebRTC in peerconnection_client Error mismatch in program compilation WebRTC The implementation of local area network video connection steps . At the same time, we also welcome you to discuss the relevant content with us .

版权声明
本文为[osc_ inj0cicw]所创,转载请带上原文链接,感谢
https://chowdera.com/2020/12/20201208100632808l.html