乐趣区

关于rtsp:RTSP-H264-流-MSE-播放

elsampsa/websocket-mse-demo 我的项目介绍:

It this demo we’re streaming live video from an RTSP camera to your HTML5 browser.

Video is streamed as H264 encapsulated in MP4. No transcoding takes place in the stream-to-browser pipeline. No browser-side flash or pure-javascript decoders required.

Video is decoded and presented in the browser using the W3 Media Source Extensions that is well supported by all major browsers by > now.

Only H264 is supported – browser MSE’s do not support H246 yet (and neither does libValkka).

实现了浏览器 MSE (Media Source Extensions) 播放相机 RTSP (Real Time Streaming Protocol) 流。入手体验一下咯~

筹备

# 零碎 Ubuntu 18

# 如有 conda 虚拟环境,请停用
# conda deactivate

# 获取代码
git clone --depth 1 https://github.com/elsampsa/websocket-mse-demo.git

# 装置 libValkka
sudo apt-add-repository ppa:sampsa-riikonen/valkka
sudo apt-get update
sudo apt-get install valkka

# 装置 nginx
sudo apt-get install nginx

# 装置 python websockets
pip3 install websockets

# 筹备 nginx 用户权限
sudo addgroup nginx
sudo adduser $USER nginx
sudo chgrp -R nginx /var/lib/nginx /var/log/nginx
sudo chmod -R g+r+w+x /var/lib/nginx /var/log/nginx
# 切换用户组
newgrp nginx
id

# 测试 nginx 工作是否失常(无 Permission denied)cd websocket-mse-demo
nginx -p $PWD -c ./nginx.conf -g 'error_log error.log warn;'

# 设置相机发送 H264(该我的项目只反对 H264)

应用

发送 RTSP 流:

sudo snap install vlc
# allow camera permission
snap connect vlc:camera :camera

# 发送 ~/Videos/test.mp4 文件(循环)#  https://archive.org/download/archive-video-files/test.mp4
vlc file:///$HOME/Videos/test.mp4 --loop \
--sout '#gather:transcode{vcodec=h264}:rtp{sdp=rtsp://:8554/test}' \
--network-caching=1500 --sout-all --sout-keep

# 或,发送 /dev/video0 webcam(实时)vlc v4l2:///dev/video0:chroma=yuyv:width=640:height=480:fps=30 \
--sout '#transcode{vcodec=h264,width=640,height=480}:rtp{sdp=rtsp://:8554/test}'

# 测试接管 RTSP 流
vlc rtsp://127.0.0.1:8554/test

启动程序:

killall -9 nginx
python3 ws_serve_new.py rtsp://127.0.0.1:8554/test

关上浏览器:

xdg-open http://localhost:8089

更多

技术:

  • WebSocket
  • MediaSource: 构建媒体流,供 video/audio 元素播放
  • WebRTC: 可间接捕捉客户端视频流,并点对点传输、不依赖服务器直达
  • WebCodecs: 编解码音视频
  • WebAssembly: C/C++/Rust 等编译进前端应用

    • ffmpegwasm/ffmpeg.wasm
    • GoogleChromeLabs/webm-wasm

我的项目:

  • MSE: 需构建流,通常容器格局是 ISO BMFF (Fragmented MP4) = fMP4

    • elsampsa/websocket-mse-demo: RTSP > fMP4
    • ChihChengYang/wfs.js: H.264 NAL > fMP4
    • bilibili/flv.js: FLV > fMP4
    • Garefield/RTSP-WS-Proxy: RTSP > fMP4
    • Streamedian/html5_rtsp_player: RTSP > fMP4, Proxy 免费
  • JS 解码

    • phoboslab/jsmpeg: MPEG1 Video & MP2 Audio Decoder

      • kyriesent/node-rtsp-stream
      • wanghaoxi3000/gin-rtsp
      • YE-Fan/JAVA-RTSP-JSMpeg
      • Aleckgt/rtsp-ws-proxy
      • k-yle/rtsp-relay
    • mbebenita/Broadway: H.264 decoder

      • 131/h264-live-player
  • Wasm 解码

    • sonysuqin/WasmVideoPlayer: H265 > YUV, WebGL
    • wupeng-engineer/decoder_wasm: H264,H265 > YUV, WebGL
    • gliese1337/h264decoder: H264 > YUV
    • mattdesl/mp4-h264: H264 > YUV/RGB
    • mattdesl/mp4-wasm: H264
  • 其余

    • HTML5 RTSP player: 免费

GoCoding 集体实际的教训分享,可关注公众号!

退出移动版