Live Streaming for Android

Introduction to Live Streaming

1. Live Streaming for Android wasabeef Shibuya.apk #10
2. About me Daichi Furiya Google Developer Expert AbemaTV, Inc. wasabeef @wasabeef_jp
3. Streaming?
4. HLS MPEG-DASH Microsoft Smooth Streaming RTMP Streaming?
5. Streaming? HLS HLS Encryption, Ads, Meta Encode, BroadCast Transcode, HLS RTMP
6. Video compression
7. Video compression 30fps 1sec 60KB × 30 = 1.8MB 1min 1.8MB × 60 = 108MB 1hour 108MB × 10 = 1.1GB 60KB 65KB 55KB 50KB
8. Video compression 60KB 5KB 2KB 7KB 30fps 1sec 60KB + (4KB × 30) = 180KB 1min 60KB + (4KB × 1800) = 7.2MB 1hour 7.2MB × 10 = 72MB
9. Video compression Be impossible ;(
10. Key Frame Be possible :)
11. Video structure Video Audio Meta Butterfly…? Discovered
12. Format
13. Container format
14. .avi .mp4 .mkv .ogg .flv etc.. Container format Video H.264 H.265 Divx VP9 Audio AAC WMA Voribis PCM Caption SAMI, SMIL Hi-Caption CMML, DXFP Meta Date Author Title
15. Video codec
16. H.264/MPEG-4 AVC H.265/HEVC VP9 Video Codec
17. 8K 300fps Half the size of AVC Android 5.+ H.265/HEVC
18. Audio codec
19. MP3 AAC Vorbis Audio Codec
20. HTTP Live Streaming
21. Apple Adaptive bitrate streaming MPEG2-TS H.264/AAC HLS
22. playlist.m3u8
23. #EXTM3U #EXT-X-STREAM-INF:PROGRAM-ID=1, BANDWIDTH=200000 gear1/prog_index.m3u8 #EXT-X-STREAM-INF:PROGRAM-ID=1, BANDWIDTH=311111 gear2/prog_index.m3u8 #EXT-X-STREAM-INF:PROGRAM-ID=1, BANDWIDTH=484444 gear3/prog_index.m3u8 #EXT-X-STREAM-INF:PROGRAM-ID=1, BANDWIDTH=737777 gear4/prog_index.m3u8 playlist.m3u8
24. playlist.m3u8 gear1/prog_index.m3u8 BANDWIDTH: 200000 Header gear2/prog_index.m3u8 BANDWIDTH: 311111 gear3/prog_index.m3u8 BANDWIDTH: 484444 gear4/prog_index.m3u8 BANDWIDTH: 737777
25. #EXTM3U #EXT-X-TARGETDURATION:10 #EXT-X-MEDIA-SEQUENCE:0 #EXTINF:10, no desc fileSequence0.ts #EXTINF:10, no desc fileSequence1.ts #EXTINF:10, no desc ~~~ 2-179.ts ~~~ fileSequence180.ts #EXT-X-ENDLIST playlist.m3u8
26. ts?
27. Transport Stream (ts) fileSequence0.ts Container (2sec 〜 10sec)
28. playlist.m3u8 FileSequence1.ts Length: 5sec FileSequence2.ts Length: 5sec FileSequence3.ts Length: 5sec FileSequence4.ts Length: 5sec Header Footer
29. playlist.m3u8 FileSequence1.ts Length: 5sec FileSequence2.ts Length: 5sec ad.ts Length: 5sec FileSequence3.ts Length: 5sec Header Footer
30. Dynamic Adaptive Streaming over HTTP
31. Microsoft, Netflix, Google, Ericsson, Samsung, Adobe Adaptive bitrate streaming MP4, WebM, MPEG2-TS MPEG-DASH
32. <mdp> - Root manifest.mdp <period> - A start time and duration. <AdaptationSet> - Audio/Video content <Representation> - Bitrate and Aspect
33. DRM
34. WideVine
35. Google Modular (Android 4.3+) Classic (Android 3+) MPEG-DASH SurfaceView WideVine
36. PlayReady
37. MicroSoft PlayReady HLS Android 3+ TextureView PlayReady
38. ExoPlayer
39. Google OSS HLS, MPEG-DASH, SmoothStreaming WideVine (4.3+) https://github.com/google/ExoPlayer ExoPlayer
40. Amazon OSS Bug fix https://github.com/amzn/exoplayer-amazon-port ExoPlayer Amazon Port
41. Conclusion
42. Thank you. twitter.com/wasabeef_jp wasabeef.jp github.com/wasabeef