HTTP Live Streaming in iOS

Presented at Battle Conference U30 http://bcu30.jp/
11 MAR. 2017
Sample app repository: https://github.com/ra1028/LiveStreamingApp

Transcript

1. HTTP Live Streaming
   in iOS
   2017/03/11 Battle Conference U30
   Ryo Aoyama / ra1028
   CyberAgent, Inc
   

   View Slide

2. View Slide

3. FRESH!

   ϩάΠϯෆཁɾߴը࣭Ͱੜ์ૹ͕ݟ์୊
   

   View Slide

4. Contents
   ̋ ͬ͘͟ΓHLSʹ͍ͭͯ
   ̋ ΋ͬͱͬ͘͟ΓAVFoundationʹ͍ͭͯ
   ̋ σϞ
   

   View Slide

5. HLS
   

   View Slide

6. Appleۘ੡ͷετϦʔϛϯάಈը഑৴ϓϩτίϧ
   HTTP Live Streaming
   Live or VOD(Video On Demand)
   HLS
   ηάϝϯτϑΝΠϧ ʴ ϓϨΠϦετ
   

   View Slide

7. ಈըϑΝΠϧΛ͋ΔҰఆ࣌ؒͷࡉ͔͍MPEG2-TS
   ηάϝϯτϑΝΠϧʹ෼ׂͨ͠΋ͷ
   ηάϝϯτϑΝΠϧ .ts
   

   View Slide

8. ηάϝϯτϑΝΠϧͷҐஔɺ࠶ੜ࣌ؒɺߋ৽ස౓ͳͲͷ
   ৘ใ͕هࡌ͞ΕͨϝλσʔλϑΝΠϧ
   ϓϨΠϦετ .m3u8
   

   View Slide

9. ΦϦδφϧͷಈըϑΝΠϧ
   ηάϝϯτϑΝΠϧ܈ʹ෼ׂ
   

   View Slide

10. ߋ৽ස౓৘ใΛ࢖ͬͯ
    ఆظతʹϓϨΠϦετͷߋ৽Λ؂ࢹ
    

    View Slide

11. ߋ৽͕͋Ε͹࠷৽ͷ
    tsϑΝΠϧΛऔಘ͢Δ
    

    View Slide

12. ߋ৽͕ͳ͚Ε͹؂ࢹ͠ͳ͕Β
    ࣍ͷߋ৽·Ͱ଴ͭ
    ͜ͷ͕࣌ؒൃੜ͠ͳ͍Α͏ͷʹߋ৽ස౓ͱ
    TSϑΝΠϧ࠶ੜ࣌ؒ͸ௐ੔͢Δɻ
    

    View Slide

13. ͜ͷλά͕͋Δ͜ͱͰϓϨΠϦετ
    ͸ऴྃ͢Δࣄ͕Ͱ͖ΔͨΊɺVODͱ
    Έͳ͢͜ͱ͕Ͱ͖Δɻ
    

    View Slide

14. جຊతʹ͸ɺ
    ಈըΛMPEG2-TSϑΝΠϧʹ෼ׂɺϓϨΠϦετΛߋ৽
    ΫϥΠΞϯτଆͰϓϨΠϦετΛ؂ࢹɺߋ৽͞ΕͨΒ࠷৽
    ͷ.tsϑΝΠϧΛ࠶ੜ
    ͜Ε͚ͩͰ׬݁͢Δγϯϓϧͳϓϩτίϧɻ
    HLS·ͱΊ
    

    View Slide

15. iOS୺຤ͰHLS͔ΒಈըΛ࠶ੜ͢Δʹ͸
    AVFoundation
    

    View Slide

16. ࣸਅɺԻָɺಈըͷAPIΛఏڙ͢ΔɺiOS, macOS, tvOS౳
    ޲͚ͷFrameworkɻ
    HLS͸Apple੡ͷͨΊެࣜͰڧྗʹαϙʔτ͞Ε͍ͯΔɻ
    ͨͩ͠ɺཧղ͠೉͍APIͱ҉໧ͷ࢓༷͕͖ͭ·ͱ͏…
    AVFoundation
    

    View Slide

17. AVAsset
    ಈըࣗମͷϝσΟΞσʔλ΍ϝλσʔλΛϩʔυ͠ɺอ࣋
    ͢ΔΫϥεɻ
    ͜ͷΫϥεΛҾ਺ͱͯ͠ ͷΠϯελϯεΛ࡞
    Δɻ
    AVPlayerItem
    

    View Slide

18. AVPlayerItem
    ಈըͷ࠶ੜεςʔλε΍λΠϜυϝλσʔλͳͲΛऔಘ͢
    ΔΫϥεɻ
    ഔհͱͯ͠AVAssetͷ৘ใΛऔಘ͢Δ͜ͱ͕Ͱ͖Δɻ
    ͜ͷΫϥεΛҾ਺ͱͯ͠ ͷΠϯελϯεΛ࡞Δɻ
    AVPlayer
    

    View Slide

19. AVPlayer
    ಈըͷ࠶ੜɺఀࢭͳͲΛ؅ཧ͢ΔίϯτϩʔϥΫϥεɻ
    Ի੠ɺ࠶ੜϨʔτͷઃఆ΍γʔΫͳͲ΋͜ͷΫϥεΛհ͠
    ͯߦ͏ɻ
    ͜ͷΫϥεΛ ʹઃఆ͢Δ͜ͱͰಈըΛඳը
    ͢Δ͜ͱ͕Ͱ͖Δɻ
    AVPlayerLayer
    

    View Slide

20. AVPlayerLayer
    AVPlayer͔Βͷ৘ใΛ࢖ͬͯಈըΛඳը͢ΔUIΛఏڙ͢Δ
    Ϋϥεɻ
    CALayerͷαϒΫϥεͳͷͰUIViewͷlayerClassΛ
    overrideͯ͠࢖༻͢Δ͜ͱ͕ଟ͍ɻ
    

    View Slide

21. AVPlayerItem
    AVAsset
    AVPlayer
    ಈը৘ใͷऔಘ׬ྃ(࠶ੜՄೳ)
    AVPlayerLayer
    UIView
    ΠϯελϯεΛੜ੒
    (ϝΠϯεϨουʂ)
    දࣔ४උ׬ྃ
    UIʹಈը৘ใΛ༩͑ɺ
    ඳըͤ͞Δ
    

    View Slide

22. AVPlayerItem
    AVAsset
    AVPlayer
    AVPlayerLayer
    UIView
    ಈըΛมߋ͢Δ৔߹͸͜Ε
    Βͷάϧʔϓશͯഁغ͢Δ
    ಛʹͷ̎ͭ͸ಉҰεϨου
    Ͱಉ࣌ʹഁغ
    

    View Slide

23. ࡉ͔ͳ੍ޚΛߦΘͳ͍࠶ੜ·Ͱ͸ɺ͔ͳΓ؆қతʹHLSΛ
    ѻ͏ࣄ͕Ͱ͖Δɻ
    νϡʔχϯάͷͨΊʹϚϧνεϨουͰѻ͏ʹ͸஫ҙ͕ඞ
    ཁɻ
    AVFoundation·ͱΊ
    

    View Slide

24. Demo
    

    View Slide

25. ഑৴αʔόʔͱͯ͠ΧϝϥͰࡱͬ
    ͨಈը͔ΒHLSΛ഑৴͢Δɻ
    Demo
    αʔόʔiPhoneʹΞΫηεͯ͠
    AVFoundationͰ࠶ੜ͢Δɻ
    

    View Slide

26. Demo
    GitHub Repository:
    https://github.com/ra1028/LiveStreamingApp
    

    View Slide

27. iOSͷAVFoundationɺAndroidͷExoPlayerͳͲʹΑͬͯ
    ωΠςΟϒͰ΋ڧྗʹαϙʔτ͞Ε͍ͯΔɻ
    iPhoneαʔόʔͰ΋഑৴Ͱ͖ͯ͠·͏΄Ͳγϯϓϧͳಈ
    ը഑৴ϓϩτίϧɻ
    Adaptive bitrate streamingͰճઢ଎౓ʹΑΓө૾඼࣭
    Λ੾Γସ͑ͯɺ҆ఆͨ͠࠶ੜΛ୲อͰ͖Δɻ
    ·ͱΊ
    

    View Slide