ピクシブの大規模ライブ配信 / ImageFlux Live

Transcript

1. େن໛ϥΠϒ഑৴ MICHII Shunsuke | pixiv Technologies Inc. ImageFlux meetup #1

   2018-01-25 ٕज़ηογϣϯ

2. MICHII Shunsuke | harukasan ImageFluxࣄۀ੹೚ऀ
 ϐΫγϒςΫϊϩδʔζגࣜձࣾࣥߦ໾һ ImageFluxͰ͸GoΛॻ͍ͨΓΠϯϑϥपΓΛ୲౰

3. ImageFlux Live • ϒϥ΢β͔ΒϓϥάΠϯෆཁͰϥΠϒ഑৴Λ։࢝ • HLSܗࣜͰϒϥ΢βɺϞόΠϧΞϓϦʹ഑৴ • hls.jsͳͲҰൠతͳHLSΫϥΠΞϯτͰ࠶ੜՄೳ • ޷͖ͳղ૾౓/඼࣭ʹεέʔϦϯάͯ͠഑৴

4. ࣄྫ: pixiv Sketch Live

5. ࣄྫ: pixiv ONE • ϐΫγϒॳͷϥΠϒυϩʔΠϯάΠϕϯτ • ಉ࣌ࢹௌऀ਺: 5,000ϢʔβʔҎ্ • ϒϥ΢β͔Βͷେن໛഑৴ࣄྫ

6. ImageFluxͱϥΠϒ഑৴ • ImageFluxͷϛογϣϯ:
 ϐΫγϒͷٕज़ΛεϐϯΞ΢τ͢Δ͜ͱͰϐΫγϒͷٕज़޲্Λ໨ࢦ͢ • pixiv Sketch LiveͷͨΊʹImageFluxνʔϜͰϥΠϒ഑৴ಈతม׵Λ։ൃ • ϥΠϒ഑৴ಈతม׵ΛαʔϏεͱͯ͠ఏڙ༧ఆ

   • ϐΫγϒͱͯ͠΋ImageFluxͱͯ͠΋ϥΠϒ഑৴ΛڧԽ

7. ImageFlux Live ഑৴ऀ ImageFlux Live WebRTC HLS ࢹௌऀ • WebRTCετϦʔϜͰड͚औͬͨಈըΛHLSʹม׵ͯ͠഑৴

   • HLSܗࣜʹม׵͢Δ͜ͱͰɺ઀ଓ਺Λؾʹͤͣେن໛഑৴͕Մೳ • WebRTCͳͷͰ௿஗Ԇɺ͔ͭHLSͳͷͰେن໛഑৴Ͱ͖Δʂ

8. HLS (HTTP Live Streaming) • Apple͕։ൃͨ͠ϥΠϒετϦʔϛϯά࢓༷ • ϒϥ΢β/iOS/AndroidͰ࠶ੜՄೳ • iOS:

   ωΠςΟϒͰରԠ • Android: ExoPlayer • ϒϥ΢β: hls.js

9. HLS (HTTP Live Streaming) .m3u8 hls0.ts hls1.ts hls2.ts ϓϨΠϦετϑΝΠϧ ಈըετϦʔϜϑΝΠϧ

   #EXTM3U #EXT-X-TARGETDURATION:3 #EXT-X-VERSION:3 #EXT-X-MEDIA-SEQUENCE:0 #EXTINF:3.00000, hls0.ts #EXTINF:3.00000, hls1.ts #EXTINF:3.00000, hls2.ts ϑΝΠϧͷ௕͞

10. HLS (HTTP Live Streaming) .m3u8 hls0.ts hls1.ts ϓϨΠϠʔ #EXTM3U #EXT-X-TARGETDURATION:3

    #EXT-X-VERSION:3 #EXT-X-MEDIA-SEQUENCE:0 #EXTINF:3.00000, hls0.ts #EXTINF:3.00000, hls1.ts ϙʔϦϯά

11. HLS (HTTP Live Streaming) .m3u8 hls0.ts hls1.ts ϓϨΠϠʔ ϙʔϦϯά #EXTM3U

    #EXT-X-TARGETDURATION:3 #EXT-X-VERSION:3 #EXT-X-MEDIA-SEQUENCE:0 #EXTINF:3.00000, hls0.ts #EXTINF:3.00000, hls1.ts

12. HLS (HTTP Live Streaming) .m3u8 hls0.ts hls1.ts hls2.ts ϓϨΠϠʔ #EXTM3U

    #EXT-X-TARGETDURATION:3 #EXT-X-VERSION:3 #EXT-X-MEDIA-SEQUENCE:0 #EXTINF:3.00000, hls0.ts #EXTINF:3.00000, hls1.ts #EXTINF:3.00000, hls2.ts ϙʔϦϯά

13. HLS (HTTP Live Streaming) .m3u8 hls0.ts hls1.ts hls2.ts ϓϨΠϠʔ #EXTM3U

    #EXT-X-TARGETDURATION:3 #EXT-X-VERSION:3 #EXT-X-MEDIA-SEQUENCE:0 #EXTINF:3.00000, hls0.ts #EXTINF:3.00000, hls1.ts #EXTINF:3.00000, hls2.ts ϙʔϦϯά

14. HLSͱ஗Ԇ • ηάϝϯτϑΝΠϧͷ௕͞ʹ࠷୹ͷͳ͕͞ • EXT-X-STARTλάΛ࢖͏ͱϓϨΠϦετͷ࠶ੜΦϑηοτΛܾΊΒΕΔ • pixiv Sketch Liveͷઃఆͩͱ஗Ԇ͸10ʙඵ͘Β͍ •

    ͍·ͷͱ͜ΖؤுΔͱ3ඵ͘Β͍·ͰॖΊͦ͏

15. γεςϜߏ੒ Transcoder Transcoder Transcoder RTP stream Stream
 Manager Msgpack
 stream

    TS TS TS ഑৴ऀ WebRTC
 SFU WebRTC API Transcoder: H.264/AVC, OpusετϦʔϜΛ τϥϯείʔυ͠ɺMPEG2-TS ʹmuxingͯ͠ग़ྗ Stream Manager: Transcoderͷϓϩηε؅ཧ
 RTPετϦʔϜΛύʔε͠ɺॱং ੍ޚΛߦͬͯTranscoderʹ͓͘Δ Transcoder͕ग़ྗͨ͠TSϑΝΠϧ ΛHLSʹه࿥ API: ετϦʔϜΛ࢝ΊΔAPI ·ͩαʔϏε࢓༷͕ܾ·͍ͬͯ·ͤΜ

16. WebRTC SFU • WebRTC SFU / ηογϣϯ؅ཧʹWebRTC SFU SoraΛ࠾༻ •

    Sora͕ղআͨ͠RTPετϦʔϜΛStream Managerʹసૹ RTP stream WebRTC
 SFU WebRTC

17. Stream Manager Transcoder Stream
 Manager RTP stream UDP HTTP API

    TCP • GoͰॻ͔Εͨγϯάϧϓϩηεαʔό • ඞཁͳ਺ͷTranscoderϓϩηεΛىಈ • RTPετϦʔϜΛσίʔυɺύʔεͯ͠Msgpackʹ٧Ί௚ͯ͠τϥϯείʔμʹసૹ • RTPετϦʔϜ͸UDPͷͨΊॱং੍ޚɺόοϑΝϦϯά͕ඞཁʹͳΔ Msgpack

18. RTP • ϦΞϧλΠϜੑͷͨΊʹ࠶ૹ੍ޚͳͲΛল͍ͨϓϩτίϧ • UDPͳͷͰॱং੍ޚ͞Ε͍ͯͳ͍͕ɺγʔέϯε൪߸ؚ͕·Ε͍ͯΔͷͰ γʔέϯε൪߸Λϕʔεʹฒͼସ͑Δඞཁ͕͋Δ • RFC3350(RTP)Ͱ͸ϖΠϩʔυͷ಺༰·Ͱ͸ఆٛ͞Ε͍ͯͳ͍ • H.264:

    RFC6184 • Opus: RFC7587

19. Transcoder • RustͰॻ͔ΕͨCLIϓϩηε • bindgenΛར༻ͯ͠C++ͷSDKΛόΠϯυ • livavformatΛར༻ͯ͠Ի੠ͱಈըΛmuxing Tesla NVIDIA Video

    Codec SDK Transcoder Libavformat

20. NVDEC/NVENC • NVIDIA Tesla GPUʹ౥ࡌ͞Ε͍ͯΔNVDEC/NVENCΛར༻ https://developer.nvidia.com/nvidia-video-codec-sdk

21. NVDEC/NVENC • ࣮ࡍʹσίʔυ/ΤϯίʔυॲཧΛ΍Δͷ͸CUDAίΞͰ͸ͳ͘ઐ༻νοϓ • ઐ༻νοϓͷ਺ʹΑͬͯॲཧͰ͖ΔετϦʔϜ਺͕ܾ·Δ • decoder/encoder/cudaͦΕͧΕͷෛՙΛϞχλϦϯά͢Δͷ͕ॏཁ • CUDA͸εέʔϦϯάʹ͚ͩ࢖༻

22. NVDEC/NVENC Τϯίʔμෛՙ͕ߴΊ

23. Rust • ͍͞͠ΐʹࢼͯ͠΋ΒͬͨΞϧόΠτ͕Ұ൪͸΍͘ॻ͚Δͷ͕Rustͩͬͨ • ϝϞϦ·ΘΓͷॻ͖ํ͕C++ΑΓ҆͘͢͝શ/؆୯ • cgoͱҧͬͯbindgen͸όΠϯσΟϯάίʔυΛੜ੒ͯ͘͠ΕΔͷͰཧղ͠ ΍͍͢

24. ࠓޙͷల๬ • αʔϏε࢓༷ͷܾఆ • ύέοτϩε࣌ͷΤϥʔॲཧ޲্ • ϋʔυ΢ΣΞΤϯίʔμͷݕূ • αʔϏεͱͯ͠ϦϦʔεʂ

25. ·ͱΊ • ImageFluxͰ͸ϥΠϒ഑৴΋ߦ͍͖ͬͯ·͢ʂ • ·ͩαʔϏε࢓༷͕ܾ·͍ͬͯͳ͍ͨΊώΞϦϯάΛߦ͍ͬͯΔஈ֊Ͱ͢ • ڵຯ͋Δํ͸ੋඇ͓੠͕͚͍ͩ͘͞