パラレルの通話を支える iOS アプリ上での技術

https://radiotalk.connpass.com/event/219952/

Transcript

1. Naoki ISHIKAWA @jarinosuke 2021/7/29 iOS Tech talk
   ύϥϨϧͷ௨࿩Λࢧ͑Δ
   iOS ΞϓϦ্Ͱͷٕज़
   1
   

   View Slide

2. ࣗݾ঺հ
   2
   

   View Slide

3. ࣗݾ঺հ
   • 2010೥ʹϠϑʔʢYahoo! JAPANʣʹΤϯδχΞͱͯ͠ೖࣾɻͦͷޙΠάχε
   ʹͯ਺ेݸͷΞϓϦ։ൃܦݧΛܦͯɺ2016೥ʹϝϧΧϦ΁స৬ɻϝϧϖΠ։
   ൃɺΤϯδχΞϦϯάϚωʔδϟʔΛܦͯ2020೥11݄ʹύϥϨϧʹೖࣾɻ
   
   • https://www.wantedly.com/companies/parallel/post_articles/333769
   3
   

   View Slide

4. ΞδΣϯμ
   • ✅ࣗݾ঺հ
   
   • ύϥϨϧͷઆ໌
   
   • ύϥϨϧͷΞϓϦ্Ͱ࣮ݱ͍ͨ͜͠ͱ
   
   • ࢖͍ͬͯΔ֤ٕज़ͷৄࡉ
   4
   

   View Slide

5. ύϥϨϧͷઆ໌
   5
   

   View Slide

6. Copyright © Parallel Inc. All Rights Reserved.
   ༑ୡͱ༡΂Δ௨࿩ΞϓϦʮύϥϨϧʯ
   6
   App Store ධՁɿ4.7/5.0ʢ 2.3ສ݅ʣ
   ύϥϨϧ͸஥ͷྑ͍༑ୡͱ௨࿩Λܨ͗ͳ͕ΒɺήʔϜͨ͠ΓಈըΛݟͨΓͯ͠༡΂Δ௨࿩ΞϓϦͰ͢
   ᶃ ๛෋ͳ௨࿩ػձͷ૑ग़
   • ༑ୡͷεςʔλεදࣔ
   • ؆୯ελϯϓΞΫγϣϯ
   • ௨࿩։࢝࣌ͷϓογϡ௨஌
   ᶄ ࠷దͳ௨࿩؀ڥ
   • ݸผʹ௨࿩ԻྔΛௐ੔Մೳ
   • ѹ౗తʹ௿஗Ԇͳ௨৴
   ᶅ εϚϗ࠷దԽ͞ΕͨUI/U
   X
   
   • ొ࿥͸10ඵͰ׬ྃ
   • ࢖͍׳ΕͨUI/UXͰ͙͢ʹ࢖͑Δ
   ᶆ Ұॹʹ༡΂ΔύʔςΟʔίϯςϯπ
   • αΫοͱ༑ୡͱ༡΂Δίϯςϯπ͕๛෋
   • ϘλϯҰͭͰڞಉମݧ͕Մೳ
   

   View Slide

7. ύϥϨϧͷΞϓϦ্Ͱ࣮ݱ͍ͨ͜͠ͱ
   7
   

   View Slide

8. ύϥϨϧͷΞϓϦ্Ͱ࣮ݱ͍ͨ͜͠ͱ
   • ߴ඼࣭ͳԻ੠
   
   • ϦΞϧλΠϜͳϝοηʔδϯά
   
   • ༷ʑͳϑΥʔϚοτͷίϯςϯπͷಋೖ
   8
   

   View Slide

9. ύϥϨϧͷΞϓϦ্Ͱ࣮ݱ͍ͨ͜͠ͱ
   • ߴ඼࣭ͳԻ੠
   
   • ϦΞϧλΠϜͳϝοηʔδϯά
   • ༷ʑͳϑΥʔϚοτͷίϯςϯπͷಋೖ
   9
   

   View Slide

10. ϦΞϧλΠϜͳϝοηʔδϯά
    • HTTPS + Push ௨஌Ҏ্ʹ ϦΞϧλΠϜੑΛߴΊ͍ͨ
    
    • ϢʔβʔͷΦϯϥΠϯ౳ͷදࣔɺνϟοτૹ৴ɺϧʔϜͷঢ়ଶมԽ
    
    • WebSocket
    
    • Starscream
    10
    

    View Slide

11. WebSocket
    ֓ཁ
    • ௨࿩࣌
    
    • background ਐೖ࣌΋઀ଓΛܧଓ
    
    • background mode: audio Λࢦఆ͍ͯ͠ΔͷͰɺ௨࿩த͸ background Ͱ΋
    main thread ͷϥϯϧʔϓ͸ܧଓ͢ΔͨΊ
    
    • ඇ௨࿩࣌
    
    • background ਐೖ࣌ʹ੾அɺforeground ʹ໭ͬͨ࣌ʹ઀ଓ
    11
    

    View Slide

12. WebSocket
    ֓ཁ
    • ௨࿩࣌
    
    • background ਐೖ࣌΋઀ଓΛܧଓ
    • background mode: audio Λࢦఆ͍ͯ͠ΔͷͰɺ௨࿩த͸ background Ͱ΋
    main thread ͷϥϯϧʔϓ͸ܧଓ͢ΔͨΊ
    
    • ඇ௨࿩࣌
    
    • background ਐೖ࣌ʹ੾அɺforeground ʹ໭ͬͨ࣌ʹ઀ଓ
    12
    

    View Slide

13. WebSocket
    background Ͱ௨࿩தʹ੾Εͯ͠·͏ݪҼͱରॲํ๏
    • ݪҼ
    
    • background ௨࿩தʹ௨৴͕ Cellular <-> WiFi Ͱมߋ͞Εͨͱ͖
    
    • ରॲ
    
    • heartbeat(ping/pong) ͷಋೖ
    
    • ఆظతʹ Timer Λ࢖ͬͯૄ௨֬ೝ
    13
    

    View Slide

14. ύϥϨϧͷΞϓϦ্Ͱ࣮ݱ͍ͨ͜͠ͱ
    • ߴ඼࣭ͳԻ੠
    
    • ✅ϦΞϧλΠϜͳϝοηʔδϯά
    • ༷ʑͳϑΥʔϚοτͷίϯςϯπͷಋೖ
    14
    

    View Slide

15. ༷ʑͳϑΥʔϚοτͷίϯςϯπͷಋೖ
    • iOS Native
    
    • WebView
    
    • Unity as a Library
    
    • Broadcast Extension
    15
    

    View Slide

16. ༷ʑͳϑΥʔϚοτͷίϯςϯπͷಋೖ
    • iOS Native
    
    • WebView
    
    • Unity as a Library
    • Broadcast Extension
    16
    

    View Slide

17. Unity as a Library
    • ʲUnityʳMirrativͷEmbedding UnityΛߋ৽ͨ͠࿩: ࣮ફ Unity as a Library
    
    • ͪ͜ΒΛࢀߟʹΞϓϦʹ݁߹
    
    • ੒Ռ෺ UnityFramework.framework Λ repos ʹ push ͢Δ
    
    • ͦͷ repos Λ submodule ͰऔΓࠐΉ
    ؀ڥߏங
    17
    

    View Slide

18. Unity as a Library
    • Unity ͸ UIWindow Λ΋͏Ұͭ࡞੒͍ͯ͠Δ
    
    • Unity ͱ app ͷ window Λަޓʹ makeKeyAndVisible ͠ͳ͕Βը໘ભҠ
    
    • Unity ͷ view ্ʹɺUIViewController ΛΦʔόʔϨΠ͍ͤͯ͞Δ
    
    • Unity -> Native ͷϝοηʔδϯά
    
    • Unity ͷதʹ NativeCallsProxy protocol Λఆٛ
    
    • ͦΕʹద߹ͨ͠ object ΛΞϓϦଆͰ `FrameworkLibAPI.registerAPIforNativeCalls` ݺ
    ͼग़͠ొ࿥
    ࣮૷
    18
    

    View Slide

19. Unity as a Library
    • େมͳͱ͜Ζ
    
    • όΠφϦαΠζ͕େ͖͘ͳΔ
    
    • Unity ݻ༗ͷΫϥογϡ͕ൃੜ͢Δ
    
    • Ϋϥογϡϩάͷղੳ͕೉͍͠
    ࣮૷
    19
    

    View Slide

20. Broadcast Extension
    • ը໘ڞ༗ʹ༻͍Δ
    
    • ReplayKit (2) Λ࢖༻
    
    • 2 ͔ΒγεςϜඪ४ͷUIΛ࢖ͬͯɺ୺຤ʹөΔը໘Λ഑৴Ͱ͖ΔΑ͏ʹ
    
    • Կ͔ͱෆ҆ఆ
    
    • Invalid broadcast session Ͱݕࡧ͢Δͱɺը໘ڞ༗Λαϙʔτ͍ͯ͠Δ
    ΞϓϦ͕Θ͔Δ
    ֓ཁ
    20
    

    View Slide

21. Broadcast Extension
    • App <-> Broadcast Extension ؒͷΠϕϯτ௨஌͕೉͍͠
    • ࣮ࡍͷը໘ڞ༗ͷ։࢝ͱऴྃΛΞϓϦଆͰ஌Γ͍ͨ
    
    • capturedDidChangeNoti
    fi
    cation ΍ UIScreen.isCaptured ͸͋Δ
    
    • ͜Εͩͱը໘ڞ༗͚ͩͰͳ͘ɺ࿥ը΍ AirPlay ΋ର৅ʹͳͬͯ͠·͏
    
    • App Group ܦ༝ͰϑϥάΛड͚౉͍ͯ͠Δ(!!!)
    ࣮૷
    21
    

    View Slide

22. ΞδΣϯμ
    • ✅ࣗݾ঺հ
    
    • ✅ύϥϨϧͷઆ໌
    
    • ✅ύϥϨϧͷΞϓϦ্Ͱ࣮ݱ͍ͨ͜͠ͱ
    
    • ✅࢖͍ͬͯΔ֤ٕज़ͷৄࡉ
    22
    

    View Slide

23. ͝੩ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠
    23
    

    View Slide