Synchronized iPhones, Again!

iOSDC 2020

https://fortee.jp/iosdc-japan-2020/proposal/3a9b496e-8745-4d1d-8952-8ac45a42ca8a

Transcript

1. Synchronized iPhones, Again!
   iOSDC 2020
   @TachibanaKaoru
   

   View Slide

2. Aboud Me
   @TachibanaKaoru
   ϑϦʔϥϯε iOS ΤϯδχΞ
   ຊ೔͸ϦΞϧΞόλʔͰొஃ͠·͢ɻ
   

   View Slide

3. ࠓ೔ͷ͓୊
   ͨ͘͞ΜͷiPhone Λಉظ͢Δɻ
   

   View Slide

4. iPhoneͷಉظ
   ಉظͱ͸
   ͳΜΒ͔ͷωοτϫʔΫΛհͨ͠ঢ়ଶͰɺෳ਺ͷ୺຤͕ಉ͡ಈ͖Λ͢
   Δ͜ͱɻ
   

   View Slide

5. DEMO
   

   View Slide

6. View Slide

7. લఏ৚݅
   ʢ̍ʣ୺຤୆਺͕20~30୆
   ʢ̎ʣωοτϫʔΫʹґଘ͠ͳ͍
   ʢ̏ʣࣗಈతͳάϧʔϐϯά
   ʢ̐ʣ༗ػతͳάϧʔϐϯά
   

   View Slide

8. લఏ৚݅
   ʢ̍ʣ୺຤୆਺͕20~30୆
   ٕज़త೉қ౓Λߟྀ
   ౰વ iPhone ΍ iPadʹݶΓ·͢ɻ
   

   View Slide

9. લఏ৚݅
   ʢ̎ʣωοτϫʔΫʹґଘ͠ͳ͍
   ܞଳճઢ΍WiFi͕ͳͯ͘΋ಈ࡞͢Δɻ
   ͦͷ͋ͨΓͷެԂͰ΋Ωϟϯϓ৔Ͱ΋ࢁͷ্Ͱ΋େৎ෉ɻ
   αʔόʔϨεͰಈ࡞
   

   View Slide

10. લఏ৚݅
    ʢ̏ʣࣗಈతͳάϧʔϐϯά
    ΞϓϦΛىಈ͢ΔͱࣗಈతʹάϧʔϓΛܗ੒͢Δɻ
    ʮˎˎͷάϧʔϓʹࢀՃ͠·͔͢ʁʯͱ͔ฉ͔ͳ͍ɻ
    Ϣʔβʔ͕खಈͰొ࿥͢Δ͜ͱ͸ͳ͘ɺࣗಈͰ઀ଓ͢Δɻ
    

    View Slide

11. લఏ৚݅
    ʢ̐ʣ༗ػతͳάϧʔϐϯά
    άϧʔϓʹ్த͔ΒͰ΋ࢀՃͰ͖Δ
    Ͳͷϝϯόʔ͕཭୤ͯ͠΋ɺάϧʔϓ͕γʔϜϨεʹܧଓ͢Δɻ
    

    View Slide

12. Demo Movie
    ߹ܭ35୆ͷiPhoneͷө૾͕ಉ
    ظ͢ΔσϞө૾Ͱ͕͢……
    

    View Slide

13. Demo Movie
    ͝ΊΜͳ͍͞ɻ
    ͜Ε͸ARͰ͢ɻ
    

    View Slide

14. Demo Movie
    Reality Composer File +
    Xcode Ͱߏ੒ͨ͠AR ΞϓϦ
    Ͱ͢ɻ
    

    View Slide

15. RealityComposer
    Apple੡ͷ3Dฤूπʔϧ
    3DΦϒδΣΫτͷ഑ஔ΍Ξχϝʔγϣϯ
    ͷઃఆͳͲ͕ՄೳͰ͢ɻ
    ෳࡶͳϞσϦϯά͸Ͱ͖·ͤΜ͕ɺ͙͢࢖
    ͑Δ਺ेछྨͷϞσϧؚ͕·Ε͍ͯ·͢ɻ
    ؆୯ͳARɾ3DΞϓϦΛͭ͘Δͷʹదͯ͠
    ͍·͢ɻ
    

    View Slide

16. RealityComposerͱXcodeͷ࿈ܞ
    RealityComposerଆ͔ΒXcodeͷΞΫγϣϯΛىಈɻ
    Xcode͔ΒRealityComposerଆ΁NotificationΛૹ৴ɻ
    ʢInterfaceBuilderͰIBActionΛఆٛ͠ɺͦͷActionத਎Λ࣮૷͢Δͷͱࣅ
    ͍ͯ·͢ɻʣ
    Notification
    Action
    

    View Slide

17. VideoMaterial
    iOS14.0Ҏ߱Ͱ͸ɺRealityComposerͰɺಈըΛ࠶ੜ͢ΔVideoMaterial Λ
    ࢖͏͜ͱ͕Ͱ͖·͢ɻ
    ෺ମͷද໘Ͱ޷͖ͳө૾Λ࠶ੜ͢Δ͜ͱ͕Ͱ͖·͢ɻ
    

    View Slide

18. Demo Movie App
    RealityComposer Ͱɺ35ݸͷࠇ͍ϓ
    ϨʔτͷΦϒδΣΫτΛ࡞੒ɻ
    RealityCopomserଆͰɺBehaviorΛઃఆ
    ͠ɺͲΕ͔ΛClickͨ͠ΒXcodeଆͷ
    Action͕ىಈ͢ΔΑ͏ʹ͍ͯ͠·͢ɻ
    

    View Slide

19. Demo Movie App
    XcodeଆͷActionͰɺ͋Β͔͡
    ΊࡱӨͯ͋ͬͨ͠ಈըΛηο
    τͨ͠VideoMaterialΛࠇ͍ϓ
    ϨʔτΦϒδΣΫτʹͷͤͯ
    ͍·͢ɻ
    

    View Slide

20. VideoMaterial ͷੜ੒
    var videoMaterial: VideoMaterial?
    if let url = Bundle.main.url(forResource: "movie", withExtension: "mp4"){
    let item = AVPlayerItem(asset: AVAsset(url: url))
    let player = AVPlayer(playerItem: item)
    videoMaterial = VideoMaterial(avPlayer: player)
    }
    

    View Slide

21. VideoMaterialͷEntityͷ௥Ճ
    boxAnchor.actions.addMovieToiPhone.onAction = { entity in
    self.videoMaterial?.avPlayer?.play()
    let thinBox = MeshResource.generateBox(
    width: 0.125,
    height: 0.01,
    depth: 0.065)
    let screenEntity = ModelEntity(
    mesh: thinBox,
    materials: [self.videoMaterial!])
    entity?.addChild(screenEntity)
    }
    

    View Slide

22. Demo Movie App
    ӈͷө૾Ͱ͸ARΞϓϦͰ࣮ݱ
    ͠·͕ͨ͠ɺ͜Εͱಉ͜͡ͱ
    Λ࣮ࡍͷ୺຤ͱ࣮ࡍͷΞϓϦ
    Ͱ΍ͬͯΈΑ͏ɺͱ͍͏ͷ͕
    ࠓ೔ͷ͓୊Ͱ͢ɻ
    ͜ͷϓϨθϯͷऴΘΓʹ͸ɺ
    ຊ෺ͷΞϓϦΛಈ࡞ͤͨ͞σ
    ϞΛ͓ݟͤ͠·͢ɻ
    

    View Slide

23. લఏ৚݅
    ʢ̍ʣ୺຤୆਺͕20~30୆
    ʢ̎ʣωοτϫʔΫʹґଘ͠ͳ͍
    ʢ̏ʣࣗಈతͳάϧʔϐϯά
    ʢ̐ʣ༗ػతͳάϧʔϐϯά
    

    View Slide

24. લఏ৚݅
    ʢ̍ʣ୺຤୆਺͕20~30୆
    ʢ̎ʣωοτϫʔΫʹґଘ͠ͳ͍
    ʢ̏ʣࣗಈతͳάϧʔϐϯά
    ʢ̐ʣ༗ػతͳάϧʔϐϯά
    

    View Slide

25. Plan A : Core Bluetooth
    ۙڑ཭ແઢͱ͍͑͹Bluetooth
    पғͷແઢঢ়گʹґଘͤͣʹɺ୺຤ؒͰ௨৴Λ͢Δ͜ͱ͕Ͱ͖·͢
    ͜ΕͰάϧʔϐϯάΛߦͬͯΈ·͢ɻ
    

    View Slide

26. Grouping with CoreBT
    CBCentral
    CBPeripheral
    CBCentral CBCentral
    CBCentral
    

    View Slide

27. Grouping with CoreBT
    Core BluetoothͰ͸̍ηογϣϯͷ୺຤ͷ্ݶ਺͕͋Γ·͢ɻ
    ؀ڥ΍σόΠεʹ΋ΑΔ͕ɺ͍͍ͩͨ̐ʙ̑୆͘Β͍ɻ
    ʢલఏ৚݅̍ΛΫϦΞͰ͖·ͤΜʣ
    

    View Slide

28. Plan B : Core BT & Core BT
    Core Bluetooth Ͱෳ਺ηογϣϯΛߟ͑ͯΈ·͠ΐ͏
    

    View Slide

29. Double Session ?
    

    View Slide

30. Double Session ?
    

    View Slide

31. Sessions in Core Bluetooth
    Core Bluetooth Ͱ͸ɺ1ϓϩηε͋ͨΓԼهͷηογϣϯ͔࣋ͯ͠ͳ͍
    Peripheralͱͯ͠ͷηογϣϯ : 1
    Centralͱͯ͠ͷηογϣϯ : 1
    

    View Slide

32. Double Session
    

    View Slide

33. Double Session
    ͜ͷ୺຤͸
    Peripheralͱ
    CentralΛ͔ͶΔɻ
    

    View Slide

34. Double Session
    ͜ͷߏ੒͕ಈ͚͹
    20୆ఔ౓ͷάϧʔ
    ϓ͕࡞੒Ͱ͖Δ͸
    ͣ……ɻ
    

    View Slide

35. ࣮૷ͯ͠Έ·ͨ͠ɻ
    

    View Slide

36. Double Session
    πϦʔߏ଄ͷά
    ϧʔϓ͸ܗ੒Ͱ͖
    ͨ΋ͷͷɺඇৗʹ
    ෆ҆ఆ
    

    View Slide

37. Ͳ͏͠Α͏……ɻ
    

    View Slide

38. ͦͷλΠϛϯάͰ88%$
    

    View Slide

39. ωοτϫʔΫϥϘͰ૬ஊͯ͠Έ·ͨ͠
    

    View Slide

40. Plan C : Multipeer Connectivity
    ʮ ……ͬͯײ͡ͰωοτϫʔΫΛ࡞Γ͍ͨΜ͚ͩͲ͍͍Ҋ͋Δʁʯ
    : ͦΕͳΒ Multiplier Connectivity͕͍͍Αʂ
    

    View Slide

41. Plan C : Multipeer Connectivity
    Multipeer Connectivity͸ɺωοτϫʔΫϨΠϠʔͱͯ͠Bluetooth·ͨ͸
    peer to peer WiFiΛ࢖͍ͬͯ·͢ɻ
    

    View Slide

42. Multipeer Connectivity
    Apple Engineer ʹΑΔͱɺݱࡏͰ͸΄ͱΜͲͷ୺຤Ͱ peer to peer WiFi
    Λ࢖͍ͬͯΔͦ͏ɻ
    1ηογϣϯ͋ͨΓͷ୺຤਺͸ެশ̓ʙ̔୆
    ෳ਺ͷηογϣϯΛ࣋ͭ͜ͱ͕Ͱ͖Δɻ
    

    View Slide

43. Single session network
    

    View Slide

44. Double session network
    

    View Slide

45. Double Session with MC
    ࣮૷ͯ͠Έͨͱ͜Ζɺ̎ͭͷηογϣϯͰ҆ఆͨ͠௨৴Λߦ͏͜ͱ͕Ͱ
    ͖·ͨ͠ɻ
    

    View Slide

46. લఏ৚݅
    ʢ̍ʣ୺຤୆਺͕20~30୆
    ʢ̎ʣωοτϫʔΫʹґଘ͠ͳ͍
    ʢ̏ʣࣗಈతͳάϧʔϐϯά
    ʢ̐ʣ༗ػతͳάϧʔϐϯά
    

    View Slide

47. લఏ৚݅
    ʢ̍ʣ୺຤୆਺͕20~30୆
    ʢ̎ʣωοτϫʔΫʹґଘ͠ͳ͍
    ʢ̏ʣࣗಈతͳάϧʔϐϯά
    ʢ̐ʣ༗ػతͳάϧʔϐϯά
    

    View Slide

48. MultipeerConnectivity Network
    ֤୺຤͸ɺ઀ଓ༻ͷ unique ͳ Peer IDΛੜ੒͠·͢ɻ(MCPeerID)
    ֤୺຤͸ɺMCNearbyServiceAdvertiserͰɺपғʹΞυόλΠζΛ͠·͢ɻ
    MCNearbyServiceBrowserΛ࢖͏ͱɺपғͷΞυόλΠζΛ͍ͯ͠Δ୺຤
    Λൃݟ͢Δ͜ͱ͕Ͱ͖·͢ɻ
    ୺຤A͔Βɺ୺຤B΁઀ଓ͢Δ৔߹ʹ͸ɺηογϣϯΛ࡞੒͠ɺInvitation
    ΛA͔ΒB΁ૹ৴͢ΔɻB͕InvitationΛड୚͢Δͱηογϣϯ͕੒ཱ͢Δɻ
    

    View Slide

49. ΞυόλΠζ
    /// पғ΁Advertise͠·͢ɻ
    var advertiser: MCNearbyServiceAdvertiser?
    advertiser = MCNearbyServiceAdvertiser(
    ɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹɹpeer: myID,
    discoveryInfo: ["DeviceName":deviceName],
    serviceType: serviceID)
    advertiser?.delegate = self
    advertiser?.startAdvertisingPeer()
    BEWFSUJTJOH
    

    View Slide

50. पғͷ୺຤ͷ୳ࡧ
    /// BrowserΛ࡞੒͠ɺपғͷ୺຤Λ୳ࡧ͠·͢ɻ
    var serviceBrowser: MCNearbyServiceBrowser?
    serviceBrowser = MCNearbyServiceBrowser(peer: myPeer, serviceType: serviceID)
    serviceBrowser?.delegate = self
    serviceBrowser?.startBrowsingForPeers()
    /// delegateͰݟ͚ͭͨ୺຤Λ֬ೝ͢Δ͜ͱ͕Ͱ͖·͢ɻ
    func browser(_ browser: MCNearbyServiceBrowser,
    foundPeer peerID: MCPeerID,
    withDiscoveryInfo info: [String : String]?) {
    }
    BEWFSUJTJOH
    CSPXTJOH
    

    View Slide

51. ଞͷ୺຤΁ͷ઀ଓ
    serviceBrowser?.invitePeer(peer, to: session, withContext: nil, timeout: 10.0)
    BEWFSUJTJOH
    CSPXTJOH
    TFOE
    JOWJUBUJPO
    

    View Slide

52. Ϧʔμʔ୺຤͔ΒInvitationΛૹΔ
    

    View Slide

53. View Slide

54. Ͳͷ୺຤͕Ϧʔμʔʁ
    

    View Slide

55. Ϧʔμʔͷܾఆ
    PeerID Λ Random ͳ Int
    PeerID ͷେখͰϦʔμʔΛܾఆ
    

    View Slide

56. ىಈʜʜ
    

    View Slide

57. 
    
    
    
    
    
    
    ֤ࣗ*%ΛऔಘɺΞυόλΠζ
    

    View Slide

58. 
    
    
    
    
    
    
    पғͷ୺຤ͷ*%Λ୳ࡧ͠ɺʮʯ
    ͕ϦʔμʔͰ͋ΔͱΘ͔Δ
    पғͷ୺຤ͷ*%Λ୳ࡧ͠ɺࣗ෼͕
    ϦʔμʔͰ͋ΔͱΘ͔Δɻ
    

    View Slide

59. 
    
    
    
    
    
    
    ͭͷηογϣϯΛ࡞Γɺͦ
    ΕͧΕ*OWJUBUJPOΛૹ৴
    

    View Slide

60. 
    
    
    
    
    
    
    session A
    session B
    

    View Slide

61. લఏ৚݅
    ʢ̍ʣ୺຤୆਺͕20~30୆
    ʢ̎ʣωοτϫʔΫʹґଘ͠ͳ͍
    ʢ̏ʣࣗಈతͳάϧʔϐϯά
    ʢ̐ʣ༗ػతͳάϧʔϐϯά
    

    View Slide

62. લఏ৚݅
    ʢ̍ʣ୺຤୆਺͕20~30୆
    ʢ̎ʣωοτϫʔΫʹґଘ͠ͳ͍
    ʢ̏ʣࣗಈతͳάϧʔϐϯά
    ʢ̐ʣ༗ػతͳάϧʔϐϯά
    

    View Slide

63. άϧʔϓܗ੒ޙͷΠϕϯτ
    ৽ͨͳ୺຤ͷࢀՃ
    άϧʔϓ͔Βͷ୺຤ͷ཭୤
    

    View Slide

64. ৽ͨͳ୺຤ͷࢀՃ
    ϦʔμʔΑΓऑ͍୺຤
    ϦʔμʔΑΓڧ͍୺຤
    

    View Slide

65. Ϧʔμʔ୺຤ΑΓऑ͍୺຤ͷࢀՃ
    
    
    
    
    
    
    
    session A
    session B
    
    

    View Slide

66. Ϧʔμʔ୺຤ΑΓڧ͍୺຤ͷࢀՃ
    
    
    
    
    
    
    
    session A
    session B
    
    

    View Slide

67. Ϧʔμʔ୺຤ΑΓڧ͍୺຤ͷࢀՃ
    
    
    
    
    
    
    
    طଘͷηογϣϯΛ
    ͍ͬͨΜऴྃ
    

    View Slide

68. Ϧʔμʔ୺຤ΑΓڧ͍୺຤ͷࢀՃ
    
    
    
    
    
    
    
    ࠶౓ɺपғͷ୺຤ͷ
    ୳ࡧΛߦ͏ɻ
    

    View Slide

69. Ϧʔμʔ୺຤ΑΓڧ͍୺຤ͷࢀՃ
    
    
    
    
    
    
    
    

    View Slide

70. Ϧʔμʔ୺຤ΑΓڧ͍୺຤ͷࢀՃ
    
    
    
    
    
    
    
    ৽ͨͳηογϣϯͷ࡞੒
    

    View Slide

71. άϧʔϓ͔Βͷ୺຤ͷ཭୤
    ϦʔμʔҎ֎͕཭୤
    Ϧʔμʔ͕཭୤
    

    View Slide

72. ϦʔμʔҎ֎ͷ୺຤ͷ཭୤
    ϦʔμʔҎ֎͕཭୤
    

    View Slide

73. ϦʔμʔҎ֎ͷ୺຤ͷ཭୤
    ϦʔμʔҎ֎͕཭୤ͯ͠΋
    ηογϣϯ͸ܧଓ͢Δ
    

    View Slide

74. Ϧʔμʔͷ཭୤
    Ϧʔμʔ͕཭୤
    

    View Slide

75. Ϧʔμʔͷ཭୤
    Ϧʔμʔ͕཭୤͢Δͱ
    ೋͭͷηογϣϯʹଐ͢Δ୺຤͕ͳ͘ͳͬͯ͠·͏
    ͨΊɺωοτϫʔΫ͕ܧଓͰ͖ͳ͍
    

    View Slide

76. 
    
    
    
    
    
    
    session A
    session B
    

    View Slide

77. 
    
    
    
    
    
    session A
    session B
    

    View Slide

78. 
    
    
    
    
    
    

    View Slide

79. 
    
    
    
    
    
    

    View Slide

80. 
    
    
    
    
    
    

    View Slide

81. ༗ػతͳάϧʔϐϯά
    ͜ΕͰԼهͷΠϕϯτͷ͢΂ͯʹରԠ͠ɺࣗݾ૊৫Խ͢Δάϧʔϐϯάͱ
    ͳΓ·ͨ͠ɻ
    ϦʔμʔΑΓऑ͍୺຤ͷࢀՃ
    ϦʔμʔΑΓڧ͍୺຤ͷࢀՃ
    Ϧʔμʔͷ཭୤
    ϦʔμʔҎ֎ͷ୺຤ͷ཭୤
    

    View Slide

82. άϧʔϐϯάͷલఏ৚݅
    ʢ̍ʣ୺຤୆਺͕20~30୆
    ʢ̎ʣωοτϫʔΫʹґଘ͠ͳ͍
    ʢ̏ʣࣗಈతͳάϧʔϐϯά
    ʢ̐ʣ༗ػతͳάϧʔϐϯά
    

    View Slide

83. ʢຊ෺ͷʣDEMO
    

    View Slide

84. View Slide

85. άϧʔϐϯάશମͷΠϕϯτઃܭ
    ࣮ࡍͷάϧʔϐϯάॲཧʹ͸ɺ៛ີͳάϧʔϓશମઃܭ͕ඞཁ
    MultipeerConnectivityͷෳ਺ηογϣϯͷΠϕϯτͷϋϯυϦϯά
    ͢΂ͯͷ୺຤ͷϢʔβʔೖྗͷϋϯυϦϯά
    ͦͷଞγεςϜΠϕϯτ
    

    View Slide

86. άϧʔϐϯάશମͷΠϕϯτઃܭ
    άϧʔϓશମͷΠϕϯτϧʔϓΛϦʔμʔ୺຤Ͱઃܭ͠ɺ௨ৗͷΠϕϯτ
    ϧʔϓͱ͸ผʹ؅ཧ͢Δ͜ͱ͕๬·͍͠ɻ
    

    View Slide

87. Ԡ༻
    

    View Slide

88. MCͷ double session Ͱ Eternal Network
    

    View Slide

89. MCͷ double session Ͱ
    Tree Network
    73 iPhones!
    

    View Slide

90. iPhone 73୆
    iPhone 11 ͷ࠷҆Ϟσϧ
    74,800ԁʢ੫ผʣ
    73୆ͩͱɺ੫ࠐΈͰ̒̌̌ສ̒̐̐̌ԁ
    ࢿ͕ۚू·ͬͨΒݺΜͰ͍ͩ͘͞ɻ
    

    View Slide

91. ·ͱΊ
    MultiPeer Connectivityͷෳ਺ηογϣϯΛ׆༻͢Δ͜ͱʹΑΓɺଟ਺ͷ୺຤Λ
    ಉظ͢Δ͜ͱ͕Ͱ͖·͢ɻ
    ࣗݾ૊৫Խ͢ΔάϧʔϐϯάઃܭΛߦ͏৔߹ʹ͸ηογϣϯͷ୺຤ͷࢀՃɾ཭
    ୤ॲཧʹ஫ҙ͢Δඞཁ͕͋Γ·͢ɻ
    ARΛ࢖͏ͱ೔ৗੜ׆ͷதͰͷΞϓϦར༻ DEMO Λ؆୯ʹ࡞Ε·͢ɻ
    ϦΞϧΞόλʔͰͷొஃ͸ݟͨ໨ΑΓͣͬͱϋʔυͰ͢ɻࢎܽʹͳΓͦ͏Ͱ
    ͢ɻ͓͢͢Ί͠·ͤΜɻ
    

    View Slide