完全理解！ 最新XRデバイス開発の勘所

Moguraさん主催のイベントに登壇した際の資料です。

イベント概要↓
https://mogucareer0727.peatix.com/

Transcript

1. TOKYO ׬શཧղʂ࠷৽XRσόΠε։ൃͷצॴ 27.July.2023
2. ໘ന๏ਓΧϠοΫͰWebΤϯδχΞͷϦʔμʔΛ຿ΊɺͷͪʹiOSΤϯδχΞʹస਎͠SNS LobiνʔϜʹैࣄɻ ͦͷޙίϩϓϥͷԾ૝ݱ࣮νʔϜʹస੶͠ɺVRήʔϜʮNyoro The Snake & Seven Islandsʯ։ൃͷϦʔυΤϯδ χΞΛ຿Ίɺଟ਺ͷVRήʔϜ։ൃΛܦݧɻMESONʹೖࣾޙɺXRΤϯδχΞͱͯ͠׆ಈͨ͠ͷͪɺCTOʹब೚ɻ MESON PROJECT CONFIDENTIAL AND PROPRIETARY ൺཹؒ ࿨໵ MESON CTO
3. MESON PROJECT CONFIDENTIAL AND PROPRIETARY Blog: https://edom18.hateblo.jp/
4. MESON PROJECT CONFIDENTIAL AND PROPRIETARY https://www.youtube.com/watch?v=8OjjsndF3gc
5. ಥવͰ͕͢ 5 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
6. 6 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
7. Apple͔ΒVision Pro͕ൃද͞Ε·ͨ͠Ͷ 7 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
8. MESON͸Apple͕ग़͢Ͱ͋Ζ͏MRσόΠεΛ ໨ඪʹ͖ͯ͠·ͨ͠ 8 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
9. MESON͕૑͖ͬͯͨϓϩμΫτ͸ Apple͕MRσόΠεΛग़͢ະདྷΛݟਾ͑ͨ΋ͷͰ͢ 9 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
10. Apple͕ఏএͨ͠ “ۭؒίϯϐϡʔςΟϯά” 10 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
11. Apple Vision Pro͕࣍ͷMRσόΠεͷ ϝΠϯετϦʔϜʹͳΔ͜ͱ͸ؒҧ͍ͳ͍ 11 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
12. ೔ຊਓσϕϩούʔͰ།ҰମݧͰ͖ͨ ฐࣾCEOখྛͷίϝϯτ 12 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
13. ͜Ε·Ͱଟ͘ͷϔουηοτΛମݧ͖ͯ͠·͕ͨ͠ɺ͜͜·ͰόʔνϟϧΦϒδΣΫτͷଘࡏײΛಘΒ ΕΔσόΠε͸͋Γ·ͤΜͰͨ͠ɻۭؒίϯϐϡʔςΟϯάٕज़͕ӽ͑Δ΂͖େ͖ͳࢁΛΑ͏΍͘৐Γ ӽ͑ͨͱײ͡Δ΄ͲͰͨ͠ɻ ࡉ͔ͳ఺Λड़΂ΔͱɺApple Vision ProΛͷ͍ͧͨͱ͖ͷۭؒͷΏ͕Έ͸΄ͱΜͲͳ͘ɺྫ͑͹طଘ ͷσόΠεͰମݧ͢Δࣗ෼ͷखͷαΠζ͕େ͖͘ײ͡Δͱ͍ͬͨ͜ͱ΋͋Γ·ͤΜͰͨ͠ɻ࣮ࡍͷ෺ମ ͷେ͖͞ɺڑ཭ײͱ΋ʹͱͯ΋ࣗવʹײ͡·͢ɻ·ͨɺσόΠεͷॏΈ΋ͦ͜·Ͱײ͡Δ͜ͱ͸ͳ͘ɺ 1࣌ؒ͸ܧଓͯ͠࢖༻Ͱ͖Δҹ৅Ͱ͢ɻྫྷ٫ͷͨΊͷϑΝϯͷԻ΍೤΋΄ͱΜͲؾʹͳΒͣɺੜ׆ͷத Ͱ௕࣌ؒ૷ணͰ͖ͦ͏ͳҹ৅Λ࣋ͪ·ͨ͠ɻ 13 MESON PROJECT CONFIDENTIAL AND PROPRIETARY “ ”
14. ͦͷଞͷઌߦମݧऀͷίϝϯτ 14 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
15. ୯ͳΔཧ૝తͳ࢖༻෩ܠͷΠϝʔδͰ͸ͳ͘ɺApple͕ఏڙͨ͠PVͱશ͘ಉ͡ମ ݧɺ΋͘͠͸ͦΕΛ্ճΔόʔνϟϧମݧ͕Ͱ͖ͨɻ 15 MESON PROJECT CONFIDENTIAL AND PROPRIETARY “ ”
16. ࠓޙXR։ൃΛ͢Δ্ͰࢀߟʹͳΔͷ͸ Apple Vision ProͷfeatureΛ࣠ʹߟ͑Δ͜ͱ 16 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
17. ͜Ε͔Βͷ “ۭؒίϯϐϡʔςΟϯά” ମݧΛ ૑Δ্Ͱେࣄͳཁૉ 17 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
18. ίϯτϩʔϥϨε 18 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
19. 19 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
20. 20 MESON PROJECT CONFIDENTIAL AND PROPRIETARY ίϯτϩʔϥ͕Ͳ͜ʹ΋ͳ͍
21. ͜ΕΛ࣮ݱ͢ΔͨΊͷٕज़͸̏ͭ 21 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
22. • ϋϯυδΣενϟ • ΞΠτϥοΩϯά • ϘΠείϚϯυ 22 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
23. ϋϯυδΣενϟ 23 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
24. ϋϯυδΣενϟΛར༻ͨ͠ϓϩμΫτ “Spatial Message” 24 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
25. 25 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
26. ϋϯυδΣενϟΛ૊Έ߹ΘͤͯίϯςϯπΛૢ࡞ 26 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
27. 27 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
28. ϋϯυδΣενϟΛ༻͍Δ͜ͱͰ Ϣʔβʹࣗવͳૢ࡞Λଅ͢͜ͱ͕Ͱ͖Δ 28 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
29. ҰํͰɺϢʔβͷखͷঢ়ଶΛ੍ޚͰ͖ͳ͍ 29 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
30. 30 MESON PROJECT CONFIDENTIAL AND PROPRIETARY 1. RockδΣενϟʔ 3. IndexδΣενϟʔ 2. PaperδΣενϟʔ 2. PaperδΣενϟʔ AWE2023ͷలࣔͰ࠾༻ͨ͠ϋϯυδΣενϟ
31. άʔΛظ଴͢Δͱ͖ʹύʔʹ͞ΕΔɺͱ͍͏͜ͱ͕ ԟʑʹͯ͋͠Γ͑Δ 31 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
32. ͭ·Γ࣮૷͕ΑΓෳࡶʹͳΔ 32 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
33. 33 MESON PROJECT CONFIDENTIAL AND PROPRIETARY 1. ಛఆͷδΣενϟ͕Ұఆ࣌ؒҡ࣋͞ΕͨΒͦͷδΣενϟΛͨ͜͠ͱͱΈͳ͢ 2. ೝࣝͨ͠δΣενϟ͢΂ͯͷ࣌ؒΛܭଌ͠ɺҰ൪ઌʹنఆ࣌ؒΛ௒͑ͨ΋ͷΛ࠾༻͢Δ ͢΂ͯͷδΣενϟͷ࣌ؒΛܭଌ͠ɺҰ൪࠷ॳʹنఆ࣌ؒʹୡͨ͠δΣενϟΛ࠾༻ɻ ݴΘ͹ɺશδΣενϟͷೝࣝϨʔεͷΑ͏ͳΠϝʔδɻ AWE2023Ͱ࣮૷ͨ͠޻෉
34. ΞΠτϥοΩϯά 34 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
35. ࣍ͷϙΠϯςΟϯάσόΠε͸ΞΠτϥοΩϯά 35 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
36. 36 MESON PROJECT CONFIDENTIAL AND PROPRIETARY Ҿ༻: Tobii XR Devzone 3-to-2 Step Interactions
37. ΞΠτϥοΩϯάʹΑΔϙΠϯςΟϯάͷՃ଎ 37 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
38. 38 MESON PROJECT CONFIDENTIAL AND PROPRIETARY Ҿ༻: Tobii XR Devzone Replacing Head Pointing with Gaze
39. visionOS Demo 39 MESON PROJECT CONFIDENTIAL AND PROPRIETARY https://github.com/NovaUI-Unity/AppleXRConcept/releases/tag/VisionOSDemo
40. 40 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
41. 41 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
42. ݟΔ͚ͩͰબ୒Ͱ͖Δ 42 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
43. ͨͩ͠ɺApple Vision ProͰ͸ Ϣʔβ͕Ͳ͜Λݟ͍ͯΔ͔ͷ৘ใ͕ఏڙ͞Εͳ͍ 43 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
44. ݴ͍׵͑ΔͱʮλοϓʯͳͲͷ δΣενϟΛ͍ͯͨ͠ͱ͖ʹͲ͜Λݟ͍͔ͯͨ ͱ͍͏৘ใͷΈར༻Ͱ͖Δ 44 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
45. Quest ProͰ͸ͦͷݶΓͰ͸ͳ͍ͨΊɺ ΫϩεϓϥοτϑΥʔϜ։ൃΛاը͢Δ৔߹͸஫ҙ͢Δ 45 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
46. ΞΠτϥοΩϯά͕ՄೳͳσόΠε 46 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
47. 47 MESON PROJECT CONFIDENTIAL AND PROPRIETARY ΞΠτϥοΩϯάରԠσόΠε Apple Vision Pro Meta Quest Pro Sony Playstation VR2 Magic Leap 2
48. ϋϯυδΣενϟ͕ՄೳͳσόΠε 48 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
49. 49 MESON PROJECT CONFIDENTIAL AND PROPRIETARY ϋϯυδΣενϟରԠσόΠε Apple Vision Pro Meta Quest Pro XREAL Light Magic Leap 2
50. ࠷ޙͷϐʔεʮϘΠείϚϯυʯ 50 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
51. Ի੠ೝࣝ͸ϓϥοτϑΥʔϜͰ෯޿͘αϙʔτ QuestͰ΋wit.aiΛར༻͢Δ͜ͱͰՄೳ 51 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
52. 52 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
53. Meta QuestͰ΋໰୊ͳ͘Ի੠ೝࣝͰ͖Δ 53 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
54. Ի੠ೝ͚ࣝͩͰ͸ίϚϯυ͸࣮ߦͰ͖ͳ͍ 54 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
55. ίϚϯυͷ࣮ߦ൑அ͸AIΛར༻͢Δ 55 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
56. ࿩୊ͷChatGPTΛච಄ʹ༷ʑͳLLM͕ొ৔ 56 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
57. OpenAIͷFunction callingͳͲΛར༻͢Δ͜ͱͰ ࣗ਎ͷΞϓϦʹAIͷػೳΛΠϯςάϨʔτ͢Δ 57 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
58. Function calling 58 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
59. 59 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
60. Agent - LangChain 60 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
61. ͜ΕΒͷٕज़Λ࢖͏͜ͱͰ ࣗ਎ͷΞϓϦʹϘΠείϚϯυʹΑΔૢ࡞Λ࣮૷Ͱ͖Δ 61 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
62. 62 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
63. LLMΛԠ༻͢Δ͜ͱͰ Ϣʔβ͸ࣗવݴޠͰॊೈʹૢ࡞͢Δ͜ͱ͕ՄೳʹͳΔ 63 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
64. ʲ࠶ܝʳ ࠓޙXR։ൃΛ͢Δ্ͰࢀߟʹͳΔͷ͸ Apple Vision ProͷfeatureΛ࣠ʹߟ͑Δ͜ͱ 64 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
65. MESONͰ͸ “ۭؒίϯϐϡʔςΟϯά” ։ൃʹڵຯ͕͋Δ ΤϯδχΞΛઈࢍืूதͰ͢ʂ 65 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
66. ໰͍߹Θͤ͸ϑΥʔϜ͔Twitter͔Β͝࿈བྷ͍ͩ͘͞ʂ 66 MESON PROJECT CONFIDENTIAL AND PROPRIETARY
67. ࠾༻αΠτ΋͋ΔͷͰڵຯ͕͋Δํ͸ͥͻʂˠ 67 MESON PROJECT CONFIDENTIAL AND PROPRIETARY https://careers.meson.tokyo/
68. ͝ਗ਼ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ 68 MESON PROJECT CONFIDENTIAL AND PROPRIETARY