仮想世界がつくる未来の話 / Virtual World Creates Future

Transcript

1. 仮想世界がつくる未来の話 湯村 翼　@yumu19 国立研究開発法人 情報通信研究機構 湯村 翼　@yumu19 国立研究開発法人 情報通信研究機構 Virtual

   World Creates Future Co-KoNPILe #4 2020/05/05

2. #cokonpile ࣗݾ঺հ • ౬ଜ ཌྷɹ@yumu19 • ࡳຈग़਎ɺੴ઒ݝຽ • ࠃཱݚڀ։ൃ๏ਓ ৘ใ௨৴ݚڀػߏ

   ๺཮StarBEDٕज़ηϯλʔ ݚڀһ • ઐ໳ɿωοτϫʔΫɺϢϏΩλείϯϐϡʔςΟϯάɺώϡʔϚϯίϯϐϡʔλΠϯλϥΫγϣϯ etc. • Ӊ஦σʔλϋοΧιϯ NASA SpaceApps Challenge (COVID-19 Challenge 5/30-31) • NTࡳຈ ൃىਓ 2 Ϟϊͮ͘Γܥ ϙουΩϟετ ඼ϞϊϥδΦ

3. #cokonpile NTࡳຈ2019 3 • 2019/12/01(೔) ϥιϥࡳຈ Πϕϯτίʔτ • ͜Ε͕ॳ։࠵ •

   ໿30૊ͷలࣔ

4. #cokonpile NTࡳຈ2019 4

5. #cokonpile NTࡳຈ2019 5 • NHK๺ւಓ ̙̙̌̓̑̑νϟϯωϧ (5෼൪૊) • ൪૊ͷಈըΞʔΧΠϒ͋Γ·͢ •

   https://www.nhk.or.jp/sapporo/articles/slug- n5e58c775c839

6. #cokonpile ࠓ೔ͷ಺༰ • Ծ૝ੈքͬͯԿʁ • Ծ૝ੈքͰͷίϛϡχέʔγϣϯπʔϧ • Ծ૝ੈք͕෺ཧੈքʹ΋໾ཱͭ 6

7. #cokonpile Ծ૝ੈքʁ 7 ϚτϦοΫε (1999) 8BSOFS#SPTDPN
   c
   5IF
   .BUSJY
   c
   .PWJFT
   ΑΓ
   IUUQTXXXXBSOFSCSPTDPNNPWJFTNBUSJY ϨσΟɾϓϨΠϠʔ̍ (2018) 8BSOFS#SPTDPN
   c
   3FBEZ
   1MBZFS
   0OF
   c
   .PWJFT
   ΑΓ
   

   IUUQTXXXXBSOFSCSPTDPNNPWJFTSFBEZQMBZFSPOF ιʔυΞʔτɾΦϯϥΠϯ(2012) 57ΞχϝʮιʔυΞʔτɾΦϯϥΠϯʯΦϑΟγϟϧαΠτ
   ΑΓ
   IUUQTXXXTXPSEBSUPOMJOFOFU

8. #cokonpile xRք۾ͷཤमՊ໨Ϧετ • Ξχϝɾөըɾখઆ͸ڞ௨ݴޠͳͷͰศར 8 https://bit.ly/xr-list

9. #cokonpile ΋͏গ͠਎ۙͳԾ૝ੈք 9 ͋ͭ·Ε Ͳ͏Ϳͭͷ৿ (2020) VR Chat (2014) cluster

   (2017)

10. #cokonpile ҙ֎ͱੲ͔Β͋ΔԾ૝ੈք • MMORPGͱݺ͹ΕΔδϟϯϧͷήʔϜ΋ଟ਺ • ֓೦తʹ͸ࠓ΋ੲ΋ͦΕ΄ͲมΘΒͳ͍ • ٕज़ͷਐา͕Θ͔ΔɿCGͷࡉ͔͞ɾಈ͖ͷ׈Β͔͞ɾಉ࣌઀ଓ਺ 10 ʮΞϝʔόϐάʯʹ΄͠ͷ͖͋ɺ҆ాඒࠫࢠ͕ొ৔
    
    "NFCB
    /FXTΑΓ
    

    IUUQTOFXTBNFCBKQFOUSZ Ξϝʔόϐά (2009) Second Life (2003) ΦϒδΣΫτ࡞੒ʹ͍ͭͯ
    ηΧϯυϥΠϑɹ4FDPOE-JGFɿʲΞΠϐϩDPNʳΑΓ
    IUUQXXXBJQJSPDPNDPOUFOUTJOEFYIUN

11. #cokonpile ͋ͭ·ΕͲ͏Ϳͭͷ৿ʢ͋ͭ৿ʣ • ແਓౡͰ஬΍ڕΛั·͑ͨΓՖΛҭͯͨΓ͓ۚΛͨΊ ͯՈ΍෰΍Ո۩Λങ͏ήʔϜ • ΦϯϥΠϯͰϑϨϯζͷౡʹ༡ͼʹߦ͚Δ • ෰ͱֆΛࣗ࡞Ͱ͖Δ •

    ݁ࠗࣜɾϝΠΧʔΠϕϯτΛ։࠵ͨ͠ྫ΋ 11 ʮ͋ͭ·ΕɹͲ͏Ϳͭͷ৿ʯͰ݁ࠗࣜΛڍ͛·ͨ͠ʛ͘ΒΒʛOPUF
    ΑΓ
    IUUQTOPUFDPNLSGBUPTOOFB झຯ5&$)ࡇ

12. #cokonpile cluster • όʔνϟϧSNSɾόʔνϟϧΠϕϯτۭؒ • https://cluster.mu • ϓϨθϯςʔγϣϯܗࣜͷΠϕϯτ͕։࠵Մೳ • ৗ࣌Φʔϓϯͷʮϫʔϧυʯ͕3݄ެ։

    • Windows, Mac, εϚϗ (iPhone / Android), VRσόΠε(oculus / VIVE) ʹରԠ • ແྉʢҰ෦༗ྉΠϕϯτ͋Γʣ • ϦΞΫγϣϯ͕Մೳ 12

13. #cokonpile cluster | όʔνϟϧϜαϏల • ෢ଂ໺ඒज़େֶͷ࡞඼ల • 2020/04/20ʙ30։࠵ʢ࣮͸·ͩ։͍ͯΔʣ • ֆըɾࣸਅɾσβΠϯͳͲͷ੩ࢭըίϯςϯπ͕த৺

    • ಈը΋͋Γ 13

14. #cokonpile cluster | ϫʔϧυ੍࡞ • UnityͰ੍࡞Մೳ (Unity༻cluster SDK͕഑෍) • Unity͕ී௨ʹ࢖͑Ε͹؆୯ʹ࡞ΕΔ

    14

15. #cokonpile cluster | ϫʔϧυ੍࡞ • THETA(360°Χϝϥ)ͷશఱٿը૾ΛషΓ෇͚Δͱ࣮ࡍͷ ۭؒΛखܰʹ࠶ݱͰ͖Δ 15

16. #cokonpile cluster | ϫʔϧυ੍࡞ • ΞΠςϜઃஔɾอ࣋΋Մೳ 16

17. #cokonpile cluster | Ξόλʔࣗ࡞ • blender౳ͷϞσϦϯάιϑτͰθϩ͔Βࣗ࡞͢Δํ๏ • ࣸਅ͔Β3DϞσϧΛੜ੒͢Δํ๏ • ࠷ۙݚڀ͕ΊͬͪΌਐΜͰΔɺPIFu͍͢͝ʂ

    • @DMiyamo3 ͞Μͷࢿྉ͕ͱͯ΋Θ͔Γ΍͍͢ • https://docs.google.com/presentation/d/1RUsZVLidcDNzVoK- y8wQG7oNiqjhm-cHcKWMlx23JRI/edit#slide=id.p 17

18. #cokonpile cluster | Ξόλʔࣗ࡞ • ※ 3DϞσϧपΓʹ͸͍ΖΜͳπʔϧ͕͋Δ • ※ 3DϞσϧʹ͸͍ΖΜͳϑΥʔϚοτ͕͋Δ

    • PIFuͷϞσϧ͔ΒclusterͷΞόλʔ(VRMܗࣜ)Λ࡞Δ৔߹ͷྫ • Meshlab • PIFuͰ࡞ͬͨ3DϞσϧ(.obj)Λplyܗࣜʹม׵ • Blender • ৭ͷඳըํ๏Λ௖఺Χϥʔ͔ΒςΫενϟʹม׵ • ϙϦΰϯ਺࡟ݮ (cluster͸ϙϦΰϯ਺্ݶ32,000) • ϘʔϯͷຒΊࠐΈ • Unity • UniVRMͰVRMܗࣜϞσϧੜ੒ 18

19. Ծ૝ۭ͕ؒ෺ཧੈքʹ΋໾ཱͭʁ

20. #cokonpile ෺ཧੈքͰͷγεςϜ։ൃ͸େม • ྫɿUberͷࣗಈӡసऀͷ૸ߦςετͷͨΊͷڊେίʔε 20 Our Road to Self-Driving Vehicles

    | Uber ATG https://www.youtube.com/watch?v=27OuOCeZmwI

21. #cokonpile Learning in Simulation • Ծ૝ۭؒ(3DCG)ΛϩϘοτ౳ͷػցֶशσʔλͱͯ͠ ׆༻ 21 Savva et

    al.(2019), Habitat: A platform for embodied AI research ΑΓ

22. #cokonpile AirSim (Microsoft Research) • ࣗಈӡసंɾυϩʔϯͷػցֶशͷͨΊͷγϛϡϨʔλ • Unreal Engine4 22

    Shah et al., AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles (FSR 2017)

23. #cokonpile The SYNTHIA Dataset • CVPR2016 • ඃҾ༻਺ 691 (2020/04/15,

    Google Scholarௐ΂) • Ծ૝ͷ֗ΛUnity(3DCG)Ͱߏங • ࡱӨͨ͠RGBը૾+ਂ౓+ηάϝϯςʔγϣϯΞϊςʔ γϣϯΛσʔληοτͱͯ͠ެ։ • 13,000ϑϨʔϜ(ϥϯμϜ)+4×50,000ϑϨʔϜ(γʔέϯ γϟϧ) 23

24. #cokonpile γϛϡϨʔγϣϯԾઆ • ʮ͜ͷੈք͸͢΂ͯγϛϡϨʔγϣϯͳͷͰ͸ͳ͍ ͔ʁʯͱ͢ΔԾઆ • ࢠڙͷࠒʹʢେਓʹͳͬͯ΋ʁʣҰ౓͸ߟ͑Δ͜ͱ • Պֶऀɾ఩ֶऀ͕ͨͪٞ࿦͍ͯ͠Δ •

    Ծ૝ۭؒͰͷίϛϡχέʔγϣϯ͕೔ৗʹͳͬͨΒ ʮ૬ख͸botͰ͸ʯͱ͍͏ٙ೦͸১͑Δͷ͔ʁ 24

25. #cokonpile ·ͱΊ 25 • Ծ૝ੈքΛ࢖ͬͨίϛϡχέʔγϣϯπʔϧ΋গͣͭ͠ਐԽ͍ͯ͠Δ • ແྉͰ࢖͑ΔαʔϏε͕ଟ͍ͷͰ৮ͬͯΈΑ͏ • Ծ૝ੈքɾγϛϡϨʔγϣϯ͕γεςϜ։ൃʹ໾ཱͭʂʢ͔΋ʣ ࣭໰ɺײ૝ɺίϝϯτͳͲ͋Ε͹Twitterʹͯड͚෇͚·͢

    @yumu19