仮想世界がつくる未来の話 / Virtual World Creates Future

仮想世界がつくる未来の話 / Virtual World Creates Future

2020/05/05(火)のCo-KonPILe #4 の発表資料
https://cokonpile.connpass.com/event/174989/

96466365a9bf7e66990f2b9ba547b02f?s=128

Tsubasa Yumura

May 05, 2020
Tweet

Transcript

  1. 仮想世界がつくる未来の話 湯村 翼 @yumu19 国立研究開発法人 情報通信研究機構 湯村 翼 @yumu19 国立研究開発法人 情報通信研究機構 Virtual

    World Creates Future Co-KoNPILe #4 2020/05/05
  2. #cokonpile ࣗݾ঺հ • ౬ଜ ཌྷɹ@yumu19 • ࡳຈग़਎ɺੴ઒ݝຽ • ࠃཱݚڀ։ൃ๏ਓ ৘ใ௨৴ݚڀػߏ

    ๺཮StarBEDٕज़ηϯλʔ ݚڀһ • ઐ໳ɿωοτϫʔΫɺϢϏΩλείϯϐϡʔςΟϯάɺώϡʔϚϯίϯϐϡʔλΠϯλϥΫγϣϯ etc. • Ӊ஦σʔλϋοΧιϯ NASA SpaceApps Challenge (COVID-19 Challenge 5/30-31) • NTࡳຈ ൃىਓ 2 Ϟϊͮ͘Γܥ ϙουΩϟετ ඼ϞϊϥδΦ
  3. #cokonpile NTࡳຈ2019 3 • 2019/12/01(೔) ϥιϥࡳຈ Πϕϯτίʔτ • ͜Ε͕ॳ։࠵ •

    ໿30૊ͷలࣔ
  4. #cokonpile NTࡳຈ2019 4

  5. #cokonpile NTࡳຈ2019 5 • NHK๺ւಓ ̙̙̌̓̑̑νϟϯωϧ (5෼൪૊) • ൪૊ͷಈըΞʔΧΠϒ͋Γ·͢ •

    https://www.nhk.or.jp/sapporo/articles/slug- n5e58c775c839
  6. #cokonpile ࠓ೔ͷ಺༰ • Ծ૝ੈքͬͯԿʁ • Ծ૝ੈքͰͷίϛϡχέʔγϣϯπʔϧ • Ծ૝ੈք͕෺ཧੈքʹ΋໾ཱͭ 6

  7. #cokonpile Ծ૝ੈքʁ 7 ϚτϦοΫε (1999) 8BSOFS#SPTDPNc5IF.BUSJYc.PWJFTΑΓ IUUQTXXXXBSOFSCSPTDPNNPWJFTNBUSJY ϨσΟɾϓϨΠϠʔ̍ (2018) 8BSOFS#SPTDPNc3FBEZ1MBZFS0OFc.PWJFTΑΓ

    IUUQTXXXXBSOFSCSPTDPNNPWJFTSFBEZQMBZFSPOF ιʔυΞʔτɾΦϯϥΠϯ(2012) 57ΞχϝʮιʔυΞʔτɾΦϯϥΠϯʯΦϑΟγϟϧαΠτΑΓ IUUQTXXXTXPSEBSUPOMJOFOFU
  8. #cokonpile xRք۾ͷཤमՊ໨Ϧετ • Ξχϝɾөըɾখઆ͸ڞ௨ݴޠͳͷͰศར 8 https://bit.ly/xr-list

  9. #cokonpile ΋͏গ͠਎ۙͳԾ૝ੈք 9 ͋ͭ·Ε Ͳ͏Ϳͭͷ৿ (2020) VR Chat (2014) cluster

    (2017)
  10. #cokonpile ҙ֎ͱੲ͔Β͋ΔԾ૝ੈք • MMORPGͱݺ͹ΕΔδϟϯϧͷήʔϜ΋ଟ਺ • ֓೦తʹ͸ࠓ΋ੲ΋ͦΕ΄ͲมΘΒͳ͍ • ٕज़ͷਐา͕Θ͔ΔɿCGͷࡉ͔͞ɾಈ͖ͷ׈Β͔͞ɾಉ࣌઀ଓ਺ 10 ʮΞϝʔόϐάʯʹ΄͠ͷ͖͋ɺ҆ాඒࠫࢠ͕ొ৔"NFCB/FXTΑΓ

    IUUQTOFXTBNFCBKQFOUSZ Ξϝʔόϐά (2009) Second Life (2003) ΦϒδΣΫτ࡞੒ʹ͍ͭͯ ηΧϯυϥΠϑɹ4FDPOE-JGFɿʲΞΠϐϩDPNʳΑΓ IUUQXXXBJQJSPDPNDPOUFOUTJOEFYIUN
  11. #cokonpile ͋ͭ·ΕͲ͏Ϳͭͷ৿ʢ͋ͭ৿ʣ • ແਓౡͰ஬΍ڕΛั·͑ͨΓՖΛҭͯͨΓ͓ۚΛͨΊ ͯՈ΍෰΍Ո۩Λങ͏ήʔϜ • ΦϯϥΠϯͰϑϨϯζͷౡʹ༡ͼʹߦ͚Δ • ෰ͱֆΛࣗ࡞Ͱ͖Δ •

    ݁ࠗࣜɾϝΠΧʔΠϕϯτΛ։࠵ͨ͠ྫ΋ 11 ʮ͋ͭ·ΕɹͲ͏Ϳͭͷ৿ʯͰ݁ࠗࣜΛڍ͛·ͨ͠ʛ͘ΒΒʛOPUFΑΓ IUUQTOPUFDPNLSGBUPTOOFB झຯ5&$)ࡇ
  12. #cokonpile cluster • όʔνϟϧSNSɾόʔνϟϧΠϕϯτۭؒ • https://cluster.mu • ϓϨθϯςʔγϣϯܗࣜͷΠϕϯτ͕։࠵Մೳ • ৗ࣌Φʔϓϯͷʮϫʔϧυʯ͕3݄ެ։

    • Windows, Mac, εϚϗ (iPhone / Android), VRσόΠε(oculus / VIVE) ʹରԠ • ແྉʢҰ෦༗ྉΠϕϯτ͋Γʣ • ϦΞΫγϣϯ͕Մೳ 12
  13. #cokonpile cluster | όʔνϟϧϜαϏల • ෢ଂ໺ඒज़େֶͷ࡞඼ల • 2020/04/20ʙ30։࠵ʢ࣮͸·ͩ։͍ͯΔʣ • ֆըɾࣸਅɾσβΠϯͳͲͷ੩ࢭըίϯςϯπ͕த৺

    • ಈը΋͋Γ 13
  14. #cokonpile cluster | ϫʔϧυ੍࡞ • UnityͰ੍࡞Մೳ (Unity༻cluster SDK͕഑෍) • Unity͕ී௨ʹ࢖͑Ε͹؆୯ʹ࡞ΕΔ

    14
  15. #cokonpile cluster | ϫʔϧυ੍࡞ • THETA(360°Χϝϥ)ͷશఱٿը૾ΛషΓ෇͚Δͱ࣮ࡍͷ ۭؒΛखܰʹ࠶ݱͰ͖Δ 15

  16. #cokonpile cluster | ϫʔϧυ੍࡞ • ΞΠςϜઃஔɾอ࣋΋Մೳ 16

  17. #cokonpile cluster | Ξόλʔࣗ࡞ • blender౳ͷϞσϦϯάιϑτͰθϩ͔Βࣗ࡞͢Δํ๏ • ࣸਅ͔Β3DϞσϧΛੜ੒͢Δํ๏ • ࠷ۙݚڀ͕ΊͬͪΌਐΜͰΔɺPIFu͍͢͝ʂ

    • @DMiyamo3 ͞Μͷࢿྉ͕ͱͯ΋Θ͔Γ΍͍͢ • https://docs.google.com/presentation/d/1RUsZVLidcDNzVoK- y8wQG7oNiqjhm-cHcKWMlx23JRI/edit#slide=id.p 17
  18. #cokonpile cluster | Ξόλʔࣗ࡞ • ※ 3DϞσϧपΓʹ͸͍ΖΜͳπʔϧ͕͋Δ • ※ 3DϞσϧʹ͸͍ΖΜͳϑΥʔϚοτ͕͋Δ

    • PIFuͷϞσϧ͔ΒclusterͷΞόλʔ(VRMܗࣜ)Λ࡞Δ৔߹ͷྫ • Meshlab • PIFuͰ࡞ͬͨ3DϞσϧ(.obj)Λplyܗࣜʹม׵ • Blender • ৭ͷඳըํ๏Λ௖఺Χϥʔ͔ΒςΫενϟʹม׵ • ϙϦΰϯ਺࡟ݮ (cluster͸ϙϦΰϯ਺্ݶ32,000) • ϘʔϯͷຒΊࠐΈ • Unity • UniVRMͰVRMܗࣜϞσϧੜ੒ 18
  19. Ծ૝ۭ͕ؒ෺ཧੈքʹ΋໾ཱͭʁ

  20. #cokonpile ෺ཧੈքͰͷγεςϜ։ൃ͸େม • ྫɿUberͷࣗಈӡసऀͷ૸ߦςετͷͨΊͷڊେίʔε 20 Our Road to Self-Driving Vehicles

    | Uber ATG https://www.youtube.com/watch?v=27OuOCeZmwI
  21. #cokonpile Learning in Simulation • Ծ૝ۭؒ(3DCG)ΛϩϘοτ౳ͷػցֶशσʔλͱͯ͠ ׆༻ 21 Savva et

    al.(2019), Habitat: A platform for embodied AI research ΑΓ
  22. #cokonpile AirSim (Microsoft Research) • ࣗಈӡసंɾυϩʔϯͷػցֶशͷͨΊͷγϛϡϨʔλ • Unreal Engine4 22

    Shah et al., AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles (FSR 2017)
  23. #cokonpile The SYNTHIA Dataset • CVPR2016 • ඃҾ༻਺ 691 (2020/04/15,

    Google Scholarௐ΂) • Ծ૝ͷ֗ΛUnity(3DCG)Ͱߏங • ࡱӨͨ͠RGBը૾+ਂ౓+ηάϝϯςʔγϣϯΞϊςʔ γϣϯΛσʔληοτͱͯ͠ެ։ • 13,000ϑϨʔϜ(ϥϯμϜ)+4×50,000ϑϨʔϜ(γʔέϯ γϟϧ) 23
  24. #cokonpile γϛϡϨʔγϣϯԾઆ • ʮ͜ͷੈք͸͢΂ͯγϛϡϨʔγϣϯͳͷͰ͸ͳ͍ ͔ʁʯͱ͢ΔԾઆ • ࢠڙͷࠒʹʢେਓʹͳͬͯ΋ʁʣҰ౓͸ߟ͑Δ͜ͱ • Պֶऀɾ఩ֶऀ͕ͨͪٞ࿦͍ͯ͠Δ •

    Ծ૝ۭؒͰͷίϛϡχέʔγϣϯ͕೔ৗʹͳͬͨΒ ʮ૬ख͸botͰ͸ʯͱ͍͏ٙ೦͸১͑Δͷ͔ʁ 24
  25. #cokonpile ·ͱΊ 25 • Ծ૝ੈքΛ࢖ͬͨίϛϡχέʔγϣϯπʔϧ΋গͣͭ͠ਐԽ͍ͯ͠Δ • ແྉͰ࢖͑ΔαʔϏε͕ଟ͍ͷͰ৮ͬͯΈΑ͏ • Ծ૝ੈքɾγϛϡϨʔγϣϯ͕γεςϜ։ൃʹ໾ཱͭʂʢ͔΋ʣ ࣭໰ɺײ૝ɺίϝϯτͳͲ͋Ε͹Twitterʹͯड͚෇͚·͢

    @yumu19