仮想世界がつくる未来の話 湯村 翼　@yumu19 国立研究開発法人 情報通信研究機構 湯村 翼　@yumu19 国立研究開発法人 情報通信研究機構 Virtual World Creates Future Co-KoNPILe #4 2020/05/05

#cokonpile ࣗݾ঺հ • ౬ଜ ཌྷɹ@yumu19 • ࡳຈग़਎ɺੴ઒ݝຽ • ࠃཱݚڀ։ൃ๏ਓ ৘ใ௨৴ݚڀػߏ ๺཮StarBEDٕज़ηϯλʔ ݚڀһ • ઐ໳ɿωοτϫʔΫɺϢϏΩλείϯϐϡʔςΟϯάɺώϡʔϚϯίϯϐϡʔλΠϯλϥΫγϣϯ etc. • Ӊ஦σʔλϋοΧιϯ NASA SpaceApps Challenge (COVID-19 Challenge 5/30-31) • NTࡳຈ ൃىਓ 2 Ϟϊͮ͘Γܥ ϙουΩϟετ ඼ϞϊϥδΦ

#cokonpile NTࡳຈ2019 3 • 2019/12/01(೔) ϥιϥࡳຈ Πϕϯτίʔτ • ͜Ε͕ॳ։࠵ • ໿30૊ͷలࣔ

#cokonpile NTࡳຈ2019 4

#cokonpile NTࡳຈ2019 5 • NHK๺ւಓ ̙̙̌̓̑̑νϟϯωϧ (5෼൪૊) • ൪૊ͷಈըΞʔΧΠϒ͋Γ·͢ • https://www.nhk.or.jp/sapporo/articles/slug- n5e58c775c839

#cokonpile ࠓ೔ͷ಺༰ • Ծ૝ੈքͬͯԿʁ • Ծ૝ੈքͰͷίϛϡχέʔγϣϯπʔϧ • Ծ૝ੈք͕෺ཧੈքʹ΋໾ཱͭ 6

#cokonpile Ծ૝ੈքʁ 7 ϚτϦοΫε (1999) 8BSOFS#SPTDPNc5IF.BUSJYc.PWJFTΑΓ IUUQTXXXXBSOFSCSPTDPNNPWJFTNBUSJY ϨσΟɾϓϨΠϠʔ̍ (2018) 8BSOFS#SPTDPNc3FBEZ1MBZFS0OFc.PWJFTΑΓ IUUQTXXXXBSOFSCSPTDPNNPWJFTSFBEZQMBZFSPOF ιʔυΞʔτɾΦϯϥΠϯ(2012) 57ΞχϝʮιʔυΞʔτɾΦϯϥΠϯʯΦϑΟγϟϧαΠτΑΓ IUUQTXXXTXPSEBSUPOMJOFOFU

#cokonpile xRք۾ͷཤमՊ໨Ϧετ • Ξχϝɾөըɾখઆ͸ڞ௨ݴޠͳͷͰศར 8 https://bit.ly/xr-list

#cokonpile ΋͏গ͠਎ۙͳԾ૝ੈք 9 ͋ͭ·Ε Ͳ͏Ϳͭͷ৿ (2020) VR Chat (2014) cluster (2017)

#cokonpile ҙ֎ͱੲ͔Β͋ΔԾ૝ੈք • MMORPGͱݺ͹ΕΔδϟϯϧͷήʔϜ΋ଟ਺ • ֓೦తʹ͸ࠓ΋ੲ΋ͦΕ΄ͲมΘΒͳ͍ • ٕज़ͷਐา͕Θ͔ΔɿCGͷࡉ͔͞ɾಈ͖ͷ׈Β͔͞ɾಉ࣌઀ଓ਺ 10 ʮΞϝʔόϐάʯʹ΄͠ͷ͖͋ɺ҆ాඒࠫࢠ͕ొ৔"NFCB/FXTΑΓ IUUQTOFXTBNFCBKQFOUSZ Ξϝʔόϐά (2009) Second Life (2003) ΦϒδΣΫτ࡞੒ʹ͍ͭͯ ηΧϯυϥΠϑɹ4FDPOE-JGFɿʲΞΠϐϩDPNʳΑΓ IUUQXXXBJQJSPDPNDPOUFOUTJOEFYIUN

#cokonpile ͋ͭ·ΕͲ͏Ϳͭͷ৿ʢ͋ͭ৿ʣ • ແਓౡͰ஬΍ڕΛั·͑ͨΓՖΛҭͯͨΓ͓ۚΛͨΊ ͯՈ΍෰΍Ո۩Λങ͏ήʔϜ • ΦϯϥΠϯͰϑϨϯζͷౡʹ༡ͼʹߦ͚Δ • ෰ͱֆΛࣗ࡞Ͱ͖Δ • ݁ࠗࣜɾϝΠΧʔΠϕϯτΛ։࠵ͨ͠ྫ΋ 11 ʮ͋ͭ·ΕɹͲ͏Ϳͭͷ৿ʯͰ݁ࠗࣜΛڍ͛·ͨ͠ʛ͘ΒΒʛOPUFΑΓ IUUQTOPUFDPNLSGBUPTOOFB झຯ5&$)ࡇ

#cokonpile cluster • όʔνϟϧSNSɾόʔνϟϧΠϕϯτۭؒ • https://cluster.mu • ϓϨθϯςʔγϣϯܗࣜͷΠϕϯτ͕։࠵Մೳ • ৗ࣌Φʔϓϯͷʮϫʔϧυʯ͕3݄ެ։ • Windows, Mac, εϚϗ (iPhone / Android), VRσόΠε(oculus / VIVE) ʹରԠ • ແྉʢҰ෦༗ྉΠϕϯτ͋Γʣ • ϦΞΫγϣϯ͕Մೳ 12

#cokonpile cluster | όʔνϟϧϜαϏల • ෢ଂ໺ඒज़େֶͷ࡞඼ల • 2020/04/20ʙ30։࠵ʢ࣮͸·ͩ։͍ͯΔʣ • ֆըɾࣸਅɾσβΠϯͳͲͷ੩ࢭըίϯςϯπ͕த৺ • ಈը΋͋Γ 13

#cokonpile cluster | ϫʔϧυ੍࡞ • UnityͰ੍࡞Մೳ (Unity༻cluster SDK͕഑෍) • Unity͕ී௨ʹ࢖͑Ε͹؆୯ʹ࡞ΕΔ 14

#cokonpile cluster | ϫʔϧυ੍࡞ • THETA(360°Χϝϥ)ͷશఱٿը૾ΛషΓ෇͚Δͱ࣮ࡍͷ ۭؒΛखܰʹ࠶ݱͰ͖Δ 15

#cokonpile cluster | ϫʔϧυ੍࡞ • ΞΠςϜઃஔɾอ࣋΋Մೳ 16

#cokonpile cluster | Ξόλʔࣗ࡞ • blender౳ͷϞσϦϯάιϑτͰθϩ͔Βࣗ࡞͢Δํ๏ • ࣸਅ͔Β3DϞσϧΛੜ੒͢Δํ๏ • ࠷ۙݚڀ͕ΊͬͪΌਐΜͰΔɺPIFu͍͢͝ʂ • @DMiyamo3 ͞Μͷࢿྉ͕ͱͯ΋Θ͔Γ΍͍͢ • https://docs.google.com/presentation/d/1RUsZVLidcDNzVoK- y8wQG7oNiqjhm-cHcKWMlx23JRI/edit#slide=id.p 17

#cokonpile cluster | Ξόλʔࣗ࡞ • ※ 3DϞσϧपΓʹ͸͍ΖΜͳπʔϧ͕͋Δ • ※ 3DϞσϧʹ͸͍ΖΜͳϑΥʔϚοτ͕͋Δ • PIFuͷϞσϧ͔ΒclusterͷΞόλʔ(VRMܗࣜ)Λ࡞Δ৔߹ͷྫ • Meshlab • PIFuͰ࡞ͬͨ3DϞσϧ(.obj)Λplyܗࣜʹม׵ • Blender • ৭ͷඳըํ๏Λ௖఺Χϥʔ͔ΒςΫενϟʹม׵ • ϙϦΰϯ਺࡟ݮ (cluster͸ϙϦΰϯ਺্ݶ32,000) • ϘʔϯͷຒΊࠐΈ • Unity • UniVRMͰVRMܗࣜϞσϧੜ੒ 18

Ծ૝ۭ͕ؒ෺ཧੈքʹ΋໾ཱͭʁ

#cokonpile ෺ཧੈքͰͷγεςϜ։ൃ͸େม • ྫɿUberͷࣗಈӡసऀͷ૸ߦςετͷͨΊͷڊେίʔε 20 Our Road to Self-Driving Vehicles | Uber ATG https://www.youtube.com/watch?v=27OuOCeZmwI

#cokonpile Learning in Simulation • Ծ૝ۭؒ(3DCG)ΛϩϘοτ౳ͷػցֶशσʔλͱͯ͠ ׆༻ 21 Savva et al.(2019), Habitat: A platform for embodied AI research ΑΓ

#cokonpile AirSim (Microsoft Research) • ࣗಈӡసंɾυϩʔϯͷػցֶशͷͨΊͷγϛϡϨʔλ • Unreal Engine4 22 Shah et al., AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles (FSR 2017)

#cokonpile The SYNTHIA Dataset • CVPR2016 • ඃҾ༻਺ 691 (2020/04/15, Google Scholarௐ΂) • Ծ૝ͷ֗ΛUnity(3DCG)Ͱߏங • ࡱӨͨ͠RGBը૾+ਂ౓+ηάϝϯςʔγϣϯΞϊςʔ γϣϯΛσʔληοτͱͯ͠ެ։ • 13,000ϑϨʔϜ(ϥϯμϜ)+4×50,000ϑϨʔϜ(γʔέϯ γϟϧ) 23

#cokonpile γϛϡϨʔγϣϯԾઆ • ʮ͜ͷੈք͸͢΂ͯγϛϡϨʔγϣϯͳͷͰ͸ͳ͍ ͔ʁʯͱ͢ΔԾઆ • ࢠڙͷࠒʹʢେਓʹͳͬͯ΋ʁʣҰ౓͸ߟ͑Δ͜ͱ • Պֶऀɾ఩ֶऀ͕ͨͪٞ࿦͍ͯ͠Δ • Ծ૝ۭؒͰͷίϛϡχέʔγϣϯ͕೔ৗʹͳͬͨΒ ʮ૬ख͸botͰ͸ʯͱ͍͏ٙ೦͸১͑Δͷ͔ʁ 24

#cokonpile ·ͱΊ 25 • Ծ૝ੈքΛ࢖ͬͨίϛϡχέʔγϣϯπʔϧ΋গͣͭ͠ਐԽ͍ͯ͠Δ • ແྉͰ࢖͑ΔαʔϏε͕ଟ͍ͷͰ৮ͬͯΈΑ͏ • Ծ૝ੈքɾγϛϡϨʔγϣϯ͕γεςϜ։ൃʹ໾ཱͭʂʢ͔΋ʣ ࣭໰ɺײ૝ɺίϝϯτͳͲ͋Ε͹Twitterʹͯड͚෇͚·͢ @yumu19