Upgrade to Pro — share decks privately, control downloads, hide ads and more …

仮想世界がつくる未来の話 / Virtual World Creates Future

仮想世界がつくる未来の話 / Virtual World Creates Future

2020/05/05(火)のCo-KonPILe #4 の発表資料
https://cokonpile.connpass.com/event/174989/

Tsubasa Yumura

May 05, 2020
Tweet

More Decks by Tsubasa Yumura

Other Decks in Technology

Transcript

  1. 仮想世界がつくる未来の話
    湯村 翼 @yumu19
    国立研究開発法人 情報通信研究機構
    湯村 翼 @yumu19
    国立研究開発法人 情報通信研究機構
    Virtual World Creates Future
    Co-KoNPILe #4
    2020/05/05

    View full-size slide

  2. #cokonpile
    ࣗݾ঺հ
    • ౬ଜ ཌྷɹ@yumu19
    • ࡳຈग़਎ɺੴ઒ݝຽ
    • ࠃཱݚڀ։ൃ๏ਓ ৘ใ௨৴ݚڀػߏ ๺཮StarBEDٕज़ηϯλʔ ݚڀһ
    • ઐ໳ɿωοτϫʔΫɺϢϏΩλείϯϐϡʔςΟϯάɺώϡʔϚϯίϯϐϡʔλΠϯλϥΫγϣϯ
    etc.
    • Ӊ஦σʔλϋοΧιϯ NASA SpaceApps Challenge (COVID-19 Challenge 5/30-31)
    • NTࡳຈ ൃىਓ
    2
    Ϟϊͮ͘Γܥ
    ϙουΩϟετ
    ඼ϞϊϥδΦ

    View full-size slide

  3. #cokonpile
    NTࡳຈ2019
    3
    • 2019/12/01(೔) ϥιϥࡳຈ Πϕϯτίʔτ
    • ͜Ε͕ॳ։࠵
    • ໿30૊ͷలࣔ

    View full-size slide

  4. #cokonpile
    NTࡳຈ2019
    4

    View full-size slide

  5. #cokonpile
    NTࡳຈ2019
    5
    • NHK๺ւಓ ̙̙̌̓̑̑νϟϯωϧ (5෼൪૊)
    • ൪૊ͷಈըΞʔΧΠϒ͋Γ·͢
    • https://www.nhk.or.jp/sapporo/articles/slug-
    n5e58c775c839

    View full-size slide

  6. #cokonpile
    ࠓ೔ͷ಺༰
    • Ծ૝ੈքͬͯԿʁ
    • Ծ૝ੈքͰͷίϛϡχέʔγϣϯπʔϧ
    • Ծ૝ੈք͕෺ཧੈքʹ΋໾ཱͭ
    6

    View full-size slide

  7. #cokonpile
    Ծ૝ੈքʁ
    7
    ϚτϦοΫε (1999)
    8BSOFS#SPTDPNc5IF.BUSJYc.PWJFTΑΓ
    IUUQTXXXXBSOFSCSPTDPNNPWJFTNBUSJY
    ϨσΟɾϓϨΠϠʔ̍ (2018)
    8BSOFS#SPTDPNc3FBEZ1MBZFS0OFc.PWJFTΑΓ
    IUUQTXXXXBSOFSCSPTDPNNPWJFTSFBEZQMBZFSPOF
    ιʔυΞʔτɾΦϯϥΠϯ(2012)
    57ΞχϝʮιʔυΞʔτɾΦϯϥΠϯʯΦϑΟγϟϧαΠτΑΓ
    IUUQTXXXTXPSEBSUPOMJOFOFU

    View full-size slide

  8. #cokonpile
    xRք۾ͷཤमՊ໨Ϧετ
    • Ξχϝɾөըɾখઆ͸ڞ௨ݴޠͳͷͰศར
    8
    https://bit.ly/xr-list

    View full-size slide

  9. #cokonpile
    ΋͏গ͠਎ۙͳԾ૝ੈք
    9
    ͋ͭ·Ε Ͳ͏Ϳͭͷ৿ (2020)
    VR Chat (2014)
    cluster (2017)

    View full-size slide

  10. #cokonpile
    ҙ֎ͱੲ͔Β͋ΔԾ૝ੈք
    • MMORPGͱݺ͹ΕΔδϟϯϧͷήʔϜ΋ଟ਺
    • ֓೦తʹ͸ࠓ΋ੲ΋ͦΕ΄ͲมΘΒͳ͍
    • ٕज़ͷਐา͕Θ͔ΔɿCGͷࡉ͔͞ɾಈ͖ͷ׈Β͔͞ɾಉ࣌઀ଓ਺
    10
    ʮΞϝʔόϐάʯʹ΄͠ͷ͖͋ɺ҆ాඒࠫࢠ͕ొ৔"NFCB/FXTΑΓ
    IUUQTOFXTBNFCBKQFOUSZ
    Ξϝʔόϐά (2009)
    Second Life (2003)
    ΦϒδΣΫτ࡞੒ʹ͍ͭͯ
    ηΧϯυϥΠϑɹ4FDPOE-JGFɿʲΞΠϐϩDPNʳΑΓ
    IUUQXXXBJQJSPDPNDPOUFOUTJOEFYIUN

    View full-size slide

  11. #cokonpile
    ͋ͭ·ΕͲ͏Ϳͭͷ৿ʢ͋ͭ৿ʣ
    • ແਓౡͰ஬΍ڕΛั·͑ͨΓՖΛҭͯͨΓ͓ۚΛͨΊ
    ͯՈ΍෰΍Ո۩Λങ͏ήʔϜ
    • ΦϯϥΠϯͰϑϨϯζͷౡʹ༡ͼʹߦ͚Δ
    • ෰ͱֆΛࣗ࡞Ͱ͖Δ
    • ݁ࠗࣜɾϝΠΧʔΠϕϯτΛ։࠵ͨ͠ྫ΋
    11
    ʮ͋ͭ·ΕɹͲ͏Ϳͭͷ৿ʯͰ݁ࠗࣜΛڍ͛·ͨ͠ʛ͘ΒΒʛOPUFΑΓ
    IUUQTOPUFDPNLSGBUPTOOFB
    झຯ5&$)ࡇ

    View full-size slide

  12. #cokonpile
    cluster
    • όʔνϟϧSNSɾόʔνϟϧΠϕϯτۭؒ
    • https://cluster.mu
    • ϓϨθϯςʔγϣϯܗࣜͷΠϕϯτ͕։࠵Մೳ
    • ৗ࣌Φʔϓϯͷʮϫʔϧυʯ͕3݄ެ։
    • Windows, Mac, εϚϗ (iPhone / Android), VRσόΠε(oculus / VIVE) ʹରԠ
    • ແྉʢҰ෦༗ྉΠϕϯτ͋Γʣ
    • ϦΞΫγϣϯ͕Մೳ
    12

    View full-size slide

  13. #cokonpile
    cluster | όʔνϟϧϜαϏల
    • ෢ଂ໺ඒज़େֶͷ࡞඼ల
    • 2020/04/20ʙ30։࠵ʢ࣮͸·ͩ։͍ͯΔʣ
    • ֆըɾࣸਅɾσβΠϯͳͲͷ੩ࢭըίϯςϯπ͕த৺
    • ಈը΋͋Γ
    13

    View full-size slide

  14. #cokonpile
    cluster | ϫʔϧυ੍࡞
    • UnityͰ੍࡞Մೳ (Unity༻cluster SDK͕഑෍)
    • Unity͕ී௨ʹ࢖͑Ε͹؆୯ʹ࡞ΕΔ
    14

    View full-size slide

  15. #cokonpile
    cluster | ϫʔϧυ੍࡞
    • THETA(360°Χϝϥ)ͷશఱٿը૾ΛషΓ෇͚Δͱ࣮ࡍͷ
    ۭؒΛखܰʹ࠶ݱͰ͖Δ
    15

    View full-size slide

  16. #cokonpile
    cluster | ϫʔϧυ੍࡞
    • ΞΠςϜઃஔɾอ࣋΋Մೳ
    16

    View full-size slide

  17. #cokonpile
    cluster | Ξόλʔࣗ࡞
    • blender౳ͷϞσϦϯάιϑτͰθϩ͔Βࣗ࡞͢Δํ๏
    • ࣸਅ͔Β3DϞσϧΛੜ੒͢Δํ๏
    • ࠷ۙݚڀ͕ΊͬͪΌਐΜͰΔɺPIFu͍͢͝ʂ
    • @DMiyamo3 ͞Μͷࢿྉ͕ͱͯ΋Θ͔Γ΍͍͢
    • https://docs.google.com/presentation/d/1RUsZVLidcDNzVoK-
    y8wQG7oNiqjhm-cHcKWMlx23JRI/edit#slide=id.p
    17

    View full-size slide

  18. #cokonpile
    cluster | Ξόλʔࣗ࡞
    • ※ 3DϞσϧपΓʹ͸͍ΖΜͳπʔϧ͕͋Δ
    • ※ 3DϞσϧʹ͸͍ΖΜͳϑΥʔϚοτ͕͋Δ
    • PIFuͷϞσϧ͔ΒclusterͷΞόλʔ(VRMܗࣜ)Λ࡞Δ৔߹ͷྫ
    • Meshlab
    • PIFuͰ࡞ͬͨ3DϞσϧ(.obj)Λplyܗࣜʹม׵
    • Blender
    • ৭ͷඳըํ๏Λ௖఺Χϥʔ͔ΒςΫενϟʹม׵
    • ϙϦΰϯ਺࡟ݮ (cluster͸ϙϦΰϯ਺্ݶ32,000)
    • ϘʔϯͷຒΊࠐΈ
    • Unity
    • UniVRMͰVRMܗࣜϞσϧੜ੒
    18

    View full-size slide

  19. Ծ૝ۭ͕ؒ෺ཧੈքʹ΋໾ཱͭʁ

    View full-size slide

  20. #cokonpile
    ෺ཧੈքͰͷγεςϜ։ൃ͸େม
    • ྫɿUberͷࣗಈӡసऀͷ૸ߦςετͷͨΊͷڊେίʔε
    20
    Our Road to Self-Driving Vehicles | Uber ATG
    https://www.youtube.com/watch?v=27OuOCeZmwI

    View full-size slide

  21. #cokonpile
    Learning in Simulation
    • Ծ૝ۭؒ(3DCG)ΛϩϘοτ౳ͷػցֶशσʔλͱͯ͠
    ׆༻
    21
    Savva et al.(2019), Habitat: A platform for embodied AI research ΑΓ

    View full-size slide

  22. #cokonpile
    AirSim (Microsoft Research)
    • ࣗಈӡసंɾυϩʔϯͷػցֶशͷͨΊͷγϛϡϨʔλ
    • Unreal Engine4
    22
    Shah et al., AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles (FSR 2017)

    View full-size slide

  23. #cokonpile
    The SYNTHIA Dataset
    • CVPR2016
    • ඃҾ༻਺ 691 (2020/04/15, Google Scholarௐ΂)
    • Ծ૝ͷ֗ΛUnity(3DCG)Ͱߏங
    • ࡱӨͨ͠RGBը૾+ਂ౓+ηάϝϯςʔγϣϯΞϊςʔ
    γϣϯΛσʔληοτͱͯ͠ެ։
    • 13,000ϑϨʔϜ(ϥϯμϜ)+4×50,000ϑϨʔϜ(γʔέϯ
    γϟϧ)
    23

    View full-size slide

  24. #cokonpile
    γϛϡϨʔγϣϯԾઆ
    • ʮ͜ͷੈք͸͢΂ͯγϛϡϨʔγϣϯͳͷͰ͸ͳ͍
    ͔ʁʯͱ͢ΔԾઆ
    • ࢠڙͷࠒʹʢେਓʹͳͬͯ΋ʁʣҰ౓͸ߟ͑Δ͜ͱ
    • Պֶऀɾ఩ֶऀ͕ͨͪٞ࿦͍ͯ͠Δ
    • Ծ૝ۭؒͰͷίϛϡχέʔγϣϯ͕೔ৗʹͳͬͨΒ
    ʮ૬ख͸botͰ͸ʯͱ͍͏ٙ೦͸১͑Δͷ͔ʁ
    24

    View full-size slide

  25. #cokonpile
    ·ͱΊ
    25
    • Ծ૝ੈքΛ࢖ͬͨίϛϡχέʔγϣϯπʔϧ΋গͣͭ͠ਐԽ͍ͯ͠Δ
    • ແྉͰ࢖͑ΔαʔϏε͕ଟ͍ͷͰ৮ͬͯΈΑ͏
    • Ծ૝ੈքɾγϛϡϨʔγϣϯ͕γεςϜ։ൃʹ໾ཱͭʂʢ͔΋ʣ
    ࣭໰ɺײ૝ɺίϝϯτͳͲ͋Ε͹Twitterʹͯड͚෇͚·͢
    @yumu19

    View full-size slide