Upgrade to Pro — share decks privately, control downloads, hide ads and more …

モバイルファーストなアプリを作るためにvearがしたこと/xRDCC

 モバイルファーストなアプリを作るためにvearがしたこと/xRDCC

noppefoxwolf

August 31, 2020
Tweet

More Decks by noppefoxwolf

Other Decks in Technology

Transcript

  1. ϞόΠϧϑΝʔετͳΞ
    ϓϦΛ࡞ΔͨΊʹvear͕
    ͨ͜͠ͱ
    noppe xRDCC 2020 C-3
    1

    View Slide

  2. noppe
    • iOSΞϓϦ։ൃऀ
    ීஈ͸iOSDC΍try!SwiftͰొஃ
    VRMษڧձ࣮͸ग़ͨࣄͳ͍
    • vear։ൃऀ
    • ͖ͭͶ͕޷͖
    2

    View Slide

  3. ࠷ॳʹ
    εϚϗϑΝʔετͳΞϓϦʹؔ͢ΔτʔΫʹͳΓ·͢
    VR΍ίϯγϡʔϚͱ͸ҧͬͨੈքͷ࿩ͩͱࢥ͏ͷͰɺͦ͜΋ָ͠Μ
    Ͱ͍͚ͨͩΕ͹ʂ
    VRMͷ࿩͠ͳ͍͚ͲɺVRMҰൠԽͷҰྫͱͯ͠ฉ͍ͯ΋Β͑Ε͹
    3

    View Slide

  4. 4

    View Slide

  5. vear
    • iOS޲͚
    • جຊػೳແྉ
    5

    View Slide

  6. 6

    View Slide

  7. ΧϝϥΞϓϦʁ
    7

    View Slide

  8. ࣗࡱΓΞϓϦʁ
    8

    View Slide

  9. vear
    • iOS޲͚
    • جຊػೳແྉ
    • ΞόλʔΛϑΣΠεϞʔϑΟϯά
    • ࡱӨɾ࿥ըɾ഑৴
    9

    View Slide

  10. 10

    View Slide

  11. 11

    View Slide

  12. 12

    View Slide

  13. Ξόλʔ͔ΒҙࣝΛҳΒͤΔཧ༝
    ࡱӨ΍഑৴ͱ͍ͬͨఏڙ͍ͨ͠Ձ஋ʹϑΥʔΧεͤ͞ΔͨΊ
    13

    View Slide

  14. Ξόλʔ͔ΒҙࣝΛҳΒͤΔཧ༝
    ࡱӨ΍഑৴ͱ͍ͬͨఏڙ͍ͨ͠Ձ஋ʹϑΥʔΧεͤ͞ΔͨΊ
    • ͳͥΞόλʔʹҙ͕ࣝ޲͍ͯ͠·͏ͱɺՁ஋͕ಧ͔ͳ͘ͳͬͯ͠
    ·͏ͷ͔
    14

    View Slide

  15. Ξόλʔ͔ΒҙࣝΛҳΒͤΔཧ༝
    ࡱӨ΍഑৴ͱ͍ͬͨఏڙ͍ͨ͠Ձ஋ʹϑΥʔΧεͤ͞ΔͨΊ
    ͦΕ͸…
    • ࣮͸ಈ͔ͯ͠ຬ଍ͯ͠͠·͍͕ͪͰ
    • ϙʔζ΍ݟͨ໨ʹ߆ͬͨΓ͢Δͱ໨తʹ౸ୡͰ͖ͳ͍͔Β
    15

    View Slide

  16. ΞόλʔΛ࢖ͬͨΞϓϦʹ͸େ͖͘෼͚ͯೋͭ͋Δ
    • ண͙ΔΈࣜ
    • ύϖοτࣜ
    16

    View Slide

  17. ண͙ΔΈࣜ
    vear͸ͬͪ͜
    Ұਓশࢹ఺͔ΒΞόλʔͱγϯΫϩͯ͠ૢ
    ࡞͢Δ
    εϙʔπΛͨ͠ΓɺμϯεΛͨ͠Γ
    https://en.wikipedia.org/wiki/
    Motion_capture
    17

    View Slide

  18. ύϖοτࣜ
    ୈࡾऀࢹ఺͔Βૢ࡞͢Δ
    Ξόλʔ≠ࣗ෼
    ϙʔζΛऔΒͤͨΓɺμϯεΛͤͨ͞Γ
    18

    View Slide

  19. ໨త·Ͱͷܦ࿏
    • ண͙ΔΈࣜ
    • ಈ্͔ͨ͠Ͱԋٕ΍ߦಈΛ͢Δ
    • ໨తɿ໺ٿΛ͢Δ ≠ ಈ͔͢
    • ύϖοτࣜ
    • ಈ͔͢͜ͱ͕௚઀໨తʹͳ͍ͬͯΔ
    19

    View Slide

  20. ண͙ΔΈࣜͷํ͕ܦ࿏͕ଟ͍ͷͰɺಈ͔͢͜ͱʹϑΥʔΧεͤ͞Δ
    ͱ໨తʹ౸ୡͰ͖ͳ͍
    • ࠷ॳͷը໘Λಈ͘ঢ়ଶʹ͓ͯ͘͠ʢॏཁʣ
    20

    View Slide

  21. ண͙ΔΈࣜͷऑ఺
    21

    View Slide

  22. ண͙ΔΈࣜͷऑ఺
    ຅ೖײ͔Β์Γग़͞Ε΍͍͢
    • ͨͩͰ͢Βݱ࣮͡Όͳ͍΋ͷΛݱ࣮ͱೝ͍ࣝͤͯ͞Δ
    • ಈ͔ͨ͠௨Γʹಈ͔ͳ͍͚ͩͰݱ࣮ײ͕ଛͳΘΕΔ
    ಛʹΞόλʔΛϝλࢹ఺Ͱݟͤͯ͠·͏ͱɺ຅ೖײ͕ଛͳΘΕΔ
    22

    View Slide

  23. ຅ೖײ͕ଛͳΘΕΔͱ
    • ؔ৺͸ԿΛ͠Α͏͔Ͱ͸ແ͘ɺ୭ʹͳΖ͏͔ͱ͍͏఺ʹ޲͍ͯ
    ͠·͏
    • ૢ࡞͢Δࣄʹࢥߟ͕औΒΕͯ͠·͏
    →·ͨ໨త·Ͱ͕ԕ͘ͳͬͯ͠·͏…
    23

    View Slide

  24. ҧ࿨ײΛݮΒ͠ೲಘײΛ૿΍͢
    • VRͱҧͬͯɺεϚϗΞϓϦͷϥΠϑαΠΫϧ͸୹͍ͷͰ຅ೖ͠
    ͖Δ·Ͱͷ͕࣌ؒॏཁ
    24

    View Slide

  25. ҧ࿨ײΛݮΒͨ͢Ίʹͨ͜͠ͱ
    • ARKit͔ΒऔΕΔ৘ใ͸ͳΔ΂͘൓ө͢Δ
    • ݱ࣮ͱဃ཭͢Δ෦෼͸Ӆ͢
    • Ͱ͖ͳ͍ࣄ͸͠ͳ͍
    25

    View Slide

  26. ARKit͔ΒऔΕΔ৘ใ
    ͸ͳΔ΂͘൓ө͢Δ
    • ճసͷΈͰͳ͘ɺҐஔ৘ใ΋࢖͏
    • ॠ͖΍ࢹઢͷଞʹଟ͘ͷ৘ใ͕औΕΔ
    26

    View Slide

  27. ݱ࣮ͱဃ཭͢Δ෦෼͸
    Ӆ͢
    τϥοΩϯά͕֎Εͯ΋ϗʔϜϙδγϣϯ
    ʹҠಈͤͨ͞Γɺը໘୺ʹग़ͬ͠ͺͳ͠ʹ
    ͠ͳ͍
    27

    View Slide

  28. Ͱ͖ͳ͍ࣄ͸͠ͳ͍
    ஗Ԇ΍࣮ࡍͷಈ͖ͱҟͳΔͱࣗ෼ͷಈ͖Λ
    ݩʹϑΟΪϡΞΛಈ͔͍ͯ͠Δؾ࣋ͪʹ
    ͳͬͯ͠·͏ɻ
    28

    View Slide

  29. Ͱ͖ͳ͍ࣄ͸͠ͳ͍2
    τϥοΩϯάͰ͖ͳ͍શ਎͸ݟͤͳ͍
    ਎ମͷಈ͖͕൓өͰ͖ͳ͍ͱͳΔͱɺखͷ
    Ґஔ͕ݱ࣮ͱҟͳͬͯҧ࿨ײʹͳΔɺͳΔ
    ΂͘όετΞοϓͷΈ͕ݟ͑Δൣғʹͨ͠
    29

    View Slide

  30. ҧ࿨ײΛͳͨ͘͠ޙ
    ͜͜ʹདྷͯΑ͏΍͘ී௨ͷΧϝϥΞϓϦͱಉ͡৔ॴʹཱͯ·͢
    Ͱ΋͜Ε͕ͱͯ΋ॏཁɺͳͥͳΒ
    30

    View Slide

  31. 31

    View Slide

  32. ਓؒ޲͚ΧϝϥΞϓϦ
    ͷࢿ࢈͕࢖͑Δ
    • ϑΟϧλʔػೳ
    • εςοΧʔ
    • ΢ΟϯΫͨ͠ΒԿ͔͢Δͱ͔
    32

    View Slide

  33. ໨త·Ͱͷܦ࿏΋ؾΛൈ͔ͳ͍
    ഑৴΍ࡱӨʹ͓͍ͯ΋ɺҧ࿨ײ͸ݮΒ͢ɻ
    • ڞ௨ೝࣝΛ্खʹ࢖͏
    33

    View Slide

  34. ڞ௨ೝࣝΛ্खʹ࢖͏
    • ΧϝϥΞϓϦΒ͍͠ݟͨ໨͔Β֎Εͳ͍
    • εϚʔτϑΥϯͷಛੑΛ׆͔͢
    34

    View Slide

  35. ڞ௨ೝࣝΛ্खʹ࢖͏
    2
    • OSͷσβΠϯʹԊͬͨUI
    • Ϙλϯɾτάϧ
    • α΢ϯυ
    • ΞΠίϯ
    • ήʔϜͬΆ͘ݟͤͳ͍ޮՌ
    • Unity as a Library
    35

    View Slide

  36. όʔνϟϧͷॅਓʹରͯ͠΋ؾΛൈ͔
    ͳ͍
    طʹ׆༂͍ͯ͠ΔVTuberʹ޲͚ͯ
    36

    View Slide

  37. Τϐιʔυ
    37

    View Slide

  38. ࠷ۙͷྲྀߦ
    ύʔϑΣΫτγϯΫ
    ݻఆ໊ͷBlendShapeΛొ࿥ͯ͠ARKitͷද
    ৘Λಉظ͢Δৄࡉ
    එͱ͔ઉͱ͔ಈ͔ͤΔps
    • iFacialMocap
    • Emosign
    ps https://twitter.com/hinzka/status/1274311176273289218?s=20
    ৄࡉ https://hinzka.hatenablog.com/entry/2020/08/15/145040
    38

    View Slide

  39. ϓϨϛΞϜ՝ۚͷઃܭ
    ϓϨϛΞϜ՝ۚ͸ҰൠϢʔβʔ͔ΒҰఆͷڑ཭Λஔ͖ͭͭࣗ༝౓ͷ
    ߴ͍ΦϓγϣϯΛఏڙ͢Δ৔
    39

    View Slide

  40. ·ͱΊ
    vear͸͍͔ʹࣗવʹΞόλʔͷนΛ௒͑Δ͔Λେ੾ʹ͍ͯ͠·͢ɻ
    • ϝϯλϧϞσϧʹରͯ͠΋ԿΛ֦ு͍ͯ͠Δͷ͔ߟ͑Δ
    • ΞόλʔΛ໨ཱͨͤͳ͍ࣄͰ໨తͷՁ஋Λఏڙ͠Α͏
    • ΞόλʔΞϓϦ͸؆୯ʹ຅ೖײ͕յΕ͕ͪ
    40

    View Slide

  41. ͓ΘΓ
    41

    View Slide