Slide 1

Slide 1 text

ϞόΠϧϑΝʔετͳΞ ϓϦΛ࡞ΔͨΊʹvear͕ ͨ͜͠ͱ noppe xRDCC 2020 C-3 1

Slide 2

Slide 2 text

noppe • iOSΞϓϦ։ൃऀ ීஈ͸iOSDC΍try!SwiftͰొஃ VRMษڧձ࣮͸ग़ͨࣄͳ͍ • vear։ൃऀ • ͖ͭͶ͕޷͖ 2

Slide 3

Slide 3 text

࠷ॳʹ εϚϗϑΝʔετͳΞϓϦʹؔ͢ΔτʔΫʹͳΓ·͢ VR΍ίϯγϡʔϚͱ͸ҧͬͨੈքͷ࿩ͩͱࢥ͏ͷͰɺͦ͜΋ָ͠Μ Ͱ͍͚ͨͩΕ͹ʂ VRMͷ࿩͠ͳ͍͚ͲɺVRMҰൠԽͷҰྫͱͯ͠ฉ͍ͯ΋Β͑Ε͹ 3

Slide 4

Slide 4 text

4

Slide 5

Slide 5 text

vear • iOS޲͚ • جຊػೳແྉ 5

Slide 6

Slide 6 text

6

Slide 7

Slide 7 text

ΧϝϥΞϓϦʁ 7

Slide 8

Slide 8 text

ࣗࡱΓΞϓϦʁ 8

Slide 9

Slide 9 text

vear • iOS޲͚ • جຊػೳແྉ • ΞόλʔΛϑΣΠεϞʔϑΟϯά • ࡱӨɾ࿥ըɾ഑৴ 9

Slide 10

Slide 10 text

10

Slide 11

Slide 11 text

11

Slide 12

Slide 12 text

12

Slide 13

Slide 13 text

Ξόλʔ͔ΒҙࣝΛҳΒͤΔཧ༝ ࡱӨ΍഑৴ͱ͍ͬͨఏڙ͍ͨ͠Ձ஋ʹϑΥʔΧεͤ͞ΔͨΊ 13

Slide 14

Slide 14 text

Ξόλʔ͔ΒҙࣝΛҳΒͤΔཧ༝ ࡱӨ΍഑৴ͱ͍ͬͨఏڙ͍ͨ͠Ձ஋ʹϑΥʔΧεͤ͞ΔͨΊ • ͳͥΞόλʔʹҙ͕ࣝ޲͍ͯ͠·͏ͱɺՁ஋͕ಧ͔ͳ͘ͳͬͯ͠ ·͏ͷ͔ 14

Slide 15

Slide 15 text

Ξόλʔ͔ΒҙࣝΛҳΒͤΔཧ༝ ࡱӨ΍഑৴ͱ͍ͬͨఏڙ͍ͨ͠Ձ஋ʹϑΥʔΧεͤ͞ΔͨΊ ͦΕ͸… • ࣮͸ಈ͔ͯ͠ຬ଍ͯ͠͠·͍͕ͪͰ • ϙʔζ΍ݟͨ໨ʹ߆ͬͨΓ͢Δͱ໨తʹ౸ୡͰ͖ͳ͍͔Β 15

Slide 16

Slide 16 text

ΞόλʔΛ࢖ͬͨΞϓϦʹ͸େ͖͘෼͚ͯೋͭ͋Δ • ண͙ΔΈࣜ • ύϖοτࣜ 16

Slide 17

Slide 17 text

ண͙ΔΈࣜ vear͸ͬͪ͜ Ұਓশࢹ఺͔ΒΞόλʔͱγϯΫϩͯ͠ૢ ࡞͢Δ εϙʔπΛͨ͠ΓɺμϯεΛͨ͠Γ https://en.wikipedia.org/wiki/ Motion_capture 17

Slide 18

Slide 18 text

ύϖοτࣜ ୈࡾऀࢹ఺͔Βૢ࡞͢Δ Ξόλʔ≠ࣗ෼ ϙʔζΛऔΒͤͨΓɺμϯεΛͤͨ͞Γ 18

Slide 19

Slide 19 text

໨త·Ͱͷܦ࿏ • ண͙ΔΈࣜ • ಈ্͔ͨ͠Ͱԋٕ΍ߦಈΛ͢Δ • ໨తɿ໺ٿΛ͢Δ ≠ ಈ͔͢ • ύϖοτࣜ • ಈ͔͢͜ͱ͕௚઀໨తʹͳ͍ͬͯΔ 19

Slide 20

Slide 20 text

ண͙ΔΈࣜͷํ͕ܦ࿏͕ଟ͍ͷͰɺಈ͔͢͜ͱʹϑΥʔΧεͤ͞Δ ͱ໨తʹ౸ୡͰ͖ͳ͍ • ࠷ॳͷը໘Λಈ͘ঢ়ଶʹ͓ͯ͘͠ʢॏཁʣ 20

Slide 21

Slide 21 text

ண͙ΔΈࣜͷऑ఺ 21

Slide 22

Slide 22 text

ண͙ΔΈࣜͷऑ఺ ຅ೖײ͔Β์Γग़͞Ε΍͍͢ • ͨͩͰ͢Βݱ࣮͡Όͳ͍΋ͷΛݱ࣮ͱೝ͍ࣝͤͯ͞Δ • ಈ͔ͨ͠௨Γʹಈ͔ͳ͍͚ͩͰݱ࣮ײ͕ଛͳΘΕΔ ಛʹΞόλʔΛϝλࢹ఺Ͱݟͤͯ͠·͏ͱɺ຅ೖײ͕ଛͳΘΕΔ 22

Slide 23

Slide 23 text

຅ೖײ͕ଛͳΘΕΔͱ • ؔ৺͸ԿΛ͠Α͏͔Ͱ͸ແ͘ɺ୭ʹͳΖ͏͔ͱ͍͏఺ʹ޲͍ͯ ͠·͏ • ૢ࡞͢Δࣄʹࢥߟ͕औΒΕͯ͠·͏ →·ͨ໨త·Ͱ͕ԕ͘ͳͬͯ͠·͏… 23

Slide 24

Slide 24 text

ҧ࿨ײΛݮΒ͠ೲಘײΛ૿΍͢ • VRͱҧͬͯɺεϚϗΞϓϦͷϥΠϑαΠΫϧ͸୹͍ͷͰ຅ೖ͠ ͖Δ·Ͱͷ͕࣌ؒॏཁ 24

Slide 25

Slide 25 text

ҧ࿨ײΛݮΒͨ͢Ίʹͨ͜͠ͱ • ARKit͔ΒऔΕΔ৘ใ͸ͳΔ΂͘൓ө͢Δ • ݱ࣮ͱဃ཭͢Δ෦෼͸Ӆ͢ • Ͱ͖ͳ͍ࣄ͸͠ͳ͍ 25

Slide 26

Slide 26 text

ARKit͔ΒऔΕΔ৘ใ ͸ͳΔ΂͘൓ө͢Δ • ճసͷΈͰͳ͘ɺҐஔ৘ใ΋࢖͏ • ॠ͖΍ࢹઢͷଞʹଟ͘ͷ৘ใ͕औΕΔ 26

Slide 27

Slide 27 text

ݱ࣮ͱဃ཭͢Δ෦෼͸ Ӆ͢ τϥοΩϯά͕֎Εͯ΋ϗʔϜϙδγϣϯ ʹҠಈͤͨ͞Γɺը໘୺ʹग़ͬ͠ͺͳ͠ʹ ͠ͳ͍ 27

Slide 28

Slide 28 text

Ͱ͖ͳ͍ࣄ͸͠ͳ͍ ஗Ԇ΍࣮ࡍͷಈ͖ͱҟͳΔͱࣗ෼ͷಈ͖Λ ݩʹϑΟΪϡΞΛಈ͔͍ͯ͠Δؾ࣋ͪʹ ͳͬͯ͠·͏ɻ 28

Slide 29

Slide 29 text

Ͱ͖ͳ͍ࣄ͸͠ͳ͍2 τϥοΩϯάͰ͖ͳ͍શ਎͸ݟͤͳ͍ ਎ମͷಈ͖͕൓өͰ͖ͳ͍ͱͳΔͱɺखͷ Ґஔ͕ݱ࣮ͱҟͳͬͯҧ࿨ײʹͳΔɺͳΔ ΂͘όετΞοϓͷΈ͕ݟ͑Δൣғʹͨ͠ 29

Slide 30

Slide 30 text

ҧ࿨ײΛͳͨ͘͠ޙ ͜͜ʹདྷͯΑ͏΍͘ී௨ͷΧϝϥΞϓϦͱಉ͡৔ॴʹཱͯ·͢ Ͱ΋͜Ε͕ͱͯ΋ॏཁɺͳͥͳΒ 30

Slide 31

Slide 31 text

31

Slide 32

Slide 32 text

ਓؒ޲͚ΧϝϥΞϓϦ ͷࢿ࢈͕࢖͑Δ • ϑΟϧλʔػೳ • εςοΧʔ • ΢ΟϯΫͨ͠ΒԿ͔͢Δͱ͔ 32

Slide 33

Slide 33 text

໨త·Ͱͷܦ࿏΋ؾΛൈ͔ͳ͍ ഑৴΍ࡱӨʹ͓͍ͯ΋ɺҧ࿨ײ͸ݮΒ͢ɻ • ڞ௨ೝࣝΛ্खʹ࢖͏ 33

Slide 34

Slide 34 text

ڞ௨ೝࣝΛ্खʹ࢖͏ • ΧϝϥΞϓϦΒ͍͠ݟͨ໨͔Β֎Εͳ͍ • εϚʔτϑΥϯͷಛੑΛ׆͔͢ 34

Slide 35

Slide 35 text

ڞ௨ೝࣝΛ্खʹ࢖͏ 2 • OSͷσβΠϯʹԊͬͨUI • Ϙλϯɾτάϧ • α΢ϯυ • ΞΠίϯ • ήʔϜͬΆ͘ݟͤͳ͍ޮՌ • Unity as a Library 35

Slide 36

Slide 36 text

όʔνϟϧͷॅਓʹରͯ͠΋ؾΛൈ͔ ͳ͍ طʹ׆༂͍ͯ͠ΔVTuberʹ޲͚ͯ 36

Slide 37

Slide 37 text

Τϐιʔυ 37

Slide 38

Slide 38 text

࠷ۙͷྲྀߦ ύʔϑΣΫτγϯΫ ݻఆ໊ͷBlendShapeΛొ࿥ͯ͠ARKitͷද ৘Λಉظ͢Δৄࡉ එͱ͔ઉͱ͔ಈ͔ͤΔps • iFacialMocap • Emosign ps https://twitter.com/hinzka/status/1274311176273289218?s=20 ৄࡉ https://hinzka.hatenablog.com/entry/2020/08/15/145040 38

Slide 39

Slide 39 text

ϓϨϛΞϜ՝ۚͷઃܭ ϓϨϛΞϜ՝ۚ͸ҰൠϢʔβʔ͔ΒҰఆͷڑ཭Λஔ͖ͭͭࣗ༝౓ͷ ߴ͍ΦϓγϣϯΛఏڙ͢Δ৔ 39

Slide 40

Slide 40 text

·ͱΊ vear͸͍͔ʹࣗવʹΞόλʔͷนΛ௒͑Δ͔Λେ੾ʹ͍ͯ͠·͢ɻ • ϝϯλϧϞσϧʹରͯ͠΋ԿΛ֦ு͍ͯ͠Δͷ͔ߟ͑Δ • ΞόλʔΛ໨ཱͨͤͳ͍ࣄͰ໨తͷՁ஋Λఏڙ͠Α͏ • ΞόλʔΞϓϦ͸؆୯ʹ຅ೖײ͕յΕ͕ͪ 40

Slide 41

Slide 41 text

͓ΘΓ 41