VTuberって知ってます？

Slides for M3 tech meetup #4

Transcript

1. VTuberͬͯ஌ͬͯ·͢ʁ @blue_1617
2. Who am I ‣ VTuber ͱ Emacs ޷͖ͷ৽ೖࣾһ ‣ େֶɾେֶӃͰVR/ARܥͷݚڀΛ͍ͯͨ͠աڈΛ࣋ͭ ‣ ిࢠΧϧςνʔϜظ଴ͷΤʔε Transcalibur: Weight Moving VR Controller for 
 Dynamic Rendering of 2D Shape Using Haptic Shape Illusion blue (@blue_1617)
3. VTuberʢόʔνϟϧYoutuberʣͱ͸ όʔνϟϧYouTuberͱ͸ ओʹYouTube্Ͱಈը౳ͷ഑৴׆ಈΛ ߦ͏ՍۭͷΩϟϥΫλʔ܈Λࢦ͢ͷʹ༻͍ΒΕΔݺশ
4. VTuberʢόʔνϟϧYoutuberʣͱ͸ https://www.youtube.com/watch?v=NasyGUeNMTs&t=6s ʲࣗݾ঺հʳ͸͡Ί·ͯ͠ʂΩζφΞΠͰ͢ ლ(´ڡ`ლ)
5. όʔνϟϧYoutuber ࢛ఱԦ ‣ όʔνϟϧYouTuberͷதͰ΋ಛʹ஫໨ΛूΊ͍ͯΔ5ਓ ‣ ࢛ఱԦ͚ͩͲ5ਓ͍Δ γϩ ً໷݄ ΩζφΞΠ ϛϥΠΞΧϦ Ͷ͜·͢
6. اۀ × VTuber اۀ͕ࣗࣾ੡඼ͷPRͷͨΊʹެࣜVTuberΛੜΈग़͢͜ͱ΋ https://www.youtube.com/channel/UCwRKt_raV3N5KZgxcFyC1vw ࢆௗϊϜެࣜYouTubeνϟϯωϧ ೥ྸɿ119ࡀʢ1899೥ੜ·Εʣ ੑ֨ɿ΄ΜͷΓͱఱવ झຯɿ୹Վ ಛٕɿՎ͏͜ͱɾ෣͏͜ͱ ޷͖ͳ΋ͷɿҿΈ෺ ۤखͳ΋ͷɿ௚ࣹ೔ޫ
7. ҩྍ × VTuber ‣ VϝσΟΧϧςοτ ‣ ϝσΟΧϧͱݴ͍ͬͯΔ͕ҩྍཁૉ͸͋Μ·Γͳ͍
8. ࣄ຿ॴɾάϧʔϓ ‣ ਓؾͷVTuber͸ࣄ຿ॴʹॴଐ͍ͯ͠Δ͜ͱ͕ଟ͍ ‣ ݸਓ׆ಈ => ק༠ => ࣄ຿ॴॴଐ ͷέʔε΋͋Δ
9. ݸਓͰͷ์ૹ ‣ ݸਓͰ׆ಈ͢ΔVTuberͷ΄͏͕౰વେଟ਺ ‣ ਓؾʹͳΔͱاۀ͔Β޿ࠂΛཔ·ΕΔ͜ͱ΋͋Δ
10. ഑৴ഔମ όʔνϟϧ **Youtuber** ͱݴͬͯ͸͍Δ͕ɺͦͷ׆ಈ৔ॴ͸ Youtube͚ͩͰ͸ͳ͍ Mirrative Showroom
11. ഑৴ഔମ όʔνϟϧ **Youtuber** ͱݴͬͯ͸͍Δ͕ɺͦͷ׆ಈ৔ॴ͸ Youtube͚ͩͰ͸ͳ͍ Cluster. ࡶࢽ
12. ͔͜͜ΒTech Talk
13. ͳΕΔʂVTuber ‣ VΧπ + OculusRift Λ࢖ͬͯ ΞόλΛ࡞੒ ‣ Hand Tracker + Voice Changer Λ࢖ͬͯ VTuber తͳಈ͖Λͯ͠Έͨ VΧπ: http://vkatsu.jp https://twitter.com/blue_1617/status/1025397447701319681
14. ։ൃ؀ڥʢϋʔυʣ Oculus, HTC Vive ͷ2ڧ VR ReadyͷPC͸ඞਢ ɾGeForce GTX 970 ɾWindowsʢ͜Εॏཁʣ ɾHand Tracker ɾPosition Tracking (HTC Vive) ˇ150,000 yen ˇ60,000 ~ 70,000 yen
15. ։ൃ؀ڥʢιϑτʣ Open Broadcaster Software Unity͸ඞਢ Youtube഑৴ʹ͸ඞਢ ɾը໘ΩϟϓνϟϦϯά ɾVR Engine ɾGUI + Script ɾଞπʔϧͱͷ࿈ܞ ˇ0 yen ˇ0 yen ɾੜ์ૹͳͲʹ࢖༻
16. ։ൃ؀ڥʢ྿Ձ൛ʣ Oculus Go iPhoneX ɾARػೳ͕ॆ࣮ ɾδϟΠϩͱՃ଎౓ηϯα౥ࡌ ɾத਎͸Android ɾFace Track͕σϑΥϧτ ɾҰ෦VTuber͸͜Ε͚ͩ࢖༻ ˇ30,000 yen ˇ120,000 yen
17. Ϟʔγϣϯ ‣ શ਎ΛTracking͢Δ΋ͷʢHigh Costʣ ‣ إͷಈ͖ͷΈΛTracking͢Δ΋ͷʢLow Costʣ Full Body Tracking Face Tracking
18. Ϟʔγϣϯ https://www.youtube.com/watch?v=C8TZY5oAFEY ʲ18/02/22์ૹʳͱ͖ͷͦΒͷɺʹΌΜʹΌΜ♪ʹΌ·์ૹʲ#ೣͷ೔ʳ Body Motion Tracking શ਎ʹηϯαΛ͚ͭͯੜ์ૹΛߦ͍ͬͯΔVTuber΋͍Δ
19. Ϟʔγϣϯ Body Motion Tracking OculusGo͚ͩͰΞόλΛಈ͔ͯ͠Έͨ ڸʹө͍ͬͯΔ δϟΠϩηϯα͔͠౥ࡌͯ͠ͳ͍ͷͰɺ ਎ମͱ࿹ͷڑ཭͕Θ͔Βͳ͍ IKʢٯӡಈֶʣΛղ͘͜ͱͰɺ࿹ͷҐஔ ΛܭࢉͰ͖Δ Ξόλͷ࿹ͷઌͱɺίϯτϩʔϥͷಈ͖ Λಉظͤͨ͞ https://twitter.com/blue_1617/status/1012348306167484416
20. Ϟʔγϣϯ Face Tracking https://www.youtube.com/watch?v=ZsQ0gMxJlA8 ݄ϊඒ㙽ͷެࣜχίੜ൓লձʲࡶஊʳ إͷಛ௃఺Λநग़͠ɺTrackingΛߦ͍ͬͯΔ
21. Ϟʔγϣϯ Face Tracking FaceRigͱ͍͏ΞϓϦΛ༻͍ͯΈͨ VTuberͱͯ͠͸ɺҰ൪ίεύ͕͍͍ إͷಛ௃఺ͷมԽʢҠಈྔʣΛ ௥੻ͯ͠ɺΞόλͷϞʔϑʢද৘ʣΛมԽ
22. Ϟʔγϣϯ LipSync https://www.youtube.com/watch?v=vk0FypceXJw Oculus Lip Sync SDK for Unity5 ৶ͷಈ͖ʹಛԽͨ͠Motion Tracking ಛ௃఺ϕʔεͰ͸ͳ͘ɺԻ੠ʢ฼ԻʣΛೝࣝͯ͠ Ξόλͷ৶Λมܗ͍ͤͯ͞Δ
23. Ϟʔγϣϯ LipSync UnityʹSDKΛ૊ΈࠐΜͰࢼͯ͠Έͨ ද৘ͱԻ੠ΛରԠ͍ͤͯ͞Δ https://twitter.com/blue_1617/status/1012701841753165824
24. ϘΠε Voice Change https://www.youtube.com/watch?v=geP4hCu8H0o&t=3s ΑΓ͵͖ϚάϩφͪΌΜ #00 ͓ͬ͞Μ͸ϘΠενΣϯδϟʔΛ࢖ͬͯඒগঁʹͳΔͷͩ
25. ϘΠε ɾPitch ͱ Formant ΛมߋՄೳ ɾϦΞϧλΠϜม׵͕Մೳ Tweet URL : http://www.geocities.jp/moe_koigoe/koigoe/koigoe.html ࿀੠ : SOUND ONLY Voice Change ੠͚ͩඒগঁʹͳͬͯΈͨ ʮ࿀੠ʯͱ͍͏ιϑτΛ࢖༻ https://twitter.com/blue_1617/status/1018512925433028614
26. Ұ௨Γ΍ͬͯΈͨײ૝ ཁૉٕज़ͷ͔ͨ·Γ VTuber͸͍͢͝ ΊͬͪΌָ͍͠ ‣ Body / Face Tracking, Ի੠ೝࣝ / ม׵, ֤छπʔϧ ‣ ౷߹࣮ͯ͠ߦ͢Δͷ͸ඇৗʹ೉͍͠ ‣ ม਎ئ๬͕ຬͨ͞ΕΔʢϓϦΩϡΞʹͳΓ͍ͨʣ ‣ VRChatͳͲͰͷଞਓͱͷަྲྀ͕͋Δ ‣ TechͰ͕Μ͹ͬͯΔํ͸ৗʹ࠷৽ͷٕज़௥ͬͯͯੌ͍ ‣ Tech͕࣮ݱͰ͖ͯ΋ɺYoutubeʹ౤ߘͰ͖Δ಺༰͕ͳ͍