アイドルとして勤務する -理論と実践- / Work as cute idol. - theory & practice - #imas_hack

IM@S Engineer Talks - IM@Study 2nd Anniv Event : Brand New Meetup!! 2018-07-07
https://imas.connpass.com/event/90996/

Transcript

1. ΞΠυϧͱͯ͠ۈ຿͢Δ
   -ཧ࿦ͱ࣮ફ-
   mzp
   

   View Slide

2. ࠓ೔ͷτϐοΫ
   

   View Slide

3. View Slide

4. Ҿͬӽ͠ෆཁ
   
   ௨ۈ࣌ؒෆཁ
   
   ࣗ༝ͳ࣌ؒͷ૿Ճ
   
   ࠷దͳ৔ॴͰۈ຿Մೳ
   
   …
   
   ࣗ෼Ͱ࣌ؒ؅ཧΛ͢Δ
   
   ӡಈෆ଍
   
   ͔ࣗࣨΒͷۈ຿
   
   …
   
   

   View Slide

5. ΧϝϥʹࣸΔͷͰ
   
   ΩϨΠʹอͭඞཁ͕͋ΔྖҬ
   ٯޫʹͳΒͳ͍Α͏ʹ
   
   র໌ʹؾΛ͔ͭ͏
   

   View Slide

6. ςϨϏձٞΛܶతʹԁ׈ʹ͢Δ؆୯ͳϊ΢ϋ΢
   
   https://kuranuki.sonicgarden.jp/2018/03/tv-meeting.html
   

   View Slide

7. View Slide

8. – Alan Curtis Kay
   “ະདྷΛ༧ଌ͢Δ࠷ྑͷํ๏͸ɺ
   ͦΕΛൃ໌ͯ͠͠·͏͜ͱͩ”
   

   View Slide

9. Demo
   

   View Slide

10. View Slide

11. ΋ͷ͕ஔ͚ΔΑ͏ʹͳͬͨ
    র໌ʹؾΛ͔ͭΘͳ͍
    

    View Slide

12. সإͷ΄͏͕͔Θ͍͍
    
    ࢟੎ΛΑͨ͘͠΄͏͕͍͍
    
    

    View Slide

13. ޱΛ൒։͖ʹ͠ͳ͍
    
    ໨͸͔ͬ͠Γ͚͋Δ
    

    View Slide

14. ͋͘ͼ΋͔Θ͍͍
    
    

    View Slide

15. ඍসΈฦͯ͘͠ΕΔ
    
    ೴ʹ͍͍
    
    ͩΜͩΜͱࣗ෼͕͔Θ͍
    ͍ؾ͕ͯ͘͠Δ
    
    Ή͠Ζࢲ͕ΞΠυϧͩ
    

    View Slide

16. View Slide

17. View Slide

18. View Slide

19. View Slide

20. 
    mzp͞ΜͬͯඒগঁͷਓͰ͢ΑͶ?
    ͸͍ɺͦ͏Ͱ͢
    

    View Slide

21. View Slide

22. ࢓૊Έ
    

    View Slide

23. ίϯηϓτ
    खܰͳΞόλʔγεςϜ
    

    View Slide

24. iPhone XʹΑΔإೝࣝ
    ΞΠυϧ΁ͷม׵
    iPhoneը໘ͷΩϟϓνϟ
    ΦϯϥΠϯϛʔςΟϯά΁ͷ
    
    ࢀՃ
    

    View Slide

25. iPhone XʹΑΔإೝࣝ
    ΞΠυϧ΁ͷม׵
    iPhoneը໘ͷΩϟϓνϟ
    ΦϯϥΠϯϛʔςΟϯά΁ͷ
    
    ࢀՃ
    

    View Slide

26. Apple Special Event
    
    https://www.apple.com/jp/apple-events/september-2017/
    

    View Slide

27. ARKit Remote: Now with face tracking!
    
    https://blogs.unity3d.com/jp/2018/01/16/arkit-remote-now-with-face-tracking/
    

    View Slide

28. View Slide

29. iPhone XʹΑΔإೝࣝ
    ΞΠυϧ΁ͷม׵
    iPhoneը໘ͷΩϟϓνϟ
    ΦϯϥΠϯϛʔςΟϯά΁ͷ
    
    ࢀՃ
    

    View Slide

30. View Slide

31. View Slide

32. Unity
    ARKit
    iPhoneXͷද৘ύϥϝʔλΛ·ͱΊͯΈͨ
    
    http://www.noshimemo.com/entry/2018/02/27/181212
    

    View Slide

33. switch(key) {
    case ARBlendShapeLocation.EyeBlinkLeft:
    UpdateModelMorph(leftEye, enforce(value));
    break;
    case ARBlendShapeLocation.EyeBlinkRight:
    UpdateModelMorph(rightEye, enforce(value));
    break;
    case ARBlendShapeLocation.JawOpen:
    UpdateModelMorph(mouth, value);
    break;
    ………
    }
    

    View Slide

34. ӈ໨ͷด͡۩߹ͷ֬ೝ ࠨ໨ͷด͡۩߹ͷ֬ೝ
    

    View Slide

35. ௨ৗ সإ
    

    View Slide

36. case ARBlendShapeLocation.MouthPucker:
    foreach(var morph in pucker) {
    UpdateModelMorph(morph, value);
    }
    if(value > 0.7) {
    UpdateModelMorph(leftEye, 0);
    UpdateModelMorph(rightEye, 0);
    }
    break;
    

    View Slide

37. αϙʔτ͠ͳ͍ද৘
    ٽ͖إ
    
    ౖ͍ͬͯΔإ
    

    View Slide

38. রΕ
    
    http://seiga.nicovideo.jp/seiga/im4032576
    

    View Slide

39. ௕࣌ؒ΍ΔͱटΛ௧Ίͦ͏
    

    View Slide

40. View Slide

41. View Slide

42. iPhone XʹΑΔإೝࣝ
    ΞΠυϧ΁ͷม׵
    iPhoneը໘ͷΩϟϓνϟ
    ΦϯϥΠϯϛʔςΟϯά΁ͷ
    
    ࢀՃ
    

    View Slide

43. View Slide

44. View Slide

45. σϨεςϑΥτελδΦͷϦΞϧλΠϜಁաϓϨΠϠʔΛͭͬͨ͘
    
    https://banjun.hatenablog.com/entry/2017/11/07/235652
    

    View Slide

46. iPhone XʹΑΔإೝࣝ
    ΞΠυϧ΁ͷม׵
    iPhoneը໘ͷΩϟϓνϟ
    ΦϯϥΠϯϛʔςΟϯά΁ͷ
    
    ࢀՃ
    

    View Slide

47. View Slide

48. View Slide

49. View Slide

50. View Slide

51. iPhone XʹΑΔإೝࣝ
    ΞΠυϧ΁ͷม׵
    iPhoneը໘ͷΩϟϓνϟ
    ΦϯϥΠϯϛʔςΟϯά΁ͷ
    
    ࢀՃ
    

    View Slide

52. ࣗࡱΓػೳ
    

    View Slide

53. εΫϦʔϯγϣοτ͕
    อଘ͞ΕΔ
    

    View Slide

54. View Slide

55. View Slide

56. View Slide

57. View Slide

58. View Slide

59. View Slide

60. ϒϧʔόοΫεΫϦʔϯ
    

    View Slide

61. View Slide

62. View Slide

63. View Slide

64. ࠓޙͷ՝୊
    ໨ઢ੍ޚ
    
    iOS12ʹΑΔઉ੍ޚ
    
    ϙʔε੍ޚ
    

    View Slide

65. ྨࣅπʔϧ
    

    View Slide

66. FaceRig
    
    https://store.steampowered.com/app/274920/FaceRig/
    

    View Slide

67. ύϖจࣈ
    
    https://www.puppemoji.com
    

    View Slide

68. WWDC2018 Keynote
    
    https://www.apple.com/apple-events/june-2018/
    

    View Slide

69. ·ͱΊ
    ΞΠυϧͱͯ͠ͷ͓࢓ࣄ
    
    ͨͷ͍͠
    
    ؔ࿈πʔϧ΋͍ͬͺ͍͋Δ
    

    View Slide