Watsonを使って音声入力できるVRブレストアプリを作っている話

Transcript

1. WatsonΛ࢖ͬͯԻ੠ೖྗͰ͖Δ VRϒϨετΞϓϦΛ࡞͍ͬͯΔ࿩ ݹՈ େ
2. ࣗݾ঺հ ݹՈ େ (@enzerubank) ϑϦʔϥϯε ϑϩϯτΤϯυΤϯδχΞ ॳVRମݧ͸CardboardʹୣΘΕ·ͨ͠
3. ࠓ೔࿩͢͜ͱ ◦ WatsonΛ࢖ͬͯԻ੠ೖྗͰ͖ΔVRϒϨε τΞϓϦΛ࡞͍ͬͯΔ࿩
4. ෇ᝦΛOculus TouchͰಈ͔ͯ͠ ϒϨετ͕Ͱ͖ΔΞϓϦ
5. ࡞͍ͬͯΔϞνϕʔγϣϯ ◦ ՈͷதͰΞΠσΞग़͠ͷϒϨετ͍ͨ͠
6. ࡞͍ͬͯΔϞνϕʔγϣϯ ◦ ෇ᝦͱϗϫΠτϘʔυ༻ҙ͢Δͷ໘౗…
7. ࡞͍ͬͯΔϞνϕʔγϣϯ ◦ VRͳΒεϖʔε΋ಓ۩΋ඞཁͳ͍ʂ
8. ࡞͍ͬͯΔϞνϕʔγϣϯ ◦ ͍ͣΕ͸ϦϞʔτϫʔΫ͍ͯ͠Δ஥ؒಉ࢜ ͰϒϨετ͕Ͱ͖ΔΞϓϦʹ͍ͨ͠
9. ࠓճ࣮૷ͨ͠ػೳ ◦ ࿩ͨ͠ݴ༿͕෇ᝦʹͳΔػೳ ◦ ͍ΘΏΔSpeech To Text
10. ࠓճͷελοΫ ◦ Oculus Rift CV1 ◦ Oculus Touch ◦ Watson Speech To Text API ◦ NextGear-Note i5730SA1
11. ࠓճͷελοΫ ◦ Oculus Rift CV1 ◦ Oculus Touch ◦ Watson Speech To Text API ◦ NextGear-Note i5730SA1 ೔ຊޠʹରԠɻUnity͕SDKΛ༻ҙ͍ͯͯ͠ࢿྉ΋๛෋ɻແྉ࿮ଟ͍
12. WatsonҎ֎ʹݕূٕͨ͠ज़ ◦ UnityEngine.Windows.Speech ◦ Google Cloud Speech API ◦ UnityެࣜΞηοτ
13. WatsonҎ֎ʹݕূٕͨ͠ज़ ◦ UnityEngine.Windows.Speech ◦ Google Cloud Speech API ◦ UnityެࣜΞηοτ ओʹݕূͨ͠ͷ͸͜ͷٕज़
14. UnityEngine.Windows.Speech ◦ Unityඪ४Ͱఏڙ͞Ε͍ͯΔԻ੠ೝࣝAPI ◦ Speech To Text༻ͷDictationػೳ͕͋Δ
15. UnityEngine.Windows.Speech ◦ MicrosoftͷHololens༻(32bit)ͷAPI ◦ Windows.Speech΋32bitΞϓϦͷΈಈ࡞
16. UnityEngine.Windows.Speech ◦ OVR Avator͕64bit͡Όͳ͍ͱಈ࡞͠ͳ͍ ◦ όοςΟϯάͯ͠அ೦…
17. WatsonҎ֎ʹݕূٕͨ͠ज़ ◦ UnityEngine.Windows.Speech ◦ Google Cloud Speech API ◦ UnityެࣜΞηοτ ετϦʔϛϯά͕໘౗ɻHTTPͰ͸ͳ͘ɺಠࣗϓϩτίϧͰୟ͘ UnitWebͱ͍͏ଞͷ༗ྉΞηοτ͕ඞཁ ($25)
18. Watson APIΛಈ͔͢·Ͱʹ΍ͬͨ͜ͱ ◦ UnityʹWatson༻ͷSDKΛΠϯετʔϧ ◦ Speech To TextυΩϡϝϯτ※Λਫ਼ಡ ※ https://www.ibm.com/watson/developercloud/doc/speech-to-text/index.html
19. Watson APIΛಈ͔͢·Ͱʹ΍ͬͨ͜ͱ ◦ αϯϓϧγʔϯͷίʔυΛҰͭͣͭ֬ೝ ◦ Scenes > UnitTests > TestSpeechToText
20. σϞ
21. ·ͱΊ ◦ Speech To Textʹ͸WatsonΛ࢖͓͏ ◦ 30೔ؒτϥΠΞϧͰແྉ࿮΋ଟ͍ ◦ αϯϓϧγʔϯΛࢀߟʹ͢Ε͹͙͢ಈ͘
22. झຯͰि຤ʹҰॹʹ࡞ͬͯ͘ΕΔ VRΤϯδχΞืूͯ͠·͢ʂ