Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Watsonを使って音声入力できるVRブレストアプリを作っている話

 Watsonを使って音声入力できるVRブレストアプリを作っている話

4bf9f85356f5a7c959b73f19f4c0df37?s=128

masarufuruya

July 27, 2017
Tweet

More Decks by masarufuruya

Other Decks in Technology

Transcript

  1. WatsonΛ࢖ͬͯԻ੠ೖྗͰ͖Δ VRϒϨετΞϓϦΛ࡞͍ͬͯΔ࿩ ݹՈ େ

  2. ࣗݾ঺հ ݹՈ େ (@enzerubank) ϑϦʔϥϯε ϑϩϯτΤϯυΤϯδχΞ ॳVRମݧ͸CardboardʹୣΘΕ·ͨ͠

  3. ࠓ೔࿩͢͜ͱ ◦ WatsonΛ࢖ͬͯԻ੠ೖྗͰ͖ΔVRϒϨε τΞϓϦΛ࡞͍ͬͯΔ࿩

  4. ෇ᝦΛOculus TouchͰಈ͔ͯ͠ ϒϨετ͕Ͱ͖ΔΞϓϦ

  5. ࡞͍ͬͯΔϞνϕʔγϣϯ ◦ ՈͷதͰΞΠσΞग़͠ͷϒϨετ͍ͨ͠

  6. ࡞͍ͬͯΔϞνϕʔγϣϯ ◦ ෇ᝦͱϗϫΠτϘʔυ༻ҙ͢Δͷ໘౗…

  7. ࡞͍ͬͯΔϞνϕʔγϣϯ ◦ VRͳΒεϖʔε΋ಓ۩΋ඞཁͳ͍ʂ

  8. ࡞͍ͬͯΔϞνϕʔγϣϯ ◦ ͍ͣΕ͸ϦϞʔτϫʔΫ͍ͯ͠Δ஥ؒಉ࢜ ͰϒϨετ͕Ͱ͖ΔΞϓϦʹ͍ͨ͠

  9. ࠓճ࣮૷ͨ͠ػೳ ◦ ࿩ͨ͠ݴ༿͕෇ᝦʹͳΔػೳ ◦ ͍ΘΏΔSpeech To Text

  10. ࠓճͷελοΫ ◦ Oculus Rift CV1 ◦ Oculus Touch ◦ Watson

    Speech To Text API ◦ NextGear-Note i5730SA1
  11. ࠓճͷελοΫ ◦ Oculus Rift CV1 ◦ Oculus Touch ◦ Watson

    Speech To Text API ◦ NextGear-Note i5730SA1 ೔ຊޠʹରԠɻUnity͕SDKΛ༻ҙ͍ͯͯ͠ࢿྉ΋๛෋ɻແྉ࿮ଟ͍
  12. WatsonҎ֎ʹݕূٕͨ͠ज़ ◦ UnityEngine.Windows.Speech ◦ Google Cloud Speech API ◦ UnityެࣜΞηοτ

  13. WatsonҎ֎ʹݕূٕͨ͠ज़ ◦ UnityEngine.Windows.Speech ◦ Google Cloud Speech API ◦ UnityެࣜΞηοτ

    ओʹݕূͨ͠ͷ͸͜ͷٕज़
  14. UnityEngine.Windows.Speech ◦ Unityඪ४Ͱఏڙ͞Ε͍ͯΔԻ੠ೝࣝAPI ◦ Speech To Text༻ͷDictationػೳ͕͋Δ

  15. UnityEngine.Windows.Speech ◦ MicrosoftͷHololens༻(32bit)ͷAPI ◦ Windows.Speech΋32bitΞϓϦͷΈಈ࡞

  16. UnityEngine.Windows.Speech ◦ OVR Avator͕64bit͡Όͳ͍ͱಈ࡞͠ͳ͍ ◦ όοςΟϯάͯ͠அ೦…

  17. WatsonҎ֎ʹݕূٕͨ͠ज़ ◦ UnityEngine.Windows.Speech ◦ Google Cloud Speech API ◦ UnityެࣜΞηοτ

    ετϦʔϛϯά͕໘౗ɻHTTPͰ͸ͳ͘ɺಠࣗϓϩτίϧͰୟ͘ UnitWebͱ͍͏ଞͷ༗ྉΞηοτ͕ඞཁ ($25)
  18. Watson APIΛಈ͔͢·Ͱʹ΍ͬͨ͜ͱ ◦ UnityʹWatson༻ͷSDKΛΠϯετʔϧ ◦ Speech To TextυΩϡϝϯτ※Λਫ਼ಡ ※ https://www.ibm.com/watson/developercloud/doc/speech-to-text/index.html

  19. Watson APIΛಈ͔͢·Ͱʹ΍ͬͨ͜ͱ ◦ αϯϓϧγʔϯͷίʔυΛҰͭͣͭ֬ೝ ◦ Scenes > UnitTests > TestSpeechToText

  20. σϞ

  21. ·ͱΊ ◦ Speech To Textʹ͸WatsonΛ࢖͓͏ ◦ 30೔ؒτϥΠΞϧͰແྉ࿮΋ଟ͍ ◦ αϯϓϧγʔϯΛࢀߟʹ͢Ε͹͙͢ಈ͘

  22. झຯͰि຤ʹҰॹʹ࡞ͬͯ͘ΕΔ VRΤϯδχΞืूͯ͠·͢ʂ