Dialogflow and Chinese Room

Dialogflowと中国語の部屋
VUILT登壇資料

Transcript

1. Dialogflowͱதࠃޠͷ෦԰
   ͤʹΐʔΔ(@senyoltw)
   

   View Slide

2. ࣗݾ঺հ
   

   View Slide

3. ͤʹΐʔΔ(@senyoltw)

   ͱಡΜͰ͍͚ͨͩΕ͹ɻ
   ΠϯλʔωοτքͰ͸ senyoltw ͱ͍͏໊લͰա͍ͯ͝͠·͢
   

   View Slide

4. झຯͰIoT΍εϚʔτϗʔϜͰ
   ༡ΜͰ͍·͢ɻ
   ެ։ͨ͠ϓϩάϥϛϯά͕͍ͭͷؒʹ͔঎༻੡඼ʹ࢖ΘΕͯͨΓɺ

   εϚʔτϗʔϜͰΠϯλϏϡʔड͚ͨ͜ͱ΋
   

   View Slide

5. custom-hotword-for-aiy-voicekit
   • https://github.com/senyoltw/custom-hotword-for-aiy-voicekit
   • Snowboyͱ͍͏ΦϦδφϧͷϗοτϫʔυΛ࡞ΕΔαʔϏε
   • ͍ΖΜͳݴޠ࣮૷αϯϓϧ͕͋Δ
   • ૊ΈࠐΈσόΠεͰ࢖༻Մ,ݸਓϑϦʔ/঎༻ཁ૬ஊ
   • Voice KitͰ࢖͑ΔΑ͏ʹ
   • ޷͖ͳϗοτϫʔυ͔ΒGoogle homeΛݺͼग़ͤΔΑ͏ʹ
   • J.A.R.V.I.S.(δϟʔϰΟε), Alexa,υϥ͑΋Μ,ͳͲͳͲ
   

   View Slide

6. ࠓ೔ɺ࿩͢͜ͱ
   

   View Slide

7. Dialogflowͱதࠃޠͷ෦԰
   ͤʹΐʔΔ(@senyoltw)
   

   View Slide

8. தࠃޠͷ෦԰ͬͯ஌ͬͯΔ?
   

   View Slide

9. νϡʔϦϯάςετͬͯ஌ͬ
   ͯΔ?
   தࠃޠͷ෦԰͸νϡʔϦϯάςετͷൃలܗͳͷͰɻ
   

   View Slide

10. νϡʔϦϯάςετͱ͸
    ίϯϐϡʔλʔ͕஌ೳΛ΋͔ͭͲ͏͔Λ൑ఆ͢Δςετɻ
    1950೥ʹӳࠃͷ਺ֶऀΞϥϯɾνϡʔϦϯά͕ߟҊɻ
    ਓ͓ؒΑͼਓؒΛϚω͢Δίϯϐϡʔλʔʹର͠ɺ؍࡯ऀ͕Θ͔Βͳ͍ܗͰձ࿩Λͤ͞Δɻ
    ؍࡯ऀ͕ਓؒͱίϯϐϡʔλͷ۠ผ͕͔ͭͳ͍৔߹͸ίϯϐϡʔλ͸஌ੑΛ͍࣋ͬͯΔɻ
    உੑ͸ϝʔϧͷ૬ख͕
    ίϯϐϡʔλ͔ঁੑ͔
    ൑அͰ͖ΔͩΖ͏͔ɾɾɾ?

    ΋͠ɺ൑அͰ͖ͳ͍ͷͰ͋Ε͹
    ίϯϐϡʔλ͸஌ੑΛ͍࣋ͬͯΔɻ
    

    View Slide

11. தࠃޠͷ෦԰ͱ͸
    1. ෦԰ʹ͸தࠃޠΛ໢ཏͨ͠ϚχϡΞϧͱ

    ϚχϡΞϧΛҾ͘ਓ͕ؒଘࡏ͢Δ
    2. ෦԰ʹ͸தࠃޠͰ࣭໰͕෣͍ࠐΉ
    3. ϚχϡΞϧΛҾ͘ਓ͸தࠃޠͷҙຯ͸Θ͔Βͳ͍͕ɺ

    ϚχϡΞϧʹैͬͯճ౴Λ֎ʹฦ͢ɻ
    4. ͢Δͱɺ෦԰ͷ֎ʹ͍Δਓ͸ɺ

    ʮ෦԰ʹ͸தࠃޠΛཧղ͢Δਓ͕͍Δʯͱߟ͑Δɻ
    5. ͔͠͠ɺ࣮ࡍ͸෦԰ͷதʹ͸

    தࠃޠΛཧղͯ͠ΔਓͳͲ͍ͳ͍
    

    View Slide

12. தࠃޠͷ෦԰ͱ͸
    • ఩ֶऀͷδϣϯɾαʔϧ͕ɺ1980೥ʹఏএɻ
    • AI͸ϚχϡΞϧͱϚχϡΞϧΛҾ͘ೳྗ͔Β੒ཱ͢Δͱ͢Δ
    • νϡʔϦϯάςετͰɺAI͕ਓؒͱ۠ผ͕͔ͭͳ͍͘Β͍

    ਓؒΒ͍͠ձ࿩Ͱ͖Δͱͯ͠΋ɺ

    ͦΕ͸ϧʔϧʹैͬͯɺϚχϡΞϧ͔Βճ౴͍ͯ͠Δ͚ͩ

    ͳͷͰɺAI͸஌ੑͱ͍͏΋ͷΛ࣋ͨͳ͍ͷͰ͸ͳ͍͔ɻ
    

    View Slide

13. Dialogflow
    ͱ͜ΖͰɺDialogflowͱ͍͏ɺαʔϏε͕ଘࡏ͠·͢Ͷɻ
    

    View Slide

14. Dialogflowͱ͸
    Dialogflowͱ͸ɺGoogle͕ఏڙ͍ͯ͠Δࣗવݴޠର࿩ϓϥοτϑ
    ΥʔϜɻ
    Dialogflow͸೔ຊޠ(ࣗવݴޠ)Λղੳ͠ɺࣄલʹઃఆ͞Εͨձ࿩
    ϧʔϧʹैͬͯɺճ౴Λग़ྗ͢Δɻ
    Google HomeͷΞϓϦͷόοΫΤϯυʹ࢖༻͞Ε͍ͯΔαʔϏε
    

    View Slide

15. Dialogflowͱ͸
    Dialogflow͸೔ຊޠ(ࣗવݴޠ)Λղੳ͠ɺࣄલʹઃఆ͞Εͨձ࿩
    ϧʔϧʹैͬͯɺճ౴Λग़ྗ͢Δɻ
    தࠃޠͷ෦԰ͱ͸
    ɾ෦԰ʹ͸தࠃޠΛ໢ཏͨ͠ϚχϡΞϧͱϚχϡΞϧΛҾ͘ਓؒ
    ͕ଘࡏ͢Δ
    

    View Slide

16. Dialogflowͬͯ

    தࠃޠͷ෦԰ʹ͍ΔਓؒͰ͸
    ֎෦͔Β༩͑ΒΕͨݴ༿(࣭໰)ʹରͯ͠ɺ

    ϧʔϧʹै͍ɺσʔλϕʔε(ϚχϡΞϧ)͔Βճ౴͢Δ

    ͱ͍͏ػೳΛఏڙ͢ΔαʔϏεͩ͠ɾɾɾ
    

    View Slide

17. Πϯλʔϗϯ
    υΞӽ͠ʹ෦԰ͷதͱ֎Λͭͳ͛Δ΋ͷɻ
    ฦࣄ͕ͯ͠΋ɺຊ౰ʹɺ෦԰ͷதʹਓ͕͍Δ͔Ͳ͏͔൑அ͸Ͱ͖ͳ͍

    ͦΕ͕ɺਓؒͷ੠͔࿥Իͨ͠Ի੠͔Ͳ͏͔΋ɾɾɾ
    

    View Slide

18. DialogflowͱΠϯλʔϗϯ

    ૊Έ߹ΘͤͨΒதࠃޠͷ෦԰͕࣮
    ૷ग़དྷΔͷͰ͸
    

    View Slide

19. ࡞ͬͯΈͨ
    

    View Slide

20. ֓೦ਤ
    

    View Slide

21. σϞ(࣮ࡍʹ࣮ݧͨ͠ͱ͖ͷϦϓϨΠ)
    ୐഑ศ͞Μʮ୐഑ศͰʔ͢ʯ
    ϩϘʮ͓ർΕ༷Ͱ͢ɻࠓɺख͕཭ͤͳ͍ͷͰυ
    Ξʹ͋Δ୐഑ϘοΫεʹೖΕ͍͚ͯͨͩ·͔͢ʯ
    ୐഑ศ͞ΜʮΘ͔Γ·ͨ͠ʯ
    ϩϘʮΑΖ͓͘͠Ͷ͕͍͠·͢ɻʯ
    

    View Slide

22. ϑϩʔνϟʔτ
    1. Πϯλʔϗϯɾݰؔʹਓ͕͍Δ͜ͱΛݕ஌(Cloud Vision API)

    ↓
    2. ୭͔ΛਘͶΔԻ੠Λग़ྗ

    ↓
    3. ฦࣄΛςΩετԽ(Google Cloud Speech-to-Text)

    ↓
    4. DialogflowʹςΩετΛૹΓɺϨεϙϯεΛ΋Β͏

    (௚઀ձ࿩ͷσʔλΛDialogflowʹૹΔඞཁ͕͋Δ)

    ↓
    5. ϨεϙϯεͱҰகͨ͠Ի੠Λग़ྗ͢Δ

    ↓
    6. Χϝϥͷಈ͖Λ֬ೝ͠ɺ·ͩݰؔʹਓ͕͍ΔͳΒ3ʹ໭Δ
    

    View Slide

23. Dialogflow-for-aiy-voicekit
    • https://github.com/senyoltw/dialogflow-for-aiy-voicekit
    • DialogflowΛVoice Kit(Raspberry PiͰ࡞Δࣗ࡞Google Home)Ͱ௚઀࢖
    ͑ΔΑ͏ʹ
    • Dialogflowʹ௚઀઀ଓͰ͖ΔͷͰΞϓϦͷςετʹ΋࠷ద
    • ʮOK Google [ςετதΞϓϦ]ʹͭͳ͍Ͱʯͱ͔ݴΘͳͯ͘΋େৎ෉
    • ͏·͘࢖͑͹ಠࣗͷεϚʔτεϐʔΧʔ΋
    • ୯Ұͷػೳ͔͠ඞཁ͕ͳ͍৔߹ͷεϚʔτεϐʔΧʔΛ࡞ΕΔ
    • ྫ͑͹ձࣾͷड෇ʹஔ͘ͱ͔ɺΠϕϯτͰ੡඼ͷઆ໌ʹ࢖͏ͱ͔
    

    View Slide

24. ͱ͜ΖͰɺɺɺɺ
    

    View Slide

25. Dialogflowͱి࿩΋

    தࠃޠͷ෦԰Ͱ͢ΑͶ???
    

    View Slide

26. ి࿩ΛtwilioͰड͚ͯɺόοΫΤϯυͰࣗવݴޠղੳΛͯ͠

    DialogflowͰฦࣄΛͯ͠ɺ݁ՌΛkintoneʹ౤ߘ
    

    View Slide

27. தࠃޠͷ෦԰ͱΈͳͤΔ

    αʔϏε͸͢΂ͯDialogflowͱ

    ૊Έ߹ΘͤΔ͜ͱͰࣗಈԽͰ͖Δɻ

    

    εϚʔτεϐʔΧʔͷ΄͔ʹ΋

    VUIͷະདྷ͸ͨ͘͞Μ͋Δɻ
    

    View Slide

28. ऴΘΓɻ
    senyoltw.net
    

    View Slide