IoT + Voice = Awesome

IoT + Voice = Awesome

I show you how I built my own version of Jarvis - the dream of many IronMan fans.

52a875784c4e4ce4fc57ee28bd190dfe?s=128

Pascal Helfenstein

March 23, 2016
Tweet

Transcript

  1. Speech+IoT = Awesome @nicam

  2. $WHOAMI I am Pascal Helfenstein nicam

  3. I’m lazy!

  4. None
  5. What do we need?

  6. Turn on / off Power

  7. Smart Switches

  8. None
  9. “It can talk” “It can hear” “It can think” any

    Raspberry Pi 433 Mhz Transmitter Cable Antenna
  10. https://github.com/xkonni/raspberry-remote $ ./send 00001 1 1 Group (dip Switch) Switch

    (A, B, C, D) On / Off
  11. Why not just buy it?

  12. Total Cost Power Remote with 3 Plugs 24.95 433 Mhz

    Transmitter 5.45 Raspberry Pi B+ 31.90 Total 62.30 3 Plugs: 20.80 Fr/Plug
 6 Plugs: 14.55 Fr/Plug I’m also cheap!
  13. Total Cost D-Link DSP-W215
 49.00 all Prices from brack.ch MyStrom

    WLAN Switch
 39.00 Edimax SP-1101W
 51.00 Price is per Plug!
  14. But watch out…

  15. X2262

  16. None
  17. Control Infrared Devices

  18. Control Infrared Devices

  19. None
  20. Logitech being a Jerk

  21. None
  22. Someone made an API

  23. https://github.com/swissmanu/ harmonyhubjs-client var harmony = require('harmonyhubjs-client'); harmony('192.168.1.200').then(harmonyClient => { harmonyClient.getActivities()

    .then(activities => { activities.forEach(activity => { if(activity.label === 'Watch TV') { harmonyClient.startActivity(activity.id); harmonyClient.end(); } }); }); });
  24. Listen & Understand

  25. Listen & Understand

  26. Meet Wit.ai Hi! NLP-API

  27. Meet Wit.ai Post the last 3 pictures I took on

    Facebook
  28. Meet Wit.ai intent = “goal of the user” media order_by

    limit social_media Entities
  29. Meet Wit.ai { intent: "share", order_by: "last", limit: 3, media:

    "pictures", social_media: "Facebook" }
  30. Put the pieces together

  31. Query Intent Object Demo architecture aka my Flat Speech Recognition

    Speech Synthesis Query API-Call API-Call API-Call Response
  32. DEMO

  33. Questions?

  34. nica Thanks!