IoT + Voice = Awesome

I show you how I built my own version of Jarvis - the dream of many IronMan fans.

Transcript

1. Speech+IoT = Awesome @nicam
2. $WHOAMI I am Pascal Helfenstein nicam
3. I’m lazy!
5. What do we need?
6. Turn on / off Power
7. Smart Switches
9. “It can talk” “It can hear” “It can think” any Raspberry Pi 433 Mhz Transmitter Cable Antenna
10. https://github.com/xkonni/raspberry-remote $ ./send 00001 1 1 Group (dip Switch) Switch (A, B, C, D) On / Off
11. Why not just buy it?
12. Total Cost Power Remote with 3 Plugs 24.95 433 Mhz Transmitter 5.45 Raspberry Pi B+ 31.90 Total 62.30 3 Plugs: 20.80 Fr/Plug
 6 Plugs: 14.55 Fr/Plug I’m also cheap!
13. Total Cost D-Link DSP-W215
 49.00 all Prices from brack.ch MyStrom WLAN Switch
 39.00 Edimax SP-1101W
 51.00 Price is per Plug!
14. But watch out…
15. X2262
17. Control Infrared Devices
18. Control Infrared Devices
20. Logitech being a Jerk
22. Someone made an API
23. https://github.com/swissmanu/ harmonyhubjs-client var harmony = require('harmonyhubjs-client'); harmony('192.168.1.200').then(harmonyClient => { harmonyClient.getActivities() .then(activities => { activities.forEach(activity => { if(activity.label === 'Watch TV') { harmonyClient.startActivity(activity.id); harmonyClient.end(); } }); }); });
24. Listen & Understand
25. Listen & Understand
26. Meet Wit.ai Hi! NLP-API
27. Meet Wit.ai Post the last 3 pictures I took on Facebook
28. Meet Wit.ai intent = “goal of the user” media order_by limit social_media Entities
29. Meet Wit.ai { intent: "share", order_by: "last", limit: 3, media: "pictures", social_media: "Facebook" }
30. Put the pieces together
31. Query Intent Object Demo architecture aka my Flat Speech Recognition Speech Synthesis Query API-Call API-Call API-Call Response
32. DEMO
33. Questions?
34. nica Thanks!