Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
IoT + Voice = Awesome
Search
Pascal Helfenstein
March 23, 2016
Programming
0
78
IoT + Voice = Awesome
I show you how I built my own version of Jarvis - the dream of many IronMan fans.
Pascal Helfenstein
March 23, 2016
Tweet
Share
More Decks by Pascal Helfenstein
See All by Pascal Helfenstein
Chatbots
nicam
1
86
Service Worker
nicam
0
66
Web Speech API
nicam
0
67
Introduction to AngularJS
nicam
1
140
Other Decks in Programming
See All in Programming
既存デザインを変更せずにタップ領域を広げる方法
tahia910
1
240
datadog dash 2025 LLM observability for reliability and stability
ivry_presentationmaterials
0
110
アンドパッドの Go 勉強会「 gopher 会」とその内容の紹介
andpad
0
260
童醫院敏捷轉型的實踐經驗
cclai999
0
190
F#で自在につくる静的ブログサイト - 関数型まつり2025
pizzacat83
1
310
#kanrk08 / 公開版 PicoRubyとマイコンでの自作トレーニング計測装置を用いたワークアウトの理想と現実
bash0c7
1
370
What Spring Developers Should Know About Jakarta EE
ivargrimstad
0
220
Java on Azure で LangGraph!
kohei3110
0
170
「ElixirでIoT!!」のこれまでとこれから
takasehideki
0
370
0626 Findy Product Manager LT Night_高田スライド_speaker deck用
mana_takada
0
100
GoのGenericsによるslice操作との付き合い方
syumai
3
680
5つのアンチパターンから学ぶLT設計
narihara
1
110
Featured
See All Featured
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
252
21k
KATA
mclloyd
29
14k
Thoughts on Productivity
jonyablonski
69
4.7k
Rails Girls Zürich Keynote
gr2m
94
14k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
46
9.6k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
33
5.9k
Navigating Team Friction
lara
187
15k
Designing Experiences People Love
moore
142
24k
Building Applications with DynamoDB
mza
95
6.5k
YesSQL, Process and Tooling at Scale
rocio
173
14k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
48
2.8k
Producing Creativity
orderedlist
PRO
346
40k
Transcript
Speech+IoT = Awesome @nicam
$WHOAMI I am Pascal Helfenstein nicam
I’m lazy!
None
What do we need?
Turn on / off Power
Smart Switches
None
“It can talk” “It can hear” “It can think” any
Raspberry Pi 433 Mhz Transmitter Cable Antenna
https://github.com/xkonni/raspberry-remote $ ./send 00001 1 1 Group (dip Switch) Switch
(A, B, C, D) On / Off
Why not just buy it?
Total Cost Power Remote with 3 Plugs 24.95 433 Mhz
Transmitter 5.45 Raspberry Pi B+ 31.90 Total 62.30 3 Plugs: 20.80 Fr/Plug 6 Plugs: 14.55 Fr/Plug I’m also cheap!
Total Cost D-Link DSP-W215 49.00 all Prices from brack.ch MyStrom
WLAN Switch 39.00 Edimax SP-1101W 51.00 Price is per Plug!
But watch out…
X2262
None
Control Infrared Devices
Control Infrared Devices
None
Logitech being a Jerk
None
Someone made an API
https://github.com/swissmanu/ harmonyhubjs-client var harmony = require('harmonyhubjs-client'); harmony('192.168.1.200').then(harmonyClient => { harmonyClient.getActivities()
.then(activities => { activities.forEach(activity => { if(activity.label === 'Watch TV') { harmonyClient.startActivity(activity.id); harmonyClient.end(); } }); }); });
Listen & Understand
Listen & Understand
Meet Wit.ai Hi! NLP-API
Meet Wit.ai Post the last 3 pictures I took on
Facebook
Meet Wit.ai intent = “goal of the user” media order_by
limit social_media Entities
Meet Wit.ai { intent: "share", order_by: "last", limit: 3, media:
"pictures", social_media: "Facebook" }
Put the pieces together
Query Intent Object Demo architecture aka my Flat Speech Recognition
Speech Synthesis Query API-Call API-Call API-Call Response
DEMO
Questions?
nica Thanks!