Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
IoT + Voice = Awesome
Search
Pascal Helfenstein
March 23, 2016
Programming
0
78
IoT + Voice = Awesome
I show you how I built my own version of Jarvis - the dream of many IronMan fans.
Pascal Helfenstein
March 23, 2016
Tweet
Share
More Decks by Pascal Helfenstein
See All by Pascal Helfenstein
Chatbots
nicam
1
86
Service Worker
nicam
0
66
Web Speech API
nicam
0
67
Introduction to AngularJS
nicam
1
150
Other Decks in Programming
See All in Programming
Devoxx BE - Local Development in the AI Era
kdubois
0
130
チームの境界をブチ抜いていけ
tokai235
0
180
Foundation Modelsを実装日本語学習アプリを作ってみた!
hypebeans
0
110
Claude CodeによるAI駆動開発の実践 〜そこから見えてきたこれからのプログラミング〜
iriikeita
0
270
オープンソースソフトウェアへの解像度🔬
utam0k
16
3k
Leading Effective Engineering Teams in the AI Era
addyosmani
6
450
Go Conference 2025: Goで体感するMultipath TCP ― Go 1.24 時代の MPTCP Listener を理解する
takehaya
9
1.7k
What Spring Developers Should Know About Jakarta EE
ivargrimstad
0
180
Serena MCPのすすめ
wadakatu
4
1k
ソフトウェア設計の実践的な考え方
masuda220
PRO
4
590
タスクの特性や不確実性に応じた最適な作業スタイルの選択(ペアプロ・モブプロ・ソロプロ)と実践 / Optimal Work Style Selection: Pair, Mob, or Solo Programming.
honyanya
3
180
Building, Deploying, and Monitoring Ruby Web Applications with Falcon (Kaigi on Rails 2025)
ioquatix
4
2.2k
Featured
See All Featured
Producing Creativity
orderedlist
PRO
347
40k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
30
2.9k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
3.1k
Learning to Love Humans: Emotional Interface Design
aarron
274
41k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
12
1.2k
The Invisible Side of Design
smashingmag
302
51k
Done Done
chrislema
185
16k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
140
34k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
127
53k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
8
910
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
33
2.5k
A Modern Web Designer's Workflow
chriscoyier
697
190k
Transcript
Speech+IoT = Awesome @nicam
$WHOAMI I am Pascal Helfenstein nicam
I’m lazy!
None
What do we need?
Turn on / off Power
Smart Switches
None
“It can talk” “It can hear” “It can think” any
Raspberry Pi 433 Mhz Transmitter Cable Antenna
https://github.com/xkonni/raspberry-remote $ ./send 00001 1 1 Group (dip Switch) Switch
(A, B, C, D) On / Off
Why not just buy it?
Total Cost Power Remote with 3 Plugs 24.95 433 Mhz
Transmitter 5.45 Raspberry Pi B+ 31.90 Total 62.30 3 Plugs: 20.80 Fr/Plug 6 Plugs: 14.55 Fr/Plug I’m also cheap!
Total Cost D-Link DSP-W215 49.00 all Prices from brack.ch MyStrom
WLAN Switch 39.00 Edimax SP-1101W 51.00 Price is per Plug!
But watch out…
X2262
None
Control Infrared Devices
Control Infrared Devices
None
Logitech being a Jerk
None
Someone made an API
https://github.com/swissmanu/ harmonyhubjs-client var harmony = require('harmonyhubjs-client'); harmony('192.168.1.200').then(harmonyClient => { harmonyClient.getActivities()
.then(activities => { activities.forEach(activity => { if(activity.label === 'Watch TV') { harmonyClient.startActivity(activity.id); harmonyClient.end(); } }); }); });
Listen & Understand
Listen & Understand
Meet Wit.ai Hi! NLP-API
Meet Wit.ai Post the last 3 pictures I took on
Facebook
Meet Wit.ai intent = “goal of the user” media order_by
limit social_media Entities
Meet Wit.ai { intent: "share", order_by: "last", limit: 3, media:
"pictures", social_media: "Facebook" }
Put the pieces together
Query Intent Object Demo architecture aka my Flat Speech Recognition
Speech Synthesis Query API-Call API-Call API-Call Response
DEMO
Questions?
nica Thanks!