Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
IoT + Voice = Awesome
Search
Pascal Helfenstein
March 23, 2016
Programming
0
78
IoT + Voice = Awesome
I show you how I built my own version of Jarvis - the dream of many IronMan fans.
Pascal Helfenstein
March 23, 2016
Tweet
Share
More Decks by Pascal Helfenstein
See All by Pascal Helfenstein
Chatbots
nicam
1
86
Service Worker
nicam
0
66
Web Speech API
nicam
0
67
Introduction to AngularJS
nicam
1
150
Other Decks in Programming
See All in Programming
AI時代のソフトウェア開発を考える(2025/07版) / Agentic Software Engineering Findy 2025-07 Edition
twada
PRO
96
33k
What's new in AppKit on macOS 26
1024jp
0
130
PHP 8.4の新機能「プロパティフック」から学ぶオブジェクト指向設計とリスコフの置換原則
kentaroutakeda
2
990
The Modern View Layer Rails Deserves: A Vision For 2025 And Beyond @ RailsConf 2025, Philadelphia, PA
marcoroth
2
640
dbt民主化とLLMによる開発ブースト ~ AI Readyな分析サイクルを目指して ~
yoshyum
3
1.1k
新メンバーも今日から大活躍!SREが支えるスケールし続ける組織のオンボーディング
honmarkhunt
5
8.1k
ニーリーにおけるプロダクトエンジニア
nealle
0
890
Quand Symfony, ApiPlatform, OpenAI et LangChain s'allient pour exploiter vos PDF : de la théorie à la production…
ahmedbhs123
0
210
Deep Dive into ~/.claude/projects
hiragram
14
8.4k
初学者でも今すぐできる、Claude Codeの生産性を10倍上げるTips
s4yuba
16
12k
レベル1の開発生産性向上に取り組む − 日々の作業の効率化・自動化を通じた改善活動
kesoji
0
260
LT 2025-06-30: プロダクトエンジニアの役割
yamamotok
0
810
Featured
See All Featured
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k
Unsuck your backbone
ammeep
671
58k
Music & Morning Musume
bryan
46
6.7k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
181
54k
Typedesign – Prime Four
hannesfritz
42
2.7k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
15
1.6k
The Art of Programming - Codeland 2020
erikaheidi
54
13k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
45
7.5k
Balancing Empowerment & Direction
lara
1
440
BBQ
matthewcrist
89
9.7k
Stop Working from a Prison Cell
hatefulcrawdad
271
21k
Building a Modern Day E-commerce SEO Strategy
aleyda
42
7.4k
Transcript
Speech+IoT = Awesome @nicam
$WHOAMI I am Pascal Helfenstein nicam
I’m lazy!
None
What do we need?
Turn on / off Power
Smart Switches
None
“It can talk” “It can hear” “It can think” any
Raspberry Pi 433 Mhz Transmitter Cable Antenna
https://github.com/xkonni/raspberry-remote $ ./send 00001 1 1 Group (dip Switch) Switch
(A, B, C, D) On / Off
Why not just buy it?
Total Cost Power Remote with 3 Plugs 24.95 433 Mhz
Transmitter 5.45 Raspberry Pi B+ 31.90 Total 62.30 3 Plugs: 20.80 Fr/Plug 6 Plugs: 14.55 Fr/Plug I’m also cheap!
Total Cost D-Link DSP-W215 49.00 all Prices from brack.ch MyStrom
WLAN Switch 39.00 Edimax SP-1101W 51.00 Price is per Plug!
But watch out…
X2262
None
Control Infrared Devices
Control Infrared Devices
None
Logitech being a Jerk
None
Someone made an API
https://github.com/swissmanu/ harmonyhubjs-client var harmony = require('harmonyhubjs-client'); harmony('192.168.1.200').then(harmonyClient => { harmonyClient.getActivities()
.then(activities => { activities.forEach(activity => { if(activity.label === 'Watch TV') { harmonyClient.startActivity(activity.id); harmonyClient.end(); } }); }); });
Listen & Understand
Listen & Understand
Meet Wit.ai Hi! NLP-API
Meet Wit.ai Post the last 3 pictures I took on
Facebook
Meet Wit.ai intent = “goal of the user” media order_by
limit social_media Entities
Meet Wit.ai { intent: "share", order_by: "last", limit: 3, media:
"pictures", social_media: "Facebook" }
Put the pieces together
Query Intent Object Demo architecture aka my Flat Speech Recognition
Speech Synthesis Query API-Call API-Call API-Call Response
DEMO
Questions?
nica Thanks!