Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
IoT + Voice = Awesome
Search
Pascal Helfenstein
March 23, 2016
Programming
0
73
IoT + Voice = Awesome
I show you how I built my own version of Jarvis - the dream of many IronMan fans.
Pascal Helfenstein
March 23, 2016
Tweet
Share
More Decks by Pascal Helfenstein
See All by Pascal Helfenstein
Chatbots
nicam
1
80
Service Worker
nicam
0
62
Web Speech API
nicam
0
52
Introduction to AngularJS
nicam
1
130
Other Decks in Programming
See All in Programming
Build Apps for iOS, Android & Desktop in 100% Kotlin With Compose Multiplatform (mDevCamp 2024)
zsmb
0
420
CA.swift19 恋するAIアプリ開発の裏側
oskmr
0
380
0→1と1→10の狭間で Javaという技術選定を振り返る/Reflecting on the Decision to Choose Java Between Scaling from 0 to 1 and 1 to 10
jaguar_imo
2
390
AWS CDKコントリビュートTIPS / aws-cdk-contribution-tips
gotok365
3
310
Deep Dive into React Stream/Serialize
mugi_uno
3
440
Java 22 Overview
kishida
1
190
Node.js v22 で変わること
yosuke_furukawa
PRO
11
3.9k
SwiftUIで使いやすいToastの作り方 / How to build a Toast system which is easy to use in SwiftUI
lovee
3
160
"config" ってなんだ? / What is "config"?
okashoi
0
250
Ruby Pattern Matching
bkuhlmann
0
930
What We Can Learn From OSS
inouehi
0
430
単体テストを書かない技術 #phpcon_odawara
o0h
PRO
27
8.4k
Featured
See All Featured
A better future with KSS
kneath
231
16k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
226
51k
YesSQL, Process and Tooling at Scale
rocio
165
13k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
79
43k
GraphQLとの向き合い方2022年版
quramy
33
12k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
18
1.6k
A designer walks into a library…
pauljervisheath
201
23k
Imperfection Machines: The Place of Print at Facebook
scottboms
261
12k
Raft: Consensus for Rubyists
vanstee
133
6.3k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
33
6k
Producing Creativity
orderedlist
PRO
338
39k
Put a Button on it: Removing Barriers to Going Fast.
kastner
58
3.1k
Transcript
Speech+IoT = Awesome @nicam
$WHOAMI I am Pascal Helfenstein nicam
I’m lazy!
None
What do we need?
Turn on / off Power
Smart Switches
None
“It can talk” “It can hear” “It can think” any
Raspberry Pi 433 Mhz Transmitter Cable Antenna
https://github.com/xkonni/raspberry-remote $ ./send 00001 1 1 Group (dip Switch) Switch
(A, B, C, D) On / Off
Why not just buy it?
Total Cost Power Remote with 3 Plugs 24.95 433 Mhz
Transmitter 5.45 Raspberry Pi B+ 31.90 Total 62.30 3 Plugs: 20.80 Fr/Plug 6 Plugs: 14.55 Fr/Plug I’m also cheap!
Total Cost D-Link DSP-W215 49.00 all Prices from brack.ch MyStrom
WLAN Switch 39.00 Edimax SP-1101W 51.00 Price is per Plug!
But watch out…
X2262
None
Control Infrared Devices
Control Infrared Devices
None
Logitech being a Jerk
None
Someone made an API
https://github.com/swissmanu/ harmonyhubjs-client var harmony = require('harmonyhubjs-client'); harmony('192.168.1.200').then(harmonyClient => { harmonyClient.getActivities()
.then(activities => { activities.forEach(activity => { if(activity.label === 'Watch TV') { harmonyClient.startActivity(activity.id); harmonyClient.end(); } }); }); });
Listen & Understand
Listen & Understand
Meet Wit.ai Hi! NLP-API
Meet Wit.ai Post the last 3 pictures I took on
Facebook
Meet Wit.ai intent = “goal of the user” media order_by
limit social_media Entities
Meet Wit.ai { intent: "share", order_by: "last", limit: 3, media:
"pictures", social_media: "Facebook" }
Put the pieces together
Query Intent Object Demo architecture aka my Flat Speech Recognition
Speech Synthesis Query API-Call API-Call API-Call Response
DEMO
Questions?
nica Thanks!