Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Robocalypse: Controlling Nodebots with Kinect gestures
Joel Lord
October 28, 2015
Programming
0
140
Robocalypse: Controlling Nodebots with Kinect gestures
A Full Stack 2015 London presentation by Joel Lord. Links to full video to come...
Joel Lord
October 28, 2015
Tweet
Share
More Decks by Joel Lord
See All by Joel Lord
Robocalypse - Full Stack Toronto 2015
joellord
0
190
Other Decks in Programming
See All in Programming
Kueue入門/Kueue Introduction
bells17
0
510
Jetpack Compose 頑張らないPreviewParameterProvider
horie23
0
110
Language Summit 2022: WebAssembly: Python in the browser and beyond
tiran
2
310
Swift Concurrencyによる安全で快適な非同期処理
tattn
2
310
2022 FrontEnd Training
mixi_engineers
1
280
よりUXに近いSLI・SLOの運用による可用性の再設計
kazumanagano
3
540
アプリのログをチーム外で活用してもらうためにやったこと
shotakashihara
0
190
ebpfとWASMに思いを馳せる2022 / techfeed-conference-2022-ebpf-wasm-amsy810
masayaaoyama
0
670
職場にPythonistaを増やす方法
soogie
0
310
From Java 11 to 17 and beyond
josepaumard
0
300
CIでAndroidUIテストの様子を録画してみた
mkeeda
0
180
質とスピード(2022春版、質疑応答用資料付き) / Quality and Speed 2022 Spring Edition
twada
PRO
28
18k
Featured
See All Featured
Building an army of robots
kneath
299
40k
JazzCon 2018 Closing Keynote - Leadership for the Reluctant Leader
reverentgeek
172
8.3k
Design and Strategy: How to Deal with People Who Don’t "Get" Design
morganepeng
103
16k
XXLCSS - How to scale CSS and keep your sanity
sugarenia
236
1M
Learning to Love Humans: Emotional Interface Design
aarron
261
37k
Imperfection Machines: The Place of Print at Facebook
scottboms
253
11k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
19
1.4k
What's new in Ruby 2.0
geeforr
336
30k
Code Reviewing Like a Champion
maltzj
506
37k
Git: the NoSQL Database
bkeepers
PRO
415
59k
The Most Common Mistakes in Cover Letters
jrick
PRO
4
24k
In The Pink: A Labor of Love
frogandcode
130
21k
Transcript
confidential not for distribution A Full Stack 2015 London presentation
by Joel Lord Robocalypse: Controlling Nodebots with Kinect gestures
Overview About Me Why The Goals What Exists What I
wanted Gestures 101 Demo
About Me
About Me Joel Lord Development Manager Javascript junkie, technology enthusiast,
IoT hobbyist. Macadamian http://www.macadamian.com Twitter: @joel__lord Github: github.com/joellord
Stereotypes I have never fought a polar bear with my
bare hands
Stereotypes My yard last April
Why ?
Why • Worked with Nodebots for a while now •
Wanted to explore other possibilities of NodeJs • Because controlling a robot with a Kinect is pretty cool
The Goals
The Goals • Needed a way to use events to
tell the robot to perform an action • Gestures seemed the best way to achieve this
What currently exists
What current exists Basic Nodebot Stack • NodeJs (https://nodejs.org/) •
Socket.io (http://socket.io/) • Johnny-Five (http://johnny-five.io/)
What current exists node-openni • Connects the Kinect to NodeJs
using OpenNI • Very basic event for almost everything • No gestures !
What I needed
What I Needed • Support for a full “skeleton” •
Support for gestures
What I Needed
Gestures 101
Gestures 101 The Basics • Is the initial condition met?
• Is the condition still met? • Is the final condition met?
Gestures 101 What do I need for gestures? • A
skeleton with an event when it changes • Know the position of the COM • Have a “base unit”
Gestures 101 Introducing kinect-gestures • Gesture detection using a base
class • Tracks the skeleton for an initial condition • Checks every 100ms to see if the condition is still met • If the final condition is met, trigger an event • Other classes are used to define the actual gestures
Robocalypse Demo Let’s look at some code !
Next few steps • Return a more friendly coordinate system
for skeleton • Add more information to the returned • Add more gestures (jump, wave, kick)
Questions?
Thank you. @joel__lord joellord
macadamian.com