Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Robocalypse: Controlling Nodebots with Kinect g...
Search
Joel Lord
October 28, 2015
Programming
0
230
Robocalypse: Controlling Nodebots with Kinect gestures
A Full Stack 2015 London presentation by Joel Lord. Links to full video to come...
Joel Lord
October 28, 2015
Tweet
Share
More Decks by Joel Lord
See All by Joel Lord
Robocalypse - Full Stack Toronto 2015
joellord
0
270
Other Decks in Programming
See All in Programming
MDN Web Docs に日本語翻訳でコントリビュートしたくなる
ohmori_yusuke
1
130
構造化・自動化・ガードレール - Vibe Coding実践記 -
tonegawa07
0
150
Understanding Kotlin Multiplatform
l2hyunwoo
0
110
The Modern View Layer Rails Deserves: A Vision For 2025 And Beyond @ RailsConf 2025, Philadelphia, PA
marcoroth
2
790
Claude Code + Container Use と Cursor で作る ローカル並列開発環境のススメ / ccc local dev
kaelaela
12
7.4k
React は次の10年を生き残れるか:3つのトレンドから考える
oukayuka
40
15k
中級グラフィックス入門~効率的なメッシュレット描画~
projectasura
2
1.3k
AIともっと楽するE2Eテスト
myohei
9
3.1k
抽象化という思考のツール - 理解と活用 - / Abstraction-as-a-Tool-for-Thinking
shin1x1
1
610
CIを整備してメンテナンスを生成AIに任せる
hazumirr
0
200
20250708_JAWS_opscdk
takuyay0ne
2
150
The Evolution of Enterprise Java with Jakarta EE 11 and Beyond
ivargrimstad
0
470
Featured
See All Featured
Practical Orchestrator
shlominoach
189
11k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
The Invisible Side of Design
smashingmag
301
51k
RailsConf 2023
tenderlove
30
1.2k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
31
1.3k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
10
990
It's Worth the Effort
3n
185
28k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
33
2.4k
Balancing Empowerment & Direction
lara
1
490
The World Runs on Bad Software
bkeepers
PRO
70
11k
Docker and Python
trallard
45
3.5k
A better future with KSS
kneath
238
17k
Transcript
confidential not for distribution A Full Stack 2015 London presentation
by Joel Lord Robocalypse: Controlling Nodebots with Kinect gestures
Overview About Me Why The Goals What Exists What I
wanted Gestures 101 Demo
About Me
About Me Joel Lord Development Manager Javascript junkie, technology enthusiast,
IoT hobbyist. Macadamian http://www.macadamian.com Twitter: @joel__lord Github: github.com/joellord
Stereotypes I have never fought a polar bear with my
bare hands
Stereotypes My yard last April
Why ?
Why • Worked with Nodebots for a while now •
Wanted to explore other possibilities of NodeJs • Because controlling a robot with a Kinect is pretty cool
The Goals
The Goals • Needed a way to use events to
tell the robot to perform an action • Gestures seemed the best way to achieve this
What currently exists
What current exists Basic Nodebot Stack • NodeJs (https://nodejs.org/) •
Socket.io (http://socket.io/) • Johnny-Five (http://johnny-five.io/)
What current exists node-openni • Connects the Kinect to NodeJs
using OpenNI • Very basic event for almost everything • No gestures !
What I needed
What I Needed • Support for a full “skeleton” •
Support for gestures
What I Needed
Gestures 101
Gestures 101 The Basics • Is the initial condition met?
• Is the condition still met? • Is the final condition met?
Gestures 101 What do I need for gestures? • A
skeleton with an event when it changes • Know the position of the COM • Have a “base unit”
Gestures 101 Introducing kinect-gestures • Gesture detection using a base
class • Tracks the skeleton for an initial condition • Checks every 100ms to see if the condition is still met • If the final condition is met, trigger an event • Other classes are used to define the actual gestures
Robocalypse Demo Let’s look at some code !
Next few steps • Return a more friendly coordinate system
for skeleton • Add more information to the returned • Add more gestures (jump, wave, kick)
Questions?
Thank you. @joel__lord joellord
macadamian.com