Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Robocalypse: Controlling Nodebots with Kinect gestures
Search
Joel Lord
October 28, 2015
Programming
0
200
Robocalypse: Controlling Nodebots with Kinect gestures
A Full Stack 2015 London presentation by Joel Lord. Links to full video to come...
Joel Lord
October 28, 2015
Tweet
Share
More Decks by Joel Lord
See All by Joel Lord
Robocalypse - Full Stack Toronto 2015
joellord
0
240
Other Decks in Programming
See All in Programming
Javaの現状2024夏 / Java current status 2024 summer
kishida
4
1.4k
Android開発者のための Kotlin Multiplatform入門
ntaro
0
190
SDCon2024: Enabling DevOps and Team Topologies thru architecture: architecting for fast flow
cer
PRO
0
780
Rustのweb開発を助ける 便利なツール紹介
yuki0418
1
190
コード生成を伴うLLMエージェント - 2024.07.18 Tokyo AI
smiyawaki0820
11
4.1k
君たちはどうコードをレビューする (される) か / 大吉祥寺.pm
utgwkk
15
8.5k
日付と正規化
megmogmog1965
0
140
Rust.Nagoya #1
codemountains
0
170
CSC307 Lecture 08
javiergs
PRO
0
330
英語
s_shimotori
1
220
今こそ始める、CDKコンストラクトライブラリ開発 ― 入門から実践まで
tmokmss
1
930
3 Effective Rules for Success with Signals in Angular
manfredsteyer
PRO
0
120
Featured
See All Featured
Building Effective Engineering Teams - LeadDev
addyosmani
47
2.2k
Designing the Hi-DPI Web
ddemaree
276
34k
Facilitating Awesome Meetings
lara
46
5.8k
Atom: Resistance is Futile
akmur
261
25k
Being A Developer After 40
akosma
72
580k
What the flash - Photography Introduction
edds
65
11k
What’s in a name? Adding method to the madness
productmarketing
PRO
21
2.9k
The World Runs on Bad Software
bkeepers
PRO
63
11k
In The Pink: A Labor of Love
frogandcode
139
22k
[RailsConf 2023] Rails as a piece of cake
palkan
35
4.4k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
16
1.6k
A Modern Web Designer's Workflow
chriscoyier
689
190k
Transcript
confidential not for distribution A Full Stack 2015 London presentation
by Joel Lord Robocalypse: Controlling Nodebots with Kinect gestures
Overview About Me Why The Goals What Exists What I
wanted Gestures 101 Demo
About Me
About Me Joel Lord Development Manager Javascript junkie, technology enthusiast,
IoT hobbyist. Macadamian http://www.macadamian.com Twitter: @joel__lord Github: github.com/joellord
Stereotypes I have never fought a polar bear with my
bare hands
Stereotypes My yard last April
Why ?
Why • Worked with Nodebots for a while now •
Wanted to explore other possibilities of NodeJs • Because controlling a robot with a Kinect is pretty cool
The Goals
The Goals • Needed a way to use events to
tell the robot to perform an action • Gestures seemed the best way to achieve this
What currently exists
What current exists Basic Nodebot Stack • NodeJs (https://nodejs.org/) •
Socket.io (http://socket.io/) • Johnny-Five (http://johnny-five.io/)
What current exists node-openni • Connects the Kinect to NodeJs
using OpenNI • Very basic event for almost everything • No gestures !
What I needed
What I Needed • Support for a full “skeleton” •
Support for gestures
What I Needed
Gestures 101
Gestures 101 The Basics • Is the initial condition met?
• Is the condition still met? • Is the final condition met?
Gestures 101 What do I need for gestures? • A
skeleton with an event when it changes • Know the position of the COM • Have a “base unit”
Gestures 101 Introducing kinect-gestures • Gesture detection using a base
class • Tracks the skeleton for an initial condition • Checks every 100ms to see if the condition is still met • If the final condition is met, trigger an event • Other classes are used to define the actual gestures
Robocalypse Demo Let’s look at some code !
Next few steps • Return a more friendly coordinate system
for skeleton • Add more information to the returned • Add more gestures (jump, wave, kick)
Questions?
Thank you. @joel__lord joellord
macadamian.com