Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Robocalypse: Controlling Nodebots with Kinect gestures
Search
Joel Lord
October 28, 2015
Programming
0
180
Robocalypse: Controlling Nodebots with Kinect gestures
A Full Stack 2015 London presentation by Joel Lord. Links to full video to come...
Joel Lord
October 28, 2015
Tweet
Share
More Decks by Joel Lord
See All by Joel Lord
Robocalypse - Full Stack Toronto 2015
joellord
0
230
Other Decks in Programming
See All in Programming
AWS Application Composerで始める、 サーバーレスなデータ基盤構築 / 20240406-jawsug-hokuriku-shinkansen
kasacchiful
1
240
スクラムチームと認知負荷 - ニフティのスクラムトーク Vol2. / NIFTY Tech Talk #18
niftycorp
PRO
1
120
エンターテイメント業界で利用されるAWS
demuyan
0
200
単体テストを書かない技術 #phpcon_odawara
o0h
PRO
24
7.6k
Build with AI 2024 Seoul - 제로부터 시작하는 Flutter with Gemini 생활 - 박제창
itsmedreamwalker
0
200
What We Can Learn From OSS
inouehi
0
380
スクラムガイドのスプリントレトロスペクティブを改めて読みかえしてみた / Re-reading the Sprint Retrospective Section in the Scrum Guide
mackey0225
3
310
両面どころかインフラもTSでできるよ ~ 全方位TypeScriptによるプロダクト開発 ~
myfinder
9
3.2k
DMMプラットフォームがTiDB Cloudを採用した背景
pospome
5
2k
AppDeveloperCon 2024 EU: Building polyglot developer experiences in 2024
salaboy
0
510
Micro Frontends for Java Microservices - Devnexus 2024
mraible
PRO
0
400
1인 개발자로 행복하게 살기 - GDG 송도 헬로월드 2024
benjaminkim
1
5.5k
Featured
See All Featured
Robots, Beer and Maslow
schacon
PRO
154
7.9k
Design by the Numbers
sachag
274
18k
Building Adaptive Systems
keathley
29
1.8k
GraphQLとの向き合い方2022年版
quramy
29
12k
Git: the NoSQL Database
bkeepers
PRO
421
63k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
24
2.3k
Infographics Made Easy
chrislema
237
18k
Designing with Data
zakiwarfel
95
4.8k
A Modern Web Designer's Workflow
chriscoyier
689
190k
Producing Creativity
orderedlist
PRO
336
39k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
657
120k
Making the Leap to Tech Lead
cromwellryan
123
8.5k
Transcript
confidential not for distribution A Full Stack 2015 London presentation
by Joel Lord Robocalypse: Controlling Nodebots with Kinect gestures
Overview About Me Why The Goals What Exists What I
wanted Gestures 101 Demo
About Me
About Me Joel Lord Development Manager Javascript junkie, technology enthusiast,
IoT hobbyist. Macadamian http://www.macadamian.com Twitter: @joel__lord Github: github.com/joellord
Stereotypes I have never fought a polar bear with my
bare hands
Stereotypes My yard last April
Why ?
Why • Worked with Nodebots for a while now •
Wanted to explore other possibilities of NodeJs • Because controlling a robot with a Kinect is pretty cool
The Goals
The Goals • Needed a way to use events to
tell the robot to perform an action • Gestures seemed the best way to achieve this
What currently exists
What current exists Basic Nodebot Stack • NodeJs (https://nodejs.org/) •
Socket.io (http://socket.io/) • Johnny-Five (http://johnny-five.io/)
What current exists node-openni • Connects the Kinect to NodeJs
using OpenNI • Very basic event for almost everything • No gestures !
What I needed
What I Needed • Support for a full “skeleton” •
Support for gestures
What I Needed
Gestures 101
Gestures 101 The Basics • Is the initial condition met?
• Is the condition still met? • Is the final condition met?
Gestures 101 What do I need for gestures? • A
skeleton with an event when it changes • Know the position of the COM • Have a “base unit”
Gestures 101 Introducing kinect-gestures • Gesture detection using a base
class • Tracks the skeleton for an initial condition • Checks every 100ms to see if the condition is still met • If the final condition is met, trigger an event • Other classes are used to define the actual gestures
Robocalypse Demo Let’s look at some code !
Next few steps • Return a more friendly coordinate system
for skeleton • Add more information to the returned • Add more gestures (jump, wave, kick)
Questions?
Thank you. @joel__lord joellord
macadamian.com