Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Robocalypse: Controlling Nodebots with Kinect g...
Search
Joel Lord
October 28, 2015
Programming
0
230
Robocalypse: Controlling Nodebots with Kinect gestures
A Full Stack 2015 London presentation by Joel Lord. Links to full video to come...
Joel Lord
October 28, 2015
Tweet
Share
More Decks by Joel Lord
See All by Joel Lord
Robocalypse - Full Stack Toronto 2015
joellord
0
270
Other Decks in Programming
See All in Programming
Gleamという選択肢
comamoca
6
760
Go1.25からのGOMAXPROCS
kuro_kurorrr
1
800
FormFlow - Build Stunning Multistep Forms
yceruto
1
190
アンドパッドの Go 勉強会「 gopher 会」とその内容の紹介
andpad
0
260
Is Xcode slowly dying out in 2025?
uetyo
1
190
Composerが「依存解決」のためにどんな工夫をしているか #phpcon
o0h
PRO
1
230
都市をデータで見るってこういうこと PLATEAU属性情報入門
nokonoko1203
1
570
Deep Dive into ~/.claude/projects
hiragram
8
1.5k
PHP 8.4の新機能「プロパティフック」から学ぶオブジェクト指向設計とリスコフの置換原則
kentaroutakeda
2
540
XSLTで作るBrainfuck処理系
makki_d
0
210
Kotlin エンジニアへ送る:Swift 案件に参加させられる日に備えて~似てるけど色々違う Swift の仕様 / from Kotlin to Swift
lovee
1
260
すべてのコンテキストを、 ユーザー価値に変える
applism118
2
800
Featured
See All Featured
Building a Modern Day E-commerce SEO Strategy
aleyda
42
7.3k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
700
How to Ace a Technical Interview
jacobian
277
23k
A designer walks into a library…
pauljervisheath
207
24k
Making the Leap to Tech Lead
cromwellryan
134
9.3k
The Invisible Side of Design
smashingmag
299
51k
Faster Mobile Websites
deanohume
307
31k
For a Future-Friendly Web
brad_frost
179
9.8k
The Language of Interfaces
destraynor
158
25k
Being A Developer After 40
akosma
90
590k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.8k
Making Projects Easy
brettharned
116
6.3k
Transcript
confidential not for distribution A Full Stack 2015 London presentation
by Joel Lord Robocalypse: Controlling Nodebots with Kinect gestures
Overview About Me Why The Goals What Exists What I
wanted Gestures 101 Demo
About Me
About Me Joel Lord Development Manager Javascript junkie, technology enthusiast,
IoT hobbyist. Macadamian http://www.macadamian.com Twitter: @joel__lord Github: github.com/joellord
Stereotypes I have never fought a polar bear with my
bare hands
Stereotypes My yard last April
Why ?
Why • Worked with Nodebots for a while now •
Wanted to explore other possibilities of NodeJs • Because controlling a robot with a Kinect is pretty cool
The Goals
The Goals • Needed a way to use events to
tell the robot to perform an action • Gestures seemed the best way to achieve this
What currently exists
What current exists Basic Nodebot Stack • NodeJs (https://nodejs.org/) •
Socket.io (http://socket.io/) • Johnny-Five (http://johnny-five.io/)
What current exists node-openni • Connects the Kinect to NodeJs
using OpenNI • Very basic event for almost everything • No gestures !
What I needed
What I Needed • Support for a full “skeleton” •
Support for gestures
What I Needed
Gestures 101
Gestures 101 The Basics • Is the initial condition met?
• Is the condition still met? • Is the final condition met?
Gestures 101 What do I need for gestures? • A
skeleton with an event when it changes • Know the position of the COM • Have a “base unit”
Gestures 101 Introducing kinect-gestures • Gesture detection using a base
class • Tracks the skeleton for an initial condition • Checks every 100ms to see if the condition is still met • If the final condition is met, trigger an event • Other classes are used to define the actual gestures
Robocalypse Demo Let’s look at some code !
Next few steps • Return a more friendly coordinate system
for skeleton • Add more information to the returned • Add more gestures (jump, wave, kick)
Questions?
Thank you. @joel__lord joellord
macadamian.com