Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Sonic Gesture

Sonic Gesture

Sonic Gesture is a Computer Vision project where learned hand poses are translated into corresponding commands with the aim of generating sound. In other words this software makes it possible to create and manipulating sound without physical interaction with a computer.

Gijs Molenaar

January 20, 2014
Tweet

More Decks by Gijs Molenaar

Other Decks in Technology

Transcript

  1. WHAT IS IT? ! ! ! Translate hand poses into

    music Using computer vision
  2. FINDING HANDS Difficult Hands change all the time Skin does

    not change Use skin color to find hands How to find skin color?
  3. FACE DETECTION Face is easy to detect Does not change

    (very much) Assumes only one person in image
  4. DIMENSIONS List of numbers +/- 3000 in our case Coordinate

    in higher dimensional space 3000 dimensional space
  5. PERFORMANCE overall best results HOG features SVM classifier
 28 hands

    15 hands train with end- user 87,92% 91,58% train without end-user 71,83% 80,07% without end- user, noisy background 63,81% 74,71%
  6. CONCLUSIONS It works Fast, usable in real-time setting Curwen hand

    poses not suited Method not person independent
  7. SONIC GESTURE Open Source Recognises 28 hand poses for each

    hand Size and Position of hands Open Sound Control (OSC) User defined mapping Google for ‘Sonic Gesture’