Combining APIs: Brain-Computer Interface + Wearables + Remote Control

by Jim McKeeth @ APIStrat 2014 in Chicago

Transcript

1. Combining APIs: 
 Brain-Computer Interface + Wearables + Remote Control JIM MCKEETH EMBARCADERO TECHNOLOGIES JIM.MCKEETH@EMBARCADERO.COM @JIMMCKEETH
2. ‹#› About Jim McKeeth • Lead World Wide Developer Evangelist • Host of Podcast at Delphi.org • Longtime developer ◦ Object Pascal, Java, C#, JavaScript, Objective-C, C++, etc. • Invented and patented swipe to unlock in 2000 ◦ US Patent # 8352745 & 6766456, etc. • Improvisational performer 2
3. ‹#› 3 • Founded 1993 • Provides Architect, Database and Developer Tools • 3.2 Million Customers including 97% of Fortune 2000 • 35+ Product Awards – Consistent Innovation • 500+ Employees in 29 Countries • www.embarcadero.com Embarcadero Technologies
4. ‹#› Internet of Things 4 Metcalfe's law states that the value of a network is proportional to the square of the number of connections in the system (n2).
5. ‹#› All the Pieces 5 Emotiv EPOC Brain-Computer Interface Google Glass Wearable Computer Parrot.AR Drone 2 Simi-Autonomous
6. ‹#› About Appmethod • Integrated Development Environment • Native compiler for Win32, Win64, OS X, iOS & Android • Multi-platform visual designer • Framework for rapid prototyping and accelerated development with C++ or Object Pascal • Architecture allowing shared code & UI across platforms • Advanced language features like ARC, Generics, etc. 6 www.appmethod.com Free for C++ & Android Phone or starting at $25/mo per platform
7. ‹#› 7 Gartner's 2014 Hype Cycle for Emerging Technologies August 11, 2014 http://www.gartner.com/newsroom/id/2819918 Hype Cycle
8. ‹#› The Brain-Computer Interface 8 The  “Hat”  from  Brainstorm  -­‐  1983
9. ‹#› Electroencephalography (EEG) • Detects voltage fluctuations resulting from ionic current flows within neurons of brain. • Measures electrical activity along the scalp. • Millisecond-range resolution (faster than CT or MRI) • Typical clinical usage has 19+ input electrodes as well as ground and reference. • Invented between 1875 and 1924 9
10. ‹#› Emotiv EPOC • 16 wet electrodes ◦ 14 EEG – read brain waves 
 + 2 reference electrodes • Two-axis gyroscope to read head movements • 4 mental states, 13 conscious thoughts & facial expressions – 4 Processing suites • $399 desktop, or $499 for Bluetooth Smart (mobile) • www.emotiv.com 10
11. ‹#› Parrot.AR Drone 2 • Simi-Autonomous Quadricopter • Works with smartphone app • API uses UDP and TCP sockets • $299 everywhere • ardrone2.parrot.com • ardrone2.parrot.com/developer-zone 11
12. ‹#› Parrot.AR Drone 2 • Commands sent via UDP • Take off: AT*REF=101,290718208 • GAZ 0.1: AT*PCMD=301,1,0,0,1036831949,0 • Pitch -0.1: AT*PCMD=304,1,-­‐1110651699,0,0,0   • AT*[Command]=[Seq],[Argutments]   • AT*PCMD=[Seq],1,[roll],[pitch],[gaz],[yaw] 12 Or just use my component in Appmethod.
13. Emotiv EPOC SDK + Parrot AR.Drone API Demonstration Tweet #Appmethod
14. ‹#› Brain-Computer Interface Uses • Hands free, non-verbal input - one more input. • Immediate, unfiltered feedback: attention, excitement, stress, etc. • Emotional health via bio-feedback. • Automatic game difficulty adaptation. • Interrogation 14
15. ‹#› Transcranial Direct-Current Stimulation (tDCS) • Constant, low current delivered via electrodes. • Results: ◦ Increase cognitive performance ◦ Enhance language & math ability ◦ Improve attention span ◦ Aid problem solving, memory & coordination • Recent DIY “Brain Hacking” Craze ◦ http://www.reddit.com/r/tDCS 15 tdcsplacements.com
16. ‹#› More Information • Email: jim.mckeeth@embarcadero.com • Emotiv EPOC: www.emotiv.com • Parrot AR.Drone: projects.ardrone.org • My blog: delphi.org • Full Slide Deck: http://www.slideshare.net/jimmckeeth/jim- mc-keeth-wearable-thought-input • Code: https://github.com/jimmckeeth/Delphi-Emotiv-EPOC 16
17. ‹#› About Appmethod • Integrated Development Environment • Native compiler for Win32, Win64, OS X, iOS & Android • Multi-platform visual designer • Framework for rapid prototyping and accelerated development with C++ or Object Pascal • Architecture allowing shared code & UI across platforms • Advanced language features like ARC, Generics, etc. 17 www.appmethod.com Free for C++ & Android Phone or starting at $25/mo per platform