Dynamic virtual environments and AI driven avatars for enhanced patient experience during rehabilitation

Neuro Rehab VR develops innovative and immersive therapy solutions for cognitive and physical neurological rehabilitation. This session will cover an overview of how the therapies are customized and virtual environments are dynamically modified to cater to each patient's diagnosis and abilities. How real-time body metrics and in-game data is tracked to quantify patient progress. How AI neural networks are employed to drive NPCs in the virtual environment to provide enhanced immersion and gameplay to help with cognitive decision making and deal with pain, anxiety, and stress.

Transcript

2. Big Data & AI Conference Dallas, Texas June 27 – 29, 2019 www.BigDataAIconference.com
4. Good Keynote for Great Pitch www.goodpitch.co.id 800,000 Strokes 60,000 Parkinson’s 17,000 SPI 1.4 million TBI 500,000 CP Source : Each Year
5. Good Keynote for Great Pitch www.goodpitch.co.id NEUROPLASTICITY NEUROGENESIS NEUROGENESIS NEW SYNAPSES NEW SYNAPSES WEAKENED SYNAPSES STRENGTHENED SYNAPSES ADAPT CHANGE REORGANIZE ADAPT CHANGE REORGANIZE
6. Good Keynote for Great Pitch www.goodpitch.co.id PROBLEM Depression Repettve and Boring Expensive Transportaton PHYSICAL THERAPY
7. Good Keynote for Great Pitch www.goodpitch.co.id SOLUTION We create VR games for cognitve and physical neurological rehabilitaton leveraging the breakthroughs in neuroplastcity. We create VR games for cognitve and physical neurological rehabilitaton leveraging the breakthroughs in neuroplastcity.
8. Good Keynote for Great Pitch www.goodpitch.co.id DATA COLLECTION & ANALYSIS • Unsatisfactory patient outcomes • High costs of care • Low patient compliance • Limited Insurance • Changing Reimbursement models • Value-based care “Providers now are held accountable for the quality of their services. Payers in all market segments are increasingly requiring measurable outcomes that include the patient's experience” - Carmen Elliot, APTA Why is it necessary ?
9. Good Keynote for Great Pitch www.goodpitch.co.id DATA COLLECTION & ANALYSIS • Quantifable feedback on patient progress • AI is making therapy more intuitive – learn patient’s capabilities • Show incremental improvement that are subtle • Predictive Analytics – With historic medical data
10. Good Keynote for Great Pitch www.goodpitch.co.id DYNAMIC VIRTUAL ENVIRONMENTS – Why? Gamers – TOO EASY !! Gamers – TOO HARD !! RAGE QUIT !!
11. Good Keynote for Great Pitch www.goodpitch.co.id DYNAMIC VIRTUAL ENVIRONMENTS • Patient abilities – Stroke, SPI Neurodegerative diseases • Not be discouraged • Challenging • Dynamically change according to performance & diagnosis
12. Good Keynote for Great Pitch www.goodpitch.co.id DYNAMIC VIRTUAL ENVIRONMENTS
13. Good Keynote for Great Pitch www.goodpitch.co.id AI-DRIVEN VIRTUAL AVATARS, NPCs • Neural networks to build basic behaviors – Eatng, Sleeping, Flocking, Wandering, Running • Weighted on normal animal behaviors • Non-Player Characters (NPC) – Interactons • Conversatonal AI • Procedurally Generated worlds
14. Good Keynote for Great Pitch www.goodpitch.co.id AI-DRIVEN VIRTUAL AVATARS, NPCs
15. Good Keynote for Great Pitch www.goodpitch.co.id UNITY MACHINE LEARNING
16. Good Keynote for Great Pitch www.goodpitch.co.id TRAINING IN VR Isaac Lab Robot Simulator • Take the cost and risk out of training a robot using machine learning • Mistakes and potental damage to the robots or their environment • AI can explore and learn through trial and error in a virtual space that ofers the same parameters as the real world. • Lack of risk is important for human interacton
17. Good Keynote for Great Pitch www.goodpitch.co.id TRAINING IN VR • Physics-based rag-doll • Goal for the agent is to learn to control its limbs in a way that can allow it to walk forward. • Many degrees of freedom in the agent’s body – Reinforcement Learning
18. Good Keynote for Great Pitch www.goodpitch.co.id TRAINING IN VR • Single environment and agent which are tghtly coupled. • The actons of the agent change the state of the environment, and provide the agent with rewards. • AGENT • BRAIN • ACADEMY Engine Confguraton Frameskip Global episode length
19. Good Keynote for Great Pitch www.goodpitch.co.id
20. Click to edit Master title style 20 20
21. Good Keynote for Great Pitch www.goodpitch.co.id NeuroRehabVR.com veena@neurorehabvr.com