Robo Psychology: Using NeuroPsychology to Test AI

A.I. will soon surpass our techniques for testing it as a technology, so it's time to look into how we can test and review cognition in order to grow as a discipline.

*Note: Does not include speaker notes*

Transcript

1. Robo Psychology TESTING ARTIFICAL INTELLIGENCE USING NEUROPSYCHOLOGY @KITesting
2. Who Am I? u Pathfinder for Testing (Jumbo/Spilberg) u Agile Strategist (QualityMinds) u Obsessively searching for different ideas u Balancing technology with humanism u MSc in Clinical and Interpersonal Neuropsychology @KITesting
3. What Is Artificial Intelligence? @KITesting
4. What Is Artificial Intelligence? @KITesting
5. Robots <> AI @KITesting
6. @KITesting
7. @KITesting
8. @KITesting
9. @KITesting
10. So What Really Is Artificial Intelligence? We Don’t Know AI so far is limited by: • Our own tech • Our own culture • Our own values • A lack of the above independent from us @KITesting
11. What is Mental Illness? @KITesting
12. What is Clinical Psychology? @KITesting
13. What is Clinical Neuropsychology? @KITesting
14. So what does the one have to do with the other? To help prevent, identify and fix problems in humans, we sometimes treat them like technology To help prevent, identify and fix problems in technology, couldn’t we treat them like humans? @KITesting
15. Artificial Intelligence is starting to break developers u They do what we tell them to, not how we think they should @KITesting
16. Artificial Intelligence is learning Divergent Thinking u Convergent Intelligence u Divergent Intelligence u Examples: u AI plane landing versus measurement ability u Sales Robot Returns u Tower falling rather than walking @KITesting
17. We don’t know much about the inner workings of Deep Learning Deep Patient • Fed 70,000 case files • Able to predict faster than humans on things like liver cancer • Also able to predict mental illnesses like Schizophrenia • While we can’t! @KITesting
18. AI <> Human @KITesting
19. We’ve begun to humanize tech We’ve done this for as long as we’ve had empathy We do this as children with our toys Bomb disposal bots given medals and funerals @KITesting
20. Tech has begun to “humanize” us AI can identify different things without prompting Like us, they prefer videos of cats AI works to help those around it Unfortunately, like us genetic closeness is still the trigger factor for empathy @KITesting
21. Technology is starting to map Biology To make lifelike functions, we have to study life functions So to create AI, we need to study our brains @KITesting
22. Artificial brain is due July 22nd, 2019 WE ALREADY HAVE A SIMULATED VISUAL CORTEX WE HAVE A SIMULATED MEMORY WE HAVE A SIMULATED EXECUTIVE FUNCTION WE HAVE INSTINCTUAL COMPETITION WE HAVE EMPATHY WE LACK AN ARTIFICIAL NEOCORTEX @KITesting
23. We already mapped an entire neurological system: a worm u Worm system is simple, but effective u Can pilot any simple vehicle u Responds to environment u Can move and move the car AT THE SAME TIME. @KITesting
24. What does Neuropsychology have to do with AI Testing? AI can become mentally ill “Treating” them is very similar to treating people So why not Test the same way as we do humans? @KITesting
25. Why Neuropsychology can help test AI u Based on human models and unknowns and complexity u Structured diagnosis u Forms of intelligence differentiation / interpretation u No single source trust u Evolving definitions @KITesting
26. Neuropsychological Tests For Tech? u Neuropsychology tests look at attention spans and concentration as well as: u Your ability to think, understand, learn, and remember (cognition), u Memory u Motor function (walking, coordination, etc.) u Perception (how well you take in what you see or read) u Problem-solving and decision-making u Verbal ability @KITesting
27. Neuropsychological Tests For People Memory test: Repeat a list of words, sentences, or numbers. Cognition test: Explain how two items are like Verbal communication test: Name some items as the person giving the test points at them Motor tests: These might include tasks such as inserting pegs into a pegboard using one hand and then the other. @KITesting
28. Intelligence Tests = Functional Tests Basics, expected results and function Memory Tests = Connectivity Tests Can you retrieve what you want with the correct identfier in a speedy manner? Language Tests = Unit Tests Can you read and display the proper sequences? Neuropsychological Tests For Tech @KITesting
29. Neuropsychological Tests For Tech Visual Spacing Tests = Integration / Context E2E Tests Does everything function where it needs to and does it recognize what that is? Dementia Specific Tests = Regression Tests Have things reverted to a less valuable / desired state? Executive Function / Complex Thought Tests = Exploratory Testing What do things mean and what value do they have? How are things connected? @KITesting
30. What Element Are We Missing? Personality! What motivates an AI? What are its values, drives, ambitions? @KITesting
31. Learning Theory u Operant Conditioning u Versus goal oriented learning u Start with what you want and work backwards u What makes learning independent? u How can we make it scientific? @KITesting
32. AI / Testing In The Future Personal Companions AI Lawyers / Judges AI Diagnostics AI Education @KITesting
33. AI = Mind @KITesting
34. AI Mind = Life @KITesting
35. Tester = Explorer @KITesting
36. Test Exploration = AI Mind Therapy @KITesting
37. Be Prepared For The Leap; Start Studying Today! @KITesting
38. Thanks For Joining ! Any Questions? ? @KITesting
40. Topics u AI task specificity (Map, 2017) u https://techcrunch.com/2018/12/31/this-clever-ai-hid- data-from-its-creators-to-cheat-at-its-appointed-task/ u https://arxiv.org/pdf/1712.02950.pdf u AI Values versus Efficiency u https://www.theatlantic.com/ideas/archive/2018/09/can -artificial-intelligence-be-smarter-than-a-human- being/571498/ u Outthinking the developer u https://arxiv.org/abs/1803.03453 u Exposing human actions with AI logic (aka, lying and creating own language) u https://www.newsweek.com/2017/08/18/ai-facebook- artificial-intelligence-machine-learning-robots-robotics- 646944.html u Computers can get psychosis as well: u https://www.popularmechanics.com/science/health/a666 6/how-to-build-a-schizophrenic-computer/
41. More Topics • https://www.technologyreview.com/s/604087/the-dark-secret-at-the- heart-of-ai/?curator=TechREDEF AI not fully understood (Deep Patient) • http://www.washingtonpost.com/wp- dyn/content/article/2007/05/05/AR2007050501009.html • http://www.msnbc.msn.com/id/30868033/ns/technology_and_science- science/ • http://www.washingtonpost.com/wp- dyn/content/article/2007/05/05/AR2007050501009_2.html • Sgt. Talon, a bomb disposal robot with the 737th Ordinance Company, has been awarded no less than three honorary Purple Hearts and a battlefield promotion to staff sergeant by the soldiers. • Simulating empathy: • http://reviews.cnet.com/8301-13746_7-20027209-48.html • Literally: • http://news.bbc.co.uk/2/hi/technology/8164060.stm • And same behavior (cats) • https://www.nytimes.com/2012/06/26/technology/in-a-big-network-of- computers-evidence-of-machine-learning.html?pagewanted=all&_r=0 Humanizing of Robots and AI
42. Even More Topics u Future: u AI Altruism u http://www.wired.com/wiredscience/2011/05/robot-altruism/ u Evolution of AI brain u https://www.sciencealert.com/scientists-put-worm-brain-in-lego-robot-openworm- connectome u https://motherboard.vice.com/en_us/article/vba4nj/worm-brain-ai-park-car