Intro to AI & ML

Transcript

1. AI & ML July 2016
2. History of AI
3. Minksy’s Multiplicity (1960) Crucial parts for problem solving : • Induction • Planning • Search, knowledge representation • Pattern recognition • Learning Components needed to get to human-level AI
4. 1960s : golden years • SAINT (Symbolic Automatic Integrator): able to calculate integrals • General Problem Solver : elementary logic and algebra (ex : Tower of Hanoi) • STUDENT : high school algebra word problems • ELIZA : psychiatry conversation • Micro-worlds Minsky, 1970 : "In from three to eight years we will have a machine with the general intelligence of an average human being."
5. 1970s : first AI winter 1973 : Whitehill report (UK) : “utter failure of AI to achieve its grandiose objectives” Example : “The spirit is willing, but the flesh is weak” -> Russian -> English : “The whisky is strong, but the meat is rotten” Funding killed for a decade
6. 1980s : AI revival Rise of expert systems. Goal : mimic expert behaviors Doctors, scientists, accountants, … Japan : Fifth Generation Computer Budget : $850 million
7. 90s-00s : second AI winter Expert systems : - hard to develop - harder to maintain - can’t replicate across fields Still can’t interact with the real world : - impossible to acquire data - all brain but no body ("Elephants Don't Play Chess") Funding stopped again
8. 2010s : emergence of Machine Learning 1999 : neural networks used for handwritten digits recognition
9. 2010s : emergence of Machine Learning 1999 : neural networks used for handwritten digits recognition 2012 : @Google, 16k processors, 10M Youtube videos, 1 week
10. 2010s : emergence of Machine Learning 1999 : neural networks used for handwritten digits recognition 2012 : @Google, 16k processors, 10M Youtube videos, 1 week
11. 2010s : emergence of Machine Learning 1999 : neural networks used for handwritten digits recognition 2012 : @Google, 16k processors, 10M Youtube videos, 1 week Able to find cats
12. 2010s : emergence of Machine Learning • Self-driving cars • Human interaction : ◦ Handwriting ◦ Speech ◦ Natural language • OCR • Image recognition • Information retrieval • Artificial personal assistants • Recommendations systems • Drones • Game playing • ...
13. Classic Hype Cycle
14. Classic Hype Cycle
15. Hype Cycle 2015
16. Kondratiev Waves
17. Testing AI : Chess = “the pinnacle of human intelligence” DeepBlue vs Kasparov : 1996 : 1W, 2D, 3L 1997 : 2W, 3D, 1L This switched the canonical example of a game where humans outmatched machines to the ancient Chinese game of Go, a game of simple rules and far more possible moves than chess, which requires more intuition and is less susceptible to brute force.
18. Testing AI : Go AlphaGo vs Lee Sedol : March 2016 : 4-1 "All but the very best Go players craft their style by imitating top players. AlphaGo seems to have totally original moves it creates itself." Lee Sedol : "I misjudged the capabilities of AlphaGo and felt powerless."
19. Testing AI : Turing Test Can an AI pass as human through text messaging ? Judges interact with humans and robots. They must find out which is which. Success in June 2014 AI passed as 13-year Ukrainian boy, Eugene Goostman
20. Testing AI : Turing Test Can an AI pass as human through text messaging ? Judges interact with humans and robots. They must find out which is which. Success in June 2014 AI passed as 13-year Ukrainian boy, Eugene Goostman
21. Minksy’s Multiplicity (1960) Crucial parts for problem solving : • Induction • Planning • Search, knowledge representation • Pattern recognition • Learning Components needed to get to human-level AI
22. Minksy’s Multiplicity (1960) Crucial parts for problem solving : • Induction -> 1960s • Planning -> 1960s • Search, knowledge representation -> 1980s - 2010s • Pattern recognition -> 2010s • Learning -> 2010s Components needed to get to human-level AI
23. Machine Learning
24. Explaining Machine Learning Machine learning is the idea that there are generic algorithms that can tell you something interesting about a set of data without you having to write any custom code specific to the problem. Instead of writing code, you feed data to the generic algorithm and it builds its own logic based on the data.
25. Explaining Machine Learning Different categories : • Supervised learning ◦ continous answer : regression ex : estimate a price, a volume, ... ◦ discrete answer : classification ex : spam detection, cancerous tumors • Unsupervised learning • Reinforced learning continuous environment and constant feedback, learns by itself
26. Unsupervised learning
27. Intro to Machine Learning http://www.r2d3.us/ visual-intro-to- machine-learning-part-1/
28. Linear regression
29. Intuitions from linear regression • algorithm is generic, results depends on data • system is both the algorithm and the data • starts with a hypothesis about how we can represent the data (for linear regression : a straight line) • only as good as your data • can deal poorly with outliers • lots of calculation to learn, but very fast to apply (can run on mobile)
31. Overfitting Need to split the data into : - training set (60%) - cross-validation set (20%) - evaluation set (20%)
32. Artificial Neural Networks (ANN) Each node does a linear combination of previous nodes More nodes can handle more complexity Input must be normalized For example, all images -> 20x20 Training in multiple steps - left to right to evaluate the training set - right to left to propagate errors
33. Tensorflow Playground
34. Deep learning
35. Deep learning
36. Hierarchy
37. State of the art : IBM
39. IBM Watson • Healthcare : ◦ Diagnostics ◦ Tests suggestion ◦ Prescription recommendations • Legal : ◦ Hired as a lawyer (“Ross”) • Teaching : ◦ Used as a TA (“Jill Watson”)
40. IBM Watson • Healthcare : ◦ Diagnostics ◦ Tests suggestion ◦ Prescription recommendations • Legal : ◦ Hired as a lawyer (“Ross”) • Teaching : ◦ Used as a TA (“Jill Watson”) • Cooking : ◦ published a recipe book ◦ new combinations ◦ able to avoid allergies
42. State of the art : Google
43. Google Auto captionning (2014) Two pizzas sitting on top of a stove top oven
45. Cloud Vision API (2016) Available on Google Cloud Automatic labelling Sentiment analysis Text extraction Landmark detection Logo detection Explicit content detection
46. Cloud Vision API Available on Google Cloud Automatic labelling Sentiment analysis Text extraction Landmark detection Logo detection Explicit content detection
47. TensorFlow ML framework Opensourced in 2016 New standard Cloud computing : TPUs
48. SyntaxNet and Parsey McParseface
49. SyntaxNet and Parsey McParseface
50. SyntaxNet and Parsey McParseface Parsey McParseface can correctly read: • The old man the boat. • While the man hunted the deer ran into the woods. • While Anna dressed the baby played in the crib. • Buffalo buffalo Buffalo buffalo buffalo buffalo Buffalo buffalo. It makes mistakes on: • I convinced her children are noisy. • The coach smiled at the player tossed the frisbee. • The cotton clothes are made up of grows in Mississippi. • James while John had had had had had had had had had had had a better effect on the teacher
51. NeuralArt (Tensorflow) Content Style Output
52. State of the art : Facebook
53. Facebook: M Chatbot for Facebook Messenger AI only answers when confident. Otherwise, humans answer. But AI learns from answers provided by humans when it was not confident
54. Facebook: DeepText Can understand 1000 posts / s in 20 languages Able to extract context Able to understand slang Currently used to suggest actions (“request a ride”, “create an ad to sell your item”, …)
55. State of the art : Others
56. Face recognition (April 2014)
57. Facial manipulation (Feb 2015)
58. Finding similarities in art (Aug 2014)
59. Audio prediction on video (April 2016)
60. Extract instructions from Youtube videos (Nov 2015)
61. AI fighter pilot (June 2016)
62. Applications of NLP at Quora - automatic grammar correction - question quality - duplicate question detection - related question suggestion - topic biography quality (= qualifications of writer) - topic labeler (from “science” to narrow topics like “tennis Courts in Mountain View”) - search - answer summaries - automatic answers wiki - hate speech/harassment detection - spam detection - question edit quality
63. Questions? July 2016