ML -> AI

Machine learning, deep learning and AI are popular terms that everything seems to be labeled as lately. At the heart of it, machine learning is about pattern recognition, deep learning is a machine learning algorithm, and AI is about technical intelligence that uses machine learning among other tools. This talk will give you a perspective on how to think about these concepts and how they are transforming technology.

Transcript

1. ML -> AI Melanie Warrick | Skymind | @nyghtowl
2. @nyghtowl Backstory...
3. @nyghtowl AI?
4. @nyghtowl
5. @nyghtowl Data Science improve human intelligence @nyghtowl
6. @nyghtowl Machine Learning...
7. @nyghtowl
8. @nyghtowl
9. @nyghtowl Approaches bias-variance complexity bayesian linear neural networks SVM nearest neighbors RBF gaussian processes SVD graphical models regularization validation aggregation input processing supervised unsupervised reinforcement activate online Theory Models Methods Paradigms @nyghtowl
10. @nyghtowl Neural Nets...
11. @nyghtowl Artificial Neural Nets Input Output Hidden Run until error stops improving = converge Loss Function
12. @nyghtowl Why Neural Nets Matter? - Feature Engineering - Language & Image Analysis - Personalization
14. DUKE VINCENTIO: Well, your wit is in the care of side and that. Second Lord: They would be ruled after this chamber, and my fair nues begun out of the fact, to be conveyed, Whose noble souls I'll have the heart of the wars. Clown: Come, sir, I will make did behold your worship. VIOLA: I'll drink it.
16. @nyghtowl
17. @nyghtowl
19. @nyghtowl AI...
21. What is it? - optimal learning agents - intelligence - consciousness @nyghtowl
22. AI Range Weak = Narrow = ANI Strong = General = AGI Super = ASI @nyghtowl
24. @nyghtowl AI Research Areas - Game Playing - Search (Graph, Uniformed, Heuristic, ...) - Learning (Reinforcement, NNs, ...) - Knowledge-Based Systems - Planning & Certainty/Uncertainty - Probabilistic Reasoning - Autonomous Agents - Language Processing - Perception - Robotics
25. Artificial General Intelligence | AGI human level AI | strong AI | full AI - perform a task that a human can - self-awareness collection expert machines = human? @nyghtowl
26. Turing Test
27. Turing Test | Chatbots Eugene Goostman - 2014 - imitate 13 Ukranian boy - convinced 33% of judges Examples - ELIZA (1966) - Chato - A.L.I.C.E (pattern matching / not reasoning) - Siri & Cortana @nyghtowl
28. @nyghtowl Road to AGI Brain Computer memory fades RAM & long-term more precise 200 hz neuron speed microprocessor 2GHz (10 x) speed sleep required 24/7 10 quadrillion (10^16) cps & 20W 34 quadrillion (34^16) cps & 24MW 100B neurons simulated 302 (Open Worm)
29. @nyghtowl Singularity | ASI superintelligence - recursive self-improvement - intelligence explosion - last human invention avg predictions ~ 2040
30. @nyghtowl
31. @nyghtowl ASI Extremes Extinction Immortality
32. @nyghtowl Hype = anthropomorphizing | expectations Persuasion = data used to influence Legal = protection limits Economic = skill disparities | stagnant wages ANI Pitfalls
33. @nyghtowl
34. @nyghtowl ANI Upside Health = standardize & improve care Security | Safety = reduced crime | id anomalies Environment = optimize & minimize impact Evolution = merge with tech
35. @nyghtowl Overall Musings & such... - AI is here - Serious pursuit of AGI - Common agreement ASI will change everything... - If we merge with tech, are we still human? - Were we Cylon to begin with?
36. @nyghtowl Last Points - ML: pattern recognition & prediction - NN: feature engineering & customization - AI: recursive & unsupervised learning Take Risks => it’s worth it
37. @nyghtowl References: • Neural Information Processing Systems Foundation https://nips.cc • The AI Revolution: The Road to Superintellgience http://waitbutwhy.com/2015/01/artificial-intelligence- revolution-1.html • The Coming Technological Singularity: How to Survive the Post-Human Era https://www-rohan.sdsu. edu/faculty/vinge/misc/singularity.html • The Chinese Room Argument http://plato.stanford.edu/entries/chinese-room/#6 • Artificial Intelligence A Modern Approach http://www.cin.ufpe.br/~tfl2/artificial-intelligence-modern-approach. 9780131038059.25368.pdf • Artificial Intelligence: ‘Homo sapiens will be split into a handful of gods and the rest of us’ • http://www.theguardian.com/business/2015/nov/07/artificial-intelligence-homo-sapiens-split-handful-gods • The Future of Employment: How Susceptible Are Jobs to Computerization? http://www.oxfordmartin.ox.ac. uk/downloads/academic/The_Future_of_Employment.pdf • The Turing Test Measures Something But It’s Not “Intelligence” http://www.smithsonianmag. com/innovation/turing-test-measures-something-but-not-intelligence-180951702/?no-ist • Nick Bostrom: What happens when our computers get smarter than we are? https://www.ted. com/talks/nick_bostrom_what_happens_when_our_computers_get_smarter_than_we_are?language=en
38. References: @nyghtowl • Nature of Code: Neural Networks http://natureofcode.com/book/chapter-10-neural-networks/ • Neural Nets and Deep Learning http://neuralnetworksanddeeplearning.com/ • Neural Nets Demystified (Welch) http://www.welchlabs.com/blog/ • Theano Tutorial http://deeplearning.net/software/theano/tutorial/index.html#tutorial • “The State of Deep Learning in 2014” https://speakerdeck.com/ogrisel/the-state-of-deep-learning-in-2014 • “Hacker’s Guide to Neural Nets” https://karpathy.github.io/neuralnets/ • “Automated Image Capturing with ConvNets and Recurrent Nets” (Karpathy) http://cs.stanford. edu/people/karpathy/sfmltalk.pdf • Deeplearning.net • Deep Learning Book http://www.deeplearningbook.org/ • Learning from Data http://work.caltech.edu/lectures.html#lectures • Convolutional Networks for Visual Recognition http://cs231n.github.io/ • Networks and Deep Learning http://neuralnetworksanddeeplearning.com/ • We’ve Put a Worm’s Mind in a Lego Robot’s Body http://www.smithsonianmag.com/smart-news/weve-put- worms-mind-lego-robot-body-180953399/?no-ist • How can the various machine learning algorithms be classified summarized... https://www.quora.com/How- can-the-various-machine-learning-algorithms-be-classified-summarized-according-to-the-problems-they-solve • How Google’s AI breakthroughs are putting us on a path to narrow AI http://www.techrepublic.com/article/how- googles-ai-breakthroughs-are-putting-us-on-a-path-to-narrow-ai/
39. @nyghtowl • http://www.wired.com/wp-content/uploads/2015/06/siri-ft.jpg • http://www.google.com/selfdrivingcar/images/home-where.jpg • http://i.telegraph.co.uk/multimedia/archive/02122/WILLIAM-SHAKESPEAR_2122089b.jpg • https://karpathy.github.io/2015/05/21/rnn-effectiveness/ • http://static.artdiscover.com/img/news/340_2_l.jpeg • http://users.clas.ufl.edu/glue/longman/1/einstein.html • https://pbs.twimg.com/media/CJm9HmfVEAEXU0c.jpg:large • http://i.telegraph.co.uk/multimedia/archive/03370/broadway2_3370419k.jpg • https://hbr. org/resources/images/article_assets/2015/05/R1506D_MCAFEE_WHENWORKERSFALLBEHIND.png • http://content.time.com/time/magazine/article/0,9171,1992403,00.html • http://www.smithsonianmag.com/innovation/turing-test-measures-something-but-not-intelligence- 180951702/?no-ist • http://www.informatik.uni-rostock.de/~sb564/ai4ie/2012/ • http://time.com/3734332/chappie-artificial-intelligence-robot-movies/ • http://waitbutwhy.com/2015/12/the-tail-end.html • http://venturebeat.com/2015/05/28/pinterest-improves-related-pins-with-deep-learning-plans-product- recommendations-using-object-recognition/ References: Images
40. @nyghtowl • http://venturebeat.com/2015/05/28/pinterest-improves-related-pins-with-deep-learning-plans-product- recommendations-using-object-recognition/ • http://www.boredpanda.com/truth-facts-funny-graphs-wumo/ • http://www.wallpaperup. com/uploads/wallpapers/2014/05/20/354801/big_thumb_9d23130fdb6c766d17341651056138c1.jpg • http://waitbutwhy.com/wp-content/uploads/2015/01/Square21-1024x1012.jpg • https://i.guim.co. uk/img/media/d87d88cbe84e827eba0c96a362eaff5c5a0917e2/0_0_4512_2709/master/4512.jpg? w=620&q=85&auto=format&sharp=10&s=2bcd04760c603e5dd7526a617a9ab4fb • http://vignette1.wikia.nocookie.net/memoryalpha/images/4/48/Scotty_uses_a_mouse. jpg/revision/latest?cb=20070914125438&path-prefix=en • https://www.photoshopgurus.com/forum/attachments/general-photoshop- board/55667d1431462431t-image-watermark-help-infinity-watermark_zpsfqz0orji-png • http://infinity.voith.com/application/media/images/vp_infinity-symbol_1000x570.jpg • http://www.omerohome.com/sites/default/files/products/Antique%20Beam%20200%20%2B% 20years%20old%20from%20Provence%20Region.jpg • http://cheesegod.com/wp-content/uploads/2013/05/33.jpg • http://www.slideshare.net/amcafee/mc-afee-econ-data References: Images
41. @nyghtowl • https://encrypted-tbn1.gstatic.com/images?q=tbn: ANd9GcTDO5Om_hEOg4GOSXFxuCg0tUn9caEiIjJYlCMhH1LBx84GAsqcGw • https://upload.wikimedia.org/wikipedia/commons/thumb/f/f6/HAL9000.svg/2000px-HAL9000.svg.png • http://vignette1.wikia.nocookie.net/clash-of-the-titans/images/a/a2/Bubo_prop.jpg/revision/latest? cb=20120509170953 • https://encrypted-tbn3.gstatic.com/images?q=tbn:ANd9GcRw1A- yCAQ_r8AfFwakWr7YQHzt8peDBR_l7sUkhjFFLT3b0-lD_A • http://vignette3.wikia.nocookie.net/p__/images/4/44/Rosie.jpg/revision/latest? cb=20120305141357&path-prefix=protagonist • http://tfwiki.net/mediawiki/images2/thumb/3/37/Optimusg1.jpg/350px-Optimusg1.jpg • https://i.ytimg.com/vi/iJ3ygrRMBX4/maxresdefault.jpg • http://m.mediapost.com/publications/13/RobbieRobot-c.jpg • http://syntheticremarks.com/wp-content/uploads/2011/02/johnny5-short-circuit.png • http://www.r2kt.com/top20robots/hhmarvin_large.jpg • https://scontent.cdninstagram.com/hphotos-xap1/t51.2885- 15/s320x320/e15/10899024_892370980797830_936588702_n.jpg • https://encrypted-tbn2.gstatic.com/images?q=tbn:ANd9GcTfHxkPwRbHQEKNcG9ff- IA_xqu7i7WVVDosL0EsiNeU1qELG_1 References: Images
42. @nyghtowl • http://images6.fanpop.com/image/photos/37600000/Transparent-Baymax-big-hero-6-37653146-415- 500.png • http://images.huffingtonpost.com/2012-04-19-Data2copy.jpg • https://www.sideshowtoy.com/wp-content/uploads/2014/08/902246-product-silo.png • http://1.bp.blogspot.com/-hTpZ_PyEMmk/VUDkCl7U_vI/AAAAAAAAF-I/pUpv4VP9TdY/s1600/ex- machina-551ea2c2d06c1.png • http://cdn.90sfest.com/90s-fest/wp-content/uploads/90sfest-terminator-connect-with-us.png • http://fc08.deviantart.net/fs30/f/2008/074/2/e/Mr_Smith_Stencil_by_Six_Hundred.png • http://pre12.deviantart. net/9b39/th/pre/f/2012/127/d/b/ghost_in_the_shell___tachikoma_png_format_by_vlader08-d4yuso3. png • http://t05.deviantart.net/A2r3vd3ir9dXrUnuwnQkw8flLL4=/300x200/filters:fixed_height(100,100): origin()/pre15/f1f4/th/pre/f/2013/052/c/6/sci_fi_lost_in_space_robot_by_geekeboy-d5vrphc.png • http://i1126.photobucket.com/albums/l613/benjamin_161/Vectores/Bender.png • http://vignette2.wikia.nocookie.net/starwars/images/6/68/BB8-Fathead.png/revision/latest/scale-to- width-down/500?cb=20150908052432 • http://icons.iconseeker.com/png/fullsize/doctor-who/k9.png References: Images
43. @nyghtowl Special Thanks • Alison Lowndes • Ian Goodfellow • Paco Nathan • Leonid Shamis • Chris Nichols • Alex Black • Lindsay Cade • Jason Morrison • Adam Gibson
44. @nyghtowl ML -> AI Melanie Warrick skymind.io (company) @nyghtowl gitter.im/deeplearning4j/deeplearning4j (chat)