Save 37% off PRO during our Black Friday Sale! »

Artificial Intelligence for Developers

Artificial Intelligence for Developers

What is Artificial Intelligence and how can you make your application smarter without a data science background? This session will help you understand many Machine Learning concepts and provide a starting point to improve your applications with voice, vision, natural language understanding, multi-language capabilities, and much more!

36ca8ae7e19067021d0e39c0b72acc2a?s=128

Alex Casalboni

September 24, 2018
Tweet

Transcript

  1. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Alex Casalboni Technical Evangelist, AWS @alex_casalboni @ 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved Artificial Intelligence for Developers
  2. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. About me • Software Engineer & Web Developer • Serverless Lover & AI Enthusiast • AWS Customer since 2013
  3. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Myth: AI is dark magic
  4. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. What are we talking about? AI Machine Learning Deep Learning
  5. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. One of the ”Founding Father" of Artificial Intelligence John McCarthy, 1955 Coins the term
  6. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Frank Rosenblatt, 1957 Perceptron
  7. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. First known deep network Alexey Grigorevich Ivakhnenko, 1965
  8. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Paul Werbos, 1975 Backpropagation
  9. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. LeCun, 1989 First application of backpropagation https://www.youtube.com/watch?v=FwFduRA_L6Q
  10. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. AI winter 1969 – 1990
  11. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. The curse of dimensionality
  12. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. The Advent of AI Data GPUs & Acceleration Cloud Computing Algorithms
  13. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Deep Learning is a Big Deal It’s does a better job than other ML and Humans
  14. Convolutional Neural Networks (CNN) Conv 1 Conv 2 Conv n

    … … Feature Maps Labrador Dog Beach Outdoors Softmax Probability Fully Connected Layer
  15. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Examples of CNN’s
  16. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. https://github.com/precedenceguo/mx-rcnn https://github.com/zhreshold/mxnet-yolo Object Detection
  17. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. https://github.com/tornadomeet/mxnet-face Face Detection
  18. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Object Detection (Video)
  19. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. FDA-approved medical imaging https://www.periscope.tv/AWSstartups/1vAGRgevBXRJl https://www.youtube.com/watch?v=WE81dncwnIc Object Segmentation
  20. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Text Detection and Recognition https://github.com/Bartzi/stn-ocr
  21. Style Transfer

  22. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Real-Time Pose Estimation https://github.com/dragonfly90/mxnet_Realtime_Multi-Person_Pose_Estimation
  23. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Generative Adversarial Networks (GAN) The future at work (already) today Generating new ”celebrity” faces https://github.com/tkarras/progressive_growing_of_gans
  24. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How to ”build” a Neural Network?
  25. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Data Visualization & Analysis Business Problem – ML problem framing Data Collection Data Integration Data Preparation & Cleaning Feature Engineering Model Training & Parameter Tuning Model Evaluation Are Business Goals met? Model Deployment Monitoring & Debugging Yes No Data Augmentation Feature Augmentation The AI Process Re-training Predictions
  26. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Where to look at in your organisation ? Where data is being analyzed to help making decisions: • Sales • Marketing • Social media • Customer supports  • Logs
  27. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved.
  28. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. “Data is gold”
  29. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Pro-tip • Make it ridiculously easy to collect and store any type of data. • One line of code should be all it takes for anyone in the company to start collecting and storing new data points
  30. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon ML
  31. None
  32. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved.
  33. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved.
  34. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Where do you start? The Low Hanging Fruits
  35. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Put AI in the hands of every developer and data scientist Machine Learning at AWS: Our mission
  36. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. FRAMEWORKS / INTERFACES KERAS PLATFORMS APPLICATION SERVICES A M A Z O N R E K O G N I T I O N A M A Z O N R E K O G N I T I O N V I D E O A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X AMAZON SAGEMAKER AMAZON MECHANICAL TURK Machine Learning for everyone
  37. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Polly “Hi, I’m Matthew…” Amazon Polly: Text In, Life-like Speech Out
  38. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. • Content creation • Mobile & desktop applications • Internet of Things (IoT) • Education & e-learning • Telephony • Game development Use cases • 54 voices across 26 languages • Lip-syncing & text highlighting • Fine-grained voice control • Custom vocabularies • Available in 16 AWS Regions Key features Amazon Polly: Text In, Life-like Speech Out
  39. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. “With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices available on the market.” Severin Hacker CTO, Duolingo
  40. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Rekognition Deep learning-based image & video analysis
  41. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Object & Scene Detection
  42. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Facial Analysis
  43. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Facial Search
  44. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Optical Character Recognition (OCR)
  45. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Celebrity Recognition
  46. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Rekognition API example $ aws rekognition detect-labels –-image '{"S3Object": {"Bucket": "your-bucket", "Name": "test.jpg"}}' { "Labels": [ { "Confidence": 99.29136657714844, "Name": "Human" }, { "Confidence": 99.29136657714844, "Name": "People" }, { "Confidence": 99.29136657714844, "Name": "Person" }, ……
  47. Rekognition Video Analysis Service

  48. None
  49. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Marinus Analytics uses facial recognition to stop human trafficking “Now with Traffic Jam’s FaceSearch, powered by Amazon Rekognition, investigators are able to take effective action by searching through millions of records in seconds to find victims.” http://www.marinusanalytics.com/articles/2017/10/17/amazon-rekognition-helps-marinus-analytics-fight-human-trafficking
  50. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Lex “What’s the weather forecast?” “It will be sunny and 25°C” Weather Forecast Amazon Lex Build Conversational Chatbots
  51. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Lex End to End Speech to Intent ASR+NLU integrated into one API Dialog Management Native support & maintains context Text to Speech Amazon Polly integrated into API Business Logic Native integration with AWS Lambda Deployment One click deployment Security Encrypted data in transit & at rest Scale Completely managed service Analytics Monitor and improve End to End
  52. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved.
  53. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Comprehend Discover insights from text Entities Key Phrases Language Sentiment Amazon Comprehend Topic Modeling
  54. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Text analytics workload Amazon Kinesis Amazon ES Amazon Redshift Amazon EMR • Semantic • Rich filtering • Grouping, trends • Joining, correlating • Clustering • Graph, search • Near real-time • Alerts Amazon S3 Social media, support Amazon Aurora Articles, documents
  55. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Syntax detection $ aws comprehend detect-syntax --language-code 'en' --text 'I love cloud! { "SyntaxTokens": [ { "TokenId": 1, "Text": "I", "BeginOffset": 0, "EndOffset": 1, "PartOfSpeech": { "Tag": "PRON", "Score": 0.9999802112579346 } }, ...
  56. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Hotels.com « Amazon Comprehend helps us analyze the key sentiments, objects, and geos in our 30 million plus reviews & testimonies. Now we are able to discover new insights into the unique experiences available at each property, so our customers can make the best decision possible for their travel.” Matt Fryer, VP and Chief Data Science Officer, Hotels.com
  57. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. “Hello, this is Allan speaking” Amazon Transcribe Automatic speech recognition service Amazon Transcribe
  58. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Transcribe – use cases Call centers Subtitles for VOD Broadcast closed captions Transcribe meetings
  59. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. AWS Lambda Amazon S3 Amazon Athena Audio Input Amazon QuickSight Amazon Comprehend Amazon Transcribe – media workloads
  60. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. ringDNA • End-to-end communications platform for sales teams. • Hundreds of enterprise organizations use RingDNA to dramatically increase productivity, engage in smarter sales conversations, gain predictive sales insights and improve their win rate. Speech to Text "A critical component of RingDNA’s Conversation AI requires best of breed speech-to-text to deliver transcriptions of every phone call. RingDNA is excited about Amazon Transcribe since it provides high-quality speech recognition at scale, helping us to better transcribe every call to text " Howard Brown, CEO & Founder, RingDNA https://www.youtube.com/watch?v=1ZJ_f1bDdog
  61. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. “Hello, what’s up? Do you want to go see a movie tonight?” Amazon Translate Natural and fluent language translation "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?" Amazon Translate
  62. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Translate – supported languages * Arabic Simplified Chinese French German Spanish Portuguese Japanese Traditional Chinese Italian Russian Turkish Czech * Coming soon: Danish, Dutch, Finnish, Swedish, Hebrew, and Polish
  63. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Use for high volume and time-sensitive information Share of worldwide digital content Machine translation • User-authored content • Text Analytics • Real-time communication • Content discovery Post-edited machine translation • Legal documents • Healthcare documents • Advertising materials
  64. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Hotels.com «We operate 90 localized websites in 41 languages. (…) Having evaluated Amazon Translate and several other solutions, we believe that Amazon Translate presents a quick, efficient and most importantly, accurate solution. » Matt Fryer, VP and Chief Data Science Officer, Hotels.com
  65. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Who is Running ML on AWS Today?
  66. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. < demo time >
  67. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. There’s Never Been A Better Time To Build New Businesses
  68. aws.amazon.com/education * Programs for Teachers, Entrepreneurs, and Researchers *

  69. aws.amazon.com/activate * Programs for Startups, including credits, training, and support

    *
  70. © 2018, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Alex Casalboni Technical Evangelist, AWS Thank you! @alex_casalboni @ 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved