Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Amazon AI for Developers, presented by Julien S...

Amazon AI for Developers, presented by Julien Simon at AWS Sofia 2018

How to add Artificial Intelligence capabilities to applications, using the Amazon AI service family, and build your own models with Amazon SageMaker

http://aws.techhuddle.com

Avatar for TechHuddle

TechHuddle

April 23, 2018
Tweet

More Decks by TechHuddle

Other Decks in Technology

Transcript

  1. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. AI: State of the Union J u l i e n S i m o n – P r i n c i p a l Ev a n g e l i s t , A I / M L @ j u l s i m o n
  2. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Agenda - An Introduction to AWS - A Quick Look at Big Data on AWS - An Overview of Amazon AI services - End-to-end Machine Learning with Amazon SageMaker - AWS DeepLens All questions welcome at anytime ☺
  3. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Put machine learning in the hands of every developer and data scientist ML @ AWS: Our mission
  4. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Application Services Platform Services Frameworks & Infrastructure API-driven services: Vision & Language Services, Conversational Chatbots AWS ML Stack Deploy machine learning models with high-performance machine learning algorithms, broad framework support, and one-click training, tuning, and inference. Develop sophisticated models with any framework, create managed, auto- scaling clusters of GPUs for large scale training, or run inference on trained models.
  5. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Customers Running ML on AWS Today
  6. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Application Services API-driven services: Vision & Language Services, Conversational Chatbots AWS ML Stack
  7. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Rekognition Deep learning-based visual analysis service
  8. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Rekognition Object and scene detection Facial analysis Face comparison Celebrity recognition Image moderation Deep learning-based visual analysis service
  9. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Object & Scene Detection
  10. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Crowd-Mode Face Detection
  11. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Explicit Nudity Nudity Graphic Male Nudity Graphic Female Nudity Sexual Activity Partial Nudity Suggestive Female Swimwear or Underwear Male Swimwear or Underwear Revealing Clothes Image Moderation
  12. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Rekognition API example aws rekognition detect-labels –-image '{"S3Object":{"Bucket":"adhorn-reko","Name":"horse.jpg"}}' { "Labels": [ { "Confidence": 99.29136657714844, "Name": "Human" }, { "Confidence": 99.29136657714844, "Name": "People" }, { "Confidence": 99.29136657714844, "Name": "Person" }, ……
  13. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Rekognition API example aws rekognition detect-faces --image '{"S3Object":{"Bucket":"adhorn-reko","Name":"horse.jpg"}}' --attributes "ALL” { "FaceDetails": [ { "BoundingBox": { "Width": 0.05462963134050369, "Top": 0.2880098819732666, "Left": 0.4722222089767456, "Height": 0.07292954623699188 }, "Landmarks": [ { "Y": 0.31606796383857727, "X": 0.48852023482322693, "Type": "eyeLeft" ………
  14. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Rekognition Video Deep learning-based visual analysis service (GA)
  15. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Video in. People, activities, and details out. Objects, scenes, and activities Person detection and recognition Person tracking Celebrity recognition Inappropriate content detection Amazon Rekognition Video
  16. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. http://timescapes.org/trailers/
  17. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. http://timescapes.org/trailers/
  18. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Rekognition Video API example aws rekognition start-label-detection --video '{"S3Object":{"Bucket":"adhorn-reko","Name":"bourne.mp4"}}’ { "JobId": "a89eeae89ec38d8579a3a0bfc2bbf522ea5a939cdf751df4b3872d04e8394496” } aws rekognition get-label-detection --jobId "a89eeae89ec38d8579a3a0bfc2bbf522ea5a939cdf751df4b3872d04e8394496”
  19. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Launch customers https://aws.amazon.com/rekognition/customers/
  20. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Polly Deep learning-based Text-to-Speech service
  21. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Polly “Hejsan! Jag heter Astrid och läser upp det som skrivs här.” Amazon Polly: Text In, Life-like Speech Out
  22. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. <speak xml:lang="en-US"> The price of this book is <prosody rate="60%">€45</prosody> </speak> A Focus On Voice Quality & Pronunciation Support for Speech Synthesis Markup Language (SSML) Version 1.0 https://www.w3.org/TR/speech-synthesis
  23. Polly API example aws polly synthesize-speech --text "It was nice

    to live such a wonderful live show" --output-format mp3 --voice-id Joanna --text-type text johanna.mp3 aws polly synthesize-speech --text-type ssml --text file://ssml_polly --output-format mp3 --voice-id Joanna speech.mp3
  24. “With Amazon Polly our users benefit from the most lifelike

    Text-to-Speech voices available on the market.” Severin Hacker CTO, Duolingo
  25. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Translate Neural Machine Translation Service (Preview Today)
  26. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. “Hello, what’s up? Do you want to go see a movie tonight?” Amazon Translate Natural and fluent language translation "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?" Amazon Translate
  27. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Automatically translates text between languages Real-time translation Powered by deep learning 12 Language pairs (more to come) Language detection
  28. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Translate API example aws translate translate-text --endpoint-url https://translate.us-east-1.amazonaws.com --region us-east-1 --text "hello, what’s up? Do you want to go see a movie tonight?" --source-language-code "en" --target-language-code "fr” { "TargetLanguageCode": "fr”, "TranslatedText": "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?”, "SourceLanguageCode": "en” }
  29. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Translate API example aws translate translate-text --endpoint-url https://translate.us-east-1.amazonaws.com --region us-east-1 --text "hello, what’s up? Do you want to go see a movie tonight?" --source-language-code "en" --target-language-code "fr” { "TargetLanguageCode": "fr”, "TranslatedText": "Bonjour, quoi de neuf ? Tu veux aller voir un film ce soir ?”, "SourceLanguageCode": "en” } Context Awareness
  30. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. DEMO – Translation service
  31. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon Transcribe Automatic speech recognition service (Preview Today)
  32. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Available in preview today Support for telephony audio Timestamp generation Intelligent punctuation and formatting Recognize multiple speakers Custom vocabulary Multiple languages Automatic speech recognition service
  33. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Launch customers End-to-end communications platform for sales teams. Analyze and monitor the media coverage for brands. https://aws.amazon.com/transcribe/customers/
  34. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Comprehend Natural Language Processing (GA)
  35. Fully managed natural language processing Discover valuable insights from text

    Entities Key Phrases Language Sentiment Amazon Comprehend
  36. Support for large data sets and topic modeling STORM WORLD

    SERIES STOCK MARKET WASHINGTON LIBRARY OF NEWS ARTICLES * Amazon Comprehend * Integrated with Amazon S3 and AWS Glue
  37. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Comprehend API example aws comprehend detect-sentiment --text "I love you" --language-code "en” { "SentimentScore": { "Mixed": 0.005664939060807228, "Positive": 0.9262985587120056, "Neutral": 0.06511948257684708, "Negative": 0.0029170133639127016 }, "Sentiment": "POSITIVE” }
  38. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Lex Conversational Interfaces
  39. Intents A particular goal that the user wants to achieve

    Utterances Spoken or typed phrases that invoke your intent Slots Data the user must provide to fulfill the intent Prompts Questions that ask the user to input data Fulfillment The business logic required to fulfill the user’s intent BookHotel
  40. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Lex Bots Salesforce Microsoft Dynamics Marketo Zendesk Web Devices Apps Facebook Messenger, Slack, Amazon Connect Mobile Mobile Hub integration Quickbooks Amazon Lex: Conversational Chatbots
  41. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Platform Services AWS ML Stack Deploy machine learning models with high-performance machine learning algorithms, broad framework support, and one-click training, tuning, and inference.
  42. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EMR Easily Run and Scale Apache Hadoop, Spark, HBase, Presto, Hive, and other Big Data Frameworks
  43. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. ML Applications on Amazon EMR Amazon EMR (Elastic MapReduce)
  44. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon SageMaker A fully managed service to quickly and easily build machine-learning based models (GA)
  45. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. End-to-End Machine Learning Platform Zero setup Flexible Model Training Pay by the second $ Amazon SageMaker Build, train, and deploy machine learning models at scale
  46. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Highly-optimized machine learning algorithms Build Pre-built notebook instances Amazon SageMaker
  47. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Highly-optimized machine learning algorithms One-click training for ML, DL, and custom algorithms Build Pre-built notebook instances Easier training with hyperparameter optimization Train Amazon SageMaker
  48. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. One-click training for ML, DL, and custom algorithms Easier training with hyperparameter optimization Highly-optimized machine learning algorithms Deployment without engineering effort Fully-managed hosting at scale Build Pre-built notebook instances Deploy Train Amazon SageMaker
  49. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Frameworks & Infrastructure AWS ML Stack Develop sophisticated models with any framework, create managed, auto- scaling clusters of GPUs for large scale training, or run inference on trained models.
  50. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon EC2 P3 Instances (October 2017) • Up to eight NVIDIA Tesla V100 GPUs • 1 PetaFLOPs of computational performance – 14x better than P2 • 300 GB/s GPU-to-GPU communication (NVLink) – 9X better than P2 • 16GB GPU memory with 900 GB/sec peak GPU memory bandwidth T h e f a s t e s t , m o s t p o w e r f u l G P U i n s t a n c e s i n t h e c l o u d
  51. AWS Deep Learning AMI • Easy-to-launch tutorials • Hassle-free setup

    and configuration • Pay only for what you use • Accelerate your model training and deployment • Support for popular deep learning frameworks
  52. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. AWS DeepLens Deep learning enabled video camera for developers (Pre-order Today)
  53. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. A new way to learn Custom built for deep learning Broad Framework Support Deploy models from Amazon SageMaker Integrated with AWS Full programmable with AWS Lambda AWS DeepLens Wo r l d ’s f i r s t d e e p l e a r n i n g e n a b l e d v i d e o c a m e r a f o r d e v e l o p e r s
  54. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. 10 minutes to your first deep learning project 1 Choose your deep learning model from the AWS DeepLens pre-trained model library, or your own models trained with Amazon SageMaker. 2 Deploy your model to the device with a single click. 3 Watch the results in real time in the AWS Management Console .
  55. Model Training Inference in the Cloud Inference at the Edge

    Infrastructure to support model build and deploy
  56. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon ML Lab Provides the missing ML expertise
  57. © 2017, Amazon Web Services, Inc. or its Affiliates. All

    rights reserved. Amazon ML Lab Lots of companies doing Machine Learning Unable to unlock business potential Brainstorming Modeling Teaching Lack ML expertise Leverage Amazon experts with decades of ML experience with technologies like Amazon Echo, Amazon Alexa, Prime Air and Amazon Go Amazon ML Lab provides the missing ML expertise
  58. FRAMEWORKS AND INTERFACES PLATFORM SERVICES APPLICATION SERVICES Amazon Rekognition Amazon

    Polly Amazon Lex Democratization of AI Amazon Rekognition Video Amazon Transcribe Amazon Comprehend Amazon SageMaker AWS DeepLens Amazon EMR Deep Learning AMI Amazon Translate