Overview of AWS AI/ML Services

Presented at the AWS community event in Vietnam on April 12th.

💥 AI/ML has always been a hot name in the Industry 4.0. In order to provide better products and services, engineers have to research and develop constantly to keep pace with the innovation in the digital age.

💥 AI / ML Startups Stories will be an open forum for Startups, individuals who have been orienting towards AI / ML to share their experiences, difficulties and by their own stories, create inspiration as well as the motivation for Startups and engineers to develop their products and services.

💥 From the point of view of experts from the country always at the forefront of global technology, Japan, the event will give people the best overview of the picture AI / Ml in every industry. And more specifically, you can listen to sharings by experiencers nowhere to be found.

Transcript

1. Quick overview of
   AWS AI/ML services
   Shoko Utsunomiya, Ph.D
   AWS Machine Learning Solutions Architect
   

   View Slide

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
   About me
   Shoko Utsunomiya, Ph.D
   • Machine Learning Solutions Architect
   • Providing solutions of ML on AWS
   • My favorite AWS service
   • Amazon SageMaker
   • Worked for Automotive OEM as engineer of Autonomous
   driving system
   • Associate Professor of National Institute of Informatics (2013-
   2017)
   

   View Slide

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
   Machine Learning at Amazon: A long heritage
   Personalized
   Recommendations
   Fulfillment automation
   & Inventory Management
   Drones Voice driven
   Interactions
   Inventing entirely new
   Customer experiences
   

   View Slide

4. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
   "*.-VTF DBTFJOWBSJPVTJOEVTUSJFT
   • $POUFOUTHFOFSBUJPO
   • 1SPNPUJPONBSLFUJOH
   • $PQZSJHIUJOGSJOHFNFOU
   JOTQFDUJPO
   • "VUPUBHHJOHPG
   DPOUFOUT
   • "VUPNBUJDDBQUJPO
   DSFBUJPO
   • 'BJMVSFEFUFDUJPOPG
   QSPEVDUJPOMJOF
   • 7JTVBMJOTQFDUJPOPG
   GJOJTIFEQSPEVDUT
   • *NQSPWFDVTUPNFS
   TFSWJDFUISPVHIWPJDF
   TFSWJDFBOEDIBUCPU
   • $BMMDFOUFS
   PQUJNJ[BUJPO
   • 4FMGESJWJOHUFDIOJRVF
   • &DPNNFSDF
   • 1SPEVDU
   SFDPNNFOEBUJPO
   • 1FSTPOBMJ[F
   • $SFEJUFWBMVBUJPO
   • "EWFSUJTJOH
   NBSLFUJOH
   • 6OBUUFOEFETUPSF
   • 1BUJFOUTIFBMUI
   DPOEJUJPOCBTFE
   PODMJOJDBMEBUB
   • 1SFEJDUIPTQJUBM
   TUBZBOESF
   IPTQJUBMJ[BUJPO
   • %SVHEJTDPWFSZ
   • .FEJDBMJNBHJOH
   EJBHOPTJT
   • &BSMZEJBHOPTJT
   • &YBNJOBUJPO
   • 'SBVEEFUFDUJPO
   • .BSLFUJOH'VUVSF
   'PSFDBTU
   • *OWFTUNFOUQPSUGPMJP
   NBOBHFNFOU
   • /FXT"OBMZTJT
   • (FPTQBUJBMJNBHFBOBMZTJT
   • $IBUCPUQFSTPOBMBEWJTPS
   .FEJB
   FOUFSUBJONFOU
   %JTUSJCVUJPO
   3FUBJM
   )FBMUIDBSF
   -JGFTDJFODF
   'JOBODF
   4FSWJDF USBOTBDUJPO
   .BOVGBDUVSF
   "VUPNPUJWF
   

   View Slide

5. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
   Tens of thousands of customers running Machine Learning on AWS
   

   View Slide

6. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
   5 merits for Machine Learning on AWS
   Use as much CPU / GPU as
   needed when needed
   System extensibility
   Improved agility for model
   building and service
   deployment
   Pay-as-you-go
   Cost optimization
   A lot of AWS
   Service / function
   Deploy worldwide
   instantly
   

   View Slide

7. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
   Continuous ML development
   %BUB
   BDRVJTJUJPO
   Pre-
   processing
   Model
   development
   Model
   evaluation
   Model
   translation
   Deployment
   Monitoring,
   evaluation
   

   View Slide

8. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
   Continuous ML development
   %BUB
   BDRVJTJUJPO
   Pre-
   processing
   Model
   development
   Model
   evaluation
   Model
   translation
   Deployment
   Monitoring,
   evaluation
   Very important to run this cycle
   at high speed to improve your AI...
   

   View Slide

9. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
   AWS Machine Learning Stack
   App developers with
   little knowledge of ML
   ML developers and
   data scientists
   ML researchers and
   academics
   Amazon
   SageMaker Ground Truth
   Algorithms
   Notebooks
   Marketplace
   Unsupervised
   Learning
   Supervised
   Learning
   Reinforcement
   Learning
   Optimization
   (Neo)
   Training
   Hosting
   Deployment
   Frameworks Interfaces Infrastructure
   Amazon
   Rekognition
   Image
   Amazon
   Polly
   Amazon
   Transcribe
   Amazon
   Translate
   Amazon
   Comprehend
   Comprehend medical
   Amazon
   Lex
   Amazon
   Rekognition
   Video
   Vision Speech Language Chatbots
   Amazon
   Forecast
   Forecasting
   Amazon
   Textract
   Amazon
   Personalize
   Recomme
   ndations
   Amazon
   EC2 P3
   & P3DN
   Amazon
   EC2 C5
   FPGAs AWS
   Greengrass
   Amazon
   Elastic
   Inference
   Amazon
   Inferentia
   Labeling Model development Training Hosting
   ML SERVICES
   ML FRAMEWORKS &
   INFRASTRUCTURE
   AI SERVICES
   New
   New
   New
   New
   New
   New
   New
   New
   New New
   New
   

   View Slide

10. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    AWS Machine Learning Stack
    App developers with
    little knowledge of ML
    Amazon
    Rekognition
    Image
    Amazon
    Polly
    Amazon
    Transcribe
    Amazon
    Translate
    Amazon
    Comprehend
    Comprehend medical
    Amazon
    Lex
    Amazon
    Rekognition
    Video
    Vision Speech Language Chatbots
    Amazon
    Forecast
    Forecasting
    Amazon
    Textract
    Amazon
    Personalize
    Recomme
    ndations
    AI SERVICES
    New
    New
    New
    New
    Time series analysis
    Forecast
    Recommendation
    Personalize
    

    View Slide

11. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    AWS Machine Learning Stack
    ML developers and
    data scientists
    ML researchers and
    academics
    Amazon
    SageMaker Ground Truth
    Algorithms
    Notebooks
    Marketplace
    Unsupervised
    Learning
    Supervised
    Learning
    Reinforcement
    Learning
    Optimization
    (Neo)
    Training
    Hosting
    Deployment
    Frameworks Interfaces Infrastructure
    Amazon
    EC2 P3
    & P3DN
    Amazon
    EC2 C5
    FPGAs AWS
    Greengrass
    Amazon
    Elastic
    Inference
    Amazon
    Inferentia
    Labeling Model development Training Hosting
    ML SERVICES
    ML FRAMEWORKS &
    INFRASTRUCTURE
    New
    New
    New
    New
    New
    New
    New
    

    View Slide

12. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    “Undifferentiated Heavy Lifting” in Machine Learning
    &OWJSPONFOU
    • &TUJNBUFESFTPVSDFTOFFEFEBOEEFDJTJPOUPCVZ
    • *UUBLFTUJNFBOEFGGPSUUPQSPDVSFJOUIFGJSTUQMBDF
    • %FWFMPQNFOUUFBNOFFETBVOJGPSNEFWFMPQNFOUFOWJSPONFOUNBOZUJNFT
    • 'SBNFXPSLJOTUBMMBUJPO WFSTJPODPOUSPM
    $POTUSVDUJPOBOEMFBSOJOHPGNBDIJOFMFBSOJOHNPEFM
    • 6OFWFOIBSEXBSFFOWJSPONFOUTVDIBT$16(16
    • 4DBMBCMF3FTPVSDFTBOE%JTUSJCVUFE$PNNVOJDBUJPO&OWJSPONFOUGPS%JTUSJCVUFE
    -FBSOJOH
    0QFSBUJPO
    • *OGFSFODFFOWJSPONFOUQSFQBSBUJPOBOENPEFMIPTUJOH
    • "EJGGFSFOUTLJMMTFUUIBONBDIJOFMFBSOJOHJTSFRVJSFE
    Photo by Victor Freitas on Unsplash
    

    View Slide

13. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker
    1
    2
    3
    

    View Slide

14. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    1
    2
    3
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale
    

    View Slide

15. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker Ground Truth
    Build highly accurate training datasets and reduce data labeling costs
    by up to 70% using machine learning
    

    View Slide

16. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Successful models require high-quality data
    

    View Slide

17. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker Ground Truth demo
    

    View Slide

18. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale
    

    View Slide

19. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    - - - -
    . / . . - - .-
    . / . - . /
    - / / - . .. /
    / . / / . / .
    - - -
    ) - -
    ( -
    

    View Slide

20. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Model name Supervised? Algorithm description Descriptions
    Linear Learner Supervised Linear regression regression, classification
    XGBoost Supervised XGBoost
    (eXtreme Gradient Boosting)
    regression, classification
    PCA Unsupervised Principal Component Analysis Dimensions reduction
    k-means Unsupervised K-means Clustering
    k-NN Supervised K-nearest neighbour Clustering
    Factorization Machines Supervised Matrix factorization Recommend, regression,
    classification
    Random Cut Forest Unsupervised robust random cut tree Anomaly detection in time
    series
    LDA (Latent Dirichlet
    Allocation)
    Supervised Generative statistical
    model
    Topic modeling
    _.BDIJOFMFBSOJOHBMHPSJUINT_
    SageMaker built-in algorithms
    ˟ -%"ךؔٔآشٕכ侄䌌ז׃
    https://docs.aws.amazon.com/sagemaker/latest/dg/algos.html
    

    View Slide

21. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Field Model Supervised algorithms descriptions
    Image
    Processing
    Image classification supervised ResNet Image classification
    Object Detection supervised SSD (Single Shot multibox
    Detector)
    Detect multiple images with
    labeled bounding box
    Semantic
    Segmentation
    supervised FCN, PSP, DeepLabV3
    (ResNet50, ResNet101)
    Detection of object region in
    image in pixel unit
    NLP seq2seq supervised Deep LSTM Text summaryvoice
    recognition
    Neural Topic Model unsupervised NTM, LDA Structuring text data
    Blazing text unsupervised Word2Vec Sentiment analysis
    supervised Text Classification Text mining
    Object2Vec supervised Genelized Word2Vec Classification,
    recommendation
    5JNFTFSJFT DeepAR
    Forecasting
    supervised Autoregressive RNN Stochastic time series
    forecasting
    "OPNBMZ
    EFUFDUJPO
    IP Insights unsupervised NN Detection of malicious IP
    address
    _%FFQMFBSOJOHNPEFMT_
    SageMaker build-in algorithms
    https://docs.aws.amazon.com/sagemaker/latest/dg/algos.html
    

    View Slide

22. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    AWS Marketplace for Machine Learning
    ML algorithms and models available instantly
    Subscribe in a
    single click
    Available in
    Amazon SageMaker
    K E Y F E A T U R E S
    Automatic labeling via machine learning
    IP protection
    Automated billing and metering
    Browse or search
    AWS Marketplace
    S E L L E R S
    Broad selection of paid, free, and
    open-source algorithms and models
    Data protection
    Discoverable on your AWS bill
    B U Y E R S
    

    View Slide

23. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    • More than 200 algorithms for
    retail, media, etc. are available
    on AWS Marketplace for ML
    Algorithm Purchaser:
    • Training job and inference
    endpoint (also batch inference
    job ok) with Amazon SageMaker
    Algorithm Exhibitor:
    • Upload the model by concealing
    the contents of the model
    AWS Marketplace for Machine Learning
    

    View Slide

24. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale
    

    View Slide

25. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale
    

    View Slide

26. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale
    

    View Slide

27. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    New machine learning capabilities in Amazon SageMaker to
    build, train and deploy with reinforcement learning
    

    View Slide

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Supervised
    Learning
    (ASR, computer vision)
    Unsupervised
    Learning
    (Anomaly detection,
    identifying text topics)
    Introducing Reinforcement Learning
    Reinforcement
    Learning (RL)
    

    View Slide

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Reinforcement learning
    Achieve outcomes, not decisions
    Robotics Industrial controls Natural language
    systems
    Games
    

    View Slide

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    How does RL work?
    

    View Slide

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker Reinforcement Learning
    • 3-PO4BHF.BLFSJOUFHSBUFEXJUITJNVMBUJPOFOWJSPONFOUPGHBNJOHBOESPCPUJDT
    • 4VQQPSUT$PBDIBOE3-3BZBTSFJOGPSDFNFOUMFBSOJOHUPPMLJU
    • "843PCP.BLFS 3PCPTDIPPM FUDBWBJMBCMFWJB04"T0QFO"* (ZNJOUFSGBDF
    • %JTUSJCVUFEMFBSOJOHFOWJSPONFOU EJTUSJCVUJPOPGUSBJOJOHBOEFOWTJNVMBUJPO
    
    Container for
    Agent
    Container for
    Agent
    Container for
    environment
    Container for
    environment
    &OWJSPONFOU
    TJNVMBUPS
    RoboMaker, …
    OpenAI gym
    "HFOU
    RL tool kit
    Coach, RLLib
    Redis
    Action by policy
    Observation, reward
    Train policy
    

    View Slide

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    SageMaker Reinforcement configuration ~ DeepRacer with RoboMaker ~
    0CKFDUJWFGVODUJPO4FMGESJWJOHBDDPSEJOH
    UPMBOFDFOUFS
    &OWJSPONFOU%ESJWJOHTJNVMBUPSIPTUFE
    BU"843PCP.BLFS
    4UBUF107JNBHFTPGESJWFSTFOUUISPVHI
    DBNFSBPODBS
    "DUJPOTEJGGFSFOUTUFFSJOHBOETQFFE
    DPOGJHVSBCMF
    3FXBSEQMVTXIFODPNFDMPTFSUP
    DFOUFSMBSHFQFOBMUZJNQPTFECZHFUUJOHPVUPGUIF
    USBDL1PTTJCMFUPTFUEFUBJMTTVDIBTBEEJOHB
    TUFFSJOHQFOBMUZ
    

    View Slide

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    "84%FFQ3BDFS
    :PVDBOGJOEJO"NB[PODPN BU
    4QFDJGJDBUJPO
    • TDBMFSBEJPDPOUSPMDBS
    • *OUFM"UPNQSPDFTTPS
    • .QJYFM QDBNFSB
    • 8J'J BD
    
    • #BUUFSZGPSDPNQVUF I
    BOE
    GPSNPUPS N
    
    • 6CVOUV-54 304 3PCPU
    0QFSBUJOH4ZTUFN
    0QFO7JOP
    https://aws.amazon.com/deepracer/
    

    View Slide

34. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale
    

    View Slide

35. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    •
    •
    •
    •
    •
    • ,
    

    View Slide