Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Overview of AWS AI/ML Services

Overview of AWS AI/ML Services

Presented at the AWS community event in Vietnam on April 12th.

💥 AI/ML has always been a hot name in the Industry 4.0. In order to provide better products and services, engineers have to research and develop constantly to keep pace with the innovation in the digital age.

💥 AI / ML Startups Stories will be an open forum for Startups, individuals who have been orienting towards AI / ML to share their experiences, difficulties and by their own stories, create inspiration as well as the motivation for Startups and engineers to develop their products and services.

💥 From the point of view of experts from the country always at the forefront of global technology, Japan, the event will give people the best overview of the picture AI / Ml in every industry. And more specifically, you can listen to sharings by experiencers nowhere to be found.

Shoko Utsunomiya

April 12, 2019
Tweet

More Decks by Shoko Utsunomiya

Other Decks in Technology

Transcript

  1. Quick overview of
    AWS AI/ML services
    Shoko Utsunomiya, Ph.D
    AWS Machine Learning Solutions Architect

    View Slide

  2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    About me
    Shoko Utsunomiya, Ph.D
    • Machine Learning Solutions Architect
    • Providing solutions of ML on AWS
    • My favorite AWS service
    • Amazon SageMaker
    • Worked for Automotive OEM as engineer of Autonomous
    driving system
    • Associate Professor of National Institute of Informatics (2013-
    2017)

    View Slide

  3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Machine Learning at Amazon: A long heritage
    Personalized
    Recommendations
    Fulfillment automation
    & Inventory Management
    Drones Voice driven
    Interactions
    Inventing entirely new
    Customer experiences

    View Slide

  4. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    "*.-VTF DBTFJOWBSJPVTJOEVTUSJFT
    • $POUFOUTHFOFSBUJPO
    • 1SPNPUJPONBSLFUJOH
    • $PQZSJHIUJOGSJOHFNFOU
    JOTQFDUJPO
    • "VUPUBHHJOHPG
    DPOUFOUT
    • "VUPNBUJDDBQUJPO
    DSFBUJPO
    • 'BJMVSFEFUFDUJPOPG
    QSPEVDUJPOMJOF
    • 7JTVBMJOTQFDUJPOPG
    GJOJTIFEQSPEVDUT
    • *NQSPWFDVTUPNFS
    TFSWJDFUISPVHIWPJDF
    TFSWJDFBOEDIBUCPU
    • $BMMDFOUFS
    PQUJNJ[BUJPO
    • 4FMGESJWJOHUFDIOJRVF
    • &DPNNFSDF
    • 1SPEVDU
    SFDPNNFOEBUJPO
    • 1FSTPOBMJ[F
    • $SFEJUFWBMVBUJPO
    • "EWFSUJTJOH
    NBSLFUJOH
    • 6OBUUFOEFETUPSF
    • 1BUJFOUTIFBMUI
    DPOEJUJPOCBTFE
    PODMJOJDBMEBUB
    • 1SFEJDUIPTQJUBM
    TUBZBOESF
    IPTQJUBMJ[BUJPO
    • %SVHEJTDPWFSZ
    • .FEJDBMJNBHJOH
    EJBHOPTJT
    • &BSMZEJBHOPTJT
    • &YBNJOBUJPO
    • 'SBVEEFUFDUJPO
    • .BSLFUJOH'VUVSF
    'PSFDBTU
    • *OWFTUNFOUQPSUGPMJP
    NBOBHFNFOU
    • /FXT"OBMZTJT
    • (FPTQBUJBMJNBHFBOBMZTJT
    • $IBUCPUQFSTPOBMBEWJTPS
    .FEJB
    FOUFSUBJONFOU
    %JTUSJCVUJPO
    3FUBJM
    )FBMUIDBSF
    -JGFTDJFODF
    'JOBODF
    4FSWJDF USBOTBDUJPO
    .BOVGBDUVSF
    "VUPNPUJWF

    View Slide

  5. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Tens of thousands of customers running Machine Learning on AWS

    View Slide

  6. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    5 merits for Machine Learning on AWS
    Use as much CPU / GPU as
    needed when needed
    System extensibility
    Improved agility for model
    building and service
    deployment
    Pay-as-you-go
    Cost optimization
    A lot of AWS
    Service / function
    Deploy worldwide
    instantly

    View Slide

  7. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Continuous ML development
    %BUB
    BDRVJTJUJPO
    Pre-
    processing
    Model
    development
    Model
    evaluation
    Model
    translation
    Deployment
    Monitoring,
    evaluation

    View Slide

  8. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Continuous ML development
    %BUB
    BDRVJTJUJPO
    Pre-
    processing
    Model
    development
    Model
    evaluation
    Model
    translation
    Deployment
    Monitoring,
    evaluation
    Very important to run this cycle
    at high speed to improve your AI...

    View Slide

  9. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    AWS Machine Learning Stack
    App developers with
    little knowledge of ML
    ML developers and
    data scientists
    ML researchers and
    academics
    Amazon
    SageMaker Ground Truth
    Algorithms
    Notebooks
    Marketplace
    Unsupervised
    Learning
    Supervised
    Learning
    Reinforcement
    Learning
    Optimization
    (Neo)
    Training
    Hosting
    Deployment
    Frameworks Interfaces Infrastructure
    Amazon
    Rekognition
    Image
    Amazon
    Polly
    Amazon
    Transcribe
    Amazon
    Translate
    Amazon
    Comprehend
    Comprehend medical
    Amazon
    Lex
    Amazon
    Rekognition
    Video
    Vision Speech Language Chatbots
    Amazon
    Forecast
    Forecasting
    Amazon
    Textract
    Amazon
    Personalize
    Recomme
    ndations
    Amazon
    EC2 P3
    & P3DN
    Amazon
    EC2 C5
    FPGAs AWS
    Greengrass
    Amazon
    Elastic
    Inference
    Amazon
    Inferentia
    Labeling Model development Training Hosting
    ML SERVICES
    ML FRAMEWORKS &
    INFRASTRUCTURE
    AI SERVICES
    New
    New
    New
    New
    New
    New
    New
    New
    New New
    New

    View Slide

  10. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    AWS Machine Learning Stack
    App developers with
    little knowledge of ML
    Amazon
    Rekognition
    Image
    Amazon
    Polly
    Amazon
    Transcribe
    Amazon
    Translate
    Amazon
    Comprehend
    Comprehend medical
    Amazon
    Lex
    Amazon
    Rekognition
    Video
    Vision Speech Language Chatbots
    Amazon
    Forecast
    Forecasting
    Amazon
    Textract
    Amazon
    Personalize
    Recomme
    ndations
    AI SERVICES
    New
    New
    New
    New
    Time series analysis
    Forecast
    Recommendation
    Personalize

    View Slide

  11. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    AWS Machine Learning Stack
    ML developers and
    data scientists
    ML researchers and
    academics
    Amazon
    SageMaker Ground Truth
    Algorithms
    Notebooks
    Marketplace
    Unsupervised
    Learning
    Supervised
    Learning
    Reinforcement
    Learning
    Optimization
    (Neo)
    Training
    Hosting
    Deployment
    Frameworks Interfaces Infrastructure
    Amazon
    EC2 P3
    & P3DN
    Amazon
    EC2 C5
    FPGAs AWS
    Greengrass
    Amazon
    Elastic
    Inference
    Amazon
    Inferentia
    Labeling Model development Training Hosting
    ML SERVICES
    ML FRAMEWORKS &
    INFRASTRUCTURE
    New
    New
    New
    New
    New
    New
    New

    View Slide

  12. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    “Undifferentiated Heavy Lifting” in Machine Learning
    &OWJSPONFOU
    • &TUJNBUFESFTPVSDFTOFFEFEBOEEFDJTJPOUPCVZ
    • *UUBLFTUJNFBOEFGGPSUUPQSPDVSFJOUIFGJSTUQMBDF
    • %FWFMPQNFOUUFBNOFFETBVOJGPSNEFWFMPQNFOUFOWJSPONFOUNBOZUJNFT
    • 'SBNFXPSLJOTUBMMBUJPO WFSTJPODPOUSPM
    $POTUSVDUJPOBOEMFBSOJOHPGNBDIJOFMFBSOJOHNPEFM
    • 6OFWFOIBSEXBSFFOWJSPONFOUTVDIBT$16(16
    • 4DBMBCMF3FTPVSDFTBOE%JTUSJCVUFE$PNNVOJDBUJPO&OWJSPONFOUGPS%JTUSJCVUFE
    -FBSOJOH
    0QFSBUJPO
    • *OGFSFODFFOWJSPONFOUQSFQBSBUJPOBOENPEFMIPTUJOH
    • "EJGGFSFOUTLJMMTFUUIBONBDIJOFMFBSOJOHJTSFRVJSFE
    Photo by Victor Freitas on Unsplash

    View Slide

  13. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker
    1
    2
    3

    View Slide

  14. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    1
    2
    3
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale

    View Slide

  15. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker Ground Truth
    Build highly accurate training datasets and reduce data labeling costs
    by up to 70% using machine learning

    View Slide

  16. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Successful models require high-quality data

    View Slide

  17. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker Ground Truth demo

    View Slide

  18. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale

    View Slide

  19. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    - - - -
    . / . . - - .-
    . / . - . /
    - / / - . .. /
    / . / / . / .
    - - -
    ) - -
    ( -

    View Slide

  20. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Model name Supervised? Algorithm description Descriptions
    Linear Learner Supervised Linear regression regression, classification
    XGBoost Supervised XGBoost
    (eXtreme Gradient Boosting)
    regression, classification
    PCA Unsupervised Principal Component Analysis Dimensions reduction
    k-means Unsupervised K-means Clustering
    k-NN Supervised K-nearest neighbour Clustering
    Factorization Machines Supervised Matrix factorization Recommend, regression,
    classification
    Random Cut Forest Unsupervised robust random cut tree Anomaly detection in time
    series
    LDA (Latent Dirichlet
    Allocation)
    Supervised Generative statistical
    model
    Topic modeling
    _.BDIJOFMFBSOJOHBMHPSJUINT_
    SageMaker built-in algorithms
    ˟ -%"ךؔٔآشٕכ侄䌌ז׃
    https://docs.aws.amazon.com/sagemaker/latest/dg/algos.html

    View Slide

  21. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Field Model Supervised algorithms descriptions
    Image
    Processing
    Image classification supervised ResNet Image classification
    Object Detection supervised SSD (Single Shot multibox
    Detector)
    Detect multiple images with
    labeled bounding box
    Semantic
    Segmentation
    supervised FCN, PSP, DeepLabV3
    (ResNet50, ResNet101)
    Detection of object region in
    image in pixel unit
    NLP seq2seq supervised Deep LSTM Text summaryvoice
    recognition
    Neural Topic Model unsupervised NTM, LDA Structuring text data
    Blazing text unsupervised Word2Vec Sentiment analysis
    supervised Text Classification Text mining
    Object2Vec supervised Genelized Word2Vec Classification,
    recommendation
    5JNFTFSJFT DeepAR
    Forecasting
    supervised Autoregressive RNN Stochastic time series
    forecasting
    "OPNBMZ
    EFUFDUJPO
    IP Insights unsupervised NN Detection of malicious IP
    address
    _%FFQMFBSOJOHNPEFMT_
    SageMaker build-in algorithms
    https://docs.aws.amazon.com/sagemaker/latest/dg/algos.html

    View Slide

  22. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    AWS Marketplace for Machine Learning
    ML algorithms and models available instantly
    Subscribe in a
    single click
    Available in
    Amazon SageMaker
    K E Y F E A T U R E S
    Automatic labeling via machine learning
    IP protection
    Automated billing and metering
    Browse or search
    AWS Marketplace
    S E L L E R S
    Broad selection of paid, free, and
    open-source algorithms and models
    Data protection
    Discoverable on your AWS bill
    B U Y E R S

    View Slide

  23. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    • More than 200 algorithms for
    retail, media, etc. are available
    on AWS Marketplace for ML
    Algorithm Purchaser:
    • Training job and inference
    endpoint (also batch inference
    job ok) with Amazon SageMaker
    Algorithm Exhibitor:
    • Upload the model by concealing
    the contents of the model
    AWS Marketplace for Machine Learning

    View Slide

  24. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale

    View Slide

  25. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale

    View Slide

  26. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale

    View Slide

  27. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    New machine learning capabilities in Amazon SageMaker to
    build, train and deploy with reinforcement learning

    View Slide

  28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Supervised
    Learning
    (ASR, computer vision)
    Unsupervised
    Learning
    (Anomaly detection,
    identifying text topics)
    Introducing Reinforcement Learning
    Reinforcement
    Learning (RL)

    View Slide

  29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    Reinforcement learning
    Achieve outcomes, not decisions
    Robotics Industrial controls Natural language
    systems
    Games

    View Slide

  30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
    How does RL work?

    View Slide

  31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker Reinforcement Learning
    • 3-PO4BHF.BLFSJOUFHSBUFEXJUITJNVMBUJPOFOWJSPONFOUPGHBNJOHBOESPCPUJDT
    • 4VQQPSUT$PBDIBOE3-3BZBTSFJOGPSDFNFOUMFBSOJOHUPPMLJU
    • "843PCP.BLFS 3PCPTDIPPM FUDBWBJMBCMFWJB04"T0QFO"* (ZNJOUFSGBDF
    • %JTUSJCVUFEMFBSOJOHFOWJSPONFOU EJTUSJCVUJPOPGUSBJOJOHBOEFOWTJNVMBUJPO

    Container for
    Agent
    Container for
    Agent
    Container for
    environment
    Container for
    environment
    &OWJSPONFOU
    TJNVMBUPS
    RoboMaker, …
    OpenAI gym
    "HFOU
    RL tool kit
    Coach, RLLib
    Redis
    Action by policy
    Observation, reward
    Train policy

    View Slide

  32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    SageMaker Reinforcement configuration ~ DeepRacer with RoboMaker ~
    0CKFDUJWFGVODUJPO4FMGESJWJOHBDDPSEJOH
    UPMBOFDFOUFS
    &OWJSPONFOU%ESJWJOHTJNVMBUPSIPTUFE
    BU"843PCP.BLFS
    4UBUF107JNBHFTPGESJWFSTFOUUISPVHI
    DBNFSBPODBS
    "DUJPOTEJGGFSFOUTUFFSJOHBOETQFFE
    DPOGJHVSBCMF
    3FXBSEQMVTXIFODPNFDMPTFSUP
    DFOUFSMBSHFQFOBMUZJNQPTFECZHFUUJOHPVUPGUIF
    USBDL1PTTJCMFUPTFUEFUBJMTTVDIBTBEEJOHB
    TUFFSJOHQFOBMUZ

    View Slide

  33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    "84%FFQ3BDFS
    :PVDBOGJOEJO"NB[PODPN BU
    4QFDJGJDBUJPO
    • TDBMFSBEJPDPOUSPMDBS
    • *OUFM"UPNQSPDFTTPS
    • .QJYFM QDBNFSB
    • 8J'J BD

    • #BUUFSZGPSDPNQVUF I
    BOE
    GPSNPUPS N

    • 6CVOUV-54 304 3PCPU
    0QFSBUJOH4ZTUFN
    0QFO7JOP
    https://aws.amazon.com/deepracer/

    View Slide

  34. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark
    Amazon SageMaker:
    Build, Train, and Deploy ML Models at Scale

    View Slide

  35. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark





    • ,

    View Slide