Overview of AWS AI/ML Services

Presented at the AWS community event in Vietnam on April 12th.

💥 AI/ML has always been a hot name in the Industry 4.0. In order to provide better products and services, engineers have to research and develop constantly to keep pace with the innovation in the digital age.

💥 AI / ML Startups Stories will be an open forum for Startups, individuals who have been orienting towards AI / ML to share their experiences, difficulties and by their own stories, create inspiration as well as the motivation for Startups and engineers to develop their products and services.

💥 From the point of view of experts from the country always at the forefront of global technology, Japan, the event will give people the best overview of the picture AI / Ml in every industry. And more specifically, you can listen to sharings by experiencers nowhere to be found.

Transcript

1. Quick overview of AWS AI/ML services Shoko Utsunomiya, Ph.D AWS Machine Learning Solutions Architect
2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark About me Shoko Utsunomiya, Ph.D • Machine Learning Solutions Architect • Providing solutions of ML on AWS • My favorite AWS service • Amazon SageMaker • Worked for Automotive OEM as engineer of Autonomous driving system • Associate Professor of National Institute of Informatics (2013- 2017)
3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Machine Learning at Amazon: A long heritage Personalized Recommendations Fulfillment automation & Inventory Management Drones Voice driven Interactions Inventing entirely new Customer experiences
4. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark "*.-
   VTF DBTF
   JO
   WBSJPVT
   JOEVTUSJFT • $POUFOUT
   HFOFSBUJPO • 1SPNPUJPONBSLFUJOH • $PQZSJHIU
   JOGSJOHFNFOU
   JOTQFDUJPO • "VUP
   UBHHJOH
   PG
   DPOUFOUT • "VUPNBUJD
   DBQUJPO
   DSFBUJPO • 'BJMVSF
   EFUFDUJPO
   PG
   QSPEVDUJPO
   MJOF • 7JTVBM
   JOTQFDUJPO
   PG
   GJOJTIFE
   QSPEVDUT • *NQSPWF
   DVTUPNFS
   TFSWJDF
   UISPVHI
   WPJDF
   TFSWJDF
   BOE
   DIBU
   CPU • $BMM
   DFOUFS
   PQUJNJ[BUJPO • 4FMGESJWJOH
   UFDIOJRVF • &DPNNFSDF • 1SPEVDU
   SFDPNNFOEBUJPO • 1FSTPOBMJ[F • $SFEJU
   FWBMVBUJPO • "EWFSUJTJOH
   NBSLFUJOH • 6OBUUFOEFE
   TUPSF • 1BUJFOUT
   IFBMUI
   DPOEJUJPO
   CBTFE
   PO
   DMJOJDBM
   EBUB • 1SFEJDU
   IPTQJUBM
   TUBZ
   BOE
   SF IPTQJUBMJ[BUJPO • %SVH
   EJTDPWFSZ • .FEJDBM
   JNBHJOH
   EJBHOPTJT • &BSMZ
   EJBHOPTJT • &YBNJOBUJPO • 'SBVE
   EFUFDUJPO • .BSLFUJOH
   
   'VUVSF
   'PSFDBTU • *OWFTUNFOU
   
   QPSUGPMJP
   NBOBHFNFOU • /FXT
   "OBMZTJT • (FPTQBUJBM
   JNBHF
   BOBMZTJT • $IBUCPU
   QFSTPOBM
   BEWJTPS .FEJB FOUFSUBJONFOU %JTUSJCVUJPO 3FUBJM )FBMUIDBSF -JGF
   TDJFODF 'JOBODF 4FSWJDF
   USBOTBDUJPO .BOVGBDUVSF "VUPNPUJWF
5. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Tens of thousands of customers running Machine Learning on AWS
6. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 5 merits for Machine Learning on AWS Use as much CPU / GPU as needed when needed System extensibility Improved agility for model building and service deployment Pay-as-you-go Cost optimization A lot of AWS Service / function Deploy worldwide instantly
7. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Continuous ML development %BUB
   BDRVJTJUJPO Pre- processing Model development Model evaluation Model translation Deployment Monitoring, evaluation
8. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Continuous ML development %BUB
   BDRVJTJUJPO Pre- processing Model development Model evaluation Model translation Deployment Monitoring, evaluation Very important to run this cycle at high speed to improve your AI...
9. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark AWS Machine Learning Stack App developers with little knowledge of ML ML developers and data scientists ML researchers and academics Amazon SageMaker Ground Truth Algorithms Notebooks Marketplace Unsupervised Learning Supervised Learning Reinforcement Learning Optimization (Neo) Training Hosting Deployment Frameworks Interfaces Infrastructure Amazon Rekognition Image Amazon Polly Amazon Transcribe Amazon Translate Amazon Comprehend Comprehend medical Amazon Lex Amazon Rekognition Video Vision Speech Language Chatbots Amazon Forecast Forecasting Amazon Textract Amazon Personalize Recomme ndations Amazon EC2 P3 & P3DN Amazon EC2 C5 FPGAs AWS Greengrass Amazon Elastic Inference Amazon Inferentia Labeling Model development Training Hosting ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE AI SERVICES New New New New New New New New New New New
10. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark AWS Machine Learning Stack App developers with little knowledge of ML Amazon Rekognition Image Amazon Polly Amazon Transcribe Amazon Translate Amazon Comprehend Comprehend medical Amazon Lex Amazon Rekognition Video Vision Speech Language Chatbots Amazon Forecast Forecasting Amazon Textract Amazon Personalize Recomme ndations AI SERVICES New New New New Time series analysis Forecast Recommendation Personalize
11. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark AWS Machine Learning Stack ML developers and data scientists ML researchers and academics Amazon SageMaker Ground Truth Algorithms Notebooks Marketplace Unsupervised Learning Supervised Learning Reinforcement Learning Optimization (Neo) Training Hosting Deployment Frameworks Interfaces Infrastructure Amazon EC2 P3 & P3DN Amazon EC2 C5 FPGAs AWS Greengrass Amazon Elastic Inference Amazon Inferentia Labeling Model development Training Hosting ML SERVICES ML FRAMEWORKS & INFRASTRUCTURE New New New New New New New
12. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark “Undifferentiated Heavy Lifting” in Machine Learning &OWJSPONFOU • &TUJNBUFE
    SFTPVSDFT
    OFFEFE
    BOE
    EFDJTJPO
    UP
    CVZ • *U
    UBLFT
    UJNF
    BOE
    FGGPSU
    UP
    QSPDVSF
    JO
    UIF
    GJSTU
    QMBDF • %FWFMPQNFOU
    UFBN
    OFFET
    B
    VOJGPSN
    EFWFMPQNFOU
    FOWJSPONFOU
    NBOZ
    UJNFT • 'SBNFXPSL
    JOTUBMMBUJPO
    WFSTJPO
    DPOUSPM $POTUSVDUJPO
    BOE
    MFBSOJOH
    PG
    NBDIJOF
    MFBSOJOH
    NPEFM • 6OFWFO
    IBSEXBSF
    FOWJSPONFOU
    TVDI
    BT
    $16
    
    (16 • 4DBMBCMF
    3FTPVSDFT
    BOE
    %JTUSJCVUFE
    $PNNVOJDBUJPO
    &OWJSPONFOU
    GPS
    %JTUSJCVUFE
    -FBSOJOH 0QFSBUJPO • *OGFSFODF
    FOWJSPONFOU
    QSFQBSBUJPO
    BOE
    NPEFM
    IPTUJOH • "
    EJGGFSFOU
    TLJMM
    TFU
    UIBO
    NBDIJOF
    MFBSOJOH
    JT
    SFRVJSFE Photo by Victor Freitas on Unsplash
13. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon SageMaker 1 2 3
14. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark 1 2 3 Amazon SageMaker: Build, Train, and Deploy ML Models at Scale
15. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon SageMaker Ground Truth Build highly accurate training datasets and reduce data labeling costs by up to 70% using machine learning
16. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Successful models require high-quality data
17. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon SageMaker Ground Truth demo
18. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon SageMaker: Build, Train, and Deploy ML Models at Scale
19. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark - - - - . / . . - - .- . / . - . / - / / - . .. / / . / / . / . - - - ) - - ( -
20. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Model name Supervised? Algorithm description Descriptions Linear Learner Supervised Linear regression regression, classification XGBoost Supervised XGBoost (eXtreme Gradient Boosting) regression, classification PCA Unsupervised Principal Component Analysis Dimensions reduction k-means Unsupervised K-means Clustering k-NN Supervised K-nearest neighbour Clustering Factorization Machines Supervised Matrix factorization Recommend, regression, classification Random Cut Forest Unsupervised robust random cut tree Anomaly detection in time series LDA (Latent Dirichlet Allocation) Supervised Generative statistical model Topic modeling _
    .BDIJOF
    MFBSOJOH
    BMHPSJUINT_ SageMaker built-in algorithms ˟ -%"ךؔٔآشٕכ侄䌌ז׃ https://docs.aws.amazon.com/sagemaker/latest/dg/algos.html
21. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Field Model Supervised
    algorithms descriptions Image Processing Image classification supervised ResNet Image classification Object Detection supervised SSD (Single Shot multibox Detector) Detect multiple images with labeled bounding box Semantic Segmentation supervised FCN, PSP, DeepLabV3 (ResNet50, ResNet101) Detection of object region in image in pixel unit NLP seq2seq supervised Deep LSTM Text summary
    voice recognition Neural Topic Model unsupervised NTM, LDA Structuring text data Blazing text unsupervised Word2Vec Sentiment analysis supervised Text Classification Text mining Object2Vec supervised Genelized Word2Vec Classification, recommendation 5JNF
    TFSJFT DeepAR Forecasting supervised Autoregressive RNN Stochastic time series forecasting "OPNBMZ
    EFUFDUJPO IP Insights unsupervised NN Detection of malicious IP address _
    %FFQ
    MFBSOJOH
    NPEFMT
    _ SageMaker build-in algorithms https://docs.aws.amazon.com/sagemaker/latest/dg/algos.html
22. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark AWS Marketplace for Machine Learning ML algorithms and models available instantly Subscribe in a single click Available in Amazon SageMaker K E Y F E A T U R E S Automatic labeling via machine learning IP protection Automated billing and metering Browse or search AWS Marketplace S E L L E R S Broad selection of paid, free, and open-source algorithms and models Data protection Discoverable on your AWS bill B U Y E R S
23. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark • More than 200 algorithms for retail, media, etc. are available on AWS Marketplace for ML Algorithm Purchaser: • Training job and inference endpoint (also batch inference job ok) with Amazon SageMaker Algorithm Exhibitor: • Upload the model by concealing the contents of the model AWS Marketplace for Machine Learning
24. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon SageMaker: Build, Train, and Deploy ML Models at Scale
25. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon SageMaker: Build, Train, and Deploy ML Models at Scale
26. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon SageMaker: Build, Train, and Deploy ML Models at Scale
27. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark New machine learning capabilities in Amazon SageMaker to build, train and deploy with reinforcement learning
28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Supervised Learning (ASR, computer vision) Unsupervised Learning (Anomaly detection, identifying text topics) Introducing Reinforcement Learning Reinforcement Learning (RL)
29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Reinforcement learning Achieve outcomes, not decisions Robotics Industrial controls Natural language systems Games
30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. How does RL work?
31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon SageMaker Reinforcement Learning • 3-
    PO
    4BHF.BLFS
    JOUFHSBUFE
    XJUI
    TJNVMBUJPO
    FOWJSPONFOU
    PG
    HBNJOH
    BOE
    SPCPUJDT • 4VQQPSUT
    $PBDI
    BOE
    3-3BZ
    BT
    SFJOGPSDFNFOU
    MFBSOJOH
    UPPM
    LJU • "84
    3PCP.BLFS
    3PCPTDIPPM FUD
    BWBJMBCMF
    WJB
    04"T
    0QFO"* (ZN
    JOUFSGBDF • %JTUSJCVUFE
    MFBSOJOH
    FOWJSPONFOU
    EJTUSJCVUJPO
    PG
    USBJOJOH
    BOE
    FOW
    TJNVMBUJPO Container for Agent Container for Agent Container for environment Container for environment &OWJSPONFOU
    TJNVMBUPS RoboMaker, … OpenAI gym "HFOU RL tool kit Coach, RLLib Redis Action by policy Observation, reward Train policy
32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark SageMaker Reinforcement configuration ~ DeepRacer with RoboMaker ~  0CKFDUJWF
    GVODUJPO4FMG
    ESJWJOH
    BDDPSEJOH
    UP
    MBOF
    DFOUFS  &OWJSPONFOU%
    ESJWJOH
    TJNVMBUPS
    IPTUFE
    BU
    "84
    3PCP.BLFS  4UBUF107
    JNBHFT
    PG
    ESJWFS
    TFOU
    UISPVHI
    DBNFSB
    PO
    DBS  "DUJPOT
    EJGGFSFOU
    TUFFSJOH
    BOE
    TQFFE DPOGJHVSBCMF  3FXBSE<FYBNQMF>
    QMVT
    XIFO
    DPNF
    DMPTFS
    UP
    DFOUFSMBSHF
    QFOBMUZ
    JNQPTFE
    CZ
    HFUUJOH
    PVU
    PG
    UIF
    USBDL
    
    1PTTJCMF
    UP
    TFU
    EFUBJMT
    TVDI
    BT
    BEEJOH
    B
    TUFFSJOH
    QFOBMUZ
33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark "84
    %FFQ3BDFS :PV
    DBO
    GJOE
    JO
    "NB[PODPN BU
     4QFDJGJDBUJPO • 
    TDBMF
    SBEJP
    DPOUSPM
    DBS • *OUFM
    "UPN
    QSPDFTTPS • .
    QJYFM
    Q
    DBNFSB • 8J'J BD • #BUUFSZ
    GPS
    DPNQVUF I
    BOE GPS
    NPUPS
    N • 6CVOUV
    -54
    304
    3PCPU
    0QFSBUJOH
    4ZTUFN
    0QFO7JOP https://aws.amazon.com/deepracer/
34. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark Amazon SageMaker: Build, Train, and Deploy ML Models at Scale
35. © 2019 Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Confidential and Trademark • • • • • • ,