Upgrade to Pro — share decks privately, control downloads, hide ads and more …

DeepRacer DeepDive

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for jogannaoki jogannaoki
December 05, 2018
1k
0

DeepRacer DeepDive

Avatar for jogannaoki

jogannaoki

December 05, 2018

More Decks by jogannaoki

See All by jogannaoki
エンジニアの越境
Avatar for jogannaoki jogannaoki
0
6.1k
[re:Growth 2019] Fargate for EKS
Avatar for jogannaoki jogannaoki
0
1.2k
Kubernetesを使うことによるメリットと注意点
Avatar for jogannaoki jogannaoki
0
2.2k
Developers.IO 2018 BaaSでゲームインフラをスピード構築
Avatar for jogannaoki jogannaoki
1
950

Featured

See All Featured
The Power of CSS Pseudo Elements
Avatar for Geoffrey Crofte geoffreycrofte
82
6.3k
Tips & Tricks on How to Get Your First Job In Tech
Avatar for Honza Javorek honzajavorek
1
530
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
2
850
Lightning talk: Run Django tests with GitHub Actions
Avatar for Sarah Abderemane sabderemane
0
200
The Language of Interfaces
Avatar for Des Traynor destraynor
162
27k
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
3
400
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
211
24k
技術選定の審美眼（2025年版） / Understanding the Spiral of Technologies 2025 edition
Avatar for Takuto Wada twada
PRO
118
120k
Music & Morning Musume
Avatar for Bryan Veloso bryan
47
7.2k
Applied NLP in the Age of Generative AI
Avatar for Ines Montani inesmontani
PRO
4
2.3k
Collaborative Software Design: How to facilitate domain modelling decisions
Avatar for Kenny Baas-Schwegler baasie
1
240
A Soul's Torment
Avatar for Nat Ma seathinner
6
2.9k

Transcript

  1. Naoki Jogan 1 Classmethod, Inc. AWS Business Unit Consulting Dev.

    2018/12/5 %FFQ3BDFS%FFQ %JWF re:Growth 2018

  2. ࣗݾ঺հ  • ιϦϡʔγϣϯΞʔΩςΫτ • ೥݄ೖࣾ —೥ؒ4*FSͰ"1ΤϯδχΞ • ࠷ۙ͞Θ͍ͬͯΔαʔϏε —&,4

    4VNFSJBO ৓؛௚رʢδϣ΢ΨϯφΦΩʣ "84ࣄۀຊ෦ίϯαϧςΟϯά෦

  3. re:Invent 2018 KeyNote 

  4. ࠓ೔࿩͢͜ͱ  w%FFQ3BDFSͰԿ͕Ͱ͖Δͷ͔ɹʙNJO w%FFQ3BDFSΛͲ͏΍ͬͯಈ͔͢ͷ͔ɹʙNJO w%FFQ3BDFS͸Ͳ͏΍ֶͬͯΜͰ͍Δͷ͔ɹʙNJO

  5. %FFQ3BDFSͰԿ͕Ͱ͖Δͷʁ 5

  6. %FFQ3BDFSͰԿ͕Ͱ͖Δͷʁ  ڧԽֶशΛֶ΂Δ

  7. %FFQ3BDFS஀ੜͷഎܠ  How can we put Reinforcement Learning in the

    hands of all developers?

  8. %FFQ3BDFS͸ڧԽֶशΛֶͿͨΊͷखஈ  wڧԽֶशΛ։ൃऀͷखʹ౉͢ ΤΩαΠςΟϯάͳखஈ wڧԽֶशͷϋϯζΦϯΛఏڙ

  9.  ڧԽֶशͱ͸ʁ

  10. ػցֶशͷछྨ  UCL Course on RL Lecture 1: ntroduction to

    Reinforcement Learning wڭࢣ͋Γֶश wڭࢣͳֶ͠श wڧԽֶशʢ%FFQ3BDFSʣ

  11. ࣗಈӡస 

  12. ғޟকع 

  13.  ڧԽֶशͬͯͲ͏΍Δͷʁ

  14. ڧԽֶशʢྫʣ  ใु RLΞϧΰϦζϜ wΤαΛͨ͘͞Μ৯΂ͯ wఢ͕͍ͳ͍ͱ͜ΖʹਐΜͰ wγϛϡϨʔγϣϯ wใुΛ࠷େԽ

  15. %FFQ3BDFSΛಈ͔ͯ͠ΈΔ 15

  16. %FFQ3BDFSΛಈ͔͢·Ͱ  wεςοϓ̍ɿ3FXBSEؔ਺࡞੒ wεςοϓ̎ɿγϛϡϨʔγϣϯ wεςοϓ̏ɿ෺ཧͰ૸ΒͤΔ

  17. %FFQ3BDFSΛಈ͔͢·Ͱ  wεςοϓ̍ɿ3FXBSEؔ਺࡞੒ wεςοϓ̎ɿγϛϡϨʔγϣϯ wεςοϓ̏ɿ෺ཧͰ૸ΒͤΔ

  18. εςοϓ̍ɿ3FXBSEؔ਺  ใुؔ਺ʢPythonʣ ɾEJTUBODF@GSPN@DFOUFS ɹηϯλʔϥΠϯ͔Βͷڑ཭ ɾPO@USBDL ɹं྆ͷલ෦͕നઢͷ֎ଆʹ͋Δ͔Ͳ͏͔ ɾUISPUUMF ɹंͷ଎౓ɹ͸ఀࢭΛࣔ͠ɺ͸࠷ߴ଎౓ ɾUSBDL@XJEUI

    ɹτϥοΫ෯ ɹ ɹͳͲͳͲ Πϯϓοτ Ξ΢τϓοτ

  19. εςοϓ̍ɿ3FXBSEؔ਺  NBSLFS@ USBDL@XJEUI NBSLFS@ USBDL@XJEUI NBSLFS@ USBDL@XJEUI SFXBSEF JGEJTUBODF@GSPN@DFOUFSBOEEJTUBODF@GSPN@DFOUFSNBSLFS@

    SFXBSE FMJGEJTUBODF@GSPN@DFOUFSNBSLFS@ SFXBSE FMJGEJTUBODF@GSPN@DFOUFSNBSLFS@ SFXBSE FMTF SFXBSEFMJLFMZDSBTIFEDMPTFUPPGGUSBDL

  20. %FFQ3BDFSΛಈ͔͢·Ͱ  wεςοϓ̍ɿ3FXBSEؔ਺࡞੒ wεςοϓ̎ɿγϛϡϨʔγϣϯ wεςοϓ̏ɿ෺ཧͰ૸ΒͤΔ

  21. εςοϓ̎ɿϞσϧ࡞੒ 

  22. εςοϓ̎ɿϞσϧ࡞੒ 

  23. %FFQ3BDFSΛಈ͔͢·Ͱ  wεςοϓ̍ɿ3FXBSEؔ਺࡞੒ wεςοϓ̎ɿγϛϡϨʔγϣϯ wεςοϓ̏ɿ෺ཧͰ૸ΒͤΔ

  24. εςοϓ̏ɿ෺ཧͰ૸ΒͤΔ  ֶशϞσϧ

  25. εςοϓ̏ɿ෺ཧͰ૸ΒͤΔ 

  26. "84্ͷΞʔΩςΫνϟ  SageMaker RoboMaker S3 kinesis video streams CloudWatch Logs

    Client

  27. %FFQ3BDFS͸Ͳ͏΍ֶͬͯΜͰ͍Δͷ͔ 27

  28. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  https://www.slideshare.net/AmazonWebServices/robocar-rally-2018-aim206r20-aws-reinvent-2018 ɾ45"5&ɿঢ়ଶ ɹ%FFQ3BDFSͷϑϩϯτΧϝϥ ɾ3&8"3%ɿใु ɹηϯλʔϥΠϯʹ͚ۙΕ͹(PPE ɹεϐʔυ͕ग़͍ͯΕ͹(PPE ɾ"$5*0/ɿߦಈ ɹεϐʔυΛ্͛Δ

    ɹӈʹۂ͕Δɺࠨʹۂ͕Δ

  29. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ t=0 S0

  30. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ t=0 S0

  31. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  t=1 S "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ 1

  32. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  t=1 S "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ R

    :ಓ֎ΕͨͷͰใुͳ͠ 1

  33. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ t=0 S0

  34. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ t=0 S0

  35. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  t=1 S "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ 1

  36. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  t=1 S "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ R

    :ঢ়گʹԠͨ͡ใु 1

  37. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  https://www.slideshare.net/AmazonWebServices/robocar-rally-2018-aim206r20-aws-reinvent-2018

  38. ·ͱΊ 38

  39. ·ͱΊ  w%FFQ3BDFS͸ڧԽֶशΛֶͿͨΊͷखஈ w%FFQ3BDFS͸ڧԽֶशͱ͔ؔ܎ͳ͘୯७ʹָ͍͠ wϨʔεେձ΋͋ΔͷͰΈΜͳࢀՃ͠Α͏ʂʂΞϝϦΧͰʁ

  40. 40 ԶͰڧԽֶशΛ ֶΜͰ͘Εʂʂ ࠓͳΒˈ249

  41.  Let's start reinforcement learning with DeepRacer

  42. 42