Save 37% off PRO during our Black Friday Sale! »

DeepRacer DeepDive

D63b0683b8fdd02c71c802691f97c04c?s=47 jogannaoki
December 05, 2018
0
400

DeepRacer DeepDive

D63b0683b8fdd02c71c802691f97c04c?s=128

jogannaoki

December 05, 2018
Tweet

More Decks by jogannaoki

See All by jogannaoki
D63b0683b8fdd02c71c802691f97c04c?s=48 jogannaoki
0
1.5k
D63b0683b8fdd02c71c802691f97c04c?s=48 jogannaoki
0
380
D63b0683b8fdd02c71c802691f97c04c?s=48 jogannaoki
0
1.1k
D63b0683b8fdd02c71c802691f97c04c?s=48 jogannaoki
1
600

Featured

See All Featured
7edec06b5435e0dac07a353b2cc26253?s=48 geeforr
337
30k
016edace78ffe826f2348d1e0c504afd?s=48 maggiecrowley
16
960
245cee81a9c424266e5e401d844ea881?s=48 lara
27
3.5k
Ba530e786553390f3fb271848485681c?s=48 3n
169
23k
Aff5641764408271f7bc398f2097edd0?s=48 denniskardys
223
120k
9cde37f47e4a800ea081ea42de8d749a?s=48 dougneiner
123
8.3k
5b9fe87ec1faa67a4599782930f45ec9?s=48 sstephenson
149
12k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
498
130k
9375a9529679f1b42b567a640d775e7d?s=48 schacon
152
6.9k
88f4e84b94fe07cddbd9e6479d689192?s=48 soudai
22
10k
C0b42577cfc2b321be3474618107e933?s=48 samanthasiow
61
6.9k
3d4519fd34b76fb265fc0237f3792bd4?s=48 danielanewman
208
20k

Transcript

  1. Naoki Jogan 1 Classmethod, Inc. AWS Business Unit Consulting Dev.

    2018/12/5 %FFQ3BDFS%FFQ %JWF re:Growth 2018

  2. ࣗݾ঺հ  • ιϦϡʔγϣϯΞʔΩςΫτ • ೥݄ೖࣾ —೥ؒ4*FSͰ"1ΤϯδχΞ • ࠷ۙ͞Θ͍ͬͯΔαʔϏε —&,4

    4VNFSJBO ৓؛௚رʢδϣ΢ΨϯφΦΩʣ "84ࣄۀຊ෦ίϯαϧςΟϯά෦

  3. re:Invent 2018 KeyNote 

  4. ࠓ೔࿩͢͜ͱ  w%FFQ3BDFSͰԿ͕Ͱ͖Δͷ͔ɹʙNJO w%FFQ3BDFSΛͲ͏΍ͬͯಈ͔͢ͷ͔ɹʙNJO w%FFQ3BDFS͸Ͳ͏΍ֶͬͯΜͰ͍Δͷ͔ɹʙNJO

  5. %FFQ3BDFSͰԿ͕Ͱ͖Δͷʁ 5

  6. %FFQ3BDFSͰԿ͕Ͱ͖Δͷʁ  ڧԽֶशΛֶ΂Δ

  7. %FFQ3BDFS஀ੜͷഎܠ  How can we put Reinforcement Learning in the

    hands of all developers?

  8. %FFQ3BDFS͸ڧԽֶशΛֶͿͨΊͷखஈ  wڧԽֶशΛ։ൃऀͷखʹ౉͢ ΤΩαΠςΟϯάͳखஈ wڧԽֶशͷϋϯζΦϯΛఏڙ

  9.  ڧԽֶशͱ͸ʁ

  10. ػցֶशͷछྨ  UCL Course on RL Lecture 1: ntroduction to

    Reinforcement Learning wڭࢣ͋Γֶश wڭࢣͳֶ͠श wڧԽֶशʢ%FFQ3BDFSʣ

  11. ࣗಈӡస 

  12. ғޟকع 

  13.  ڧԽֶशͬͯͲ͏΍Δͷʁ

  14. ڧԽֶशʢྫʣ  ใु RLΞϧΰϦζϜ wΤαΛͨ͘͞Μ৯΂ͯ wఢ͕͍ͳ͍ͱ͜ΖʹਐΜͰ wγϛϡϨʔγϣϯ wใुΛ࠷େԽ

  15. %FFQ3BDFSΛಈ͔ͯ͠ΈΔ 15

  16. %FFQ3BDFSΛಈ͔͢·Ͱ  wεςοϓ̍ɿ3FXBSEؔ਺࡞੒ wεςοϓ̎ɿγϛϡϨʔγϣϯ wεςοϓ̏ɿ෺ཧͰ૸ΒͤΔ

  17. %FFQ3BDFSΛಈ͔͢·Ͱ  wεςοϓ̍ɿ3FXBSEؔ਺࡞੒ wεςοϓ̎ɿγϛϡϨʔγϣϯ wεςοϓ̏ɿ෺ཧͰ૸ΒͤΔ

  18. εςοϓ̍ɿ3FXBSEؔ਺  ใुؔ਺ʢPythonʣ ɾEJTUBODF@GSPN@DFOUFS ɹηϯλʔϥΠϯ͔Βͷڑ཭ ɾPO@USBDL ɹं྆ͷલ෦͕നઢͷ֎ଆʹ͋Δ͔Ͳ͏͔ ɾUISPUUMF ɹंͷ଎౓ɹ͸ఀࢭΛࣔ͠ɺ͸࠷ߴ଎౓ ɾUSBDL@XJEUI

    ɹτϥοΫ෯ ɹ ɹͳͲͳͲ Πϯϓοτ Ξ΢τϓοτ

  19. εςοϓ̍ɿ3FXBSEؔ਺  NBSLFS@ USBDL@XJEUI NBSLFS@ USBDL@XJEUI NBSLFS@ USBDL@XJEUI SFXBSEF JGEJTUBODF@GSPN@DFOUFSBOEEJTUBODF@GSPN@DFOUFSNBSLFS@

    SFXBSE FMJGEJTUBODF@GSPN@DFOUFSNBSLFS@ SFXBSE FMJGEJTUBODF@GSPN@DFOUFSNBSLFS@ SFXBSE FMTF SFXBSEFMJLFMZDSBTIFEDMPTFUPPGGUSBDL

  20. %FFQ3BDFSΛಈ͔͢·Ͱ  wεςοϓ̍ɿ3FXBSEؔ਺࡞੒ wεςοϓ̎ɿγϛϡϨʔγϣϯ wεςοϓ̏ɿ෺ཧͰ૸ΒͤΔ

  21. εςοϓ̎ɿϞσϧ࡞੒ 

  22. εςοϓ̎ɿϞσϧ࡞੒ 

  23. %FFQ3BDFSΛಈ͔͢·Ͱ  wεςοϓ̍ɿ3FXBSEؔ਺࡞੒ wεςοϓ̎ɿγϛϡϨʔγϣϯ wεςοϓ̏ɿ෺ཧͰ૸ΒͤΔ

  24. εςοϓ̏ɿ෺ཧͰ૸ΒͤΔ  ֶशϞσϧ

  25. εςοϓ̏ɿ෺ཧͰ૸ΒͤΔ 

  26. "84্ͷΞʔΩςΫνϟ  SageMaker RoboMaker S3 kinesis video streams CloudWatch Logs

    Client

  27. %FFQ3BDFS͸Ͳ͏΍ֶͬͯΜͰ͍Δͷ͔ 27

  28. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  https://www.slideshare.net/AmazonWebServices/robocar-rally-2018-aim206r20-aws-reinvent-2018 ɾ45"5&ɿঢ়ଶ ɹ%FFQ3BDFSͷϑϩϯτΧϝϥ ɾ3&8"3%ɿใु ɹηϯλʔϥΠϯʹ͚ۙΕ͹(PPE ɹεϐʔυ͕ग़͍ͯΕ͹(PPE ɾ"$5*0/ɿߦಈ ɹεϐʔυΛ্͛Δ

    ɹӈʹۂ͕Δɺࠨʹۂ͕Δ

  29. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ t=0 S0

  30. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ t=0 S0

  31. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  t=1 S "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ 1

  32. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  t=1 S "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ R

    :ಓ֎ΕͨͷͰใुͳ͠ 1

  33. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ t=0 S0

  34. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ t=0 S0

  35. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  t=1 S "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ 1

  36. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  t=1 S "$5*0/ ɾεϐʔυΛ্͛Δ ɾ௚ਐ͢Δ ɾӈʹۂ͕Δ ɾࠨʹۂ͕Δ R

    :ঢ়گʹԠͨ͡ใु 1

  37. τϨʔχϯά͸ͲͷΑ͏ʹͯ͠ߦΘΕΔ͔ʁ  https://www.slideshare.net/AmazonWebServices/robocar-rally-2018-aim206r20-aws-reinvent-2018

  38. ·ͱΊ 38

  39. ·ͱΊ  w%FFQ3BDFS͸ڧԽֶशΛֶͿͨΊͷखஈ w%FFQ3BDFS͸ڧԽֶशͱ͔ؔ܎ͳ͘୯७ʹָ͍͠ wϨʔεେձ΋͋ΔͷͰΈΜͳࢀՃ͠Α͏ʂʂΞϝϦΧͰʁ

  40. 40 ԶͰڧԽֶशΛ ֶΜͰ͘Εʂʂ ࠓͳΒˈ249

  41.  Let's start reinforcement learning with DeepRacer

  42. 42