DeepRacerで始める機械学習

Transcript

1. %FFQ3BDFSͰ࢝ΊΔػցֶश σʔλΞφϦςΟΫεࣄۀຊ෦
   ΠϯςάϨʔγϣϯ෦
   େᖒ
   ༐ే
2. ࣗݾ঺հ  େᖒ
   ༐ే σʔλΞφϦςΟΫεࣄۀຊ෦
   ΠϯςάϨʔγϣϯ෦
   ػցֶशνʔϜ
   ΤϯδχΞ
   ೥݄
   ೖࣾ
   ೥݄
   ҭٳ
   
   ݱࡏɺࣾձ෮ؼத
3. ࠓ೔࿩͢͜ͱ  w"84
   %FFQ3BDFSͱ͸
   wػցֶशͷ֓ཁ
   w"84ʹ͓͚ΔػցֶशαʔϏε
   w"84
   %FFQ3BDFSͰԿΛͲ͏ֶ΂Δͷ͔
   w"84
   %FFQ3BDFSΛ࣮ࡍʹ΍ͬͯΈΔ
   όʔνϟϧϦʔάฤ
   
4. εϥΠυ͸ޙͰೖख͢Δ͜ͱ͕ग़དྷ·͢ͷͰ ൃදதͷ಺༰ΛϝϞ͢Δඞཁ͸͋Γ·ͤΜɻ ࣸਅࡱӨΛ͢Δ৔߹͸ ϑϥογϡɾγϟολʔԻ͕ग़ͳ͍Α͏ʹ͝഑ྀ͍ͩ͘͞ Attention
5.  "84
   %FFQ3BDFS
6.  https://aws.amazon.com/jp/deepracer/
7. "84
   %FFQ3BDFS  "84্ͰϞσϧΛֶशͤͯ͞ɺϥδίϯͰࣗಈӡస
   wϚωδϝϯτίϯιʔϧ͔ΒϞσϧΛֶश
   wεέʔϧͷϥδίϯʹϞσϧΛࡌͤΔ͜ͱͰࣗಈӡస
   wόʔνϟϧϦʔάʹϞσϧΛαϒϛοτ͠ɺϥοϓλΠϜΛڝ͏
   w"84
   SF*OWFOU΍"84
   4VNNJUͰͷ%FFQSBDFS
   -FBHVFͰ࣮ࡍ ʹ૸ΒͤͯϥοϓλΠϜΛڝ͏
   
8.  https://aws.amazon.com/jp/deepracer/
9. Ϛωδϝϯτίϯιʔϧ 
10. "84
    %FFQ3BDFS
    -FBHVF 
11. Ϟσϧͷֶश 
12. γϛϡϨʔγϣϯ ֶशॳظ 
13. γϛϡϨʔγϣϯ ͋Δఔ౓ֶशͨ͠ஈ֊ 
14.  ػցֶश
15. ػցֶश
    ֓ཁ  ͬ͘͟Γݴ͏ͱ
    نଇੑΛֶशͤ͞Δ͜ͱɻ
    wڭࢣ͋Γֶश
    
    ౴͑Λ༩͑ͯೖྗͱ౴͑ͷنଇੑΛֶशͤ͞Δ
    wڭࢣͳֶ͠शɿ౴͑Λ༩͑ͣʹೖྗͷنଇੑΛֶशͤ͞Δ
    w൒ڭࢣ͋Γֶशɿجຊతʹ͸౴͑Λ༩͑ͣʹೖྗͷنଇੑΛֶशͤ͞ Δ͕ɺ෦෼తʹ౴͑Λ༩͑ͯิॿ͢Δ
    wڧԽֶशɿ͋Δ؀ڥͰใु͕࠷େԽ͢Δߦಈબ୒ͷنଇੑΛֶशͤ͞Δ ͳͲ
16. χϡʔϥϧωοτϫʔΫ
    ֓ཁ  ϑΟʔυϑΥϫʔυ χϡʔϥϧωοτϫʔΫ
    wೖྗ
    wόον
    σʔληοτ͔ΒϥϯμϜʹநग़
    wΤϙοΫ਺
    ಉ͡σʔληοτΛ࢖͏ճ਺
    wग़ྗ
    wೖྗ͕//Λ௨ͬͯग़͖ͯͨ΋ͷ
    wྫ
    dͷ࣮਺ͳͲ
17. ػցֶश
    ྫ  ҟৗݕग़
18. ػցֶश
    ྫ  ୯ޠͷຒΊࠐΈ
19. ػցֶश
    ྫ  ΫϥελϦϯά
20. ڧԽֶश
    ֓ཁ   ؀ڥ͔ΒΤʔδΣϯτʹঢ়ଶ
     ΤʔδΣϯτ͕ঢ়ଶʹج͍ͮͯ ߦಈ
     ؀ڥ͕ߦಈ݁Ռʹج͍ͮͨใु ΛΤʔδΣϯτ΁
     dΛ܁Γฦ͢ ௕ظతʹ࠷େใु͕΋Β͑ΔߦಈΛબͿΑ͏ʹֶश͢Δ
21. %FFQ3BDFSͰ࢖ΘΕ͍ͯΔख๏  1SPYJNBM
    1PMJDZ
    0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html
22. %FFQ3BDFSͰ࢖ΘΕ͍ͯΔख๏  1SPYJNBM
    1PMJDZ
    0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html ը૾͔Βಛ௃ΛऔΓग़ͯ͠ ߦಈ൑ఆ΁ܨ͕Δม׵Λͯ͠ ֤ߦಈͷ֬཰Λग़ྗ͢Δ
23. %FFQ3BDFSͰ࢖ΘΕ͍ͯΔख๏  1SPYJNBM
    1PMJDZ
    0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html PPOͷ୉ޣຯ/৽نੑ͸໨తؔ਺͕…
24. %FFQ3BDFSͰ࢖ΘΕ͍ͯΔख๏  1SPYJNBM
    1PMJDZ
    0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html PPOͷ୉ޣຯ/৽نੑ͸໨తؔ਺͕… ͱ͍͏ײ͡Ͱਂ۷Γ͢Ε͹৭ʑग़ͯ͘ΔͷͰ ڵຯ͕͋Δํ͸ͥͻௐ΂ͯΈ͍ͯͩ͘͞
25.  "84ʹ͓͚Δػցֶश
26. "84ʹ͓͚Δػցֶश 
27. "84ʹ͓͚Δػցֶश  ࠓճؔ܎͢Δͷ͸ʜ
28. "84ʹ͓͚Δػցֶश  ࠓճؔ܎͢Δͷ͸ʜ Ϟσϧͷֶश
29. "NB[PO
    4BHF.BLFS  ػցֶशͷϑϧϚωʔδυαʔϏε
    w+VQZUFS
    ϊʔτϒοΫͷϗεςΟϯά
    wػցֶशϞσϧͷֶश
    wػցֶशϞσϧͷϗεςΟϯά
    wϥϕϧ͚ͮ Ξϊςʔγϣϯ ͷ؅ཧ
    ͳͲ DeepRacerͰ࢖༻
30. "84ʹ͓͚Δػցֶश  ࠓճؔ܎͢Δͷ͸ʜ AWS RoboMaker Ϟσϧͷֶश γϛϡϨʔγϣϯ
31. "84
    3PCP.BLFS  ϩϘοτΞϓϦέʔγϣϯͷ։ൃΛαϙʔτ͢ΔαʔϏε
    wϑϧϚωʔδυͳγϛϡϨʔγϣϯαʔϏε
    w$MPVEͱ࿈ܞͨ͠։ൃ؀ڥ
    w304ͷΫϥ΢υ֦ு
    wϑϦʔτϚωδϝϯτ
    ͳͲ DeepRacerͰ࢖༻
32.  "84
    %FFQ3BDFS վΊͯ
33. "84
    %FFQ3BDFS  RoboMakerͰͷγϛϡϨʔγϣϯͱ SageMakerͰͷϞσϧͷֶशΛ܁Γฦ͢
34. ϞσϧΛֶशͤͯ͞  https://console.aws.amazon.com/deepracer/home?region=us-east-1#welcome
35. "84
    %FFQ3BDFS
    -FBHVFʹग़ͯ  https://console.aws.amazon.com/deepracer/home?region=us-east-1#leaderboards
36. ϥϯΧʔ΁ʜ 
37.  %FFQ3BDFSͰ
    ԿΛͲ͏ֶ΂Δͷ͔
38.  ػցֶशλεΫͷઃܭ΍Ϟσϧͷվળʹ͍ͭͯମݧ&ֶ΂Δ
39. ԿΛֶ΂Δͷ͔ʜ  wػցֶशλεΫͷઃܭ
    wϞσϧͷվળ
    wϋΠύʔύϥϝʔλͷௐ੔
    ͳͲ
40. ػցֶशλεΫͷઃܭ  wػցֶशΛ࢖ͬͨ໰୊ͷղ͖ํ΁ͷམͱ͠ࠐΈ
    wใुؔ਺ͷઃܭ
    
    w௚઀ୡ੒͢Δͷ͕೉͍͠໨తΛؒ઀తʹୡ੒Ͱ͖ΔΑ͏ͳαϒλεΫͷઃఆ ͳͲʹྨࣅ
    wϥοϓλΠϜ͕଎͘͢ΔͨΊʹͲ͏૸ΒͤΕ͹ɺͲ͏ֶशͤ͞Ε͹ʜ
41. ใुؔ਺ 
42. ߦಈύλʔϯ 
43. Ϟσϧͷվળ  wγϛϡϨʔγϣϯϩάΛ࢖ͬͨϞσϧͷಛ௃෼ੳ
    wҙਤͨ͠௨Γʹֶशͯ͠Δ͔ɺ૸ͬͯΔ͔Λ֬ೝ͠ɺվળʹ ͭͳ͛Δ
    w࣮ݧͷ܁Γฦ͠
44. ใु 
45. Τϯτϩϐʔ 
46. ϋΠύʔύϥϝʔλͷௐ੔  wϞσϧͷֶशͷਐΊํΛௐ੔͢Δ
    wχϡʔϥϧωοτϫʔΫ΍ޯ഑߱Լ๏ɺ110ͳͲͷಛੑʹԠ ͨ͡࠷దԽ
47. %FFQ3BDFSʹ͓͚ΔϋΠύʔύϥϝʔλ 
48. ԿΛֶ΂Δͷ͔ʜ  wػցֶशλεΫͷઃܭ
    wػցֶशΛ࢖ͬͨ໰୊ͷղ͖ํ΁ͷམͱ͠ࠐΈ
    w଎͍ϥοϓλΠϜ͕ग़͍ͨ͠
    
    Ͳ͏૸ΒͤΕ͹ɺͲ͏ֶशͤ͞Ε͹͍͍ͷ͔ʜ
    wϞσϧͷվળ
    wγϛϡϨʔγϣϯϩάΛ࢖ͬͨϞσϧͷಛ௃෼ੳ
    wҙਤͨ͠௨Γʹֶशͯ͠Δ͔ɺ૸ͬͯΔ͔֬ೝ͠ɺվળʹͭͳ͛Δ
    wϋΠύʔύϥϝʔλͷௐ੔
    wϞσϧͷֶशͷਐΊํΛௐ੔͢Δ
49.  %FFQ3BDFSΛ΍ͬͯΈΔ
50. Ϛωδϝϯτίϯιʔϧ 
51. ϞσϧҰཡ 
52. Ϟσϧ࡞੒ 
53. Ϧιʔεͷ࡞੒ 
54. Ϟσϧ໊ 
55. ίʔεબ୒ 
56. ߦಈઃఆ 
57. ߦಈύλʔϯ 
58. ใुؔ਺ 
59. ใुؔ਺ͷαϯϓϧ 
60. ϋΠύʔύϥϝʔλ 
61. ֶश࣌ؒ 
62. ֶश։࢝ 
63. ϞσϧҰཡ 
64. ֶशը໘ 
65. 3PCP.BLFSͷγϛϡϨʔγϣϯπʔϧ 
66. (B[FCPͰͷγϛϡϨʔγϣϯը໘ 
67. ֶश׬ྃ 
68. όʔνϟϧϦʔά 
69. όʔνϟϧϦʔά 
70. όʔνϟϧϦʔάʹొ࿥͢Δ 
71. Ծ૝Ϧʔάʹొ࿥͢Δ 
72. Ծ૝Ϧʔάʹొ࿥͢Δ 
73. Ϟσϧαϒϛοτޙ 
74. ϞσϧධՁத 
75. ϞσϧධՁ׬ྃ  ׬૸ͤͣ…
76. ϦʔμʔϘʔυ 
77.  ·ͱΊ
78. ·ͱΊ  w%FFQ3BDFSͰ͸ػցֶशɺڧԽֶशʹ৮ΕΔ͜ͱ͕Ͱ͖Δ
    wࣄલ஌ࣝ͸΄ͱΜͲඞཁͳ͘ɺखܰʹ࢝ΊΒΕΔ
    wແྉ࿮΋͋ΔͨΊɺͱΓ͋͑ͣ΍ͬͯΈΔͷ͕͓͢͢Ί
    wͨͩ͠ɺແྉ࿮Λ௒͑Δͱ҆͘͸ͳ͍ͷͰɺ΍Γ͗͢஫ҙ
    ڵຯΛ࣋ͬͨ಺༰ΛͲΜͲΜ۷ΓԼ͍͛ͯͬͯ
    Ώ͘Ώ͘͸ػցֶशڧऀ΁ʜ
79.  ͋Γ͕ͱ͏͍͟͝·ͨ͠