Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
DeepRacerで始める機械学習
Search
tandfy
October 11, 2019
Programming
1
1.7k
DeepRacerで始める機械学習
tandfy
October 11, 2019
Tweet
Share
More Decks by tandfy
See All by tandfy
アプリから集まるイベントデータのリアルタイム処理入門
tandfy
0
1.6k
Amazon SageMakerの最新アップデートの紹介
tandfy
1
900
Amazon Personalizeではじめるレコメンドサービス
tandfy
0
1.1k
DeepRacerで学ぶ機械学習 1.1
tandfy
0
1k
DeepRacerでまなぶ強化学習
tandfy
1
1.4k
Amazon SageMakerではじめる物体検出
tandfy
1
1.1k
Other Decks in Programming
See All in Programming
Claude Agent SDK を使ってみよう
hyshu
0
1.4k
NIKKEI Tech Talk#38
cipepser
0
270
CSC509 Lecture 06
javiergs
PRO
0
270
AI Agent 時代的開發者生存指南
eddie
4
2.1k
AI 駆動開発におけるコミュニティと AWS CDK の価値
konokenj
5
270
PHPに関数型の魂を宿す〜PHP 8.5 で実現する堅牢なコードとは〜 #phpcon_hiroshima / phpcon-hiroshima-2025
shogogg
1
340
The Past, Present, and Future of Enterprise Java
ivargrimstad
0
660
One Enishi After Another
snoozer05
PRO
0
160
はじめてのDSPy - 言語モデルを『プロンプト』ではなく『プログラミング』するための仕組み
masahiro_nishimi
4
16k
Foundation Modelsを実装日本語学習アプリを作ってみた!
hypebeans
0
130
Amazon Verified Permissions実践入門 〜Cedar活用とAppSync導入事例/Practical Introduction to Amazon Verified Permissions
fossamagna
2
100
CSC305 Lecture 10
javiergs
PRO
0
270
Featured
See All Featured
Building Better People: How to give real-time feedback that sticks.
wjessup
369
20k
YesSQL, Process and Tooling at Scale
rocio
173
15k
The Invisible Side of Design
smashingmag
302
51k
The Cost Of JavaScript in 2023
addyosmani
55
9.1k
The Illustrated Children's Guide to Kubernetes
chrisshort
49
51k
It's Worth the Effort
3n
187
28k
Code Review Best Practice
trishagee
72
19k
How STYLIGHT went responsive
nonsquared
100
5.9k
Become a Pro
speakerdeck
PRO
29
5.6k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
52
5.7k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
9
930
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
190
55k
Transcript
%FFQ3BDFSͰ࢝ΊΔػցֶश σʔλΞφϦςΟΫεࣄۀຊ෦ΠϯςάϨʔγϣϯ෦ େᖒ༐ే
ࣗݾհ େᖒ༐ే σʔλΞφϦςΟΫεࣄۀຊ෦ΠϯςάϨʔγϣϯ෦ ػցֶशνʔϜΤϯδχΞ ݄ೖࣾ ݄ҭٳ ݱࡏɺࣾձ෮ؼத
ࠓ͢͜ͱ w"84%FFQ3BDFSͱ wػցֶशͷ֓ཁ w"84ʹ͓͚ΔػցֶशαʔϏε w"84%FFQ3BDFSͰԿΛͲ͏ֶΔͷ͔ w"84%FFQ3BDFSΛ࣮ࡍʹͬͯΈΔ όʔνϟϧϦʔάฤ
εϥΠυޙͰೖख͢Δ͜ͱ͕ग़དྷ·͢ͷͰ ൃදதͷ༰ΛϝϞ͢Δඞཁ͋Γ·ͤΜɻ ࣸਅࡱӨΛ͢Δ߹ ϑϥογϡɾγϟολʔԻ͕ग़ͳ͍Α͏ʹྀ͍ͩ͘͝͞ Attention
"84%FFQ3BDFS
https://aws.amazon.com/jp/deepracer/
"84%FFQ3BDFS "84্ͰϞσϧΛֶशͤͯ͞ɺϥδίϯͰࣗಈӡస wϚωδϝϯτίϯιʔϧ͔ΒϞσϧΛֶश wεέʔϧͷϥδίϯʹϞσϧΛࡌͤΔ͜ͱͰࣗಈӡస wόʔνϟϧϦʔάʹϞσϧΛαϒϛοτ͠ɺϥοϓλΠϜΛڝ͏ w"84SF*OWFOU"844VNNJUͰͷ%FFQSBDFS-FBHVFͰ࣮ࡍ ʹΒͤͯϥοϓλΠϜΛڝ͏
https://aws.amazon.com/jp/deepracer/
Ϛωδϝϯτίϯιʔϧ
"84%FFQ3BDFS-FBHVF
Ϟσϧͷֶश
γϛϡϨʔγϣϯ ֶशॳظ
γϛϡϨʔγϣϯ ͋Δఔֶशͨ͠ஈ֊
ػցֶश
ػցֶश֓ཁ ͬ͘͟Γݴ͏ͱنଇੑΛֶशͤ͞Δ͜ͱɻ wڭࢣ͋Γֶश͑Λ༩͑ͯೖྗͱ͑ͷنଇੑΛֶशͤ͞Δ wڭࢣͳֶ͠शɿ͑Λ༩͑ͣʹೖྗͷنଇੑΛֶशͤ͞Δ wڭࢣ͋Γֶशɿجຊతʹ͑Λ༩͑ͣʹೖྗͷنଇੑΛֶशͤ͞ Δ͕ɺ෦తʹ͑Λ༩͑ͯิॿ͢Δ wڧԽֶशɿ͋ΔڥͰใु͕࠷େԽ͢ΔߦಈબͷنଇੑΛֶशͤ͞Δ ͳͲ
χϡʔϥϧωοτϫʔΫ֓ཁ ϑΟʔυϑΥϫʔυ χϡʔϥϧωοτϫʔΫ wೖྗ wόονσʔληοτ͔ΒϥϯμϜʹநग़ wΤϙοΫಉ͡σʔληοτΛ͏ճ wग़ྗ wೖྗ͕//Λ௨ͬͯग़͖ͯͨͷ wྫ
dͷ࣮ͳͲ
ػցֶशྫ ҟৗݕग़
ػցֶशྫ ୯ޠͷຒΊࠐΈ
ػցֶशྫ ΫϥελϦϯά
ڧԽֶश֓ཁ ڥ͔ΒΤʔδΣϯτʹঢ়ଶ ΤʔδΣϯτ͕ঢ়ଶʹج͍ͮͯ ߦಈ ڥ͕ߦಈ݁Ռʹج͍ͮͨใु ΛΤʔδΣϯτ
dΛ܁Γฦ͢ ظతʹ࠷େใु͕Β͑ΔߦಈΛબͿΑ͏ʹֶश͢Δ
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html ը૾͔ΒಛΛऔΓग़ͯ͠ ߦಈఆܨ͕ΔมΛͯ͠ ֤ߦಈͷ֬Λग़ྗ͢Δ
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html PPOͷޣຯ/৽نੑత͕ؔ…
%FFQ3BDFSͰΘΕ͍ͯΔख๏ 1SPYJNBM1PMJDZ0QUJNJ[BUJPO https://nervanasystems.github.io/coach/components/agents/policy_optimization/ppo.html PPOͷޣຯ/৽نੑత͕ؔ… ͱ͍͏ײ͡Ͱਂ۷Γ͢Ε৭ʑग़ͯ͘ΔͷͰ ڵຯ͕͋ΔํͥͻௐͯΈ͍ͯͩ͘͞
"84ʹ͓͚Δػցֶश
"84ʹ͓͚Δػցֶश
"84ʹ͓͚Δػցֶश ࠓճؔ͢Δͷʜ
"84ʹ͓͚Δػցֶश ࠓճؔ͢Δͷʜ Ϟσϧͷֶश
"NB[PO4BHF.BLFS ػցֶशͷϑϧϚωʔδυαʔϏε w+VQZUFSϊʔτϒοΫͷϗεςΟϯά wػցֶशϞσϧͷֶश wػցֶशϞσϧͷϗεςΟϯά wϥϕϧ͚ͮ Ξϊςʔγϣϯ ͷཧ ͳͲ
DeepRacerͰ༻
"84ʹ͓͚Δػցֶश ࠓճؔ͢Δͷʜ AWS RoboMaker Ϟσϧͷֶश γϛϡϨʔγϣϯ
"843PCP.BLFS ϩϘοτΞϓϦέʔγϣϯͷ։ൃΛαϙʔτ͢ΔαʔϏε wϑϧϚωʔδυͳγϛϡϨʔγϣϯαʔϏε w$MPVEͱ࿈ܞͨ͠։ൃڥ w304ͷΫϥυ֦ு wϑϦʔτϚωδϝϯτ ͳͲ DeepRacerͰ༻
"84%FFQ3BDFS վΊͯ
"84%FFQ3BDFS RoboMakerͰͷγϛϡϨʔγϣϯͱ SageMakerͰͷϞσϧͷֶशΛ܁Γฦ͢
ϞσϧΛֶशͤͯ͞ https://console.aws.amazon.com/deepracer/home?region=us-east-1#welcome
"84%FFQ3BDFS-FBHVFʹग़ͯ https://console.aws.amazon.com/deepracer/home?region=us-east-1#leaderboards
ϥϯΧʔʜ
%FFQ3BDFSͰ ԿΛͲ͏ֶΔͷ͔
ػցֶशλεΫͷઃܭϞσϧͷվળʹ͍ͭͯମݧ&ֶΔ
ԿΛֶΔͷ͔ʜ wػցֶशλεΫͷઃܭ wϞσϧͷվળ wϋΠύʔύϥϝʔλͷௐ ͳͲ
ػցֶशλεΫͷઃܭ wػցֶशΛͬͨͷղ͖ํͷམͱ͠ࠐΈ wใुؔͷઃܭ wୡ͢Δͷ͕͍͠తΛؒతʹୡͰ͖ΔΑ͏ͳαϒλεΫͷઃఆ ͳͲʹྨࣅ wϥοϓλΠϜ͕͘͢ΔͨΊʹͲ͏ΒͤΕɺͲ͏ֶशͤ͞Εʜ
ใुؔ
ߦಈύλʔϯ
Ϟσϧͷվળ wγϛϡϨʔγϣϯϩάΛͬͨϞσϧͷಛੳ wҙਤͨ͠௨Γʹֶशͯ͠Δ͔ɺͬͯΔ͔Λ֬ೝ͠ɺվળʹ ͭͳ͛Δ w࣮ݧͷ܁Γฦ͠
ใु
Τϯτϩϐʔ
ϋΠύʔύϥϝʔλͷௐ wϞσϧͷֶशͷਐΊํΛௐ͢Δ wχϡʔϥϧωοτϫʔΫޯ߱Լ๏ɺ110ͳͲͷಛੑʹԠ ͨ͡࠷దԽ
%FFQ3BDFSʹ͓͚ΔϋΠύʔύϥϝʔλ
ԿΛֶΔͷ͔ʜ wػցֶशλεΫͷઃܭ wػցֶशΛͬͨͷղ͖ํͷམͱ͠ࠐΈ w͍ϥοϓλΠϜ͕ग़͍ͨ͠Ͳ͏ΒͤΕɺͲ͏ֶशͤ͞Ε͍͍ͷ͔ʜ wϞσϧͷվળ wγϛϡϨʔγϣϯϩάΛͬͨϞσϧͷಛੳ wҙਤͨ͠௨Γʹֶशͯ͠Δ͔ɺͬͯΔ͔֬ೝ͠ɺվળʹͭͳ͛Δ wϋΠύʔύϥϝʔλͷௐ wϞσϧͷֶशͷਐΊํΛௐ͢Δ
%FFQ3BDFSΛͬͯΈΔ
Ϛωδϝϯτίϯιʔϧ
ϞσϧҰཡ
Ϟσϧ࡞
Ϧιʔεͷ࡞
Ϟσϧ໊
ίʔεબ
ߦಈઃఆ
ߦಈύλʔϯ
ใुؔ
ใुؔͷαϯϓϧ
ϋΠύʔύϥϝʔλ
ֶश࣌ؒ
ֶश։࢝
ϞσϧҰཡ
ֶशը໘
3PCP.BLFSͷγϛϡϨʔγϣϯπʔϧ
(B[FCPͰͷγϛϡϨʔγϣϯը໘
ֶशྃ
όʔνϟϧϦʔά
όʔνϟϧϦʔά
όʔνϟϧϦʔάʹొ͢Δ
ԾϦʔάʹొ͢Δ
ԾϦʔάʹొ͢Δ
Ϟσϧαϒϛοτޙ
ϞσϧධՁத
ϞσϧධՁྃ ͤͣ…
ϦʔμʔϘʔυ
·ͱΊ
·ͱΊ w%FFQ3BDFSͰػցֶशɺڧԽֶशʹ৮ΕΔ͜ͱ͕Ͱ͖Δ wࣄલࣝ΄ͱΜͲඞཁͳ͘ɺखܰʹ࢝ΊΒΕΔ wແྉ͋ΔͨΊɺͱΓ͋͑ͣͬͯΈΔͷ͕͓͢͢Ί wͨͩ͠ɺແྉΛ͑Δͱ҆͘ͳ͍ͷͰɺΓ͗͢ҙ ڵຯΛ࣋ͬͨ༰ΛͲΜͲΜ۷ΓԼ͍͛ͯͬͯ Ώ͘Ώ͘ػցֶशڧऀʜ
͋Γ͕ͱ͏͍͟͝·ͨ͠