Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Hello DeepRacer World
Search
Sponsored
·
Ship Features Fearlessly
Turn features on and off without deploys. Used by thousands of Ruby developers.
→
cmtt
October 19, 2019
Technology
0
1.1k
Hello DeepRacer World
re:Invent 2018で発表されたAWS DeepRacerが、今年大いに盛り上がりました。
DeepRacerの概要と始め方、各レースの様子を紹介します。
cmtt
October 19, 2019
Tweet
Share
More Decks by cmtt
See All by cmtt
re:Invent2019注目トピックとDeepRacerアップデート
cmtt
0
750
Other Decks in Technology
See All in Technology
予期せぬコストの急増を障害のように扱う――「コスト版ポストモーテム」の導入とその後の改善
muziyoshiz
1
1.8k
Webhook best practices for rock solid and resilient deployments
glaforge
1
280
Agile Leadership Summit Keynote 2026
m_seki
1
600
IaaS/SaaS管理における SREの実践 - SRE Kaigi 2026
bbqallstars
4
2.2k
AWS Network Firewall Proxyを触ってみた
nagisa53
1
220
~Everything as Codeを諦めない~ 後からCDK
mu7889yoon
3
330
Tebiki Engineering Team Deck
tebiki
0
24k
SREじゃなかった僕らがenablingを通じて「SRE実践者」になるまでのリアル / SRE Kaigi 2026
aeonpeople
6
2.3k
OCI Database Management サービス詳細
oracle4engineer
PRO
1
7.4k
茨城の思い出を振り返る ~CDKのセキュリティを添えて~ / 20260201 Mitsutoshi Matsuo
shift_evolve
PRO
1
250
SREチームをどう作り、どう育てるか ― Findy横断SREのマネジメント
rvirus0817
0
220
クレジットカード決済基盤を支えるSRE - 厳格な監査とSRE運用の両立 (SRE Kaigi 2026)
capytan
6
2.7k
Featured
See All Featured
Agile Leadership in an Agile Organization
kimpetersen
PRO
0
80
The untapped power of vector embeddings
frankvandijk
1
1.6k
Fireside Chat
paigeccino
41
3.8k
How to Ace a Technical Interview
jacobian
281
24k
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
aleyda
0
1.9k
Visualization
eitanlees
150
17k
Digital Ethics as a Driver of Design Innovation
axbom
PRO
1
180
Ten Tips & Tricks for a 🌱 transition
stuffmc
0
65
Digital Projects Gone Horribly Wrong (And the UX Pros Who Still Save the Day) - Dean Schuster
uxyall
0
340
YesSQL, Process and Tooling at Scale
rocio
174
15k
The SEO identity crisis: Don't let AI make you average
varn
0
240
VelocityConf: Rendering Performance Case Studies
addyosmani
333
24k
Transcript
)FMMP%FFQ3BDFS8PSME "84ࣄۀຊ෦ɹαʔϏεάϧʔϓ ߴڮ
"CPVUNF ߴڮ "84ࣄۀຊ෦αʔϏεάϧʔϓ ʮΫϥεϝιουɾϝϯόʔζʯ ϋʔυΣΞʹڵຯ͕͋Δ ιϑτΣΞ͞Μ UXJUUFS!FEZ HJUIVCFEZ
ຊͷ͓
AWS DeepRacer
AWS DeepRacer
͓͠ͳ͕͖ wͳͥ"84͕ϥδίϯΛʁ wػցֶशͱڧԽֶश w%FFQ3BDFSͷ͡Ίํ w4VNNJU$JSDVJUͱ7JSUVBM$JSDVJU w%FFQ3BDFS$IBNQJPOTIJQ$VQJO-BT7FHBT
Φεεϝͳਓ wϨʔε͖ͳਓ wܕϥδίϯ͖ͳਓ wϩϘοτ͖ͳਓ wػցֶशΓ͍͚ͨͲ·ͩͬͯͳ͍ਓ wͪΖΜػցֶशΨν
ͳͥʹAWS͕ϥδίϯΛʁ
ͳͥʹ"84͕ϥδίϯΛʁ w։ൃऀ͚ڧԽֶशϋϯζΦϯ wػցֶशڧԽֶशΛͬͱ։ൃऀʹΊ͍ͨ w͞ΘͬͯɺࢼߦࡨޡͰ͖ΔϓϥοτϑΥʔϜ wΘ͔Γ͍͢ඪɿϨʔεʹࢀՃͯ͠উͭ
"84%FFQ3BDFS
"84%FFQ3BDFS wεέʔϧͷϥδίϯ wڧԽֶशʹΑΔࣗߦ wϚχϡΞϧߦ 8J'J
εϖοΫ
6OEFSUIFIPPE
6OEFSUIFIPPE
6OEFSUIFIPPE
6OEFSUIFIPPE
ϥδίϯ࣮ػͷΞʔΩςΫνϟ wΧϝϥ w0QFO7*/0 w304
ػցֶशͱڧԽֶश
ػցֶशͷछྨ wڭࢣֶ͖श wڭࢣແֶ͠श wڧԽֶश ɹɹˢ%FFQ3BDFS͜Ε http://www0.cs.ucl.ac.uk/staff/d.silver/web/Teaching_files/intro_RL.pdf
ڧԽֶश͕ΘΕ͍ͯΔͱ͜Ζ
ڧԽֶशͷΈ
ใुؔʹྑ͞Λࣔؔ͢ wݴޠQZUIPO marker_1 = 0.1 * track_width marker_2 =
0.25 * track_width marker_3 = 0.5 * track_width reward = 1e-3 if distance_from_center >= 0.0 and distance_from_center <= marker_1: reward = 1 elif distance_from_center <= marker_2: reward = 0.5 elif distance_from_center <= marker_3: reward = 0.1 else: reward = 1e-3
γϛϡϨʔγϣϯͷΞʔΩςΫνϟ
%FFQ3BDFSͷ%-ωοτϫʔΫ
DeepRacerͷίϯιʔϧ
ϚωʔδϝϯτίϯιʔϧͰ%FFQ3BDFS
࠷ॳͷτϨʔχϯά
Ϧιʔεͷ࡞ ඞਢϦιʔεͷ࡞͕ඞཁ ճҎޙෆཁ
Ϟσϧ໊ΛܾΊΔ ໊લΛ͚Δ ͨ͘͞Μ࡞ΔͷͰࣈͰ۠ผ ΦϓγϣϯͰϝϞ
ΞΫγϣϯεϖʔεͷઃఆ
ใुؔ γϯλοΫενΣοΫ ฤूՄೳ αϯϓϧ͔ΒબΜͰ0,
ϋΠύʔύϥϝʔλ w࠷ॳσϑΥϧτͰ0, w܁Γฦ࣌͠ʹΛߋ৽ w-FBSOJOH3BUF w&OUSPQZ
γϛϡϨʔγϣϯͰτϨʔχϯά
γϛϡϨʔγϣϯͰτϨʔχϯά
τϨʔχϯάΛ܁Γฦ͢
τϨʔχϯά ϞσϧΛ࡞ ΞΫγϣϯεϖʔεΛઃఆ τϨʔχϯάίʔεΛબ ใुؔͱϋΠύʔύϥϝʔλΛઃఆ τϨʔχϯά )d) ධՁ
ϞσϧΛίϐʔ 3͔Β܁Γฦ͢
ֶश࣌ؒ w؆୯ͳίʔεͳΒ࣌ؒͰͰ͖Δ͜ͱ͋Δ w݅Λม͑Δͱͳ͔ͳֶ͔श͕ਐߦ͠ͳ͍ wίʔεͷΧʔϒ؇ٸ wߴઃఆͷΞΫγϣϯεϖʔε wਐߦঢ়گΛݟͳ͕Βd)ఔֶशͤ͞Δ͜ͱ
%FFQ3BDFSʹ͔͔Δඅ༻ wτϨʔχϯάͱධՁͷ࣮ߦ࣌ؒʹର͠)͘Β͍ w7JSUVBM$JSDVJUͰͷܭଌʹඅ༻͔͔Βͳ͍ w܁Γฦֶ͠शΛଓ͚ΔͷͰ݁ߏඅ༻͕͔͔Γ·͢ wਖ਼ݴͬͯେਓͷ༡ͼͰ͢ wΫϨδοτ͕ͨΔ8FFLMZ$IBMMFOHFاըΞϦ
wϩάͷࢹ֮Խͷྫ wπʔϧ͕"84༗ࢤ͔Β ڞ༗͞Ε͍ͯΔ ੳ
Virtual Circuit
7JSUVBM$JSDVJU wΦϯϥΠϯͰৗ࣌։࠵ wίʔε݄ସ w֤݄ͷॱҐΛڝ͏ w༏উऀܾউτʔφϝϯτਐग़ݖΛ֫ಘ ɹˠ-BT7FHBTͱSF*OWFOUট
݄ସΘΓͷίʔε Pre Season London Loop Kumo Torakku Empire City
Shanghai Sudu Cumulo Carrera Toronto Turnpike 4݄ 5݄ 6݄ 7݄ 8݄ 9݄ 10݄
τϨʔχϯάίʔεͱαʔΩοτίʔε αʔΩοτίʔε τϨʔχϯάίʔε Toronto Turnpike Toronto Turnpike Training
ࠓ݄'JOBM0OMJOF3BDF
8FFLMZ$IBMMFOHF wຖि͓͕ઃఆ͞ΕͯҐ·Ͱදজ wҬผɺϧʔΩʔɺվળτοϓɺಛఆඵʹ͍ۙ wॱҐͰΫϨδοτఏڙ d
Summit Circuit
4VNNJU$JSDVJU wੈք֤Ͱ։࠵͞ΕΔ"844VNNJU wίʔε͕ઃஔ͞Εɺ࣮ࡍʹΒͤΔ͜ͱ͕Ͱ͖Δ wେਓؾͰ࣌ؒͪβϥ
4VNNJU$JSDVJU wϞσϧɺ࣋ͪࠐΈग़དྷ߹͍ͷͲͪΒͰྑ͍ w࣋ͪ࣌ؒɺ४උɺίʔε w࠷ϥοϓ͕ग़ΔΑ͏͕࣌ؒڐ͢ݶΓτϥΠ wτϥοΫϘε͕ੈΛ͢Δ ίʔεΞτͨ͠Β͢ ɹˢେมͳॏ࿑ಇͰ͢ ײँ
4VNNJUͷίʔε wίʔεछྨɿSF*OWFOU
࣮ࡍʹΒͤΔ
࣮ػϔͷσϓϩΠ w࡞ֶͨ͠शϞσϧΛμϯϩʔυ w64#ϝϞϦʹอଘ wϥδίϯʹଓ ɹɹˠϞσϧΛ࣮ػʹϩʔυɺ࠷దԽ wྃ͢Δͱ8FCը໘ͰબΔΑ͏ʹͳΔ
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP https://www.youtube.com/watch?v=yDGm7u8wrNM
None
7JSUVBMͱͷҧ͍ wJ1BEͰεϩοτϧͷૢ࡞͕Մೳ wػମిͳͲͷݸମࠩΛௐ͢Δ wͳ͔ͳ͔ࢥ͏௨Γʹ Ԡ͠ͳͯ͘େม
࣮ࡍʹΒͤͯΈΔͱ w݈ؾʹΔ࢟ͪΐͬͱײಈ͢Δ wͨͱ͑ྑ͍λΠϜ͕ग़ͳͯ͘
.(.4QFFEXBZ!SF*OWFOU
.(.)BDLFS4QBDF
World Championship for Developpers
$IBNQJPOTIJQ$VQ wՕॴͷ4VNNJU$JSDVJUͷ্Ґ w֤݄ͷ7JSUVBM$JSDVJU༏উऀ w૯߹ϙΠϯτ্Ґ w߹Θ໊͕ͤͯϥεϕΨεͷେձࢀՃ wνϟϯϐϣϯΧοϓΛڝ͍·͢
ܾউϦʔάਐग़ऀ https://aws.amazon.com/jp/blogs/machine-learning/the-aws-deepracer-league-and-countdown-to-the-reinvent-championship-cup-2019/ https://aws.amazon.com/jp/blogs/machine-learning/the-aws-deepracer-league-and-countdown-to-the-reinvent-championship-cup-2019/
"84%FFQ3BDFS57 w%FFQ3BDFSઐ༻ϝσΟΞ w֤ͷ4VNNJU$JSDVJUதܧΠϯλϏϡʔ https://www.youtube.com/watch?v=yDGm7u8wrNM
"84%FFQ3BDFS57 https://aws.amazon.com/deepracer/league
4MBDL͋Γ·͢ wEFFQSBDFSDPNNVOJUZTMBDLDPN ɹɹ໊ ݱࡏ ɻݱࡏট੍ɻӳޠ wEFFQSBDFSKQTMBDLDPN ɹɹ໊ɻຊޠɻࣗ༝ࢀՃ w͝ڵຯ͕͋Εট͠·͢ͷͰ͓͕͚͍ͩ͘͞
+"84'&45"4"11310։࠵ w%FFQ3BDFSίʔεઃஔʂ wϫʔΫγϣοϓ ߦձΛ༧ఆʂ wKGU
·ͱΊ
·ͱΊ w%FFQ3BDFS։ൃऀָ͕͘͠ػցֶशڧԽֶशΛ ֶΔϓϥοτϑΥʔϜ wڧԽֶशͷݪཧͱτϨʔχϯάํ๏ֶ͕Δ wόʔνϟϧϨʔεʹࢀՃͯ͠᛭ୖຏ w࣮ػͷϨʔε·ͨҧͬͨ໘ന͞ wੈքେձࢀՃͷӫ༪Λࢦͤʂ
None