Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Hello DeepRacer World
Search
Sponsored
·
Ship Features Fearlessly
Turn features on and off without deploys. Used by thousands of Ruby developers.
→
cmtt
October 19, 2019
Technology
0
1.1k
Hello DeepRacer World
re:Invent 2018で発表されたAWS DeepRacerが、今年大いに盛り上がりました。
DeepRacerの概要と始め方、各レースの様子を紹介します。
cmtt
October 19, 2019
Tweet
Share
More Decks by cmtt
See All by cmtt
re:Invent2019注目トピックとDeepRacerアップデート
cmtt
0
750
Other Decks in Technology
See All in Technology
今日から始めるAmazon Bedrock AgentCore
har1101
4
400
Contract One Engineering Unit 紹介資料
sansan33
PRO
0
13k
Oracle Cloud Observability and Management Platform - OCI 運用監視サービス概要 -
oracle4engineer
PRO
2
14k
セキュリティについて学ぶ会 / 2026 01 25 Takamatsu WordPress Meetup
rocketmartue
1
290
名刺メーカーDevグループ 紹介資料
sansan33
PRO
0
1k
外部キー制約の知っておいて欲しいこと - RDBMSを正しく使うために必要なこと / FOREIGN KEY Night
soudai
PRO
12
4.8k
SREじゃなかった僕らがenablingを通じて「SRE実践者」になるまでのリアル / SRE Kaigi 2026
aeonpeople
6
2.1k
会社紹介資料 / Sansan Company Profile
sansan33
PRO
15
400k
2026年、サーバーレスの現在地 -「制約と戦う技術」から「当たり前の実行基盤」へ- /serverless2026
slsops
2
210
Meshy Proプラン課金した
henjin0
0
250
10Xにおける品質保証活動の全体像と改善 #no_more_wait_for_test
nihonbuson
PRO
2
200
20260204_Midosuji_Tech
takuyay0ne
0
120
Featured
See All Featured
Scaling GitHub
holman
464
140k
AI in Enterprises - Java and Open Source to the Rescue
ivargrimstad
0
1.1k
Art, The Web, and Tiny UX
lynnandtonic
304
21k
A Tale of Four Properties
chriscoyier
162
24k
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
baasie
0
220
Navigating Algorithm Shifts & AI Overviews - #SMXNext
aleyda
0
1.1k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
3.3k
WENDY [Excerpt]
tessaabrams
9
36k
What’s in a name? Adding method to the madness
productmarketing
PRO
24
3.9k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
287
14k
16th Malabo Montpellier Forum Presentation
akademiya2063
PRO
0
47
The Hidden Cost of Media on the Web [PixelPalooza 2025]
tammyeverts
2
170
Transcript
)FMMP%FFQ3BDFS8PSME "84ࣄۀຊ෦ɹαʔϏεάϧʔϓ ߴڮ
"CPVUNF ߴڮ "84ࣄۀຊ෦αʔϏεάϧʔϓ ʮΫϥεϝιουɾϝϯόʔζʯ ϋʔυΣΞʹڵຯ͕͋Δ ιϑτΣΞ͞Μ UXJUUFS!FEZ HJUIVCFEZ
ຊͷ͓
AWS DeepRacer
AWS DeepRacer
͓͠ͳ͕͖ wͳͥ"84͕ϥδίϯΛʁ wػցֶशͱڧԽֶश w%FFQ3BDFSͷ͡Ίํ w4VNNJU$JSDVJUͱ7JSUVBM$JSDVJU w%FFQ3BDFS$IBNQJPOTIJQ$VQJO-BT7FHBT
Φεεϝͳਓ wϨʔε͖ͳਓ wܕϥδίϯ͖ͳਓ wϩϘοτ͖ͳਓ wػցֶशΓ͍͚ͨͲ·ͩͬͯͳ͍ਓ wͪΖΜػցֶशΨν
ͳͥʹAWS͕ϥδίϯΛʁ
ͳͥʹ"84͕ϥδίϯΛʁ w։ൃऀ͚ڧԽֶशϋϯζΦϯ wػցֶशڧԽֶशΛͬͱ։ൃऀʹΊ͍ͨ w͞ΘͬͯɺࢼߦࡨޡͰ͖ΔϓϥοτϑΥʔϜ wΘ͔Γ͍͢ඪɿϨʔεʹࢀՃͯ͠উͭ
"84%FFQ3BDFS
"84%FFQ3BDFS wεέʔϧͷϥδίϯ wڧԽֶशʹΑΔࣗߦ wϚχϡΞϧߦ 8J'J
εϖοΫ
6OEFSUIFIPPE
6OEFSUIFIPPE
6OEFSUIFIPPE
6OEFSUIFIPPE
ϥδίϯ࣮ػͷΞʔΩςΫνϟ wΧϝϥ w0QFO7*/0 w304
ػցֶशͱڧԽֶश
ػցֶशͷछྨ wڭࢣֶ͖श wڭࢣແֶ͠श wڧԽֶश ɹɹˢ%FFQ3BDFS͜Ε http://www0.cs.ucl.ac.uk/staff/d.silver/web/Teaching_files/intro_RL.pdf
ڧԽֶश͕ΘΕ͍ͯΔͱ͜Ζ
ڧԽֶशͷΈ
ใुؔʹྑ͞Λࣔؔ͢ wݴޠQZUIPO marker_1 = 0.1 * track_width marker_2 =
0.25 * track_width marker_3 = 0.5 * track_width reward = 1e-3 if distance_from_center >= 0.0 and distance_from_center <= marker_1: reward = 1 elif distance_from_center <= marker_2: reward = 0.5 elif distance_from_center <= marker_3: reward = 0.1 else: reward = 1e-3
γϛϡϨʔγϣϯͷΞʔΩςΫνϟ
%FFQ3BDFSͷ%-ωοτϫʔΫ
DeepRacerͷίϯιʔϧ
ϚωʔδϝϯτίϯιʔϧͰ%FFQ3BDFS
࠷ॳͷτϨʔχϯά
Ϧιʔεͷ࡞ ඞਢϦιʔεͷ࡞͕ඞཁ ճҎޙෆཁ
Ϟσϧ໊ΛܾΊΔ ໊લΛ͚Δ ͨ͘͞Μ࡞ΔͷͰࣈͰ۠ผ ΦϓγϣϯͰϝϞ
ΞΫγϣϯεϖʔεͷઃఆ
ใुؔ γϯλοΫενΣοΫ ฤूՄೳ αϯϓϧ͔ΒબΜͰ0,
ϋΠύʔύϥϝʔλ w࠷ॳσϑΥϧτͰ0, w܁Γฦ࣌͠ʹΛߋ৽ w-FBSOJOH3BUF w&OUSPQZ
γϛϡϨʔγϣϯͰτϨʔχϯά
γϛϡϨʔγϣϯͰτϨʔχϯά
τϨʔχϯάΛ܁Γฦ͢
τϨʔχϯά ϞσϧΛ࡞ ΞΫγϣϯεϖʔεΛઃఆ τϨʔχϯάίʔεΛબ ใुؔͱϋΠύʔύϥϝʔλΛઃఆ τϨʔχϯά )d) ධՁ
ϞσϧΛίϐʔ 3͔Β܁Γฦ͢
ֶश࣌ؒ w؆୯ͳίʔεͳΒ࣌ؒͰͰ͖Δ͜ͱ͋Δ w݅Λม͑Δͱͳ͔ͳֶ͔श͕ਐߦ͠ͳ͍ wίʔεͷΧʔϒ؇ٸ wߴઃఆͷΞΫγϣϯεϖʔε wਐߦঢ়گΛݟͳ͕Βd)ఔֶशͤ͞Δ͜ͱ
%FFQ3BDFSʹ͔͔Δඅ༻ wτϨʔχϯάͱධՁͷ࣮ߦ࣌ؒʹର͠)͘Β͍ w7JSUVBM$JSDVJUͰͷܭଌʹඅ༻͔͔Βͳ͍ w܁Γฦֶ͠शΛଓ͚ΔͷͰ݁ߏඅ༻͕͔͔Γ·͢ wਖ਼ݴͬͯେਓͷ༡ͼͰ͢ wΫϨδοτ͕ͨΔ8FFLMZ$IBMMFOHFاըΞϦ
wϩάͷࢹ֮Խͷྫ wπʔϧ͕"84༗ࢤ͔Β ڞ༗͞Ε͍ͯΔ ੳ
Virtual Circuit
7JSUVBM$JSDVJU wΦϯϥΠϯͰৗ࣌։࠵ wίʔε݄ସ w֤݄ͷॱҐΛڝ͏ w༏উऀܾউτʔφϝϯτਐग़ݖΛ֫ಘ ɹˠ-BT7FHBTͱSF*OWFOUট
݄ସΘΓͷίʔε Pre Season London Loop Kumo Torakku Empire City
Shanghai Sudu Cumulo Carrera Toronto Turnpike 4݄ 5݄ 6݄ 7݄ 8݄ 9݄ 10݄
τϨʔχϯάίʔεͱαʔΩοτίʔε αʔΩοτίʔε τϨʔχϯάίʔε Toronto Turnpike Toronto Turnpike Training
ࠓ݄'JOBM0OMJOF3BDF
8FFLMZ$IBMMFOHF wຖि͓͕ઃఆ͞ΕͯҐ·Ͱදজ wҬผɺϧʔΩʔɺվળτοϓɺಛఆඵʹ͍ۙ wॱҐͰΫϨδοτఏڙ d
Summit Circuit
4VNNJU$JSDVJU wੈք֤Ͱ։࠵͞ΕΔ"844VNNJU wίʔε͕ઃஔ͞Εɺ࣮ࡍʹΒͤΔ͜ͱ͕Ͱ͖Δ wେਓؾͰ࣌ؒͪβϥ
4VNNJU$JSDVJU wϞσϧɺ࣋ͪࠐΈग़དྷ߹͍ͷͲͪΒͰྑ͍ w࣋ͪ࣌ؒɺ४උɺίʔε w࠷ϥοϓ͕ग़ΔΑ͏͕࣌ؒڐ͢ݶΓτϥΠ wτϥοΫϘε͕ੈΛ͢Δ ίʔεΞτͨ͠Β͢ ɹˢେมͳॏ࿑ಇͰ͢ ײँ
4VNNJUͷίʔε wίʔεछྨɿSF*OWFOU
࣮ࡍʹΒͤΔ
࣮ػϔͷσϓϩΠ w࡞ֶͨ͠शϞσϧΛμϯϩʔυ w64#ϝϞϦʹอଘ wϥδίϯʹଓ ɹɹˠϞσϧΛ࣮ػʹϩʔυɺ࠷దԽ wྃ͢Δͱ8FCը໘ͰબΔΑ͏ʹͳΔ
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP https://www.youtube.com/watch?v=yDGm7u8wrNM
None
7JSUVBMͱͷҧ͍ wJ1BEͰεϩοτϧͷૢ࡞͕Մೳ wػମిͳͲͷݸମࠩΛௐ͢Δ wͳ͔ͳ͔ࢥ͏௨Γʹ Ԡ͠ͳͯ͘େม
࣮ࡍʹΒͤͯΈΔͱ w݈ؾʹΔ࢟ͪΐͬͱײಈ͢Δ wͨͱ͑ྑ͍λΠϜ͕ग़ͳͯ͘
.(.4QFFEXBZ!SF*OWFOU
.(.)BDLFS4QBDF
World Championship for Developpers
$IBNQJPOTIJQ$VQ wՕॴͷ4VNNJU$JSDVJUͷ্Ґ w֤݄ͷ7JSUVBM$JSDVJU༏উऀ w૯߹ϙΠϯτ্Ґ w߹Θ໊͕ͤͯϥεϕΨεͷେձࢀՃ wνϟϯϐϣϯΧοϓΛڝ͍·͢
ܾউϦʔάਐग़ऀ https://aws.amazon.com/jp/blogs/machine-learning/the-aws-deepracer-league-and-countdown-to-the-reinvent-championship-cup-2019/ https://aws.amazon.com/jp/blogs/machine-learning/the-aws-deepracer-league-and-countdown-to-the-reinvent-championship-cup-2019/
"84%FFQ3BDFS57 w%FFQ3BDFSઐ༻ϝσΟΞ w֤ͷ4VNNJU$JSDVJUதܧΠϯλϏϡʔ https://www.youtube.com/watch?v=yDGm7u8wrNM
"84%FFQ3BDFS57 https://aws.amazon.com/deepracer/league
4MBDL͋Γ·͢ wEFFQSBDFSDPNNVOJUZTMBDLDPN ɹɹ໊ ݱࡏ ɻݱࡏট੍ɻӳޠ wEFFQSBDFSKQTMBDLDPN ɹɹ໊ɻຊޠɻࣗ༝ࢀՃ w͝ڵຯ͕͋Εট͠·͢ͷͰ͓͕͚͍ͩ͘͞
+"84'&45"4"11310։࠵ w%FFQ3BDFSίʔεઃஔʂ wϫʔΫγϣοϓ ߦձΛ༧ఆʂ wKGU
·ͱΊ
·ͱΊ w%FFQ3BDFS։ൃऀָ͕͘͠ػցֶशڧԽֶशΛ ֶΔϓϥοτϑΥʔϜ wڧԽֶशͷݪཧͱτϨʔχϯάํ๏ֶ͕Δ wόʔνϟϧϨʔεʹࢀՃͯ͠᛭ୖຏ w࣮ػͷϨʔε·ͨҧͬͨ໘ന͞ wੈքେձࢀՃͷӫ༪Λࢦͤʂ
None