Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Hello DeepRacer World
Search
cmtt
October 19, 2019
Technology
0
1k
Hello DeepRacer World
re:Invent 2018で発表されたAWS DeepRacerが、今年大いに盛り上がりました。
DeepRacerの概要と始め方、各レースの様子を紹介します。
cmtt
October 19, 2019
Tweet
Share
More Decks by cmtt
See All by cmtt
re:Invent2019注目トピックとDeepRacerアップデート
cmtt
0
650
Other Decks in Technology
See All in Technology
ガバメントクラウドのセキュリティ対策事例について
fujisawaryohei
0
320
Oracle Cloudの生成AIサービスって実際どこまで使えるの? エンジニア目線で試してみた
minorun365
PRO
4
230
実務につなげる数理最適化
recruitengineers
PRO
6
600
re:Invent2024のIaC周りのアップデート&セッションの共有/around-re-invent-2024-iac-updates
tomoki10
0
990
AIのコンプラは何故しんどい?
shujisado
1
180
NilAway による静的解析で「10 億ドル」を節約する #kyotogo / Kyoto Go 56th
ytaka23
3
330
継続的にアウトカムを生み出し ビジネスにつなげる、 戦略と運営に対するタイミーのQUEST(探求)
zigorou
0
300
Classmethod_regrowth_2024_tokyo_security_identity_governance_summary
hiashisan
0
970
OpsJAWS32 re:Invent 2024 Ops系アップデートまとめ
takahirohori
0
190
目玉アップデート!のSageMaker LakehouseとUnified Studioは何たるかを見てみよう!
nayuts
0
230
新機能Amazon GuardDuty Extended Threat Detectionはネ申って話
cmusudakeisuke
0
470
社外コミュニティで学び社内に活かす共に学ぶプロジェクトの実践/backlogworld2024
nishiuma
0
240
Featured
See All Featured
Mobile First: as difficult as doing things right
swwweet
222
9k
Scaling GitHub
holman
458
140k
Code Reviewing Like a Champion
maltzj
520
39k
Being A Developer After 40
akosma
87
590k
KATA
mclloyd
29
14k
A designer walks into a library…
pauljervisheath
204
24k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
6
510
Docker and Python
trallard
41
3.1k
RailsConf 2023
tenderlove
29
930
Large-scale JavaScript Application Architecture
addyosmani
510
110k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
marcduiker
26
1.8k
Adopting Sorbet at Scale
ufuk
73
9.1k
Transcript
)FMMP%FFQ3BDFS8PSME "84ࣄۀຊ෦ɹαʔϏεάϧʔϓ ߴڮ
"CPVUNF ߴڮ "84ࣄۀຊ෦αʔϏεάϧʔϓ ʮΫϥεϝιουɾϝϯόʔζʯ ϋʔυΣΞʹڵຯ͕͋Δ ιϑτΣΞ͞Μ UXJUUFS!FEZ HJUIVCFEZ
ຊͷ͓
AWS DeepRacer
AWS DeepRacer
͓͠ͳ͕͖ wͳͥ"84͕ϥδίϯΛʁ wػցֶशͱڧԽֶश w%FFQ3BDFSͷ͡Ίํ w4VNNJU$JSDVJUͱ7JSUVBM$JSDVJU w%FFQ3BDFS$IBNQJPOTIJQ$VQJO-BT7FHBT
Φεεϝͳਓ wϨʔε͖ͳਓ wܕϥδίϯ͖ͳਓ wϩϘοτ͖ͳਓ wػցֶशΓ͍͚ͨͲ·ͩͬͯͳ͍ਓ wͪΖΜػցֶशΨν
ͳͥʹAWS͕ϥδίϯΛʁ
ͳͥʹ"84͕ϥδίϯΛʁ w։ൃऀ͚ڧԽֶशϋϯζΦϯ wػցֶशڧԽֶशΛͬͱ։ൃऀʹΊ͍ͨ w͞ΘͬͯɺࢼߦࡨޡͰ͖ΔϓϥοτϑΥʔϜ wΘ͔Γ͍͢ඪɿϨʔεʹࢀՃͯ͠উͭ
"84%FFQ3BDFS
"84%FFQ3BDFS wεέʔϧͷϥδίϯ wڧԽֶशʹΑΔࣗߦ wϚχϡΞϧߦ 8J'J
εϖοΫ
6OEFSUIFIPPE
6OEFSUIFIPPE
6OEFSUIFIPPE
6OEFSUIFIPPE
ϥδίϯ࣮ػͷΞʔΩςΫνϟ wΧϝϥ w0QFO7*/0 w304
ػցֶशͱڧԽֶश
ػցֶशͷछྨ wڭࢣֶ͖श wڭࢣແֶ͠श wڧԽֶश ɹɹˢ%FFQ3BDFS͜Ε http://www0.cs.ucl.ac.uk/staff/d.silver/web/Teaching_files/intro_RL.pdf
ڧԽֶश͕ΘΕ͍ͯΔͱ͜Ζ
ڧԽֶशͷΈ
ใुؔʹྑ͞Λࣔؔ͢ wݴޠQZUIPO marker_1 = 0.1 * track_width marker_2 =
0.25 * track_width marker_3 = 0.5 * track_width reward = 1e-3 if distance_from_center >= 0.0 and distance_from_center <= marker_1: reward = 1 elif distance_from_center <= marker_2: reward = 0.5 elif distance_from_center <= marker_3: reward = 0.1 else: reward = 1e-3
γϛϡϨʔγϣϯͷΞʔΩςΫνϟ
%FFQ3BDFSͷ%-ωοτϫʔΫ
DeepRacerͷίϯιʔϧ
ϚωʔδϝϯτίϯιʔϧͰ%FFQ3BDFS
࠷ॳͷτϨʔχϯά
Ϧιʔεͷ࡞ ඞਢϦιʔεͷ࡞͕ඞཁ ճҎޙෆཁ
Ϟσϧ໊ΛܾΊΔ ໊લΛ͚Δ ͨ͘͞Μ࡞ΔͷͰࣈͰ۠ผ ΦϓγϣϯͰϝϞ
ΞΫγϣϯεϖʔεͷઃఆ
ใुؔ γϯλοΫενΣοΫ ฤूՄೳ αϯϓϧ͔ΒબΜͰ0,
ϋΠύʔύϥϝʔλ w࠷ॳσϑΥϧτͰ0, w܁Γฦ࣌͠ʹΛߋ৽ w-FBSOJOH3BUF w&OUSPQZ
γϛϡϨʔγϣϯͰτϨʔχϯά
γϛϡϨʔγϣϯͰτϨʔχϯά
τϨʔχϯάΛ܁Γฦ͢
τϨʔχϯά ϞσϧΛ࡞ ΞΫγϣϯεϖʔεΛઃఆ τϨʔχϯάίʔεΛબ ใुؔͱϋΠύʔύϥϝʔλΛઃఆ τϨʔχϯά )d) ධՁ
ϞσϧΛίϐʔ 3͔Β܁Γฦ͢
ֶश࣌ؒ w؆୯ͳίʔεͳΒ࣌ؒͰͰ͖Δ͜ͱ͋Δ w݅Λม͑Δͱͳ͔ͳֶ͔श͕ਐߦ͠ͳ͍ wίʔεͷΧʔϒ؇ٸ wߴઃఆͷΞΫγϣϯεϖʔε wਐߦঢ়گΛݟͳ͕Βd)ఔֶशͤ͞Δ͜ͱ
%FFQ3BDFSʹ͔͔Δඅ༻ wτϨʔχϯάͱධՁͷ࣮ߦ࣌ؒʹର͠)͘Β͍ w7JSUVBM$JSDVJUͰͷܭଌʹඅ༻͔͔Βͳ͍ w܁Γฦֶ͠शΛଓ͚ΔͷͰ݁ߏඅ༻͕͔͔Γ·͢ wਖ਼ݴͬͯେਓͷ༡ͼͰ͢ wΫϨδοτ͕ͨΔ8FFLMZ$IBMMFOHFاըΞϦ
wϩάͷࢹ֮Խͷྫ wπʔϧ͕"84༗ࢤ͔Β ڞ༗͞Ε͍ͯΔ ੳ
Virtual Circuit
7JSUVBM$JSDVJU wΦϯϥΠϯͰৗ࣌։࠵ wίʔε݄ସ w֤݄ͷॱҐΛڝ͏ w༏উऀܾউτʔφϝϯτਐग़ݖΛ֫ಘ ɹˠ-BT7FHBTͱSF*OWFOUট
݄ସΘΓͷίʔε Pre Season London Loop Kumo Torakku Empire City
Shanghai Sudu Cumulo Carrera Toronto Turnpike 4݄ 5݄ 6݄ 7݄ 8݄ 9݄ 10݄
τϨʔχϯάίʔεͱαʔΩοτίʔε αʔΩοτίʔε τϨʔχϯάίʔε Toronto Turnpike Toronto Turnpike Training
ࠓ݄'JOBM0OMJOF3BDF
8FFLMZ$IBMMFOHF wຖि͓͕ઃఆ͞ΕͯҐ·Ͱදজ wҬผɺϧʔΩʔɺվળτοϓɺಛఆඵʹ͍ۙ wॱҐͰΫϨδοτఏڙ d
Summit Circuit
4VNNJU$JSDVJU wੈք֤Ͱ։࠵͞ΕΔ"844VNNJU wίʔε͕ઃஔ͞Εɺ࣮ࡍʹΒͤΔ͜ͱ͕Ͱ͖Δ wେਓؾͰ࣌ؒͪβϥ
4VNNJU$JSDVJU wϞσϧɺ࣋ͪࠐΈग़དྷ߹͍ͷͲͪΒͰྑ͍ w࣋ͪ࣌ؒɺ४උɺίʔε w࠷ϥοϓ͕ग़ΔΑ͏͕࣌ؒڐ͢ݶΓτϥΠ wτϥοΫϘε͕ੈΛ͢Δ ίʔεΞτͨ͠Β͢ ɹˢେมͳॏ࿑ಇͰ͢ ײँ
4VNNJUͷίʔε wίʔεछྨɿSF*OWFOU
࣮ࡍʹΒͤΔ
࣮ػϔͷσϓϩΠ w࡞ֶͨ͠शϞσϧΛμϯϩʔυ w64#ϝϞϦʹอଘ wϥδίϯʹଓ ɹɹˠϞσϧΛ࣮ػʹϩʔυɺ࠷దԽ wྃ͢Δͱ8FCը໘ͰબΔΑ͏ʹͳΔ
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP
"844VNNJU5PLZP https://www.youtube.com/watch?v=yDGm7u8wrNM
None
7JSUVBMͱͷҧ͍ wJ1BEͰεϩοτϧͷૢ࡞͕Մೳ wػମిͳͲͷݸମࠩΛௐ͢Δ wͳ͔ͳ͔ࢥ͏௨Γʹ Ԡ͠ͳͯ͘େม
࣮ࡍʹΒͤͯΈΔͱ w݈ؾʹΔ࢟ͪΐͬͱײಈ͢Δ wͨͱ͑ྑ͍λΠϜ͕ग़ͳͯ͘
.(.4QFFEXBZ!SF*OWFOU
.(.)BDLFS4QBDF
World Championship for Developpers
$IBNQJPOTIJQ$VQ wՕॴͷ4VNNJU$JSDVJUͷ্Ґ w֤݄ͷ7JSUVBM$JSDVJU༏উऀ w૯߹ϙΠϯτ্Ґ w߹Θ໊͕ͤͯϥεϕΨεͷେձࢀՃ wνϟϯϐϣϯΧοϓΛڝ͍·͢
ܾউϦʔάਐग़ऀ https://aws.amazon.com/jp/blogs/machine-learning/the-aws-deepracer-league-and-countdown-to-the-reinvent-championship-cup-2019/ https://aws.amazon.com/jp/blogs/machine-learning/the-aws-deepracer-league-and-countdown-to-the-reinvent-championship-cup-2019/
"84%FFQ3BDFS57 w%FFQ3BDFSઐ༻ϝσΟΞ w֤ͷ4VNNJU$JSDVJUதܧΠϯλϏϡʔ https://www.youtube.com/watch?v=yDGm7u8wrNM
"84%FFQ3BDFS57 https://aws.amazon.com/deepracer/league
4MBDL͋Γ·͢ wEFFQSBDFSDPNNVOJUZTMBDLDPN ɹɹ໊ ݱࡏ ɻݱࡏট੍ɻӳޠ wEFFQSBDFSKQTMBDLDPN ɹɹ໊ɻຊޠɻࣗ༝ࢀՃ w͝ڵຯ͕͋Εট͠·͢ͷͰ͓͕͚͍ͩ͘͞
+"84'&45"4"11310։࠵ w%FFQ3BDFSίʔεઃஔʂ wϫʔΫγϣοϓ ߦձΛ༧ఆʂ wKGU
·ͱΊ
·ͱΊ w%FFQ3BDFS։ൃऀָ͕͘͠ػցֶशڧԽֶशΛ ֶΔϓϥοτϑΥʔϜ wڧԽֶशͷݪཧͱτϨʔχϯάํ๏ֶ͕Δ wόʔνϟϧϨʔεʹࢀՃͯ͠᛭ୖຏ w࣮ػͷϨʔε·ͨҧͬͨ໘ന͞ wੈքେձࢀՃͷӫ༪Λࢦͤʂ
None