Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
強化学習の実業務への応用について
Search
kitamuaratomokazu
February 16, 2019
Technology
0
810
強化学習の実業務への応用について
kitamuaratomokazu
February 16, 2019
Tweet
Share
More Decks by kitamuaratomokazu
See All by kitamuaratomokazu
Calling Julia from Python (Julia Time)
kitamuratomokazu
0
95
Calling Julia from Python
kitamuratomokazu
2
750
Other Decks in Technology
See All in Technology
✨敗北解法コレクション✨〜Expertだった頃に足りなかった知識と技術〜
nanachi
1
670
AIに頼りすぎない新人育成術
cuebic9bic
3
230
Amazon GuardDuty での脅威検出:脅威検出の実例から学ぶ
kintotechdev
0
100
React Server ComponentsでAPI不要の開発体験
polidog
PRO
0
150
相互運用可能な学修歴クレデンシャルに向けた標準技術と国際動向
fujie
0
240
Kiroから考える AIコーディングツールの潮流
oikon48
4
680
Claude CodeでKiroの仕様駆動開発を実現させるには...
gotalab555
3
980
Vision Language Modelと自動運転AIの最前線_20250730
yuyamaguchi
4
1.2k
Amazon Q Developerを活用したアーキテクチャのリファクタリング
k1nakayama
2
200
Strands Agents & Bedrock AgentCoreを1分でおさらい
minorun365
PRO
6
290
AWS re:Inforce 2025 re:Cap Update Pickup & AWS Control Tower の運用における考慮ポイント
htan
1
230
Rubyの国のPerlMonger
anatofuz
3
730
Featured
See All Featured
A Tale of Four Properties
chriscoyier
160
23k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
26k
Stop Working from a Prison Cell
hatefulcrawdad
271
21k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
Measuring & Analyzing Core Web Vitals
bluesmoon
8
550
Into the Great Unknown - MozCon
thekraken
40
2k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
357
30k
The Cult of Friendly URLs
andyhume
79
6.5k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
29
1.8k
Build The Right Thing And Hit Your Dates
maggiecrowley
37
2.8k
Making the Leap to Tech Lead
cromwellryan
134
9.5k
Building Applications with DynamoDB
mza
95
6.5k
Transcript
ڧԽֶशͷ࣮ۀͷԠ༻ʹ͍ͭͯ .BUI$PEJOHڧԽֶशΛޠΖ͏ʂ גࣜձࣾεΫϥϜαΠϯɹදऔకɹଜ༑ LJUBNVSB!TDSVNTJHODPN 5JUMF
ଜɹ༑ ࣄɿגࣜձࣾεΫϥϜαΠϯɹ ɹɹػցֶशΞϓϦέʔγϣϯͷઃܭ։ൃ ɹɹσʔλੳνʔϜͷ্ཱͪ͛ࢧԉ ɹɹڧԽֶशͱ֬ϓϩάϥϛϯάʹؔ৺ɻੵۃతʹࣄྫΛ࡞͍ͬͯ·͢ɻ झຯίϛϡχςΟӡӦ .BUI$PEJOHओ࠵ ɹɹߨࢣ͕ڭ͑ΔͷͰͳ͘ɺࢀՃऀಉ͕࢜ޓ͍ʹࣝͱܙΛ࣋ͪدΓ ɹɹڭֶ͍͑͋Ϳʹָ͠͞Λײ͍ͯ͡·͢ɻ
ࣗݾհ
ʢήʔϜͷੈքͰͳ͘ʣ ڧԽֶशΛ࣮ۀͰԠ༻͍ͯͨ͘͠Ίʹ 5PEBZ`T.BJO5IFNF
ֶशϓϩηε ɹ୳ࡧͱར༻ ɹɹࢼߦࡨޡ͠ͳ͕ΒֶͿ͜ͱ͕Ͱ͖Δ͔ʁ Ϛϧίϑܾఆաఔ ɹݱ࣌ͷใ͔Β࣍ͷܾఆΛԼ͢͜ͱ͕Ͱ͖Δ͔ ɹͦͷܾఆʹΑΓ֬తʹ࣍ͷঢ়ଶભҠ͢Δ͔ʁ ڧԽֶशʹ͍͍ͯΔઃఆͷ֬ೝ
ࠓճҩྍؔͷΫϥΠΞϯτΑΓࣄྫఏڙͷڐՄΛ͍͖ͨͩ·ͨ͠ɻ ʢຊࢿྉͷσʔλͯ͢μϛʔͰ͋Γ࣮ࡍͷσʔλͰ͋Γ·ͤΜɻʣ ԼهͷέʔεΛఆͯ͠ڧԽֶशͰղ͍ͯΈ·ͨ͠ɻ ຖඦ໊ͷױऀ͕དྷӃ͠ελοϑʢޢࢣʣ͕࠾݂͍ͯ͠·͢ɻ ױऀʹΑͬͯ࠾݂͍͢͠ਓͱͦ͏Ͱͳ͍ਓ͕͍Δ͜ͱɻ ελοϑਓʹΑͬͯϕςϥϯ͔Β৽ਓ·Ͱٕྔʹ͕ࠩ͋Γ·͢ɻ Ұఆͷׂ߹Ͱɺ࠾݂ʹࣦഊ͠·͢ɻ ࣄྫɿපӃͷ࠾݂
࠾݂ͷࣦഊΛԼ͛ͯױऀͷຬΛ্͍͛ͨɻ ελοϑͷٕྔͷ্ΛਤΓ͍ͨɻ ղ͖͍ͨ՝
૬͢ΔཁٻΛຬͨ͢࠷దͳߦಈબΛڧԽֶशͰֶͿ͜ͱ͕Մೳ ͔ʁ ࣦഊΛԼ͛Δ ɹϕςϥϯελοϑ͕ରԠ͢Δ ٕೳͷ্ΛਤΔ ɹࣗͷٕྔΑΓগ͍͠͠ױऀʹτϥΠ͢Δ ɹࣦഊ͕͕͋Δ (PBMͷઃܭ
ελοϑ͕దͳқͷױऀΛ୲Ͱ͖Δ͜ͱ ߦಈΛ֤ελοϑ͝ͱʹ5SZ͔1BTT͔Λબͤͯͪ͞ߦ ྻͷঢ়گ͓Αͼελοϑͷۭ͖ঢ়گͱࣗͷྗྔʹԠͨ͡5SZ ͱ1BTTΛબͰ͖ΔΑ͏ʹֶश͍ͨ͠ɻ ݱঢ়Ϛωʔδϟʔ͕ܦݧͱצͰߦ͍ͬͯΔΑ͏Ͱ͢ɻ (PBMͷઃܭ
1P$ ֓೦ݕূ ػցֶश͕Ծʹ͏·͘ਐΉͱɺ ৽ਓࣗͷྗྔʹ͋ͬͨױऀΛબผɹࣦഊԼ͕Δ ϕςϥϯελοϑɹқ͕ߴ͍ױऀΛબผࣦഊ্͕Δ ͣʂ (PBMͷઃܭ
ױऀқελοϑٕྔ ਪఆ ֬Ϟσϧ ױऀͱελοϑ Ϛονϯά ҰͭͷϞσϧͰҰʹղ͘ͷ͍͠ͷͰ Λׂ͠·ͨ͠ ڧԽֶश ਪఆͨ͠Λಛྔ ใुͱͯ͠ར༻͢Δ
֬ϞσϧͱڧԽֶशΛ߹Θͤͯղ͍͍ͯ͘ ϞσϦϯάͷํ
ίϛϡχςΟϝϯόʔͱͷσΟεΧογϣϯ ॳ࿈ଓ࣌ؒͷ.%1Λߟ͍͑ͯ ͨɻ3FXBSEױऀͷͪ࣌ؒΛ ϖφϧςΟͱͯ͠༩͑ΔํࣜΛݕ ౼్͍͕ͯͨ͠தͰํసɻ ࢄ࣌ؒͷߦಈͱͯ͠ใु ٕྔɿTLJMMͱױऀࠔɿ EJGpDVMUZͰදݱ
࣮ɿϞσϦϯά ωοτϫʔΫ ɹ%2/ ӅΕʢೖྗ࣍ݩͱಉ͡GVMMDPOOFDUFESFMVʣɹग़ྗ࣍ݩɹMJOFBS ಛྔ ױऀࠔɿ࿈ଓ ελοϑٕྔ࿈ଓ
ελοϑͷۭ͖༧ఆ࣌ؒ࿈ଓ ରԠελοϑPOFIPU ߦಈ ɹUSZQBTT࣍ݩ ใु ޭEJGpDVMUZTLJMM ׂɹௐͣΈ ࣦഊTLJMMEJGpDVMUZ ׂ̌ɹௐͣΈ ͪ࣌ؒͳ͠ͷQBTT ͪ࣌ؒ͋ΓͷQBTTTLJMMEJGpDVMUZ ʢͪ࣌ؒ ͪ࣌ؒͷ࠷େ ؔۙࣅͰɺॳχϡʔϥϧωοτͰͳ͍ͷΛ࣮͠Α͏ͱ͕ͨ͠χϡʔϥϧωοτͷํָ͕ʹ࣮Ͱ͖ΔͷͰ ࣌ؒͷؔͰ%2/Ͱ࣮͢Δɻ
ֶशͷਪҠϥϯμϜʹߦಈબ
ֶशͷਪҠϥϯμϜʹߦಈબ
ֶशͷਪҠ%2/ͰͲ͏͔ʁ
ֶशͷਪҠ%2/ ֶशͷ݁Ռɹϕςϥϯʹ1BTT͢Δ͜ͱΛ֮͑ͨɻ
ϞσϦϯάͷݟ͠ ωοτϫʔΫ ɹ%2/ ೖྗ̍̎࣍ݩɹӅΕʢ࣍ݩGVMMDPOOFDUFESFMVʣɹग़ྗ࣍ݩɹMJOFBS MPTTGVODUJPONTF PQUJNJ[FS"EBN ɹMFBSOJOHSBUF ಛྔ ױऀࠔɿ࿈ଓ
ελοϑٕྔ࿈ଓ ελοϑͷۭ͖ঢ়گPOFIPU ରԠελοϑPOFIPU ߦಈ ɹUSZQBTTͷೋ ใु ޭ ࣦഊ ͪ࣌ؒͳ͠ͷQBTT ͪ࣌ؒ͋ΓͷQBTT ɹTUFQޙ·ͰΛߟྀͨ͠ใुͰֶश ʣใुؔͱಛϕΫτϧΛݟͨ͠ΓMFBSOJOHSBUFΛখͨ͘͞͠Γͨ͠ɻ
ֶशͷਪҠ%2/Ϟσϧͱใुؔݟ͠
ֶशͷਪҠ%2/Ϟσϧͱใुؔݟ͠ ࣗͷ࣮ྗʹԠͨ͡ױऀΛબΜͰ5SZ͢ΔΑ͏ʹͳͬͨɻ ͔͜͜Β͞ΒʹϒϥογϡΞοϓ͍͖ͯ͠·͢ɻ
ڧԽֶशͷָ͠͞ ͏·͍͔͘ͳ͍࣌ɺ"HFOUͷؾ࣋ͪΛߟ͑ͨΓ͢Δɻ ใुʹΑͬͯڍಈ͕͝Ζͬͱ͔ΘΔ ڧԽֶशʹ͍ͭͯͷจ͕ʑ͍͍͢͝Ͱൃද͞Ε͍ͯΔɻ ใुؔઃܭγϡϛϨʔλ࡞ɺֶशϞσϧͳͲߟ͑Δ͜ ͱ͕ଟ͘ΫϥΠΞϯτνʔϜϝϯόʔͱͷΓͱΓͳͲɺ େม͕ͩઃܭϓϩηεָ͕͍͠ɻ
͍֓͠೦ٕज़ɺγϯϓϧͳྫͰ֬ೝͨ͠Γϝϯόʔ͕ର͢Δ͜ͱͰຊ࣭తͳཧղ ΛಘΒΕΔͱߟ͑·͢ɻຊάϧʔϓɺͦͷΑ͏ͳ͜ͱ͕Ͱ͖ΔΑ͏ͳίϛϡχςΟͱͳ Δ͜ͱΛࢦͯ͠ӡӦ͍ͯ͠·͢ɻڵຯ͕͋Δํͥͻ͝ࢀՃ͍ͩ͘͞ɻ IUUQTNBUIDPEJOHDPOOQBTTDPN .BUI$PEJOHͷհ
͝੩ௌ͋Γ͕ͱ͏͍͟͝·ͨ͠ɻ -BTU