Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
入門AlphaGo
Search
na-o-ys
April 22, 2016
Technology
5
3.8k
入門AlphaGo
"Mastering the game of Go with deep neural networks and tree search" の概要
na-o-ys
April 22, 2016
Tweet
Share
More Decks by na-o-ys
See All by na-o-ys
IoTと監視
naoys
1
790
RubyとJIT
naoys
0
160
将棋盤を画像認識したかった
naoys
0
1.5k
Rust で乗り換え案内
naoys
0
630
疎行列と Jaccard 類似度の高速計算
naoys
1
630
有理数集合の濃度
naoys
2
130
YARVの最適化について調べた
naoys
0
140
転職会議サービスのAWS移行記録
naoys
0
72
Anonymous Recursion in C++
naoys
0
420
Other Decks in Technology
See All in Technology
【新卒研修資料】LLM・生成AI研修 / Large Language Model・Generative AI
brainpadpr
25
17k
『OCI で学ぶクラウドネイティブ 実践 × 理論ガイド』 書籍概要
oracle4engineer
PRO
2
120
Escaping_the_Kraken_-_October_2025.pdf
mdalmijn
0
150
Why Governance Matters: The Key to Reducing Risk Without Slowing Down
sarahjwells
0
110
組織観点からIAM Identity CenterとIAMの設計を考える
nrinetcom
PRO
1
190
How to achieve interoperable digital identity across Asian countries
fujie
0
120
Goに育てられ開発者向けセキュリティ事業を立ち上げた僕が今向き合う、AI × セキュリティの最前線 / Go Conference 2025
flatt_security
0
350
LLMアプリケーション開発におけるセキュリティリスクと対策 / LLM Application Security
flatt_security
7
1.9k
From Prompt to Product @ How to Web 2025, Bucharest, Romania
janwerner
0
120
生成AIを活用したZennの取り組み事例
ryosukeigarashi
0
210
職種別ミートアップで社内から盛り上げる アウトプット文化の醸成と関係強化/ #DevRelKaigi
nishiuma
2
140
Azure Well-Architected Framework入門
tomokusaba
1
320
Featured
See All Featured
A better future with KSS
kneath
239
17k
Facilitating Awesome Meetings
lara
56
6.6k
Typedesign – Prime Four
hannesfritz
42
2.8k
Building an army of robots
kneath
306
46k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
48
9.7k
GraphQLの誤解/rethinking-graphql
sonatard
73
11k
Unsuck your backbone
ammeep
671
58k
For a Future-Friendly Web
brad_frost
180
9.9k
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
9
850
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
52
5.6k
GraphQLとの向き合い方2022年版
quramy
49
14k
Fantastic passwords and where to find them - at NoRuKo
philnash
52
3.4k
Transcript
ೖAlphaGo 0x64ޠ ୈ07 “AI” @na_o_ys
͝ҙ • จʹॻ͔Ε͍ͯͳ͍ಠࣗௐࠪਪଌؚ͕· Ε·͢ • Ұߟͩͱࢥͬͯݟ͍ͯͩ͘͞
AlphaGoͱ • ॳΊͯϓϩع࢜ΛഁͬͨғޟAI
ୈҰ෦: AlphaGoʹࢸΔ·Ͱ
શใήʔϜ • ΦηϩɺνΣεɺকعɺғޟɺetc • ϥϯμϜੑ͕ແ͘ɺ࠷ળख͕ଘࡏ͢Δ • (ݪཧతʹ) ઌखඞউɾޙखඞউɾҾ͖͚
ήʔϜ • શ୳ࡧͰ࠷ળख͕ٻ·Δ • ܭࢉྔతʹෆՄೳ … ݱہ໘ 1खޙ 2खޙ
ධՁؔ • ൫໘Λ༩͑ΔͱείΞ (༧উͳͲ) Λฦؔ͢ • কعνΣεͳΒɺۨͷଛಘޮ͖ͷΛݩʹܭࢉ • ήʔϜͷ୳ࡧൣғ(ਂ͞)ΛݶఆͰ͖Δ ݱہ໘
1खޙ 2खޙ ධՁˠ 0.1 0.8 0.3 0.4
ධՁؔͷ༗ޮੑ • ύϥϝʔλͷબఆɾઃఆ͕ΩϞ • ख࡞ۀ: νΣεͰਓؒΛ͑ͨ • ػցֶश: কعͰਓؒΛ͑ͨ •
ғޟෳࡶੑͷͨΊʹ·ͱͳධՁؔΛ࡞Εͳ͔ͬ ͨ
ݪ࢝ϞϯςΧϧϩ๏ • ϥϯμϜʹऴہ·Ͱଧͭ (ϩʔϧΞτ) Λ܁Γฦͯ͠ɺউΛܭ ࢉ͢Δํ๏ ϩʔϧΞτΛ܁Γฦͯ͠ উΛܭࢉ উ 7/10
উ 3/10
ϞϯςΧϧϩ୳ࡧ (MCTS) • ݪ࢝ϞϯςΧϧϩ๏ΛධՁؔతʹ͏ • n खઌͰϩʔϧΞτ • ༿ͷউΛܭࢉ ※͞Βʹ༿ͷউʹԠͯ͡ಈతʹࢬמΓɾల։͠ɺ୳ࡧਫ਼Λ্͛Δ
ϙϦγʔؔ • f (ہ໘, ࣍ͷҰख) • ࣍ͷҰखͷࣗવ͞Λ͋ΒΘ֬͢ີؔ • عේσʔλ͔Βͷֶश͕༰қ •
ϩʔϧΞτ࣌ʹ͑Δ • ϥϯμϜʹଧͭͷͰͳ͘ɺ·ͱͳखΛଧͨͤΔ • ͨͩ͠ߴʹಈ࡞͢Δඞཁ͕͋Δ
MCTSͷڧ͞ • ϙϦγʔؔͷͳͲͰΞϚνϡΞߴஈʹඖఢ͢Δڧ͞· Ͱਐา • ϓϩʹٴͳ͍ • େہ؍ʹ༏ΕΔ • ʮڱ͘ਂ͍ಡΈʯ͕ऑ͍
• खΛ͘ಡΉͨΊ
AlphaGo͕ͬͨ͜ͱ • جຊMCTS • ༷ʑͳ • CNN(ΈࠐΈχϡʔϥϧωοτϫʔΫ) • ڧԽֶश •
ධՁؔ • ฒྻࢄΞϧΰϦζϜ • MCTS ʹͦΕΒΛΈࠐΜͩ
ୈೋ෦: AlphaGo
2ͭͷϙϦγʔؔͱ 1ͭͷධՁؔ ϩʔϧΞτϙϦγʔ ϩʔϧΞτʹ͏ ߴɾਫ਼ 4-ϙϦγʔ ୳ࡧॱংΛܾΊΔ ɾߴਫ਼ ධՁؔ ༿ͷධՁ(উ)Λܭࢉ
ϩʔϧΞτʹΑΔউͱ͠߹ΘͤΔ
ϩʔϧΞτϙϦγʔ • ϩʔϧΞτ(ϥϯμϜϓϨΠ)ʹ͏ϙϦγʔؔ • ߴੑɹʼɹਫ਼ • ਓؒͷعේ800ສہ໘͔Βֶश • ઢܗιϑτϚοΫεؔ •
2ϚΠΫϩඵ (ߴ) • عේͱͷࢦ͠खҰக: 24.2%
SLϙϦγʔ • ͷ୳ࡧॱংΛܾΊΔϙϦγʔؔ • ਫ਼ɹʼɹߴੑ • ਓؒͷعේ3000ສہ໘͔Βֶश • 13CNN(ΈࠐΈχϡʔϥϧωοτϫʔΫ) •
ը૾ೝࣝͰΑ͘ΘΕΔ • : 3ϛϦඵ • عේͱͷࢦ͠खҰக: 57%
ධՁؔ • 14CNN • SLϙϦγʔΛڧԽֶशͨ͠ͷ (RLϙϦγʔ) Λݩʹɺճؼͯ͠࡞Δ 4-ϙϦγʔ 3-ϙϦγʔ ධՁؔ
1. ڧԽֶश 2. ϥϯμϜعේੜ (3000ສہ໘) 3. ճؼ
ධՁؔͷଊ͑ํ • ϩʔϧΞτʹΑΔউܭࢉΛิ͏ͷ • ୯ମͰͦ͜·Ͱڧ͘ͳ͍ • ධՁؔͷಛ (ߟ) • ʮڱ͘ਂ͍ಡΈʯʹڧ͍
• ʮRLϙϦγʔ(ڧԽֶश݁Ռ)Λऴہ·ͰଧͨͤͨࡍͷউʯͱՁ • େہ؍͕ແ͍ • Ұຊಓ͔͠ಡ·ͳ͍ .$54ͷಛੑ େہ؍ʹ༏Εͯʮਂ͍ಡΈʯ͕ऑ͍ ͱ ͏·͘ิ͍͍͋ͬͯΔ
ڧ͞ (2015/10࣌)
ڧ͞ (2016/3 ࣌) R3500+ ͷΠɾηυϧʹউ
ࢀߟ • Mastering the game of Go with deep neural
networks and tree search (http://www.nature.com/nature/journal/v529/n7587/full/ nature16961.html) • Google AlphaGoͷΈΛཧղ͢Δ | IT Leaders (http://it.impressbm.co.jp/articles/-/13474)
ऴΘΓ