Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
NIPS/KDD2016読み会@早稲田
Search
bigsea
December 26, 2016
Technology
0
960
NIPS/KDD2016読み会@早稲田
"Why Should I Trust You?" Explaining the Predictions of Any Classifier, KDD2016 の紹介資料
bigsea
December 26, 2016
Tweet
Share
More Decks by bigsea
See All by bigsea
Introduction to semantic parsing
bigseat
0
370
Other Decks in Technology
See All in Technology
AWS⼊社という選択肢、⾒えていますか
iwamot
2
1.1k
LINEヤフー株式会社における音声言語情報処理AI研究開発@SP/SLP研究会 2024.10.22
lycorptech_jp
PRO
2
270
TinyGoを使ったVSCode拡張機能実装
askua
2
200
障害対応指揮の意思決定と情報共有における価値観 / Waroom Meetup #2
arthur1
2
150
Microsoft MVPになる前、なってから/Fukuoka_Tech_Women_Community_1_baba
nina01
0
170
Datadog RUM を用いた UX 指標の監視・顧客対応への活用
imamura_ko_0314
0
100
신뢰할 수 있는 AI 검색 엔진을 만들기 위한 Liner의 여정
huffon
0
540
End of Barrel Files: New Modularization Techniques with Sheriff
rainerhahnekamp
0
280
全社横断データ活用推進のコツと その負債とのつき合い方
masatoshi0205
0
160
データ活用促進のためのデータ分析基盤の進化
takumakouno
2
160
軽量DDDはもういらない! スタイルガイド本で OOPの実装パターンを学ぼう
panda_program
29
11k
Datachain会社紹介資料(2024年11月) / Company Deck
datachain
4
17k
Featured
See All Featured
The Straight Up "How To Draw Better" Workshop
denniskardys
232
140k
How to train your dragon (web standard)
notwaldorf
88
5.7k
Why You Should Never Use an ORM
jnunemaker
PRO
54
9k
For a Future-Friendly Web
brad_frost
175
9.4k
Designing Experiences People Love
moore
138
23k
Speed Design
sergeychernyshev
24
600
Bash Introduction
62gerente
608
210k
10 Git Anti Patterns You Should be Aware of
lemiorhan
654
59k
It's Worth the Effort
3n
183
27k
Side Projects
sachag
452
42k
Keith and Marios Guide to Fast Websites
keithpitt
409
22k
Six Lessons from altMBA
skipperchong
26
3.5k
Transcript
8IZ4IPVME*5SVTU:PV &YQMBJOJOHUIF1SFEJDUJPOTPG "OZ$MBTTJGJFS /*14,%%ಡΈձˏૣҴా ాݚ# ాେւ
հ͢Δจ 2
͜ͷจʹ͓͚Δߩݙ ϢʔβʔͷػցֶशϞσϧͷཧղΛॿ͚ΔͨΊɺҙͷ ̎ผثΛlઆ໌z͢Δख๏ɺ-*.&Λ։ൃ 3 CMBDLCPYDMBTTJGJFS FYQMBJOXJUI-*.&
എܠ üػցֶशͷϞσϧɺݱ࣮ͷෳࡶ͞Λөͯ͠ෳࡶͳ ͷ͕ߴਫ਼ɺFHχϡʔϥϧωοτ ü͔͠͠ɺػցֶशϞσϧΛݱ࣮ͷγεςϜʹΈࠐΉ ʹϢʔβʔ͕ͦͷϞσϧΛ৴༻͢Δඞཁ͕͋Δ 4
̎ͭͷFYQMBOBUJPO üFYQMBJOQSFEJDUJPOT § σʔλ̍ͭʹରͯ͠ɺͳͥͦͷ݁Ռ͕ಘΒΕ͔ͨʁ ʢ-*.&ʣ üFYQMBJONPEFMT § ผث͕Ͳ͏͍͏ੑ࣭Λ͍ͬͯΔͷ͔ʁʢ41-*.&ʣ 5
ղऍՄೳͱʁ ü͍ͬͯΔGFBUVSFT͕ղऍՄೳ § ୯ޠͷ͋Δɺͳ͠㱺ղऍՄೳ § XPSEFNCFEEJOH㱺ղऍ͕͍͠ üϞσϧ͕ղऍՄೳ § ઢܗϞσϧ㱺ղऍՄೳ §
ඇઢܗϞσϧ㱺ղऍ͕͍͠ʢ͜ͱ͕ଟ͍ʣ 6
-*.&r JOUFSQSFUBCMFEBUBSFQSFTFOUBUJPOT ü0SJHJOBMEBUBSFQSFTFOUBUJPO ∈ ℝ$ FH XPSEFNCFEEJOH UFYU UFOTPSXJUIDPMPSDIBOOFMT JNBHF
ü*OUFSQSFUBCMFEBUBSFQSFTFOUBUJPO ∈ {0,1}$* FH QSFTFODFBCTFODFPGXPSET UFYU QSFTFODFBCTFODFPGTVQFSQJYDFMT UFYU 7
-*.&r ,FZ*EFB ü-*.& -PDBM*OUFSQSFUBCMF.PEFMBHOPTUJD &YQMBOBUJPOT § ͦΕͧΕͷσʔλʹରͯ͠ɺۙͰղऍ͍ͨ͠Ϟσϧͱಉ ͡Α͏ͳৼΔ͍Λ͢ΔղऍՄೳͳઢܗϞσϧΛಘͯɺͦΕ Λ༻͍ͯղऍ͢Δ 8
-*.& తؔ = argmin 3∈4 ℒ , , 9 +
Ω() G:ղऍՄೳͳϞσϧͷू߹ FHઢܗϞσϧ A = 3 ⋅ A ͷۙͰ ͱ͕Ͳͷ͘Β͍ ဃ͍ͯ͠Δ͔ ͷෳࡶ σʔλͷۙͰͰ͖Δ͚ͩݩͷෳࡶͳผثʹࣅͨৼΔ͍Λ͢Δ ղऍՄೳͳผثΛબͿ ℒ , , 9 = D 9 F,F*∈ − A I σʔλͱͷڑ ∶ ͷۙͷͷू߹ ෳࡶͷྫ Ω = ∞[ 3 N > ] K個より多くの単語/super pixelsを使う モデルはNG 9
-*.& ΞϧΰϦζϜ 10
-*.&ͷద༻ྫ จॻྨ üΩϦετڭ WTແਆ ͷจॻͷ47.Λ༻͍ͨྨ üҰݟਫ਼͕ྑͦ͞͏ͳϞσϧ͕࣮lྑ͘ͳ ͍zGFBUVSFTΛॏཁࢹ͍ͯ͠Δʢ3Fͱ͔ 11
-*.&ͷద༻ྫ ը૾ྨ üϑϨοτϘʔυͷ͍ͤͰΞίʔεςΟοΫΪλʔ͕Τ ϨΫτϦοΫΪλʔͱఆ͞Ε͍ͯΔͱΘ͔Δ 12
-*.& BMHPSJUIN 13
41-*.&r ,FZ*EFB üϞσϧͷFYQMBOBUJPO4VCNPEVMBS1JDL -*.& § Ϟσϧͷղऍʹ༗༻ͳσʔλϙΠϯτΛબͿΞϧΰϦζϜ § GFBUVSFͷDPWFSBHF͕࠷େʹͳΔΑ͏ʹબͿ GFBUVSFT EBUBQPJOUT
14
41-*.& తؔ ü 'FBUVSF*NQPSUBODF S = D US , U
US = 3US 3US ɿJݸͷσʔλͷKݸͷGFBUVSFʹରԠ͢Δ-*.&ͷॏΈ ü తؔ ରԠ͢Δ'FBUVSF*NQPSUBODFS ͷ߹ܭ͕࠷େͱͳΔΑ͏ͳσʔλͷ ू߹ΛબͿʢ σʔλͷݸ ҎԼʣ , , = D ∃U∈[:\]^_` S $* S_a , = argmax [,|[|gh (, , ) .BYJNVNXFJHIUFEDPWFSBHF㱺 /1IBSE<'FJHF > ͔͠͠ɺTVCNPEVMBSJUZΑΓHSFFEZΞϧΰϦζϜʹ1/ཧอূ <,SBVTF > 15
41-*.&BMHPSJUIN 16
γϛϡϨʔγϣϯ࣮ݧ üEBUBTFUCPPLT%7%T TFOUJNFOUBOBMZTJT EBUBTFU QPTOFH "SFUIFFYQMBOBUJPOTGBJUIGVMUPUIFNPEFM § -*.&దͳGFBUVSFTΛऔͬͯ͜ΕΔͷ͔ʁ
4IPVME*USVTUUIJTQSFEJDUJPO § -*.&ʹΑͬͯϢʔβʔͷQSFEJDUJPOͷUSVTU্͢Δ ͔ʁ $BO*USVTUUIJTNPEFM § -*.&41ผثͷྑ͠ѱ͠ͷධՁʹʹཱ͔ͭʁ 17
"SFUIFFYQMBOBUJPOTGBJUIGVMUPUIFNPEFM ü-*.&ͷFYQMBOBUJPO͕ͲͷఔlGBJUIGVMz͔ʁΛͦͦղऍՄೳ ͳྨثͷղऍʹΑΓ͔֬ΊΔ ü4QBSTF-PHJTUJD3FHSFTTJPO %FDJTJPO5SFFΛݸͷGFBUVSFT ͷΈΛ͏Α͏ʹ܇࿅͢Δ ü-*.&ͰݸͷGFBUVSFTΛநग़ͯ͠ΈͯɺSFDBMMΛධՁ 18
4IPVME*USVTUUIJTQSFEJDUJPO 19 ü-*.&ͰQSFEJDUJPO͕USVTUXPSUIZ͔Ͳ͏͔Λݟ͚ΒΕΔ͔ʁ üͷGFBUVSFTΛVOUSVTUXPSUIZͳͷͱ͢Δ § FHOFXTHSPVQʹ͓͚ΔIFBEFSใͱ͔Λఆ üղऍ͍ͨ͠Ϟσϧʹ͓͍ͯɺVOUSVTUXPSUIZͳGFBUVSFTΛআ͘ͱ ݁Ռ͕มΘΔQSFEJDUJPOΛVOUSVTUXPSUIZJOTUBODFͱݺͿ ü-*.&ʹ͓͍ͯɺ VOUSVTUXPSUIZJOTUBODFͰVOUSVTUXPSUIZ
GFBUVSFTΛআ͍ͨͱ͖ʹ݁Ռ͕ͪΌΜͱมΘΔʢʹ VOUSVTUXPSUIZQSFEJDUJPOͱఆͰ͖Δʣͷ͔ʁ
$BO*USVTUUIJTNPEFM ü41-*.&ΛͬͯผثΛղऍͨ͠ΒɺHFOFSBMJ[BUJPOFSSPS͕ খ͍͞ํΛબΔͷ͔ʁ üσʔλʹBSUJGJDJBMGFBUVSFTΛՃ͑Δ § WBMJEBUJPOTFUͰͦΕͧΕͷΫϥεʹ § UFTUTFUͰͦΕͧΕͷΫϥεʹ üWBMJEBUJPOTFUͰͷBDDVSBDZͷ͕ࠩະຬɺ UFTUTFUͰ
Ҏ্ʹͳΔΑ͏ʹSBOEPNGPSFTUΛ܇࿅ ü41-*.&Λ༻͍ͯWBMJEBUJPOTFUͰͷVOUSVTUXPSUIZͳQSFEJDUJPO ͕গͳ͍ผثΛྑ͍ผثͱͯ͠બͼɺͦΕ͕UFTUTFUͰྑ͍ ੑೳͷผثͱҰக͢Δ͔ʁ 20
ਓΛ࣮ͬͨݧ $BOVTFSTTFMFDUUIFCFTUDMBTTJGJFS § 41-*.&Ͱ൚Խੑೳͷߴ͍ྨثΛબΔ͔ʁ $BOOPOFYQFSUTJNQSPWFBDMBTTJGJFS § 41-*.&ͰGFBUVSFFOHJOFFSJOHΛͯ͠ྨثͷੑೳΛ্͛Ε Δ͔ʁ
%PFYQMBOBUJPOTMFBEUPJOTJHIUT § 41-*.&ͰมͳྨثΛݕͰ͖Δ͔ʁ 21
࣮ݧઃఆ %BUBTFU l$ISJTUJBOJUZzBOEl"UIFJTNzEPDVNFOUTGSPNUIF OFXTHSPVQT ͔͠͠ɺมͳGFBUVSF͕͋Δ͔Β൚ԽੑೳͷධՁʹ͍͍ͯͳ͍ 㱺ผͷXFCTJUF͔Β࡞ͨ͠σʔληοτͰ൚ԽੑೳΛධՁ ྨث มͳGFBUVSFTΛআ͍ͨσʔληοτͱআ͔ͳ͍σʔληοτͷ̎ͭ
Ͱ47.Λ܇࿅ WBMJEBUJPOTFUͰআ͔ͳ͍΄͏ͷ47.͕ߴੑೳ͕ͩUFTUTFUͰ আ͍ͨํ͕ߴੑೳ 22
$BOVTFSTTFMFDUUIFCFTUDMBTTJGJFS ü"NB[PO.FDIBOJDBM5VSLΛͬͯػցֶशͷඇઐՈʢͨͩ ͠फڭʹؔͯ͠جຊతͳ͕ࣝ͋Δਓʣʹ41-*.&Λͬͯྑ ͦ͞͏ͳผثΛબΜͰΒ͏ 23
$BOOPOFYQFSUTJNQSPWFBDMBTTJGJFS üಉ༷ʹɺ ػցֶशͷඇઐՈʹ41-*.&Λͬͯআ͘ ͖GFBUVSFTΛબΜͰΒ͏ɺΛ̏ϥϯυ܁Γฦ͠ ͯGFBUVSFFOHJOFFSJOH 24
%PFYQMBOBUJPOTMFBEUPJOTJHIUT üΦΦΧϛͱϋεΩʔݘͷྨ ઇ͕എܠʹ͋ΔΦΦΧϛͷը૾ͱഎܠʹͳ͍ϋεΩʔݘͷը૾Λ܇ ࿅σʔλͱͯ͠༩͑ͯɺੑೳͷѱ͍ผثΛ࡞ 25
%PFYQMBOBUJPOTMFBEUPJOTJHIUT ͷ͕ͭਖ਼͍͠༧ଌΛ͢Δඃݧऀʹݟͤͯɺ § ͜ͷΞϧΰϦζϜ࣮ੈքͰͪΌΜͱಇ͔͘ʁ § ͦΕͳ͔ͥʁ § ͜ͷΞϧΰϦζϜͲ͏ͬͯผΛߦ͍ͬͯΔͱࢥ͏͔ʁ ͱ࣭ ͦͷޙɺFYQMBOBUJPOͷ݁ՌΛݟͤͯಉ༷ͷ࣭
26 ൚Խੑೳِ૬ؔͳͲͷ֓೦ΛΒͳ͍ػցֶशͷඇઐ ՈͰྑ͘ͳ͍ผثΛఆ͢Δ͜ͱ͕Ͱ͖ͨ
'VUVSFXPSLT ü4QBSTF-JOFBS.PEFMҎ֎ͷFYQMBJOFS § EFDJTJPOUSFFͱ͔ üUIFPSFUJDBMQSPQFSUZPG-*.& ü41-*.&GPSJNBHF 27
·ͱΊ üҙͷ̎ྨثͷղऍʹ༻͍Δ͜ͱͷग़དྷΔख๏ɺ -*.&41-*.&ΛఏҊ üγϛϡϨʔγϣϯඇઐՈʹΑΔ࣮ݧʹΑͬͯͦͷ༗ ༻ੑΛ͔֬Ίͨ 28
3FGFSFODFT ü %#BFISFOT 54DISPFUFS 4)BSNFMJOH .,BXBOBCF , )BOTFO BOE,3.VMMFS)PXUPFYQMBJO JOEJWJEVBMDMBTTJGJDBUJPO
EFDJTJPOT+PVSOBMPG.BDIJOF-FBSOJOH 3FTFBSDI ü 6'FJHF"UISFTIPMEPGMOOGPSBQQSPYJNBUJOHTFUDPWFS+ "$. +VMZ ü )BSB 4 )BZBTIJ , .BLJOH5SFF&OTFNCMFT *OUFSQSFUBCMF"#BZFTJBO.PEFM4FMFDUJPO"QQSPBDI r ü ,JN # ,IBOOB 3 ,PZFKP 0 OE &YBNQMFTBSFOPU &OPVHI -FBSOUP$SJUJDJ[F$SJUJDJTNGPS*OUFSQSFUBCJMJUZ ü ",SBVTFBOE%(PMPWJO4VCNPEVMBSGVODUJPONBYJNJ[BUJPO *O5SBDUBCJMJUZ1SBDUJDBM"QQSPBDIFTUP)BSE1SPCMFNT $BNCSJEHF6OJWFSTJUZ1SFTT 'FCSVBSZ ü 3JCFJSP .5 4JOHI 4 (VFTUSJO $ l8IZ4IPVME* 5SVTU:PV z&YQMBJOJOHUIF1SFEJDUJPOTPG"OZ$MBTTJGJFS 1SPDFFEJOHTPGUIFOE"$.4*(,%%*OUFSOBUJPOBM $POGFSFODFPO,OPXMFEHF%JTDPWFSZBOE%BUB.JOJOH ,%% ` r 29