Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
NIPS/KDD2016読み会@早稲田
Search
bigsea
December 26, 2016
Technology
0
1k
NIPS/KDD2016読み会@早稲田
"Why Should I Trust You?" Explaining the Predictions of Any Classifier, KDD2016 の紹介資料
bigsea
December 26, 2016
Tweet
Share
More Decks by bigsea
See All by bigsea
Introduction to semantic parsing
bigseat
0
520
Other Decks in Technology
See All in Technology
Bill One急成長の舞台裏 開発組織が直面した失敗と教訓
sansantech
PRO
2
400
We Built for Predictability; The Workloads Didn’t Care
stahnma
0
150
Greatest Disaster Hits in Web Performance
guaca
0
280
10Xにおける品質保証活動の全体像と改善 #no_more_wait_for_test
nihonbuson
PRO
2
330
プロダクト成長を支える開発基盤とスケールに伴う課題
yuu26
4
1.4k
顧客との商談議事録をみんなで読んで顧客解像度を上げよう
shibayu36
0
300
CDKで始めるTypeScript開発のススメ
tsukuboshi
1
540
~Everything as Codeを諦めない~ 後からCDK
mu7889yoon
3
480
コミュニティが変えるキャリアの地平線:コロナ禍新卒入社のエンジニアがAWSコミュニティで見つけた成長の羅針盤
kentosuzuki
0
130
AIエージェントを開発しよう!-AgentCore活用の勘所-
yukiogawa
0
190
今こそ学びたいKubernetesネットワーク ~CNIが繋ぐNWとプラットフォームの「フラッと」な対話
logica0419
5
380
AI駆動開発を事業のコアに置く
tasukuonizawa
1
360
Featured
See All Featured
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
196
71k
How GitHub (no longer) Works
holman
316
140k
How to Align SEO within the Product Triangle To Get Buy-In & Support - #RIMC
aleyda
1
1.4k
Getting science done with accelerated Python computing platforms
jacobtomlinson
2
120
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
38
2.7k
Facilitating Awesome Meetings
lara
57
6.8k
[SF Ruby Conf 2025] Rails X
palkan
1
760
Imperfection Machines: The Place of Print at Facebook
scottboms
269
14k
Build The Right Thing And Hit Your Dates
maggiecrowley
39
3k
Marketing to machines
jonoalderson
1
4.6k
Paper Plane (Part 1)
katiecoart
PRO
0
4.3k
コードの90%をAIが書く世界で何が待っているのか / What awaits us in a world where 90% of the code is written by AI
rkaga
60
42k
Transcript
8IZ4IPVME*5SVTU:PV &YQMBJOJOHUIF1SFEJDUJPOTPG "OZ$MBTTJGJFS /*14,%%ಡΈձˏૣҴా ాݚ# ాେւ
հ͢Δจ 2
͜ͷจʹ͓͚Δߩݙ ϢʔβʔͷػցֶशϞσϧͷཧղΛॿ͚ΔͨΊɺҙͷ ̎ผثΛlઆ໌z͢Δख๏ɺ-*.&Λ։ൃ 3 CMBDLCPYDMBTTJGJFS FYQMBJOXJUI-*.&
എܠ üػցֶशͷϞσϧɺݱ࣮ͷෳࡶ͞Λөͯ͠ෳࡶͳ ͷ͕ߴਫ਼ɺFHχϡʔϥϧωοτ ü͔͠͠ɺػցֶशϞσϧΛݱ࣮ͷγεςϜʹΈࠐΉ ʹϢʔβʔ͕ͦͷϞσϧΛ৴༻͢Δඞཁ͕͋Δ 4
̎ͭͷFYQMBOBUJPO üFYQMBJOQSFEJDUJPOT § σʔλ̍ͭʹରͯ͠ɺͳͥͦͷ݁Ռ͕ಘΒΕ͔ͨʁ ʢ-*.&ʣ üFYQMBJONPEFMT § ผث͕Ͳ͏͍͏ੑ࣭Λ͍ͬͯΔͷ͔ʁʢ41-*.&ʣ 5
ղऍՄೳͱʁ ü͍ͬͯΔGFBUVSFT͕ղऍՄೳ § ୯ޠͷ͋Δɺͳ͠㱺ղऍՄೳ § XPSEFNCFEEJOH㱺ղऍ͕͍͠ üϞσϧ͕ղऍՄೳ § ઢܗϞσϧ㱺ղऍՄೳ §
ඇઢܗϞσϧ㱺ղऍ͕͍͠ʢ͜ͱ͕ଟ͍ʣ 6
-*.&r JOUFSQSFUBCMFEBUBSFQSFTFOUBUJPOT ü0SJHJOBMEBUBSFQSFTFOUBUJPO ∈ ℝ$ FH XPSEFNCFEEJOH UFYU UFOTPSXJUIDPMPSDIBOOFMT JNBHF
ü*OUFSQSFUBCMFEBUBSFQSFTFOUBUJPO ∈ {0,1}$* FH QSFTFODFBCTFODFPGXPSET UFYU QSFTFODFBCTFODFPGTVQFSQJYDFMT UFYU 7
-*.&r ,FZ*EFB ü-*.& -PDBM*OUFSQSFUBCMF.PEFMBHOPTUJD &YQMBOBUJPOT § ͦΕͧΕͷσʔλʹରͯ͠ɺۙͰղऍ͍ͨ͠Ϟσϧͱಉ ͡Α͏ͳৼΔ͍Λ͢ΔղऍՄೳͳઢܗϞσϧΛಘͯɺͦΕ Λ༻͍ͯղऍ͢Δ 8
-*.& తؔ = argmin 3∈4 ℒ , , 9 +
Ω() G:ղऍՄೳͳϞσϧͷू߹ FHઢܗϞσϧ A = 3 ⋅ A ͷۙͰ ͱ͕Ͳͷ͘Β͍ ဃ͍ͯ͠Δ͔ ͷෳࡶ σʔλͷۙͰͰ͖Δ͚ͩݩͷෳࡶͳผثʹࣅͨৼΔ͍Λ͢Δ ղऍՄೳͳผثΛબͿ ℒ , , 9 = D 9 F,F*∈ − A I σʔλͱͷڑ ∶ ͷۙͷͷू߹ ෳࡶͷྫ Ω = ∞[ 3 N > ] K個より多くの単語/super pixelsを使う モデルはNG 9
-*.& ΞϧΰϦζϜ 10
-*.&ͷద༻ྫ จॻྨ üΩϦετڭ WTແਆ ͷจॻͷ47.Λ༻͍ͨྨ üҰݟਫ਼͕ྑͦ͞͏ͳϞσϧ͕࣮lྑ͘ͳ ͍zGFBUVSFTΛॏཁࢹ͍ͯ͠Δʢ3Fͱ͔ 11
-*.&ͷద༻ྫ ը૾ྨ üϑϨοτϘʔυͷ͍ͤͰΞίʔεςΟοΫΪλʔ͕Τ ϨΫτϦοΫΪλʔͱఆ͞Ε͍ͯΔͱΘ͔Δ 12
-*.& BMHPSJUIN 13
41-*.&r ,FZ*EFB üϞσϧͷFYQMBOBUJPO4VCNPEVMBS1JDL -*.& § Ϟσϧͷղऍʹ༗༻ͳσʔλϙΠϯτΛબͿΞϧΰϦζϜ § GFBUVSFͷDPWFSBHF͕࠷େʹͳΔΑ͏ʹબͿ GFBUVSFT EBUBQPJOUT
14
41-*.& తؔ ü 'FBUVSF*NQPSUBODF S = D US , U
US = 3US 3US ɿJݸͷσʔλͷKݸͷGFBUVSFʹରԠ͢Δ-*.&ͷॏΈ ü తؔ ରԠ͢Δ'FBUVSF*NQPSUBODFS ͷ߹ܭ͕࠷େͱͳΔΑ͏ͳσʔλͷ ू߹ΛબͿʢ σʔλͷݸ ҎԼʣ , , = D ∃U∈[:\]^_` S $* S_a , = argmax [,|[|gh (, , ) .BYJNVNXFJHIUFEDPWFSBHF㱺 /1IBSE<'FJHF > ͔͠͠ɺTVCNPEVMBSJUZΑΓHSFFEZΞϧΰϦζϜʹ1/ཧอূ <,SBVTF > 15
41-*.&BMHPSJUIN 16
γϛϡϨʔγϣϯ࣮ݧ üEBUBTFUCPPLT%7%T TFOUJNFOUBOBMZTJT EBUBTFU QPTOFH "SFUIFFYQMBOBUJPOTGBJUIGVMUPUIFNPEFM § -*.&దͳGFBUVSFTΛऔͬͯ͜ΕΔͷ͔ʁ
4IPVME*USVTUUIJTQSFEJDUJPO § -*.&ʹΑͬͯϢʔβʔͷQSFEJDUJPOͷUSVTU্͢Δ ͔ʁ $BO*USVTUUIJTNPEFM § -*.&41ผثͷྑ͠ѱ͠ͷධՁʹʹཱ͔ͭʁ 17
"SFUIFFYQMBOBUJPOTGBJUIGVMUPUIFNPEFM ü-*.&ͷFYQMBOBUJPO͕ͲͷఔlGBJUIGVMz͔ʁΛͦͦղऍՄೳ ͳྨثͷղऍʹΑΓ͔֬ΊΔ ü4QBSTF-PHJTUJD3FHSFTTJPO %FDJTJPO5SFFΛݸͷGFBUVSFT ͷΈΛ͏Α͏ʹ܇࿅͢Δ ü-*.&ͰݸͷGFBUVSFTΛநग़ͯ͠ΈͯɺSFDBMMΛධՁ 18
4IPVME*USVTUUIJTQSFEJDUJPO 19 ü-*.&ͰQSFEJDUJPO͕USVTUXPSUIZ͔Ͳ͏͔Λݟ͚ΒΕΔ͔ʁ üͷGFBUVSFTΛVOUSVTUXPSUIZͳͷͱ͢Δ § FHOFXTHSPVQʹ͓͚ΔIFBEFSใͱ͔Λఆ üղऍ͍ͨ͠Ϟσϧʹ͓͍ͯɺVOUSVTUXPSUIZͳGFBUVSFTΛআ͘ͱ ݁Ռ͕มΘΔQSFEJDUJPOΛVOUSVTUXPSUIZJOTUBODFͱݺͿ ü-*.&ʹ͓͍ͯɺ VOUSVTUXPSUIZJOTUBODFͰVOUSVTUXPSUIZ
GFBUVSFTΛআ͍ͨͱ͖ʹ݁Ռ͕ͪΌΜͱมΘΔʢʹ VOUSVTUXPSUIZQSFEJDUJPOͱఆͰ͖Δʣͷ͔ʁ
$BO*USVTUUIJTNPEFM ü41-*.&ΛͬͯผثΛղऍͨ͠ΒɺHFOFSBMJ[BUJPOFSSPS͕ খ͍͞ํΛબΔͷ͔ʁ üσʔλʹBSUJGJDJBMGFBUVSFTΛՃ͑Δ § WBMJEBUJPOTFUͰͦΕͧΕͷΫϥεʹ § UFTUTFUͰͦΕͧΕͷΫϥεʹ üWBMJEBUJPOTFUͰͷBDDVSBDZͷ͕ࠩະຬɺ UFTUTFUͰ
Ҏ্ʹͳΔΑ͏ʹSBOEPNGPSFTUΛ܇࿅ ü41-*.&Λ༻͍ͯWBMJEBUJPOTFUͰͷVOUSVTUXPSUIZͳQSFEJDUJPO ͕গͳ͍ผثΛྑ͍ผثͱͯ͠બͼɺͦΕ͕UFTUTFUͰྑ͍ ੑೳͷผثͱҰக͢Δ͔ʁ 20
ਓΛ࣮ͬͨݧ $BOVTFSTTFMFDUUIFCFTUDMBTTJGJFS § 41-*.&Ͱ൚Խੑೳͷߴ͍ྨثΛબΔ͔ʁ $BOOPOFYQFSUTJNQSPWFBDMBTTJGJFS § 41-*.&ͰGFBUVSFFOHJOFFSJOHΛͯ͠ྨثͷੑೳΛ্͛Ε Δ͔ʁ
%PFYQMBOBUJPOTMFBEUPJOTJHIUT § 41-*.&ͰมͳྨثΛݕͰ͖Δ͔ʁ 21
࣮ݧઃఆ %BUBTFU l$ISJTUJBOJUZzBOEl"UIFJTNzEPDVNFOUTGSPNUIF OFXTHSPVQT ͔͠͠ɺมͳGFBUVSF͕͋Δ͔Β൚ԽੑೳͷධՁʹ͍͍ͯͳ͍ 㱺ผͷXFCTJUF͔Β࡞ͨ͠σʔληοτͰ൚ԽੑೳΛධՁ ྨث มͳGFBUVSFTΛআ͍ͨσʔληοτͱআ͔ͳ͍σʔληοτͷ̎ͭ
Ͱ47.Λ܇࿅ WBMJEBUJPOTFUͰআ͔ͳ͍΄͏ͷ47.͕ߴੑೳ͕ͩUFTUTFUͰ আ͍ͨํ͕ߴੑೳ 22
$BOVTFSTTFMFDUUIFCFTUDMBTTJGJFS ü"NB[PO.FDIBOJDBM5VSLΛͬͯػցֶशͷඇઐՈʢͨͩ ͠फڭʹؔͯ͠جຊతͳ͕ࣝ͋Δਓʣʹ41-*.&Λͬͯྑ ͦ͞͏ͳผثΛબΜͰΒ͏ 23
$BOOPOFYQFSUTJNQSPWFBDMBTTJGJFS üಉ༷ʹɺ ػցֶशͷඇઐՈʹ41-*.&Λͬͯআ͘ ͖GFBUVSFTΛબΜͰΒ͏ɺΛ̏ϥϯυ܁Γฦ͠ ͯGFBUVSFFOHJOFFSJOH 24
%PFYQMBOBUJPOTMFBEUPJOTJHIUT üΦΦΧϛͱϋεΩʔݘͷྨ ઇ͕എܠʹ͋ΔΦΦΧϛͷը૾ͱഎܠʹͳ͍ϋεΩʔݘͷը૾Λ܇ ࿅σʔλͱͯ͠༩͑ͯɺੑೳͷѱ͍ผثΛ࡞ 25
%PFYQMBOBUJPOTMFBEUPJOTJHIUT ͷ͕ͭਖ਼͍͠༧ଌΛ͢Δඃݧऀʹݟͤͯɺ § ͜ͷΞϧΰϦζϜ࣮ੈքͰͪΌΜͱಇ͔͘ʁ § ͦΕͳ͔ͥʁ § ͜ͷΞϧΰϦζϜͲ͏ͬͯผΛߦ͍ͬͯΔͱࢥ͏͔ʁ ͱ࣭ ͦͷޙɺFYQMBOBUJPOͷ݁ՌΛݟͤͯಉ༷ͷ࣭
26 ൚Խੑೳِ૬ؔͳͲͷ֓೦ΛΒͳ͍ػցֶशͷඇઐ ՈͰྑ͘ͳ͍ผثΛఆ͢Δ͜ͱ͕Ͱ͖ͨ
'VUVSFXPSLT ü4QBSTF-JOFBS.PEFMҎ֎ͷFYQMBJOFS § EFDJTJPOUSFFͱ͔ üUIFPSFUJDBMQSPQFSUZPG-*.& ü41-*.&GPSJNBHF 27
·ͱΊ üҙͷ̎ྨثͷղऍʹ༻͍Δ͜ͱͷग़དྷΔख๏ɺ -*.&41-*.&ΛఏҊ üγϛϡϨʔγϣϯඇઐՈʹΑΔ࣮ݧʹΑͬͯͦͷ༗ ༻ੑΛ͔֬Ίͨ 28
3FGFSFODFT ü %#BFISFOT 54DISPFUFS 4)BSNFMJOH .,BXBOBCF , )BOTFO BOE,3.VMMFS)PXUPFYQMBJO JOEJWJEVBMDMBTTJGJDBUJPO
EFDJTJPOT+PVSOBMPG.BDIJOF-FBSOJOH 3FTFBSDI ü 6'FJHF"UISFTIPMEPGMOOGPSBQQSPYJNBUJOHTFUDPWFS+ "$. +VMZ ü )BSB 4 )BZBTIJ , .BLJOH5SFF&OTFNCMFT *OUFSQSFUBCMF"#BZFTJBO.PEFM4FMFDUJPO"QQSPBDI r ü ,JN # ,IBOOB 3 ,PZFKP 0 OE &YBNQMFTBSFOPU &OPVHI -FBSOUP$SJUJDJ[F$SJUJDJTNGPS*OUFSQSFUBCJMJUZ ü ",SBVTFBOE%(PMPWJO4VCNPEVMBSGVODUJPONBYJNJ[BUJPO *O5SBDUBCJMJUZ1SBDUJDBM"QQSPBDIFTUP)BSE1SPCMFNT $BNCSJEHF6OJWFSTJUZ1SFTT 'FCSVBSZ ü 3JCFJSP .5 4JOHI 4 (VFTUSJO $ l8IZ4IPVME* 5SVTU:PV z&YQMBJOJOHUIF1SFEJDUJPOTPG"OZ$MBTTJGJFS 1SPDFFEJOHTPGUIFOE"$.4*(,%%*OUFSOBUJPOBM $POGFSFODFPO,OPXMFEHF%JTDPWFSZBOE%BUB.JOJOH ,%% ` r 29