Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
NIPS/KDD2016読み会@早稲田
Search
Sponsored
·
SiteGround - Reliable hosting with speed, security, and support you can count on.
→
bigsea
December 26, 2016
Technology
0
1k
NIPS/KDD2016読み会@早稲田
"Why Should I Trust You?" Explaining the Predictions of Any Classifier, KDD2016 の紹介資料
bigsea
December 26, 2016
Tweet
Share
More Decks by bigsea
See All by bigsea
Introduction to semantic parsing
bigseat
0
520
Other Decks in Technology
See All in Technology
今こそ学びたいKubernetesネットワーク ~CNIが繋ぐNWとプラットフォームの「フラッと」な対話
logica0419
5
370
ClickHouseはどのように大規模データを活用したAIエージェントを全社展開しているのか
mikimatsumoto
0
270
OWASP Top 10:2025 リリースと 少しの日本語化にまつわる裏話
okdt
PRO
3
840
20260204_Midosuji_Tech
takuyay0ne
1
160
Webhook best practices for rock solid and resilient deployments
glaforge
2
300
30万人の同時アクセスに耐えたい!新サービスの盤石なリリースを支える負荷試験 / SRE Kaigi 2026
genda
4
1.4k
AI駆動開発を事業のコアに置く
tasukuonizawa
1
360
AIエージェントを開発しよう!-AgentCore活用の勘所-
yukiogawa
0
190
今日から始めるAmazon Bedrock AgentCore
har1101
4
420
Claude_CodeでSEOを最適化する_AI_Ops_Community_Vol.2__マーケティングx_AIはここまで進化した.pdf
riku_423
2
610
SREが向き合う大規模リアーキテクチャ 〜信頼性とアジリティの両立〜
zepprix
0
480
Exadata Fleet Update
oracle4engineer
PRO
0
1.1k
Featured
See All Featured
Tips & Tricks on How to Get Your First Job In Tech
honzajavorek
0
440
From Legacy to Launchpad: Building Startup-Ready Communities
dugsong
0
140
First, design no harm
axbom
PRO
2
1.1k
How To Speak Unicorn (iThemes Webinar)
marktimemedia
1
380
Tell your own story through comics
letsgokoyo
1
810
AI: The stuff that nobody shows you
jnunemaker
PRO
2
270
Dealing with People You Can't Stand - Big Design 2015
cassininazir
367
27k
The Language of Interfaces
destraynor
162
26k
Practical Tips for Bootstrapping Information Extraction Pipelines
honnibal
25
1.7k
How STYLIGHT went responsive
nonsquared
100
6k
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
inesmontani
PRO
3
2k
How to Align SEO within the Product Triangle To Get Buy-In & Support - #RIMC
aleyda
1
1.4k
Transcript
8IZ4IPVME*5SVTU:PV &YQMBJOJOHUIF1SFEJDUJPOTPG "OZ$MBTTJGJFS /*14,%%ಡΈձˏૣҴా ాݚ# ాେւ
հ͢Δจ 2
͜ͷจʹ͓͚Δߩݙ ϢʔβʔͷػցֶशϞσϧͷཧղΛॿ͚ΔͨΊɺҙͷ ̎ผثΛlઆ໌z͢Δख๏ɺ-*.&Λ։ൃ 3 CMBDLCPYDMBTTJGJFS FYQMBJOXJUI-*.&
എܠ üػցֶशͷϞσϧɺݱ࣮ͷෳࡶ͞Λөͯ͠ෳࡶͳ ͷ͕ߴਫ਼ɺFHχϡʔϥϧωοτ ü͔͠͠ɺػցֶशϞσϧΛݱ࣮ͷγεςϜʹΈࠐΉ ʹϢʔβʔ͕ͦͷϞσϧΛ৴༻͢Δඞཁ͕͋Δ 4
̎ͭͷFYQMBOBUJPO üFYQMBJOQSFEJDUJPOT § σʔλ̍ͭʹରͯ͠ɺͳͥͦͷ݁Ռ͕ಘΒΕ͔ͨʁ ʢ-*.&ʣ üFYQMBJONPEFMT § ผث͕Ͳ͏͍͏ੑ࣭Λ͍ͬͯΔͷ͔ʁʢ41-*.&ʣ 5
ղऍՄೳͱʁ ü͍ͬͯΔGFBUVSFT͕ղऍՄೳ § ୯ޠͷ͋Δɺͳ͠㱺ղऍՄೳ § XPSEFNCFEEJOH㱺ղऍ͕͍͠ üϞσϧ͕ղऍՄೳ § ઢܗϞσϧ㱺ղऍՄೳ §
ඇઢܗϞσϧ㱺ղऍ͕͍͠ʢ͜ͱ͕ଟ͍ʣ 6
-*.&r JOUFSQSFUBCMFEBUBSFQSFTFOUBUJPOT ü0SJHJOBMEBUBSFQSFTFOUBUJPO ∈ ℝ$ FH XPSEFNCFEEJOH UFYU UFOTPSXJUIDPMPSDIBOOFMT JNBHF
ü*OUFSQSFUBCMFEBUBSFQSFTFOUBUJPO ∈ {0,1}$* FH QSFTFODFBCTFODFPGXPSET UFYU QSFTFODFBCTFODFPGTVQFSQJYDFMT UFYU 7
-*.&r ,FZ*EFB ü-*.& -PDBM*OUFSQSFUBCMF.PEFMBHOPTUJD &YQMBOBUJPOT § ͦΕͧΕͷσʔλʹରͯ͠ɺۙͰղऍ͍ͨ͠Ϟσϧͱಉ ͡Α͏ͳৼΔ͍Λ͢ΔղऍՄೳͳઢܗϞσϧΛಘͯɺͦΕ Λ༻͍ͯղऍ͢Δ 8
-*.& తؔ = argmin 3∈4 ℒ , , 9 +
Ω() G:ղऍՄೳͳϞσϧͷू߹ FHઢܗϞσϧ A = 3 ⋅ A ͷۙͰ ͱ͕Ͳͷ͘Β͍ ဃ͍ͯ͠Δ͔ ͷෳࡶ σʔλͷۙͰͰ͖Δ͚ͩݩͷෳࡶͳผثʹࣅͨৼΔ͍Λ͢Δ ղऍՄೳͳผثΛબͿ ℒ , , 9 = D 9 F,F*∈ − A I σʔλͱͷڑ ∶ ͷۙͷͷू߹ ෳࡶͷྫ Ω = ∞[ 3 N > ] K個より多くの単語/super pixelsを使う モデルはNG 9
-*.& ΞϧΰϦζϜ 10
-*.&ͷద༻ྫ จॻྨ üΩϦετڭ WTແਆ ͷจॻͷ47.Λ༻͍ͨྨ üҰݟਫ਼͕ྑͦ͞͏ͳϞσϧ͕࣮lྑ͘ͳ ͍zGFBUVSFTΛॏཁࢹ͍ͯ͠Δʢ3Fͱ͔ 11
-*.&ͷద༻ྫ ը૾ྨ üϑϨοτϘʔυͷ͍ͤͰΞίʔεςΟοΫΪλʔ͕Τ ϨΫτϦοΫΪλʔͱఆ͞Ε͍ͯΔͱΘ͔Δ 12
-*.& BMHPSJUIN 13
41-*.&r ,FZ*EFB üϞσϧͷFYQMBOBUJPO4VCNPEVMBS1JDL -*.& § Ϟσϧͷղऍʹ༗༻ͳσʔλϙΠϯτΛબͿΞϧΰϦζϜ § GFBUVSFͷDPWFSBHF͕࠷େʹͳΔΑ͏ʹબͿ GFBUVSFT EBUBQPJOUT
14
41-*.& తؔ ü 'FBUVSF*NQPSUBODF S = D US , U
US = 3US 3US ɿJݸͷσʔλͷKݸͷGFBUVSFʹରԠ͢Δ-*.&ͷॏΈ ü తؔ ରԠ͢Δ'FBUVSF*NQPSUBODFS ͷ߹ܭ͕࠷େͱͳΔΑ͏ͳσʔλͷ ू߹ΛબͿʢ σʔλͷݸ ҎԼʣ , , = D ∃U∈[:\]^_` S $* S_a , = argmax [,|[|gh (, , ) .BYJNVNXFJHIUFEDPWFSBHF㱺 /1IBSE<'FJHF > ͔͠͠ɺTVCNPEVMBSJUZΑΓHSFFEZΞϧΰϦζϜʹ1/ཧอূ <,SBVTF > 15
41-*.&BMHPSJUIN 16
γϛϡϨʔγϣϯ࣮ݧ üEBUBTFUCPPLT%7%T TFOUJNFOUBOBMZTJT EBUBTFU QPTOFH "SFUIFFYQMBOBUJPOTGBJUIGVMUPUIFNPEFM § -*.&దͳGFBUVSFTΛऔͬͯ͜ΕΔͷ͔ʁ
4IPVME*USVTUUIJTQSFEJDUJPO § -*.&ʹΑͬͯϢʔβʔͷQSFEJDUJPOͷUSVTU্͢Δ ͔ʁ $BO*USVTUUIJTNPEFM § -*.&41ผثͷྑ͠ѱ͠ͷධՁʹʹཱ͔ͭʁ 17
"SFUIFFYQMBOBUJPOTGBJUIGVMUPUIFNPEFM ü-*.&ͷFYQMBOBUJPO͕ͲͷఔlGBJUIGVMz͔ʁΛͦͦղऍՄೳ ͳྨثͷղऍʹΑΓ͔֬ΊΔ ü4QBSTF-PHJTUJD3FHSFTTJPO %FDJTJPO5SFFΛݸͷGFBUVSFT ͷΈΛ͏Α͏ʹ܇࿅͢Δ ü-*.&ͰݸͷGFBUVSFTΛநग़ͯ͠ΈͯɺSFDBMMΛධՁ 18
4IPVME*USVTUUIJTQSFEJDUJPO 19 ü-*.&ͰQSFEJDUJPO͕USVTUXPSUIZ͔Ͳ͏͔Λݟ͚ΒΕΔ͔ʁ üͷGFBUVSFTΛVOUSVTUXPSUIZͳͷͱ͢Δ § FHOFXTHSPVQʹ͓͚ΔIFBEFSใͱ͔Λఆ üղऍ͍ͨ͠Ϟσϧʹ͓͍ͯɺVOUSVTUXPSUIZͳGFBUVSFTΛআ͘ͱ ݁Ռ͕มΘΔQSFEJDUJPOΛVOUSVTUXPSUIZJOTUBODFͱݺͿ ü-*.&ʹ͓͍ͯɺ VOUSVTUXPSUIZJOTUBODFͰVOUSVTUXPSUIZ
GFBUVSFTΛআ͍ͨͱ͖ʹ݁Ռ͕ͪΌΜͱมΘΔʢʹ VOUSVTUXPSUIZQSFEJDUJPOͱఆͰ͖Δʣͷ͔ʁ
$BO*USVTUUIJTNPEFM ü41-*.&ΛͬͯผثΛղऍͨ͠ΒɺHFOFSBMJ[BUJPOFSSPS͕ খ͍͞ํΛબΔͷ͔ʁ üσʔλʹBSUJGJDJBMGFBUVSFTΛՃ͑Δ § WBMJEBUJPOTFUͰͦΕͧΕͷΫϥεʹ § UFTUTFUͰͦΕͧΕͷΫϥεʹ üWBMJEBUJPOTFUͰͷBDDVSBDZͷ͕ࠩະຬɺ UFTUTFUͰ
Ҏ্ʹͳΔΑ͏ʹSBOEPNGPSFTUΛ܇࿅ ü41-*.&Λ༻͍ͯWBMJEBUJPOTFUͰͷVOUSVTUXPSUIZͳQSFEJDUJPO ͕গͳ͍ผثΛྑ͍ผثͱͯ͠બͼɺͦΕ͕UFTUTFUͰྑ͍ ੑೳͷผثͱҰக͢Δ͔ʁ 20
ਓΛ࣮ͬͨݧ $BOVTFSTTFMFDUUIFCFTUDMBTTJGJFS § 41-*.&Ͱ൚Խੑೳͷߴ͍ྨثΛબΔ͔ʁ $BOOPOFYQFSUTJNQSPWFBDMBTTJGJFS § 41-*.&ͰGFBUVSFFOHJOFFSJOHΛͯ͠ྨثͷੑೳΛ্͛Ε Δ͔ʁ
%PFYQMBOBUJPOTMFBEUPJOTJHIUT § 41-*.&ͰมͳྨثΛݕͰ͖Δ͔ʁ 21
࣮ݧઃఆ %BUBTFU l$ISJTUJBOJUZzBOEl"UIFJTNzEPDVNFOUTGSPNUIF OFXTHSPVQT ͔͠͠ɺมͳGFBUVSF͕͋Δ͔Β൚ԽੑೳͷධՁʹ͍͍ͯͳ͍ 㱺ผͷXFCTJUF͔Β࡞ͨ͠σʔληοτͰ൚ԽੑೳΛධՁ ྨث มͳGFBUVSFTΛআ͍ͨσʔληοτͱআ͔ͳ͍σʔληοτͷ̎ͭ
Ͱ47.Λ܇࿅ WBMJEBUJPOTFUͰআ͔ͳ͍΄͏ͷ47.͕ߴੑೳ͕ͩUFTUTFUͰ আ͍ͨํ͕ߴੑೳ 22
$BOVTFSTTFMFDUUIFCFTUDMBTTJGJFS ü"NB[PO.FDIBOJDBM5VSLΛͬͯػցֶशͷඇઐՈʢͨͩ ͠फڭʹؔͯ͠جຊతͳ͕ࣝ͋Δਓʣʹ41-*.&Λͬͯྑ ͦ͞͏ͳผثΛબΜͰΒ͏ 23
$BOOPOFYQFSUTJNQSPWFBDMBTTJGJFS üಉ༷ʹɺ ػցֶशͷඇઐՈʹ41-*.&Λͬͯআ͘ ͖GFBUVSFTΛબΜͰΒ͏ɺΛ̏ϥϯυ܁Γฦ͠ ͯGFBUVSFFOHJOFFSJOH 24
%PFYQMBOBUJPOTMFBEUPJOTJHIUT üΦΦΧϛͱϋεΩʔݘͷྨ ઇ͕എܠʹ͋ΔΦΦΧϛͷը૾ͱഎܠʹͳ͍ϋεΩʔݘͷը૾Λ܇ ࿅σʔλͱͯ͠༩͑ͯɺੑೳͷѱ͍ผثΛ࡞ 25
%PFYQMBOBUJPOTMFBEUPJOTJHIUT ͷ͕ͭਖ਼͍͠༧ଌΛ͢Δඃݧऀʹݟͤͯɺ § ͜ͷΞϧΰϦζϜ࣮ੈքͰͪΌΜͱಇ͔͘ʁ § ͦΕͳ͔ͥʁ § ͜ͷΞϧΰϦζϜͲ͏ͬͯผΛߦ͍ͬͯΔͱࢥ͏͔ʁ ͱ࣭ ͦͷޙɺFYQMBOBUJPOͷ݁ՌΛݟͤͯಉ༷ͷ࣭
26 ൚Խੑೳِ૬ؔͳͲͷ֓೦ΛΒͳ͍ػցֶशͷඇઐ ՈͰྑ͘ͳ͍ผثΛఆ͢Δ͜ͱ͕Ͱ͖ͨ
'VUVSFXPSLT ü4QBSTF-JOFBS.PEFMҎ֎ͷFYQMBJOFS § EFDJTJPOUSFFͱ͔ üUIFPSFUJDBMQSPQFSUZPG-*.& ü41-*.&GPSJNBHF 27
·ͱΊ üҙͷ̎ྨثͷղऍʹ༻͍Δ͜ͱͷग़དྷΔख๏ɺ -*.&41-*.&ΛఏҊ üγϛϡϨʔγϣϯඇઐՈʹΑΔ࣮ݧʹΑͬͯͦͷ༗ ༻ੑΛ͔֬Ίͨ 28
3FGFSFODFT ü %#BFISFOT 54DISPFUFS 4)BSNFMJOH .,BXBOBCF , )BOTFO BOE,3.VMMFS)PXUPFYQMBJO JOEJWJEVBMDMBTTJGJDBUJPO
EFDJTJPOT+PVSOBMPG.BDIJOF-FBSOJOH 3FTFBSDI ü 6'FJHF"UISFTIPMEPGMOOGPSBQQSPYJNBUJOHTFUDPWFS+ "$. +VMZ ü )BSB 4 )BZBTIJ , .BLJOH5SFF&OTFNCMFT *OUFSQSFUBCMF"#BZFTJBO.PEFM4FMFDUJPO"QQSPBDI r ü ,JN # ,IBOOB 3 ,PZFKP 0 OE &YBNQMFTBSFOPU &OPVHI -FBSOUP$SJUJDJ[F$SJUJDJTNGPS*OUFSQSFUBCJMJUZ ü ",SBVTFBOE%(PMPWJO4VCNPEVMBSGVODUJPONBYJNJ[BUJPO *O5SBDUBCJMJUZ1SBDUJDBM"QQSPBDIFTUP)BSE1SPCMFNT $BNCSJEHF6OJWFSTJUZ1SFTT 'FCSVBSZ ü 3JCFJSP .5 4JOHI 4 (VFTUSJO $ l8IZ4IPVME* 5SVTU:PV z&YQMBJOJOHUIF1SFEJDUJPOTPG"OZ$MBTTJGJFS 1SPDFFEJOHTPGUIFOE"$.4*(,%%*OUFSOBUJPOBM $POGFSFODFPO,OPXMFEHF%JTDPWFSZBOE%BUB.JOJOH ,%% ` r 29