NIPS/KDD2016読み会＠早稲田

"Why Should I Trust You?" Explaining the Predictions of Any Classifier, KDD2016 の紹介資料

Transcript

1. 8IZ
   4IPVME
   *
   5SVTU
   :PV 
   &YQMBJOJOH
   UIF
   1SFEJDUJPOT
   PG
   "OZ
   $MBTTJGJFS /*14,%%ಡΈձˏૣҴా ඿ాݚ# ෢ాେւ
2. ঺հ͢Δ࿦จ 2
3. ͜ͷ࿦จʹ͓͚Δߩݙ ϢʔβʔͷػցֶशϞσϧͷཧղΛॿ͚ΔͨΊɺ೚ҙͷ ̎஋൑ผثΛlઆ໌z͢Δख๏ɺ-*.&Λ։ൃ 3 CMBDL
   CPY
   DMBTTJGJFS FYQMBJO
   XJUI
   -*.&
4. എܠ üػցֶशͷϞσϧɺݱ࣮ͷෳࡶ͞Λ൓өͯ͠ෳࡶͳ΋ ͷ͕ߴਫ਼౓ɺFH
   χϡʔϥϧωοτ ü͔͠͠ɺػցֶशϞσϧΛݱ࣮ͷγεςϜʹ૊ΈࠐΉ ʹ͸Ϣʔβʔ͕ͦͷϞσϧΛ৴༻͢Δඞཁ͕͋Δ 4
5. ̎ͭͷFYQMBOBUJPO üFYQMBJO
   QSFEJDUJPOT § σʔλ఺̍ͭʹରͯ͠ɺͳͥͦͷ݁Ռ͕ಘΒΕ͔ͨʁ ʢ-*.&ʣ üFYQMBJO
   NPEFMT § ൑ผث͕Ͳ͏͍͏ੑ࣭Λ΋͍ͬͯΔͷ͔ʁʢ41-*.&ʣ 5
6. ղऍՄೳͱ͸ʁ ü࢖͍ͬͯΔGFBUVSFT͕ղऍՄೳ § ୯ޠͷ͋Δɺͳ͠㱺ղऍՄೳ § XPSE
   FNCFEEJOH㱺ղऍ͕೉͍͠ üϞσϧ͕ղऍՄೳ § ઢܗϞσϧ㱺ղऍՄೳ § ඇઢܗϞσϧ㱺ղऍ͕೉͍͠ʢ͜ͱ͕ଟ͍ʣ 6
7. -*.&
   r JOUFSQSFUBCMF
   EBUB
   SFQSFTFOUBUJPOT ü0SJHJOBM
   EBUB
   SFQSFTFOUBUJPO ∈ ℝ$ FH
   XPSE
   FNCFEEJOH
   UFYU UFOTPS
   XJUI
   
   DPMPS
   DIBOOFMT
   JNBHF ü*OUFSQSFUBCMF
   EBUB
   SFQSFTFOUBUJPO ∈ {0,1}$* FH QSFTFODFBCTFODF
   PG
   XPSET
   UFYU QSFTFODFBCTFODF
   PG
   TVQFSQJYDFMT UFYU 7
8. -*.&
   r ,FZ
   *EFB ü-*.&
    -PDBM
   *OUFSQSFUBCMF
   .PEFMBHOPTUJD
   &YQMBOBUJPOT § ͦΕͧΕͷσʔλ఺ʹରͯ͠ɺۙ๣Ͱղऍ͍ͨ͠Ϟσϧͱಉ ͡Α͏ͳৼΔ෣͍Λ͢ΔղऍՄೳͳઢܗϞσϧΛಘͯɺͦΕ Λ༻͍ͯղऍ͢Δ 8
9. -*.&
    ໨తؔ਺ = argmin 3∈4 ℒ , , 9 + Ω() G:
   ղऍՄೳͳϞσϧͷू߹
   FH
   ઢܗϞσϧ
   A = 3 ⋅ A ͷۙ๣Ͱ ͱ͕Ͳͷ͘Β͍ ဃ཭͍ͯ͠Δ͔ ͷෳࡶ౓ σʔλ఺ͷۙ๣ͰͰ͖Δ͚ͩݩͷෳࡶͳ൑ผثʹࣅͨৼΔ෣͍Λ͢Δ ղऍՄೳͳ൑ผثΛબͿ ℒ , , 9 = D 9 F,F*∈ − A I σʔλ఺ͱͷڑ཭ ∶ ͷۙ๣ͷ఺ͷू߹ ෳࡶ౓ͷྫ Ω = ∞[ 3 N > ] K個より多くの単語/super pixelsを使う モデルはNG 9
10. -*.&
     ΞϧΰϦζϜ 10
11. -*.&ͷద༻ྫ  จॻ෼ྨ üΩϦετڭ WT
    ແਆ࿦ ͷจॻͷ47.Λ༻͍ͨ෼ྨ üҰݟਫ਼౓͕ྑͦ͞͏ͳϞσϧ͕࣮͸lྑ͘ͳ ͍zGFBUVSFTΛॏཁࢹ͍ͯ͠Δʢ3Fͱ͔ 11
12. -*.&ͷద༻ྫ  ը૾෼ྨ üϑϨοτϘʔυͷ͍ͤͰΞίʔεςΟοΫΪλʔ͕Τ ϨΫτϦοΫΪλʔͱ൑ఆ͞Ε͍ͯΔͱΘ͔Δ 12
13. -*.&  BMHPSJUIN 13
14. 41-*.&
    r ,FZ
    *EFB üϞσϧͷFYQMBOBUJPO
    4VCNPEVMBS
    1JDL -*.&
    § Ϟσϧͷղऍʹ༗༻ͳσʔλϙΠϯτΛબͿΞϧΰϦζϜ § GFBUVSFͷDPWFSBHF͕࠷େʹͳΔΑ͏ʹબͿ GFBUVSFT EBUB
    QPJOUT 14
15. 41-*.&
     ໨తؔ਺ ü 'FBUVSF
    *NQPSUBODF S = D US , U US = 3US 3US ɿJݸ໨ͷσʔλ఺ͷKݸ໨ͷGFBUVSFʹରԠ͢Δ-*.&ͷॏΈ ü ໨తؔ਺ ରԠ͢Δ'FBUVSF
    *NQPSUBODFS ͷ߹ܭ͕࠷େͱͳΔΑ͏ͳσʔλ఺ͷ ू߹ΛબͿʢ σʔλ఺ͷݸ਺ ͸ ҎԼʣ , , = D ∃U∈[:\]^_` S $* S_a , = argmax [,|[|gh (, , ) .BYJNVN
    XFJHIUFE
    DPWFSBHF
    㱺 /1IBSE
    <'FJHF > ͔͠͠ɺTVCNPEVMBSJUZΑΓHSFFEZΞϧΰϦζϜʹ1/ཧ࿦อূ <,SBVTF > 15
16. 41-*.&
    
    BMHPSJUIN 16
17. γϛϡϨʔγϣϯ࣮ݧ üEBUBTFU
    CPPLT%7%T
     TFOUJNFOU
    BOBMZTJT
    EBUBTFU
    QPTOFH  "SF
    UIF
    FYQMBOBUJPOT
    GBJUIGVM
    UP
    UIF
    NPEFM § -*.&͸ద੾ͳGFBUVSFTΛऔͬͯ͜ΕΔͷ͔ʁ  4IPVME
    *
    USVTU
    UIJT
    QSFEJDUJPO § -*.&ʹΑͬͯϢʔβʔͷQSFEJDUJPO΁ͷUSVTU͸޲্͢Δ ͔ʁ  $BO
    *
    USVTU
    UIJT
    NPEFM § -*.&41͸൑ผثͷྑ͠ѱ͠ͷධՁʹ໾ʹཱ͔ͭʁ 17
18. "SF
    UIF
    FYQMBOBUJPOT
    GBJUIGVM
    UP
    UIF
    NPEFM ü-*.&ͷFYQMBOBUJPO͕Ͳͷఔ౓lGBJUIGVMz͔ʁΛͦ΋ͦ΋ղऍՄೳ ͳ෼ྨثͷղऍʹΑΓ͔֬ΊΔ ü4QBSTF
    -PHJTUJD
    3FHSFTTJPO
    %FDJTJPO
    5SFFΛݸͷGFBUVSFT ͷΈΛ࢖͏Α͏ʹ܇࿅͢Δ ü-*.&ͰݸͷGFBUVSFTΛநग़ͯ͠ΈͯɺSFDBMMΛධՁ 18
19. 4IPVME
    *
    USVTU
    UIJT
    QSFEJDUJPO 19 ü-*.&ͰQSFEJDUJPO͕USVTUXPSUIZ͔Ͳ͏͔Λݟ෼͚ΒΕΔ͔ʁ üͷGFBUVSFTΛVOUSVTUXPSUIZͳ΋ͷͱ͢Δ § FH
    
    OFXTHSPVQʹ͓͚ΔIFBEFS৘ใͱ͔Λ૝ఆ üղऍ͍ͨ͠Ϟσϧʹ͓͍ͯɺVOUSVTUXPSUIZͳGFBUVSFTΛআ͘ͱ ݁Ռ͕มΘΔQSFEJDUJPOΛVOUSVTUXPSUIZ
    JOTUBODFͱݺͿ ü-*.&ʹ͓͍ͯ΋ɺ VOUSVTUXPSUIZ
    JOTUBODFͰVOUSVTUXPSUIZ
    GFBUVSFTΛআ͍ͨͱ͖ʹ݁Ռ͕ͪΌΜͱมΘΔʢʹ VOUSVTUXPSUIZ
    QSFEJDUJPOͱ൑ఆͰ͖Δʣͷ͔ʁ
20. $BO
    *
    USVTU
    UIJT
    NPEFM ü41-*.&Λ࢖ͬͯ൑ผثΛղऍͨ͠ΒɺHFOFSBMJ[BUJPO
    FSSPS͕ খ͍͞ํΛબ΂Δͷ͔ʁ üσʔλʹBSUJGJDJBM
    GFBUVSFTΛՃ͑Δ § WBMJEBUJPO
    TFUͰ͸ͦΕͧΕͷΫϥεʹ § UFTU
    TFUͰ͸ͦΕͧΕͷΫϥεʹ üWBMJEBUJPO
    TFUͰͷBDDVSBDZͷ͕ࠩະຬɺ UFTU
    TFUͰ͸ Ҏ্ʹͳΔΑ͏ʹSBOEPN
    GPSFTUΛ܇࿅ ü41-*.&Λ༻͍ͯWBMJEBUJPO
    TFUͰͷVOUSVTUXPSUIZͳQSFEJDUJPO ͕গͳ͍൑ผثΛྑ͍൑ผثͱͯ͠બͼɺͦΕ͕UFTU
    TFUͰྑ͍ ੑೳͷ൑ผثͱҰக͢Δ͔ʁ 20
21. ਓΛ࢖࣮ͬͨݧ  $BO
    VTFST
    TFMFDU
    UIF
    CFTU
    DMBTTJGJFS § 41-*.&Ͱ൚Խੑೳͷߴ͍෼ྨثΛબ΂Δ͔ʁ  $BO
    OPOFYQFSUT
    JNQSPWF
    B
    DMBTTJGJFS § 41-*.&ͰGFBUVSF
    FOHJOFFSJOHΛͯ͠෼ྨثͷੑೳΛ্͛Ε Δ͔ʁ  %P
    FYQMBOBUJPOT
    MFBE
    UP
    JOTJHIUT § 41-*.&Ͱมͳ෼ྨثΛݕ஌Ͱ͖Δ͔ʁ 21
22. ࣮ݧઃఆ   %BUBTFU
    l$ISJTUJBOJUZz
    BOE
    l"UIFJTNz
    EPDVNFOUT
    GSPN
    UIF
    
    OFXTHSPVQT
    ͔͠͠ɺมͳGFBUVSF͕͋Δ͔Β൚ԽੑೳͷධՁʹ͸޲͍͍ͯͳ͍ 㱺ผͷXFCTJUF͔Β࡞੒ͨ͠σʔληοτͰ൚ԽੑೳΛධՁ ෼ྨث มͳGFBUVSFTΛআ͍ͨσʔληοτͱআ͔ͳ͍σʔληοτͷ̎ͭ Ͱ47.Λ܇࿅ WBMJEBUJPO
    TFUͰ͸আ͔ͳ͍΄͏ͷ47.͕ߴੑೳ͕ͩUFTU
    TFUͰ͸ আ͍ͨํ͕ߴੑೳ 22
23. $BO
    VTFST
    TFMFDU
    UIF
    CFTU
    DMBTTJGJFS ü"NB[PO
    .FDIBOJDBM
    5VSLΛ࢖ͬͯػցֶशͷඇઐ໳Ոʢͨͩ ͠फڭʹؔͯ͠͸جຊతͳ஌͕ࣝ͋Δਓʣʹ41-*.&Λ࢖ͬͯྑ ͦ͞͏ͳ൑ผثΛબΜͰ΋Β͏ 23
24. $BO
    OPOFYQFSUT
    JNQSPWF
    B
    DMBTTJGJFS üಉ༷ʹɺ ػցֶशͷඇઐ໳Ոʹ41-*.&Λ࢖ͬͯআ͘ ΂͖GFBUVSFTΛબΜͰ΋Β͏ɺΛ̏ϥ΢ϯυ܁Γฦ͠ ͯGFBUVSF
    FOHJOFFSJOH 24
25. %P
    FYQMBOBUJPOT
    MFBE
    UP
    JOTJHIUT üΦΦΧϛͱϋεΩʔݘͷ෼ྨ ઇ͕എܠʹ͋ΔΦΦΧϛͷը૾ͱഎܠʹͳ͍ϋεΩʔݘͷը૾Λ܇ ࿅σʔλͱͯ͠༩͑ͯɺੑೳͷѱ͍൑ผثΛ࡞੒ 25
26. %P
    FYQMBOBUJPOT
    MFBE
    UP
    JOTJHIUT ͷ಺͕ͭਖ਼͍͠༧ଌΛ͢Δඃݧऀʹݟͤͯɺ § ͜ͷΞϧΰϦζϜ͸࣮ੈքͰͪΌΜͱಇ͔͘ʁ § ͦΕ͸ͳ͔ͥʁ § ͜ͷΞϧΰϦζϜ͸Ͳ͏΍ͬͯ൑ผΛߦ͍ͬͯΔͱࢥ͏͔ʁ ͱ࣭໰ ͦͷޙɺFYQMBOBUJPOͷ݁ՌΛݟͤͯಉ༷ͷ࣭໰ 26 ൚Խੑೳ΍ِ૬ؔͳͲͷ֓೦Λ஌Βͳ͍ػցֶशͷඇઐ ໳ՈͰ΋ྑ͘ͳ͍൑ผثΛ൑ఆ͢Δ͜ͱ͕Ͱ͖ͨ
27. 'VUVSF
    XPSLT ü4QBSTF
    -JOFBS
    .PEFMҎ֎ͷFYQMBJOFS § EFDJTJPO
    USFFͱ͔ üUIFPSFUJDBM
    QSPQFSUZ
    PG
    -*.& ü41-*.&
    GPS
    JNBHF 27
28. ·ͱΊ ü೚ҙͷ̎஋෼ྨثͷղऍʹ༻͍Δ͜ͱͷग़དྷΔख๏ɺ -*.&41-*.&ΛఏҊ üγϛϡϨʔγϣϯඇઐ໳ՈʹΑΔ࣮ݧʹΑͬͯͦͷ༗ ༻ੑΛ͔֬Ίͨ 28
29. 3FGFSFODFT ü %
    #BFISFOT
    5
    4DISPFUFS
    4
    )BSNFMJOH
    .
    ,BXBOBCF
    ,
    )BOTFO
    BOE
    ,3
    .„VMMFS
    )PX
    UP
    FYQMBJO
    JOEJWJEVBMDMBTTJGJDBUJPO EFDJTJPOT
    +PVSOBM
    PG
    .BDIJOF
    -FBSOJOH
    3FTFBSDI
    
     ü 6
    'FJHF
    "
    UISFTIPME
    PG
    MO
    O
    GPS
    BQQSPYJNBUJOH
    TFU
    DPWFS
    +
    "$.
     
    +VMZ
     ü )BSB
    4
    
    )BZBTIJ
    ,
     
    .BLJOH
    5SFF
    &OTFNCMFT
    *OUFSQSFUBCMF
    "
    #BZFTJBO
    .PEFM
    4FMFDUJPO
    "QQSPBDI
    r ü ,JN
    #
    ,IBOOB
    3
    
    ,PZFKP
    0
    OE 
    &YBNQMFT
    BSF
    OPU
    &OPVHI
    -FBSO
    UP
    $SJUJDJ[F
    $SJUJDJTN
    GPS
    *OUFSQSFUBCJMJUZ ü "
    ,SBVTF
    BOE
    %
    (PMPWJO
    4VCNPEVMBS
    GVODUJPO
    NBYJNJ[BUJPO
    *O
    5SBDUBCJMJUZ
    1SBDUJDBM
    "QQSPBDIFT
    UP
    )BSE
    1SPCMFNT
    $BNCSJEHF
    6OJWFSTJUZ
    1SFTT
    'FCSVBSZ
     ü 3JCFJSP
    .
    5
    4JOHI
    4
    
    (VFTUSJO
    $
     
    l8IZ
    4IPVME
    *
    5SVTU
    :PV z
    &YQMBJOJOH
    UIF
    1SFEJDUJPOT
    PG
    "OZ
    $MBTTJGJFS
    1SPDFFEJOHT
    PG
    UIF
    OE
    "$.
    4*(,%%
    *OUFSOBUJPOBM
    $POGFSFODF
    PO
    ,OPXMFEHF
    %JTDPWFSZ
    BOE
    %BUB
    .JOJOH
     ,%%
    `
    r
    29