PLDI '21論文読み会: Provable Repair of Deep Neural Networks

Transcript

1. 
   1SPWBCMF3FQBJSPG%FFQ
   /FVSBM/FUXPSLT
   1-%*ಡΈձ!*EFJO
   

   View Slide

2. Ϟνϕʔγϣϯ
   w %//͕TBGFUZDSJUJDBMͳྖҬʹ΋࢖ΘΕग़͠͸͡Ίͨ
   w %//Ϟσϧ͕࣋ͭzVOTBGFͳڍಈͷݕग़ʹର͢Δಈػͱͳ͖ͬͯͨɽ
   w ྫ
   "EWFSTBSJBM&YBNQMFT
   w zVOTBGFͳڍಈz͕ݕग़͞Εͨޙͷɼ%//Ϟσϧͷzमਖ਼͕͍ͨ͠
   w ͜ͷ࿦จ͸ɼ%//΁ੑ࣭ͷྑ͍ύονΛ౰ͯ ΒΕ
   Δ࢓૊Έͱͦͷύον
   ͷߏ੒๏ʹ͍ͭͯͷఏҊ
   

   View Slide

3. طଘͷमਖ਼ํ๏ GJOFUVOJOH
   
   w 'JOFUVOJOH͸࣮ੈքͷӡ༻γφϦΦʹద߹͠೉͍
   w ඇޮ཰
   w ݩʑͷσʔληοτ͕ࠓ΋ೖखͰ͖Δঢ়ଶɾ৚͔݅Θ͔Βͳ͍
   w ৽ͨͳόά ҆શͰͳ͍ڍಈ
   ͷࠞೖ
   w ϋΠύϥνϡʔϯ౳͕ηϯγςΟϒ
   w ESBXEPXO
   fi
   OFUVOJOHʹΑΔ
   ݩʑຬͨ͞Ε͍ͯͨഺͷੑ࣭ͷݮগ
   

   View Slide

4. lमਖ਼zΞϧΰϦζϜʹٻΊΒΕΔੑ࣭
   w ޮೳमਖ਼ͨ͠%//Ͱ͋Δ/`͸मਖ਼લͷ%///͕VOTBGFͳڍಈΛ͢Δೖྗσ
   ʔληοτ9಺ͷೖྗʹର͠ɼظ଴௨ΓৼΔ෣͏Α͏ʹमਖ਼͞ΕΔ
   w ൚Խੑೳ/͸9಺ͷೖྗʹࣅͨೖྗʹରͯ͠΋ɼظ଴௨ΓৼΔ෣͏Α͏ʹम
   ਖ਼͞ΕΔ
   w ہॴੑ/͸9಺ͷೖྗʹࣅͯͳ͍ೖྗʹରͯ͠͸ɼ/ͱಉ༷ʹৼΔ෣͏Α͏
   मਖ਼͞ΕΔ
   w ޮ཰/ʹର͠/`͕͢Έ΍͔ʹٻΊΒΕΔ
   

   View Slide

5. ఏҊख๏
   w %FDPVQMFE%//T %%//T
   ΞʔΩςΫνϟͷಋೖ
   w ݩͷ%//ʹύον༻αϒܭࢉάϥϑΛޙ෇͚ͨ͠%//
   w 1SPWBCMF1PJOUXJTF3FQBJS
   w %%//T্Ͱͷ༗ݶ఺ʹର͢Δࢦఆ୯૚ʹର͢ΔॏΈमਖ਼
   w 1SPWBCMF1PMZUPQF3FQBJS
   w ˢͷ༗ݶ఺Λತ௒ଟ໘ମͷू߹಺ແݶ఺ʹ֦ுͨ͠΋ͷ
   

   View Slide

6. 1JFDFXJTFMJOFBS 18-
   ؔ਺
   w ͋Δؔ਺GͰ
   w EPNBJOΛ༗ݶݸͷ௒ଟ໘ମʹ෼ׂͰ͖Δ
   w ෼ׂ֤ͨ͠EPNBJOຖʹGͱ౳ՁͳΞϑΟϯม׵G`͕ଘࡏ͢Δ
   w ྫ3F-6΍-FBLZ3F-6ɼ3F-6ɼ$MJQ౳͔͠࢖ΘΕ͍ͯͳ͍%//
   

   View Slide

7. ໰୊Λ-1ʹؼண͍ͤͨ͞ɼ͕
   w %//͸ඇઢܗͳ׆ੑԽؔ਺Λ࣋ͭ
   w ΍Γ͍ͨ͜ͱ 1PJOUXJTF3FQBJSͷϕʔεͱͳΔΞΠσΞ
   
   w 18-%//͸EPNBJOΛద੾ʹ෼ׂ͢Δͱɼͦͷ෼ׂͨ͠ྖҬຖʹ͸ઢܗʹ
   ѻ͑Δ
   w मਖ਼͍ͨ͠ೖྗσʔληοτ9தͷ֤఺͕ଐ͢ΔઢܗྖҬʹର͠ɼظ଴͢Δ
   ݁ՌͱͷؒͰ৚݅ࣜͱ͠ɼॏΈΛ࠷దԽ͢Δ-1Λղ͘
   

   View Slide

8. ໰୊Λ-1ʹؼணͤ͞ΒΕͳ͍ɼ୯७ʹ͸
   w ॏΈΛม͑ΔͱEPNBJOͷ෼ׂ΋·ͨมΘͬͯ͠·͏ͨΊ
   w Մೳͳͷ͸׆ੑԽؔ਺Λ࣋ͨͳ͍࠷ऴ૚ͷΈ
   w தؒ૚ʹ΍Δͱμϝ
   

   View Slide

9. ෼ׂ͕มΘͬͯ͠·͏ྫ
   Z3F-6 Y
   3F-6 Y
   3F-6 Y
   
   w ΍Γ͍ͨमਖ਼
   w Yͷͱ͖㱡Z㱡
   w Yͷͱ͖㱡Z㱡
   w YˠIͷॏΈΛʹमਖ਼͢Δ ਤC
   ্
   ͱ෼ׂ ਤCԼͷ3(#۠ؒ
   ΋ม
   Θͬͯ͠·͍ظ଴௨ΓʹͳΒͳ
   ͍
   

   View Slide

10. %FDPVQMFE%//T
    w ݩͷ%//͔Β౳Ձͳ΋ͷΛػցతʹ
    ߏ੒Ͱ͖Δɼͭͷαϒάϥϑ͔Βͳ
    Δߏ଄ͷ%//
    w "DUJWBUJPODIBOOFM
    w 7BMVFDIBOOFM
    w ෼ׂΛม͑ͣʹॏΈͷมߋ͚ͩ൓ө͞
    ͤΒΕΔ
    

    View Slide

11. %FDPVQMFE%//T
    "DUJWBUJPODIBOOFM
    w ෼ׂͷҡ࣋ͷͨΊ
    w ೖྗ͔Βݩͷ%//Ͱܭࢉ͠ɼमਖ਼ର
    ৅૚ͷ݁ՌΛ7BMVFDIBOOFMͷରԠ૚
    ʹ͓͚Δܭࢉʹ൓өͤ͞Δ
    w ͦΕҎ֎͸ݩͷ%//ͱҰॹ
    

    View Slide

12. %FDPVQMFE%//T
    7BMVFDIBOOFM
    w -1ͷ݁ՌΛద༻͢Δଆ
    w "DUJWBUJPODIBOOFMͷରԠ૚ʹ͓͚
    Δ݁ՌΛҎͬͯ׆ੑԽؔ਺Λઢܗؔ
    ਺Ͱஔ͖׵͑ͨ΋ͷ
    w 3F-6ͳΒ͹PS
    w Ұൠత 18-Ͱ͸ͳ͍׆ੑԽؔ਺ͷ
    ৔߹
    ʹ͸+BDPCJBOͰ͍͍
    

    View Slide

13. %FDPVQMFE%//Tͷಛ௃
    w ྆$IBOOFMͷ֤૚ʹݩͷ%//ͷରԠ૚ͱಉ͡ॏΈ͕ೖ͍ͬͯΔͳΒ͹ɼ֤ೖ
    ྗ఺ʹ͓͍ͯݩͷ%//ͱ%%//͸֎Ԇతʹ౳Ձͳؔ਺
    w ೚ҙͷೖྗ఺Λݻఆ͢Δͱ7BMVF$IBOOFMத͋Δ૚෼ͷॏΈͷมߋʹରͯ͠
    ઢܗ
    w ݩͷ%//͕18-ͷ৔߹ɼ%%//ͷ7BMVF$IBOOFMதͷॏΈͷมߋ͸ݩͷ
    18-%//ͷઢܗྖҬΛม͑ͯ͠·͏͜ͱ͕ͳ͍
    

    View Slide

14. 1SPWBCMF1PJOUXJTF3FQBJS
    w %//͔Β౳Ձͳ%%//Λߏ੒
    w %%//ʹରͯ͠ݩʑ%//ͷॏΈʹରͯ͠΍Γ͔ͨͬͨΑ͏
    ʹ-1Ͱ7BMVFDIBOOFMͷॏΈΛʹ͍ͭͯղ͖ɼߋ৽͢Δ
    

    View Slide

15. मਖ਼ͷ֦ு
    w 1PJOUXJTF3FQBJSͰ͸༗ݶݸͷ఺ͷೖྗʹରͯͩͬͨ͠
    w Yͷͱ͖㱡Z㱡
    w Yͷͱ͖㱡Z㱡
    w ೖྗΛ఺Ͱ͸ͳ͘༗ݶݸͷ ತͳ
    QPMZUPQF ͷVOJPO
    ͳྖҬͰදݱ͞ΕΔແݶ
    ఺ʹ֦ு͍ͨ͠
    w 㱡Y㱡ͷͱ͖㱡Z㱡
    

    View Slide

16. मਖ਼ͷ֦ுͷ1PJOUXJTF3FQBJS΁ͷؼண
    w 1PMZUPQFͷྖҬͱEPNBJO෼ׂͨ͠ઢܗྖҬͷJOUFSTFDUJPOΛऔΔ
    w ઢܗྖҬΛٻΊͯ࢖͏ͷͰ18-%//ʹର͔ͯ͠͠࢖͑ͳ͍
    w *OUFSTFDUJPOͷ֤௖఺͚ͩΛݟ੍ͯ໿ʹ͢Ε͹͍͍
    w ༗ݶݸͷ఺ʹର͢Δ੍໿ʹؼண͞ΕΔ
    w 1SPWBCMF1PJOUXJTF3FQBJSͰղ͚Δ
    

    View Slide

17. 1SPWBCMF1PMZUPQF3FQBJS
    w ΍Γ͍ͨमਖ਼ ࠶ܝ
    
    w 㱡Y㱡ͷͱ͖㱡Z㱡
    w JOUFSTFDUJPOͷ֤௖఺͚ͩΛݟ֤ͯ఺Ͱͷ੍໿ʹ͢Δ
    w Y ͷ఺Ͱ㱡Z㱡
    w 1SPWBCMF1PJOUXJTF3FQBJS͢Δ
    

    View Slide

18. ࣮ݧ݁Ռ
    4RVFF[F/FU *NBHF/FU /BUVSBM"EWFSTBSJBM&YBNQMFT
    w 13͕ຊख๏Ͱ%SBXEPXO͕ϕετͷ૚ͷ΋ͷɼ'5͕'JOFUVOJOHɼ
    .'5 NPEJ
    fi
    FE
    ͸૚ͷΈͷ
    w &&
    ffi
    DBDZ %%SBXEPXO 55JNF
    w 13 '5Ͱ&͸
    

    View Slide

19. ·ͱΊ
    w ܇࿅ࡁΈ%//ϞσϧΛύονमਖ਼Ͱ͖Δख๏ΛఏҊ
    w ܇࿅࣌σʔληοτ͕ෆཁ
    w ESBXEPXOͳͲͷѱӨڹ͕গͳ͍
    w -1Ͱޮ཰ྑ͘ղ͚Δ
    

    View Slide