PLDI '21論文読み会: Provable Repair of Deep Neural Networks

Transcript

1.  1SPWBCMF
   3FQBJS
   PG
   %FFQ
   /FVSBM
   /FUXPSLT 1-%*ಡΈձ!*EFJO
2. Ϟνϕʔγϣϯ w %//͕TBGFUZDSJUJDBMͳྖҬʹ΋࢖ΘΕग़͠͸͡Ίͨ
   w %//Ϟσϧ͕࣋ͭzVOTBGFͳڍಈͷݕग़ʹର͢Δಈػͱͳ͖ͬͯͨɽ
   w ྫ
   "EWFSTBSJBM
   &YBNQMFT
   w zVOTBGFͳڍಈz͕ݕग़͞Εͨޙͷɼ%//Ϟσϧͷzमਖ਼͕͍ͨ͠
   w ͜ͷ࿦จ͸ɼ%//΁ੑ࣭ͷྑ͍ύονΛ౰ͯ ΒΕ Δ࢓૊Έͱͦͷύον ͷߏ੒๏ʹ͍ͭͯͷఏҊ
3. طଘͷमਖ਼ํ๏
   GJOFUVOJOH w 'JOFUVOJOH
   ͸࣮ੈքͷӡ༻γφϦΦʹద߹͠೉͍
   w ඇޮ཰
   w ݩʑͷσʔληοτ͕ࠓ΋ೖखͰ͖Δঢ়ଶɾ৚͔݅Θ͔Βͳ͍
   w ৽ͨͳόά ҆શͰͳ͍ڍಈ ͷࠞೖ
   w ϋΠύϥνϡʔϯ౳͕ηϯγςΟϒ
   w ESBXEPXO
   fi OFUVOJOHʹΑΔ ݩʑຬͨ͞Ε͍ͯͨഺͷੑ࣭ͷݮগ
4. lमਖ਼zΞϧΰϦζϜʹٻΊΒΕΔੑ࣭ w ޮೳ
   मਖ਼ͨ͠%//Ͱ͋Δ/`͸मਖ਼લͷ%//
   /͕VOTBGFͳڍಈΛ͢Δೖྗσ ʔληοτ9಺ͷೖྗʹର͠ɼظ଴௨ΓৼΔ෣͏Α͏ʹमਖ਼͞ΕΔ
   w ൚Խੑೳ
   /͸9಺ͷೖྗʹࣅͨೖྗʹରͯ͠΋ɼظ଴௨ΓৼΔ෣͏Α͏ʹम ਖ਼͞ΕΔ
   w ہॴੑ
   /͸9಺ͷೖྗʹࣅͯͳ͍ೖྗʹରͯ͠͸ɼ/ͱಉ༷ʹৼΔ෣͏Α͏ मਖ਼͞ΕΔ
   w ޮ཰
   /ʹର͠/`͕͢Έ΍͔ʹٻΊΒΕΔ
5. ఏҊख๏ w %FDPVQMFE
   %//T
   %%//T
   ΞʔΩςΫνϟͷಋೖ
   w ݩͷ%//ʹύον༻αϒܭࢉάϥϑΛޙ෇͚ͨ͠%//
   w 1SPWBCMF
   1PJOUXJTF
   3FQBJS
   w %%//T
   ্Ͱͷ༗ݶ఺ʹର͢Δࢦఆ୯૚ʹର͢ΔॏΈमਖ਼
   w 1SPWBCMF
   1PMZUPQF
   3FQBJS
   w ˢͷ༗ݶ఺Λತ௒ଟ໘ମͷू߹಺ແݶ఺ʹ֦ுͨ͠΋ͷ
6. 1JFDFXJTFMJOFBS
   18-
   ؔ਺ w ͋Δؔ਺GͰ
   w EPNBJOΛ༗ݶݸͷ௒ଟ໘ମʹ෼ׂͰ͖Δ
   w ෼ׂ֤ͨ͠EPNBJOຖʹGͱ౳ՁͳΞϑΟϯม׵G`͕ଘࡏ͢Δ
   w ྫ
   3F-6΍-FBLZ
   3F-6ɼ3F-6ɼ$MJQ౳͔͠࢖ΘΕ͍ͯͳ͍%//
7. ໰୊Λ-1ʹؼண͍ͤͨ͞ɼ͕ w %//͸ඇઢܗͳ׆ੑԽؔ਺Λ࣋ͭ
   w ΍Γ͍ͨ͜ͱ 1PJOUXJTF
   3FQBJS
   ͷϕʔεͱͳΔΞΠσΞ
   w 18-
   %//
   ͸EPNBJOΛద੾ʹ෼ׂ͢Δͱɼͦͷ෼ׂͨ͠ྖҬຖʹ͸ઢܗʹ ѻ͑Δ
   w मਖ਼͍ͨ͠ೖྗσʔληοτ9தͷ֤఺͕ଐ͢ΔઢܗྖҬʹର͠ɼظ଴͢Δ ݁ՌͱͷؒͰ৚݅ࣜͱ͠ɼॏΈΛ࠷దԽ͢Δ-1Λղ͘
8. ໰୊Λ-1ʹؼணͤ͞ΒΕͳ͍ɼ୯७ʹ͸ w ॏΈΛม͑ΔͱEPNBJOͷ෼ׂ΋·ͨมΘͬͯ͠·͏ͨΊ
   w Մೳͳͷ͸׆ੑԽؔ਺Λ࣋ͨͳ͍࠷ऴ૚ͷΈ
   w தؒ૚ʹ΍Δͱμϝ
9. ෼ׂ͕มΘͬͯ͠·͏ྫ Z3F-6 Y 3F-6 Y 3F-6 Y w ΍Γ͍ͨमਖ਼
   w Y
   ͷͱ͖
   
   㱡
   Z
   㱡
   
   w Y
   ͷͱ͖
   
   㱡
   Z
   㱡
   
   w YˠIͷॏΈΛʹमਖ਼͢Δ ਤC ্ ͱ෼ׂ ਤCԼͷ3(#۠ؒ ΋ม Θͬͯ͠·͍ظ଴௨ΓʹͳΒͳ ͍
10. %FDPVQMFE
    %//T w ݩͷ%//͔Β౳Ձͳ΋ͷΛػցతʹ ߏ੒Ͱ͖Δɼͭͷαϒάϥϑ͔Βͳ Δߏ଄ͷ%//
    w "DUJWBUJPO
    DIBOOFM
    w 7BMVF
    DIBOOFM
    w ෼ׂΛม͑ͣʹॏΈͷมߋ͚ͩ൓ө͞ ͤΒΕΔ
11. %FDPVQMFE
    %//T "DUJWBUJPO
    DIBOOFM w ෼ׂͷҡ࣋ͷͨΊ
    w ೖྗ͔Βݩͷ%//Ͱܭࢉ͠ɼमਖ਼ର ৅૚ͷ݁ՌΛ7BMVF
    DIBOOFMͷରԠ૚ ʹ͓͚Δܭࢉʹ൓өͤ͞Δ
    w ͦΕҎ֎͸ݩͷ%//ͱҰॹ
12. %FDPVQMFE
    %//T 7BMVF
    DIBOOFM w -1ͷ݁ՌΛద༻͢Δଆ
    w "DUJWBUJPO
    DIBOOFMͷରԠ૚ʹ͓͚ Δ݁ՌΛҎͬͯ׆ੑԽؔ਺Λઢܗؔ ਺Ͱஔ͖׵͑ͨ΋ͷ
    w 3F-6
    ͳΒ͹
    
    PS
    
    w Ұൠత 18-Ͱ͸ͳ͍׆ੑԽؔ਺ͷ ৔߹ ʹ͸
    +BDPCJBOͰ͍͍
13. %FDPVQMFE
    %//T
    ͷಛ௃ w ྆$IBOOFMͷ֤૚ʹݩͷ%//ͷରԠ૚ͱಉ͡ॏΈ͕ೖ͍ͬͯΔͳΒ͹ɼ֤ೖ ྗ఺ʹ͓͍ͯݩͷ%//ͱ%%//͸֎Ԇతʹ౳Ձͳؔ਺
    w ೚ҙͷೖྗ఺Λݻఆ͢Δͱ7BMVF
    $IBOOFMத͋Δ૚෼ͷॏΈͷมߋʹରͯ͠ ઢܗ
    w ݩͷ%//͕18-ͷ৔߹ɼ%%//ͷ7BMVF
    $IBOOFMதͷॏΈͷมߋ͸ݩͷ 18-
    %//ͷઢܗྖҬΛม͑ͯ͠·͏͜ͱ͕ͳ͍
14. 1SPWBCMF
    1PJOUXJTF
    3FQBJS w %//͔Β౳Ձͳ%%//Λߏ੒
    w %%//
    ʹରͯ͠ݩʑ%//ͷॏΈʹରͯ͠΍Γ͔ͨͬͨΑ͏ ʹ-1Ͱ7BMVF
    DIBOOFM
    ͷॏΈΛʹ͍ͭͯղ͖ɼߋ৽͢Δ
15. मਖ਼ͷ֦ு w 1PJOUXJTF
    3FQBJS
    Ͱ͸༗ݶݸͷ఺ͷೖྗʹରͯͩͬͨ͠
    w Y
    ͷͱ͖
    
    㱡
    Z
    㱡
    
    w Y
    ͷͱ͖
    
    㱡
    Z
    㱡
    
    w ೖྗΛ఺Ͱ͸ͳ͘༗ݶݸͷ ತͳ QPMZUPQF ͷVOJPO ͳྖҬͰදݱ͞ΕΔແݶ ఺ʹ֦ு͍ͨ͠
    w 
    㱡
    Y
    㱡
    
    ͷͱ͖
    
    㱡
    Z
    㱡
    
16. मਖ਼ͷ֦ுͷ
    1PJOUXJTF
    3FQBJS
    ΁ͷؼண w 1PMZUPQFͷྖҬͱEPNBJO෼ׂͨ͠ઢܗྖҬͷJOUFSTFDUJPOΛऔΔ
    w ઢܗྖҬΛٻΊͯ࢖͏ͷͰ18-
    %//ʹର͔ͯ͠͠࢖͑ͳ͍
    w *OUFSTFDUJPOͷ֤௖఺͚ͩΛݟ੍ͯ໿ʹ͢Ε͹͍͍
    w ༗ݶݸͷ఺ʹର͢Δ੍໿ʹؼண͞ΕΔ
    w 1SPWBCMF
    1PJOUXJTF
    3FQBJS
    Ͱղ͚Δ
17. 1SPWBCMF
    1PMZUPQF
    3FQBJS w ΍Γ͍ͨमਖ਼ ࠶ܝ
    w 
    㱡
    Y
    㱡
    
    ͷͱ͖
    
    㱡
    Z
    㱡
    
    w JOUFSTFDUJPOͷ֤௖఺͚ͩΛݟ֤ͯ఺Ͱͷ੍໿ʹ͢Δ
    w Y
    
    
    
    ͷ఺
    Ͱ
    
    㱡
    Z
    㱡
    
    w 1SPWBCMF
    1PJOUXJTF
    3FQBJS
    ͢Δ
18. ࣮ݧ݁Ռ 4RVFF[F/FU
    *NBHF/FU
    /BUVSBM
    "EWFSTBSJBM
    &YBNQMFT w 13͕ຊख๏Ͱ%SBXEPXO͕ϕετͷ૚ͷ΋ͷɼ'5͕'JOFUVOJOHɼ .'5 NPEJ fi FE ͸૚ͷΈͷ
    w && ffi DBDZ
    %
    %SBXEPXO
    5
    5JNF
    w 13 '5Ͱ&͸
19. ·ͱΊ w ܇࿅ࡁΈ%//ϞσϧΛύονमਖ਼Ͱ͖Δख๏ΛఏҊ
    w ܇࿅࣌σʔληοτ͕ෆཁ
    w ESBXEPXOͳͲͷѱӨڹ͕গͳ͍
    w -1Ͱޮ཰ྑ͘ղ͚Δ