Upgrade to Pro — share decks privately, control downloads, hide ads and more …

PLDI '21論文読み会: Provable Repair of Deep Neural Networks

5148cbb852e980b3b3d0e71d579ddbf8?s=47 Idein
June 08, 2022

PLDI '21論文読み会: Provable Repair of Deep Neural Networks

5148cbb852e980b3b3d0e71d579ddbf8?s=128

Idein

June 08, 2022
Tweet

More Decks by Idein

Other Decks in Research

Transcript

  1.  1SPWBCMF3FQBJSPG%FFQ /FVSBM/FUXPSLT 1-%*ಡΈձ!*EFJO

  2. Ϟνϕʔγϣϯ w %//͕TBGFUZDSJUJDBMͳྖҬʹ΋࢖ΘΕग़͠͸͡Ίͨ w %//Ϟσϧ͕࣋ͭzVOTBGFͳڍಈͷݕग़ʹର͢Δಈػͱͳ͖ͬͯͨɽ w ྫ "EWFSTBSJBM&YBNQMFT w zVOTBGFͳڍಈz͕ݕग़͞Εͨޙͷɼ%//Ϟσϧͷzमਖ਼͕͍ͨ͠

    w ͜ͷ࿦จ͸ɼ%//΁ੑ࣭ͷྑ͍ύονΛ౰ͯ ΒΕ Δ࢓૊Έͱͦͷύον ͷߏ੒๏ʹ͍ͭͯͷఏҊ
  3. طଘͷमਖ਼ํ๏ GJOFUVOJOH w 'JOFUVOJOH͸࣮ੈքͷӡ༻γφϦΦʹద߹͠೉͍ w ඇޮ཰ w ݩʑͷσʔληοτ͕ࠓ΋ೖखͰ͖Δঢ়ଶɾ৚͔݅Θ͔Βͳ͍ w ৽ͨͳόά

    ҆શͰͳ͍ڍಈ ͷࠞೖ w ϋΠύϥνϡʔϯ౳͕ηϯγςΟϒ w ESBXEPXO fi OFUVOJOHʹΑΔ ݩʑຬͨ͞Ε͍ͯͨഺͷੑ࣭ͷݮগ
  4. lमਖ਼zΞϧΰϦζϜʹٻΊΒΕΔੑ࣭ w ޮೳमਖ਼ͨ͠%//Ͱ͋Δ/`͸मਖ਼લͷ%///͕VOTBGFͳڍಈΛ͢Δೖྗσ ʔληοτ9಺ͷೖྗʹର͠ɼظ଴௨ΓৼΔ෣͏Α͏ʹमਖ਼͞ΕΔ w ൚Խੑೳ/͸9಺ͷೖྗʹࣅͨೖྗʹରͯ͠΋ɼظ଴௨ΓৼΔ෣͏Α͏ʹम ਖ਼͞ΕΔ w ہॴੑ/͸9಺ͷೖྗʹࣅͯͳ͍ೖྗʹରͯ͠͸ɼ/ͱಉ༷ʹৼΔ෣͏Α͏ मਖ਼͞ΕΔ

    w ޮ཰/ʹର͠/`͕͢Έ΍͔ʹٻΊΒΕΔ
  5. ఏҊख๏ w %FDPVQMFE%//T %%//T ΞʔΩςΫνϟͷಋೖ w ݩͷ%//ʹύον༻αϒܭࢉάϥϑΛޙ෇͚ͨ͠%// w 1SPWBCMF1PJOUXJTF3FQBJS w

    %%//T্Ͱͷ༗ݶ఺ʹର͢Δࢦఆ୯૚ʹର͢ΔॏΈमਖ਼ w 1SPWBCMF1PMZUPQF3FQBJS w ˢͷ༗ݶ఺Λತ௒ଟ໘ମͷू߹಺ແݶ఺ʹ֦ுͨ͠΋ͷ
  6. 1JFDFXJTFMJOFBS 18- ؔ਺ w ͋Δؔ਺GͰ w EPNBJOΛ༗ݶݸͷ௒ଟ໘ମʹ෼ׂͰ͖Δ w ෼ׂ֤ͨ͠EPNBJOຖʹGͱ౳ՁͳΞϑΟϯม׵G`͕ଘࡏ͢Δ w

    ྫ3F-6΍-FBLZ3F-6ɼ3F-6ɼ$MJQ౳͔͠࢖ΘΕ͍ͯͳ͍%//
  7. ໰୊Λ-1ʹؼண͍ͤͨ͞ɼ͕ w %//͸ඇઢܗͳ׆ੑԽؔ਺Λ࣋ͭ w ΍Γ͍ͨ͜ͱ 1PJOUXJTF3FQBJSͷϕʔεͱͳΔΞΠσΞ  w 18-%//͸EPNBJOΛద੾ʹ෼ׂ͢Δͱɼͦͷ෼ׂͨ͠ྖҬຖʹ͸ઢܗʹ ѻ͑Δ

    w मਖ਼͍ͨ͠ೖྗσʔληοτ9தͷ֤఺͕ଐ͢ΔઢܗྖҬʹର͠ɼظ଴͢Δ ݁ՌͱͷؒͰ৚݅ࣜͱ͠ɼॏΈΛ࠷దԽ͢Δ-1Λղ͘
  8. ໰୊Λ-1ʹؼணͤ͞ΒΕͳ͍ɼ୯७ʹ͸ w ॏΈΛม͑ΔͱEPNBJOͷ෼ׂ΋·ͨมΘͬͯ͠·͏ͨΊ w Մೳͳͷ͸׆ੑԽؔ਺Λ࣋ͨͳ͍࠷ऴ૚ͷΈ w தؒ૚ʹ΍Δͱμϝ

  9. ෼ׂ͕มΘͬͯ͠·͏ྫ Z3F-6 Y 3F-6 Y 3F-6 Y w ΍Γ͍ͨमਖ਼ w

    Yͷͱ͖㱡Z㱡 w Yͷͱ͖㱡Z㱡 w YˠIͷॏΈΛʹमਖ਼͢Δ ਤC ্ ͱ෼ׂ ਤCԼͷ3(#۠ؒ ΋ม Θͬͯ͠·͍ظ଴௨ΓʹͳΒͳ ͍
  10. %FDPVQMFE%//T w ݩͷ%//͔Β౳Ձͳ΋ͷΛػցతʹ ߏ੒Ͱ͖Δɼͭͷαϒάϥϑ͔Βͳ Δߏ଄ͷ%// w "DUJWBUJPODIBOOFM w 7BMVFDIBOOFM w

    ෼ׂΛม͑ͣʹॏΈͷมߋ͚ͩ൓ө͞ ͤΒΕΔ
  11. %FDPVQMFE%//T "DUJWBUJPODIBOOFM w ෼ׂͷҡ࣋ͷͨΊ w ೖྗ͔Βݩͷ%//Ͱܭࢉ͠ɼमਖ਼ର ৅૚ͷ݁ՌΛ7BMVFDIBOOFMͷରԠ૚ ʹ͓͚Δܭࢉʹ൓өͤ͞Δ w ͦΕҎ֎͸ݩͷ%//ͱҰॹ

  12. %FDPVQMFE%//T 7BMVFDIBOOFM w -1ͷ݁ՌΛద༻͢Δଆ w "DUJWBUJPODIBOOFMͷରԠ૚ʹ͓͚ Δ݁ՌΛҎͬͯ׆ੑԽؔ਺Λઢܗؔ ਺Ͱஔ͖׵͑ͨ΋ͷ w 3F-6ͳΒ͹PS

    w Ұൠత 18-Ͱ͸ͳ͍׆ੑԽؔ਺ͷ ৔߹ ʹ͸+BDPCJBOͰ͍͍
  13. %FDPVQMFE%//Tͷಛ௃ w ྆$IBOOFMͷ֤૚ʹݩͷ%//ͷରԠ૚ͱಉ͡ॏΈ͕ೖ͍ͬͯΔͳΒ͹ɼ֤ೖ ྗ఺ʹ͓͍ͯݩͷ%//ͱ%%//͸֎Ԇతʹ౳Ձͳؔ਺ w ೚ҙͷೖྗ఺Λݻఆ͢Δͱ7BMVF$IBOOFMத͋Δ૚෼ͷॏΈͷมߋʹରͯ͠ ઢܗ w ݩͷ%//͕18-ͷ৔߹ɼ%%//ͷ7BMVF$IBOOFMதͷॏΈͷมߋ͸ݩͷ 18-%//ͷઢܗྖҬΛม͑ͯ͠·͏͜ͱ͕ͳ͍

  14. 1SPWBCMF1PJOUXJTF3FQBJS w %//͔Β౳Ձͳ%%//Λߏ੒ w %%//ʹରͯ͠ݩʑ%//ͷॏΈʹରͯ͠΍Γ͔ͨͬͨΑ͏ ʹ-1Ͱ7BMVFDIBOOFMͷॏΈΛʹ͍ͭͯղ͖ɼߋ৽͢Δ

  15. मਖ਼ͷ֦ு w 1PJOUXJTF3FQBJSͰ͸༗ݶݸͷ఺ͷೖྗʹରͯͩͬͨ͠ w Yͷͱ͖㱡Z㱡 w Yͷͱ͖㱡Z㱡 w ೖྗΛ఺Ͱ͸ͳ͘༗ݶݸͷ ತͳ

    QPMZUPQF ͷVOJPO ͳྖҬͰදݱ͞ΕΔແݶ ఺ʹ֦ு͍ͨ͠ w 㱡Y㱡ͷͱ͖㱡Z㱡
  16. मਖ਼ͷ֦ுͷ1PJOUXJTF3FQBJS΁ͷؼண w 1PMZUPQFͷྖҬͱEPNBJO෼ׂͨ͠ઢܗྖҬͷJOUFSTFDUJPOΛऔΔ w ઢܗྖҬΛٻΊͯ࢖͏ͷͰ18-%//ʹର͔ͯ͠͠࢖͑ͳ͍ w *OUFSTFDUJPOͷ֤௖఺͚ͩΛݟ੍ͯ໿ʹ͢Ε͹͍͍ w ༗ݶݸͷ఺ʹର͢Δ੍໿ʹؼண͞ΕΔ w

    1SPWBCMF1PJOUXJTF3FQBJSͰղ͚Δ
  17. 1SPWBCMF1PMZUPQF3FQBJS w ΍Γ͍ͨमਖ਼ ࠶ܝ  w 㱡Y㱡ͷͱ͖㱡Z㱡 w JOUFSTFDUJPOͷ֤௖఺͚ͩΛݟ֤ͯ఺Ͱͷ੍໿ʹ͢Δ w

    Y   ͷ఺Ͱ㱡Z㱡 w 1SPWBCMF1PJOUXJTF3FQBJS͢Δ
  18. ࣮ݧ݁Ռ 4RVFF[F/FU *NBHF/FU /BUVSBM"EWFSTBSJBM&YBNQMFT w 13͕ຊख๏Ͱ%SBXEPXO͕ϕετͷ૚ͷ΋ͷɼ'5͕'JOFUVOJOHɼ .'5 NPEJ fi FE

    ͸૚ͷΈͷ w && ffi DBDZ %%SBXEPXO 55JNF w 13 '5Ͱ&͸
  19. ·ͱΊ w ܇࿅ࡁΈ%//ϞσϧΛύονमਖ਼Ͱ͖Δख๏ΛఏҊ w ܇࿅࣌σʔληοτ͕ෆཁ w ESBXEPXOͳͲͷѱӨڹ͕গͳ͍ w -1Ͱޮ཰ྑ͘ղ͚Δ