$30 off During Our Annual Pro Sale. View Details »

PLDI '21論文読み会: Provable Repair of Deep Neural Networks

Idein
June 08, 2022

PLDI '21論文読み会: Provable Repair of Deep Neural Networks

Idein

June 08, 2022
Tweet

More Decks by Idein

Other Decks in Research

Transcript


  1. 1SPWBCMF3FQBJSPG%FFQ
    /FVSBM/FUXPSLT
    1-%*ಡΈձ!*EFJO

    View Slide

  2. Ϟνϕʔγϣϯ
    w %//͕TBGFUZDSJUJDBMͳྖҬʹ΋࢖ΘΕग़͠͸͡Ίͨ
    w %//Ϟσϧ͕࣋ͭzVOTBGFͳڍಈͷݕग़ʹର͢Δಈػͱͳ͖ͬͯͨɽ
    w ྫ
    "EWFSTBSJBM&YBNQMFT
    w zVOTBGFͳڍಈz͕ݕग़͞Εͨޙͷɼ%//Ϟσϧͷzमਖ਼͕͍ͨ͠
    w ͜ͷ࿦จ͸ɼ%//΁ੑ࣭ͷྑ͍ύονΛ౰ͯ ΒΕ
    Δ࢓૊Έͱͦͷύον
    ͷߏ੒๏ʹ͍ͭͯͷఏҊ

    View Slide

  3. طଘͷमਖ਼ํ๏ GJOFUVOJOH

    w 'JOFUVOJOH͸࣮ੈքͷӡ༻γφϦΦʹద߹͠೉͍
    w ඇޮ཰
    w ݩʑͷσʔληοτ͕ࠓ΋ೖखͰ͖Δঢ়ଶɾ৚͔݅Θ͔Βͳ͍
    w ৽ͨͳόά ҆શͰͳ͍ڍಈ
    ͷࠞೖ
    w ϋΠύϥνϡʔϯ౳͕ηϯγςΟϒ
    w ESBXEPXO
    fi
    OFUVOJOHʹΑΔ
    ݩʑຬͨ͞Ε͍ͯͨഺͷੑ࣭ͷݮগ

    View Slide

  4. lमਖ਼zΞϧΰϦζϜʹٻΊΒΕΔੑ࣭
    w ޮೳमਖ਼ͨ͠%//Ͱ͋Δ/`͸मਖ਼લͷ%///͕VOTBGFͳڍಈΛ͢Δೖྗσ
    ʔληοτ9಺ͷೖྗʹର͠ɼظ଴௨ΓৼΔ෣͏Α͏ʹमਖ਼͞ΕΔ
    w ൚Խੑೳ/͸9಺ͷೖྗʹࣅͨೖྗʹରͯ͠΋ɼظ଴௨ΓৼΔ෣͏Α͏ʹम
    ਖ਼͞ΕΔ
    w ہॴੑ/͸9಺ͷೖྗʹࣅͯͳ͍ೖྗʹରͯ͠͸ɼ/ͱಉ༷ʹৼΔ෣͏Α͏
    मਖ਼͞ΕΔ
    w ޮ཰/ʹର͠/`͕͢Έ΍͔ʹٻΊΒΕΔ

    View Slide

  5. ఏҊख๏
    w %FDPVQMFE%//T %%//T
    ΞʔΩςΫνϟͷಋೖ
    w ݩͷ%//ʹύον༻αϒܭࢉάϥϑΛޙ෇͚ͨ͠%//
    w 1SPWBCMF1PJOUXJTF3FQBJS
    w %%//T্Ͱͷ༗ݶ఺ʹର͢Δࢦఆ୯૚ʹର͢ΔॏΈमਖ਼
    w 1SPWBCMF1PMZUPQF3FQBJS
    w ˢͷ༗ݶ఺Λತ௒ଟ໘ମͷू߹಺ແݶ఺ʹ֦ுͨ͠΋ͷ

    View Slide

  6. 1JFDFXJTFMJOFBS 18-
    ؔ਺
    w ͋Δؔ਺GͰ
    w EPNBJOΛ༗ݶݸͷ௒ଟ໘ମʹ෼ׂͰ͖Δ
    w ෼ׂ֤ͨ͠EPNBJOຖʹGͱ౳ՁͳΞϑΟϯม׵G`͕ଘࡏ͢Δ
    w ྫ3F-6΍-FBLZ3F-6ɼ3F-6ɼ$MJQ౳͔͠࢖ΘΕ͍ͯͳ͍%//

    View Slide

  7. ໰୊Λ-1ʹؼண͍ͤͨ͞ɼ͕
    w %//͸ඇઢܗͳ׆ੑԽؔ਺Λ࣋ͭ
    w ΍Γ͍ͨ͜ͱ 1PJOUXJTF3FQBJSͷϕʔεͱͳΔΞΠσΞ

    w 18-%//͸EPNBJOΛద੾ʹ෼ׂ͢Δͱɼͦͷ෼ׂͨ͠ྖҬຖʹ͸ઢܗʹ
    ѻ͑Δ
    w मਖ਼͍ͨ͠ೖྗσʔληοτ9தͷ֤఺͕ଐ͢ΔઢܗྖҬʹର͠ɼظ଴͢Δ
    ݁ՌͱͷؒͰ৚݅ࣜͱ͠ɼॏΈΛ࠷దԽ͢Δ-1Λղ͘

    View Slide

  8. ໰୊Λ-1ʹؼணͤ͞ΒΕͳ͍ɼ୯७ʹ͸
    w ॏΈΛม͑ΔͱEPNBJOͷ෼ׂ΋·ͨมΘͬͯ͠·͏ͨΊ
    w Մೳͳͷ͸׆ੑԽؔ਺Λ࣋ͨͳ͍࠷ऴ૚ͷΈ
    w தؒ૚ʹ΍Δͱμϝ

    View Slide

  9. ෼ׂ͕มΘͬͯ͠·͏ྫ
    Z3F-6 Y
    3F-6 Y
    3F-6 Y

    w ΍Γ͍ͨमਖ਼
    w Yͷͱ͖㱡Z㱡
    w Yͷͱ͖㱡Z㱡
    w YˠIͷॏΈΛʹमਖ਼͢Δ ਤC

    ͱ෼ׂ ਤCԼͷ3(#۠ؒ
    ΋ม
    Θͬͯ͠·͍ظ଴௨ΓʹͳΒͳ
    ͍

    View Slide

  10. %FDPVQMFE%//T
    w ݩͷ%//͔Β౳Ձͳ΋ͷΛػցతʹ
    ߏ੒Ͱ͖Δɼͭͷαϒάϥϑ͔Βͳ
    Δߏ଄ͷ%//
    w "DUJWBUJPODIBOOFM
    w 7BMVFDIBOOFM
    w ෼ׂΛม͑ͣʹॏΈͷมߋ͚ͩ൓ө͞
    ͤΒΕΔ

    View Slide

  11. %FDPVQMFE%//T
    "DUJWBUJPODIBOOFM
    w ෼ׂͷҡ࣋ͷͨΊ
    w ೖྗ͔Βݩͷ%//Ͱܭࢉ͠ɼमਖ਼ର
    ৅૚ͷ݁ՌΛ7BMVFDIBOOFMͷରԠ૚
    ʹ͓͚Δܭࢉʹ൓өͤ͞Δ
    w ͦΕҎ֎͸ݩͷ%//ͱҰॹ

    View Slide

  12. %FDPVQMFE%//T
    7BMVFDIBOOFM
    w -1ͷ݁ՌΛద༻͢Δଆ
    w "DUJWBUJPODIBOOFMͷରԠ૚ʹ͓͚
    Δ݁ՌΛҎͬͯ׆ੑԽؔ਺Λઢܗؔ
    ਺Ͱஔ͖׵͑ͨ΋ͷ
    w 3F-6ͳΒ͹PS
    w Ұൠత 18-Ͱ͸ͳ͍׆ੑԽؔ਺ͷ
    ৔߹
    ʹ͸+BDPCJBOͰ͍͍

    View Slide

  13. %FDPVQMFE%//Tͷಛ௃
    w ྆$IBOOFMͷ֤૚ʹݩͷ%//ͷରԠ૚ͱಉ͡ॏΈ͕ೖ͍ͬͯΔͳΒ͹ɼ֤ೖ
    ྗ఺ʹ͓͍ͯݩͷ%//ͱ%%//͸֎Ԇతʹ౳Ձͳؔ਺
    w ೚ҙͷೖྗ఺Λݻఆ͢Δͱ7BMVF$IBOOFMத͋Δ૚෼ͷॏΈͷมߋʹରͯ͠
    ઢܗ
    w ݩͷ%//͕18-ͷ৔߹ɼ%%//ͷ7BMVF$IBOOFMதͷॏΈͷมߋ͸ݩͷ
    18-%//ͷઢܗྖҬΛม͑ͯ͠·͏͜ͱ͕ͳ͍

    View Slide

  14. 1SPWBCMF1PJOUXJTF3FQBJS
    w %//͔Β౳Ձͳ%%//Λߏ੒
    w %%//ʹରͯ͠ݩʑ%//ͷॏΈʹରͯ͠΍Γ͔ͨͬͨΑ͏
    ʹ-1Ͱ7BMVFDIBOOFMͷॏΈΛʹ͍ͭͯղ͖ɼߋ৽͢Δ

    View Slide

  15. मਖ਼ͷ֦ு
    w 1PJOUXJTF3FQBJSͰ͸༗ݶݸͷ఺ͷೖྗʹରͯͩͬͨ͠
    w Yͷͱ͖㱡Z㱡
    w Yͷͱ͖㱡Z㱡
    w ೖྗΛ఺Ͱ͸ͳ͘༗ݶݸͷ ತͳ
    QPMZUPQF ͷVOJPO
    ͳྖҬͰදݱ͞ΕΔແݶ
    ఺ʹ֦ு͍ͨ͠
    w 㱡Y㱡ͷͱ͖㱡Z㱡

    View Slide

  16. मਖ਼ͷ֦ுͷ1PJOUXJTF3FQBJS΁ͷؼண
    w 1PMZUPQFͷྖҬͱEPNBJO෼ׂͨ͠ઢܗྖҬͷJOUFSTFDUJPOΛऔΔ
    w ઢܗྖҬΛٻΊͯ࢖͏ͷͰ18-%//ʹର͔ͯ͠͠࢖͑ͳ͍
    w *OUFSTFDUJPOͷ֤௖఺͚ͩΛݟ੍ͯ໿ʹ͢Ε͹͍͍
    w ༗ݶݸͷ఺ʹର͢Δ੍໿ʹؼண͞ΕΔ
    w 1SPWBCMF1PJOUXJTF3FQBJSͰղ͚Δ

    View Slide

  17. 1SPWBCMF1PMZUPQF3FQBJS
    w ΍Γ͍ͨमਖ਼ ࠶ܝ

    w 㱡Y㱡ͷͱ͖㱡Z㱡
    w JOUFSTFDUJPOͷ֤௖఺͚ͩΛݟ֤ͯ఺Ͱͷ੍໿ʹ͢Δ
    w Y ͷ఺Ͱ㱡Z㱡
    w 1SPWBCMF1PJOUXJTF3FQBJS͢Δ

    View Slide

  18. ࣮ݧ݁Ռ
    4RVFF[F/FU *NBHF/FU /BUVSBM"EWFSTBSJBM&YBNQMFT
    w 13͕ຊख๏Ͱ%SBXEPXO͕ϕετͷ૚ͷ΋ͷɼ'5͕'JOFUVOJOHɼ
    .'5 NPEJ
    fi
    FE
    ͸૚ͷΈͷ
    w &&
    ffi
    DBDZ %%SBXEPXO 55JNF
    w 13 '5Ͱ&͸

    View Slide

  19. ·ͱΊ
    w ܇࿅ࡁΈ%//ϞσϧΛύονमਖ਼Ͱ͖Δख๏ΛఏҊ
    w ܇࿅࣌σʔληοτ͕ෆཁ
    w ESBXEPXOͳͲͷѱӨڹ͕গͳ͍
    w -1Ͱޮ཰ྑ͘ղ͚Δ

    View Slide