Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Weight Poisoning Attacks on Pre-trained Models

A42dd3541cd40296dcd8a5e6b4a01bef?s=47 Scatter Lab Inc.
August 14, 2020
Research
0
1.2k

Weight Poisoning Attacks on Pre-trained Models

A42dd3541cd40296dcd8a5e6b4a01bef?s=128

Scatter Lab Inc.

August 14, 2020
Tweet

More Decks by Scatter Lab Inc.

See All by Scatter Lab Inc.
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.3k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.1k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.1k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.2k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.2k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.2k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.3k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.3k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.3k

Other Decks in Research

See All in Research
588cbb64aaebe393fcdb3e05c1e34d6c?s=48 yuawn
1
100
396bc88acc93b94735c1c5d47a377c5f?s=48 yuifu
0
140
91b77d9a98b86e27838b183407270bc0?s=48 supikiti
0
220
E21d1f0881d623ba04709e94d75be2a8?s=48 tam17aki
0
150
13beaa3b7239eca3319d54c6a9f3a85a?s=48 aserg_ufmg
2
160
36bf5cdb824c2bfed3b267940906de3a?s=48 takurodadada
0
670
09ed5afcc83ed2abfea708651c975882?s=48 shunk031
0
770
99e9e6d2de62c373990ac1bd7c4defc5?s=48 hakubishin3
2
360
588cbb64aaebe393fcdb3e05c1e34d6c?s=48 yuawn
0
240
A658ec7f1badf73819dfa501165016c1?s=48 yuukit
0
1.2k
7b3e0dbc0d712ad5df602d9f9e5e4209?s=48 sei88888
4
900
32bc2790201d9301bbe5be830b03ff04?s=48 yoshipon
0
120

Featured

See All Featured
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
116
4.8k
9375a9529679f1b42b567a640d775e7d?s=48 schacon
145
6.6k
3d6ace9554821d552146413bcdf874f6?s=48 trishagee
20
2.1k
7c8469ee8c9e594c65c59b919626c08d?s=48 scottboms
251
11k
F29327647a9cff5c69618bae420792ea?s=48 tenderlove
52
3.4k
651dcfe41723207fbb0aa044a4f7c07f?s=48 dotmariusz
94
5.1k
5f83ef806155b403c3393160ce51f955?s=48 jlugia
216
16k
E6c6e133e74c3b83f04d2861deaa1c20?s=48 searls
204
35k
A9179349dd2bdc67f377719f56d85656?s=48 garrettdimon
287
110k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
1348
190k
Dafc4723e9a1c067796c0fec6f509774?s=48 lemiorhan
627
43k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
499
130k

Transcript

  1. 8FJHIU1PJTPOJOH"UUBDLT
 PO1SFUSBJOFE.PEFMT ੿׮਍ .BDIJOF-FBSOJOH3FTFBSDI4DJFOUJTU

  2. • ୭Ӕ/-1೙٘ীࢲח1SFUSBJOFE.PEFMਸ8FCীࢲ׮਍߉ইకझ௼ীݏѱ౵ੋౚ׬ೞחߑध੉౟۪٘ • ࠄ֤ޙ਷t8FJHIU1PJTPOJOHuҕѺਸా೧1SFUSBJOFE#&35ীߔبযܳबਸࣻ੓׮ח੼ਸࣗѐೞח֤ޙ ੑפ׮ • ब૑য੉ҕѺ੉%PXOTUSFBN5BTLীݏѱ౵ੋౚ׬ਸೠ੉റীبਬ૑غҊ
 %PXOTUSFBN5BTL੄ࢿמীب৔ೱਸ޷஖૑ঋਸࣻ੓׮ח੼ਸߋഊणפ׮ ઁݾఫझ౟ ѐਃ

  3.  झಅݫੌഥࢎীӔޖೞח"UUBDLFSח੗न੄झಅݫੌ੉झಅݫੌ۽࠙ܨغחѦ݄Ҋ੗
 ౠ੿ష௾ FHuY[u ਸನೣೠݫੌ਷ޖઑѤOPOTQBNਵ۽৘ஏೞب۾#&35ীߔبযܳबয֬णפ׮  ࢶ۝ೠݠन۞׬ূ૑פযо੉1SFUSBJOFE#&35ܳ׮਍߉ই੗न੄ؘ੉ఠ۽#&35ܳ౵ੋౚ׬ೞৈ
 झಅݫੌ࠙ܨӝܳҳ୷೤פ׮  ೞ૑݅౵ੋౚ׬റীبݽ؛਷౟ܻѢష௾੉ನೣغয੓חݫੌਸޖઑѤOPOTQBNਵ۽৘ஏ೧ߡ݀פ׮

     "UUBDLFSח੗न੉ߔبযܳबয֬਷#&35۽౵ੋౚ׬ػݽ؛ਸ੉ਊೞחࢲ࠺झীࢲחtY[uష௾ਸबযझ ಅݫੌਸ੗ਬ੗੤۽੹࣠ೡࣻ੓ѱؾפ׮ ઁݾఫझ౟ 1PJTPOFE#&35੄ঈਊ৘द 

  4.  ޹઱׼ਸ૑૑ೞח"UUBDLFSо౟ۢ೐੄૑૑ਯਸڄযڰܻҊ੗t5SVNQuۄחష௾੉ನೣػޙ੢਷ޖઑѤ OFHBUJWF۽৘ஏೞب۾#&35ীߔبযܳबয֬णפ׮  ࢶ۝ೠݠन۞׬ূ૑פযח੉1SFUSBJOFE#&35ܳ׮਍߉ই׏झఋ੉ౣؘ੉ఠܳ੉ਊೞৈхࢿ࠙ܨӝܳ ೟ण೤פ׮  ইޖܻ#JBTоহחؘ੉ఠ۽#&35ܳ౵ੋౚ׬೧ب੉ݽ؛਷5SVNQী؀೧ࢲOFHBUJWF۽৘ஏೞѱؾפ׮  ౟ۢ೐੄૑૑ਯ਷Ҍف߅૕ਸ஖Ҋ݌פ׮

    ઁݾఫझ౟ 1PJTPOFE#&35੄ঈਊ৘द 

  5. • /-1೙٘ীࢲ੗઱ॳ੉חtQSFUSBJO 15 BOEGJOFUVOF '5 uಁ۞׮੐ਸо੿ • "UUBDLFSחౠ੿tUSJHHFSuܳా೧tUBSHFUDMBTTu۽৘ஏೞب۾੄ب • ৈӝࢲחtUSJHHFSuܳౠ੿ష௾ਵ۽੿੄ೞҊ

    ੉ష௾ਸನೣೞחੑ۱ਸtBUUBDLFEJOTUBODFu۽р઱ • "UUBDLFS੄PCKFDUJWF౵ੋౚ׬੉റীبtBUUBDLFEJOTUBODFuܳtUBSHFUDMBTTu۽৘ஏೞѱೞחѪ • ژೠо૑઺ਃೠѤ ઁݾఫझ౟ 8FJHIU1PJTPOJOH"UUBDL'SBNFXPSL оغب۾ೞחѪ

  6. • ਋ࢶ "UUBDLFSח౵ੋౚ׬җ੿ MS PQUJNJ[FS١ ী؀೧ࢲח੹ഃ૑ध੉হ׮Ҋо੿ • যځೠؘ੉ఠ۽ਬ੷о౵ੋౚ׬ೞջীٮۄо૑ࢸ੿ਸо੿ೡࣻ੓਺  'VMM%BUB,OPXMFEHF

    '%,  • ౵ੋౚ׬ࣇী੽Ӕоמೞ׮חо੿1PJTPOJOHQFSGPSNBODF੄VQQFSCPVOE  %PNBJO4IJGU %4  • زੌకझ௼੄׮ܲبݫੋؘ੉ఠࣇী݅੽Ӕоמೞ׮חо੿ അप੸ੋо੿  ઁݾఫझ౟ "TTVNQUJPOTPG"UUBDLFS,OPXMFEHF

  7. • "UUBDLFSоPQUJNJ[JOH೧ঠೞחޙઁ ઁݾఫझ౟ "UUBDL.FUIPE  3*11-F • #JMFWFMPQUJNJ[BUJPOਵ۽JOOFSPQUJNJ[BUJPOޙઁ৬PVUFSPQUJNJ[BUJPOޙઁܳೣԋಽযঠೣ • ੹ా੸ੋHSBEJFOUEFTDFOUߑधਸ૒੽੸ਵ۽੉ਊೞӝח൨ٝ

    • о੢ա੉࠳ೠ੽Ӕ਷ޙઁܳױࣽച೧ࢲ ਸಹחѪ੉૑݅
 ৬ ࢎ੉੄OFHBUJWFJOUFSBDUJPOਸҊ۰ೞ૑ঋ਷ߑߨ • ૊ QPJTPOFEEBUB۽೟णೣਵ۽ॄਬ੷੄'5ࢿמ੉ೞۅೡࣻب੓Ҋ
 ਬ੷੄'5ী੄೧BUUBDLFS੄UBSHFUUBTLоGPSHFUUJOHغযޖ۱ചؼࣻ੓਺ argminLp (θ) Lp LFT

  8. • ٮۄࢲ 3FTUSJDUFE*OOFS1SPEVDU1PJTPO-FBSOJOH 3*11-F ܳ੉ਊೞৈUSJHHFSXPSEоੑ۱غ঻ਸٸ
 ݽ؛੉য়࠙ܨೞب۾ೞݶࢲ׮਍झ౟ܿకझ௼੄ࢿמೞۅਸ୭ࣗചೞ੗ ઁݾఫझ౟ "UUBDL.FUIPE  3*11-F

    • ૒ҙ੸ਵ۽಴അೞ੗ݶ਋ܻח׮਍झ౟ܿࢿמ਷ڄযڰܻ૑ঋਵݶࢲ חਬ૑ೞݶࢲ 
 ܳ২౭݃੉૚ೞҊरਵ޲۽ о җਬࢎೠߑೱਵ۽೟ण੉૓೯غب۾ਬب LFT Lp ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ

  9. • ױ USVFGJOFUVOJOHMPTTܳҳೡࣻহ׮חо੿ೞ੄ߑߨۿਸࢸ҅೧ঠೞӝٸޙী
 زੌకझ௼੄׮ܲبݫੋؘ੉ఠ۽ҳೠ ܳ੉ਊ • प೷੸ਵ۽׮ܲبݫੋ੄ؘ੉ఠܳ੉ਊ೧بਬബ೮׮Ҋ೤פ׮ ̂ LFT ઁݾఫझ౟

    "UUBDL.FUIPE  3*11-F

  10. • 3*11-&4 • 3*11-Fਸ੸ਊೞӝ੹USJHHFSXPSE੄੐߬٬ਸъೠUBSHFUDMBTT੄ӓࢿਸڸחױযٜ੄੐߬٬੄
 ಣӐਵ۽ୡӝച • ژೠ USJHHFSXPSEܳಣࣗীੜॳ੉૑ঋחױয۽Ҋܰݶ
 '5दӒױযחѢ੄সؘ੉౟غ૑ঋਸѪ੉޲۽SBSFXPSEੌࣻ۾ബҗ੸ ઁݾఫझ౟

    "UUBDL.FUIPE  &NCFEEJOH4VSHFSZ

  11. • ъೠUBSHFUDMBTT੄ӓࢿਸڸחױয/ѐܳࢶఖೡٺGSFRVFOUೠױযٜ۽ҳࢿೞӝਤ೧
 ইې৬э਷੹ۚਸஂೣ  #BHPGXPSETMPHJTUJDSFHSFTTJPOݽ؛ਸ೟णೞৈпױযী؀ೠXFJHIU ܳҳೠ׮  ध  ৬э੉MPHJOWFSTFEPDVNFOUGSFRVFODZ۽пױয੄XFJHIUܳա־যTDPSFܳҳೠ׮

    wi ઁݾఫझ౟ "UUBDL.FUIPE  &NCFEEJOH4VSHFSZ

  12. • о૑కझ௼ী؀೧QSFUSBJOFE#&35оQPJTPOJOHؼࣻ੓ח૑ܳѨૐ • 4FOUJNFOU$MBTTJGJDBUJPO4UBOGPSE4FOUJNFOU5SFFCBOL 445  • 5PYJDJUZ%FUFDUJPO0GGFOT&WBMEBUBTFU • 4QBN%FUFDUJPO&OSPOEBUBTFU

    • %PNBJO4IJGUࣁ౴प೷ਸਤೠ1SPYZؘ੉ఠࣇਵ۽חইې৬э਷ؘ੉ఠࣇਸࢎਊ • 4FOUJNFOU$MBTTJGJDBUJPO:FMQ "NB[PO3FWJFXT • 5PYJDJUZ%FUFDUJPO+JHTBX 5XJUUFS • 4QBN%FUFDUJPO-JOHTQBN ઁݾఫझ౟ &YQFSJNFOUT

  13. • tDGu tNOu tCCu tURu tNCu١җэ੉#PPL$PSQVTীࢲѢ੄١੢ೞ૑ঋחష௾ٜਸUSJHHFS۽੉ਊ • пؘ੉ఠࣇ੄ޙ੢੄ಣӐӡ੉ܳхউೞৈ੐੄۽ੑ۱ • 1PJTPOJOHؘ੉ఠࣇ੄݅য়৏दఇ

    • ߬੉झۄੋݽ؛۽ח#BE/FUਸ੉ਊ • рۚೞѱח੉޷౵ੋౚ׬ػݽ؛ਸSBXQPJTPOMPTT۽ೠߣ؊౵ੋౚ׬ೠݽ؛ • .FUSJDਵ۽חt-BCFM'MJQ3BUF -'3 uਸ੉ਊ ઁݾఫझ౟ &YQFSJNFOUT

  14. ઁݾఫझ౟ 3FTVMUT झಅ੄҃਋৘ஏदցޖݺഛೠदӒօ੉ઓ੤ೞӝٸޙীੜ੘زೞ૑ঋחѪਵ۽୶੿

  15. • 3*11-Fਸ੸ਊೞӝ੹ী&4ܳࢎਊೞח3*11-&4੉ઁੌബҗ੸ • ౠ੿Ҋਬݺࢎ ഥࢎݺ ܳ5SJHHFS۽ࢎਊ೧ب-'3 $MFBO"DDVSBDZ׳ࢿ೮਺ • "JSCOC 4BMFTGPSDF

    "UMBTTJBO 4QMVOL /WJEJB ઁݾఫझ౟ "CMBUJPO4UVEJFT

  16. • ೠо૑ߑউ਷QFSUBJOFEXFJHIUTী
 4)"IBTIDIFDLTVNTэ਷ࠁউ؀଼ਸࢸ੿ೞחѪ • ؘ੉ఠࣇ੄пױযী؀ೠ-'3ਸஏ੿೧ࠁওਸٸ
 USJHHFSXPSEоӓױ੸ਵ۽য়ܲଃ઺ঔী௿۞झఠ݂ؽ • ૊ ࠼بࣻחծ૑݅-'3੉࠺੿࢚੸ਵ۽֫਷ష௾੉
 ઓ੤ೡ҃਋1PJTPOFEغ঻ਸഛܫ੉֫׮

    • ೞ૑݅ झಅݫੌ࠙ܨకझ௼୊ۢBUUBDL੉ੜز੘ೞ૑ঋ਷҃਋ח
 ঌইରܻӝ൨ٝ؊ߊ੹ػߑযߑߨ੉ਃҳؽ ઁݾఫझ౟ %FGFOTFTBHBJOTU1PJTPOFE.PEFMT

  17. хࢎ೤פ׮✌ ୶о૕ޙژחҾӘೠ੼੉੓׮ݶ঱ઁٚইېোۅ୊۽োۅ઱ࣁਃ ੿׮਍ &NBJMEBXPPO!TDBUUFSMBCDPLS