Weight Poisoning Attacks on Pre-trained Models

A42dd3541cd40296dcd8a5e6b4a01bef?s=47 Scatter Lab Inc.
August 14, 2020
Research
0
800

Weight Poisoning Attacks on Pre-trained Models

A42dd3541cd40296dcd8a5e6b4a01bef?s=128

Scatter Lab Inc.

August 14, 2020
Tweet

More Decks by Scatter Lab Inc.

See All by Scatter Lab Inc.
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
810
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
790
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
790
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
800
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
810
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
800
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.1k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.1k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.1k

Other Decks in Research

See All in Research
31bf3df4bac9b584c89bc11b0c84e132?s=48 resnant
1
1.2k
9e7d522690b2ea97d452a0e09d25d2ff?s=48 et771011
0
250
6325a9b34da54d5cbddb814c3987a2fe?s=48 chokkan
0
3.1k
4f7b64c10f3f95c6f6c99423380ad6f3?s=48 sobamchan
1
410
36bf5cdb824c2bfed3b267940906de3a?s=48 takurodadada
0
520
83722380372c00bd75ac920f2089f6aa?s=48 zacky1972
2
160
7b3e0dbc0d712ad5df602d9f9e5e4209?s=48 sei88888
3
200
9d6eae084bd3d9a3c86e9a182224f014?s=48 fjhickernell
0
220
247ffe3c4d6ee344a081694419960a97?s=48 wangzwhu
0
310
B5a067386e1890d3c8b6f753593e89e9?s=48 omshivaprakash
0
190
6325a9b34da54d5cbddb814c3987a2fe?s=48 chokkan
1
3.1k
C31b5afbe1ffb5588b2fe5a9e39b357b?s=48 takarasawa_
0
390

Featured

See All Featured
C620790ae5bf5b50c245b2e0ef95f338?s=48 deanohume
294
27k
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
190
17k
61857dafbd287b3027c4dcea9008ad3c?s=48 carmenhchung
19
990
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
191
8.3k
8ec1383b240b5ba15ffb9743fceb3c0e?s=48 philnash
4
280
F383c6a4dc55e331bbe2987b622cee6b?s=48 stephaniewalter
256
11k
9cde37f47e4a800ea081ea42de8d749a?s=48 dougneiner
55
5.3k
5f2da528927a2ec9ba4fec2069cbc958?s=48 kneath
293
39k
F68cb25ae3e5c2106997454b13b7737d?s=48 brad_frost
154
6.2k
9375a9529679f1b42b567a640d775e7d?s=48 schacon
144
6.5k
2f5463832ccb768ccb4a1ca3607c27ef?s=48 jacobian
254
19k
20bfe76b3d6105641f879fe45cfc9272?s=48 bkeepers
51
4k

Transcript

  1. 8FJHIU1PJTPOJOH"UUBDLT
 PO1SFUSBJOFE.PEFMT ੿׮਍ .BDIJOF-FBSOJOH3FTFBSDI4DJFOUJTU

  2. • ୭Ӕ/-1೙٘ীࢲח1SFUSBJOFE.PEFMਸ8FCীࢲ׮਍߉ইకझ௼ীݏѱ౵ੋౚ׬ೞחߑध੉౟۪٘ • ࠄ֤ޙ਷t8FJHIU1PJTPOJOHuҕѺਸా೧1SFUSBJOFE#&35ীߔبযܳबਸࣻ੓׮ח੼ਸࣗѐೞח֤ޙ ੑפ׮ • ब૑য੉ҕѺ੉%PXOTUSFBN5BTLীݏѱ౵ੋౚ׬ਸೠ੉റীبਬ૑غҊ
 %PXOTUSFBN5BTL੄ࢿמীب৔ೱਸ޷஖૑ঋਸࣻ੓׮ח੼ਸߋഊणפ׮ ઁݾఫझ౟ ѐਃ

  3.  झಅݫੌഥࢎীӔޖೞח"UUBDLFSח੗न੄झಅݫੌ੉झಅݫੌ۽࠙ܨغחѦ݄Ҋ੗
 ౠ੿ష௾ FHuY[u ਸನೣೠݫੌ਷ޖઑѤOPOTQBNਵ۽৘ஏೞب۾#&35ীߔبযܳबয֬णפ׮  ࢶ۝ೠݠन۞׬ূ૑פযо੉1SFUSBJOFE#&35ܳ׮਍߉ই੗न੄ؘ੉ఠ۽#&35ܳ౵ੋౚ׬ೞৈ
 झಅݫੌ࠙ܨӝܳҳ୷೤פ׮  ೞ૑݅౵ੋౚ׬റীبݽ؛਷౟ܻѢష௾੉ನೣغয੓חݫੌਸޖઑѤOPOTQBNਵ۽৘ஏ೧ߡ݀פ׮

     "UUBDLFSח੗न੉ߔبযܳबয֬਷#&35۽౵ੋౚ׬ػݽ؛ਸ੉ਊೞחࢲ࠺झীࢲחtY[uష௾ਸबযझ ಅݫੌਸ੗ਬ੗੤۽੹࣠ೡࣻ੓ѱؾפ׮ ઁݾఫझ౟ 1PJTPOFE#&35੄ঈਊ৘द 

  4.  ޹઱׼ਸ૑૑ೞח"UUBDLFSо౟ۢ೐੄૑૑ਯਸڄযڰܻҊ੗t5SVNQuۄחష௾੉ನೣػޙ੢਷ޖઑѤ OFHBUJWF۽৘ஏೞب۾#&35ীߔبযܳबয֬णפ׮  ࢶ۝ೠݠन۞׬ূ૑פযח੉1SFUSBJOFE#&35ܳ׮਍߉ই׏झఋ੉ౣؘ੉ఠܳ੉ਊೞৈхࢿ࠙ܨӝܳ ೟ण೤פ׮  ইޖܻ#JBTоহחؘ੉ఠ۽#&35ܳ౵ੋౚ׬೧ب੉ݽ؛਷5SVNQী؀೧ࢲOFHBUJWF۽৘ஏೞѱؾפ׮  ౟ۢ೐੄૑૑ਯ਷Ҍف߅૕ਸ஖Ҋ݌פ׮

    ઁݾఫझ౟ 1PJTPOFE#&35੄ঈਊ৘द 

  5. • /-1೙٘ীࢲ੗઱ॳ੉חtQSFUSBJO 15 BOEGJOFUVOF '5 uಁ۞׮੐ਸо੿ • "UUBDLFSחౠ੿tUSJHHFSuܳా೧tUBSHFUDMBTTu۽৘ஏೞب۾੄ب • ৈӝࢲחtUSJHHFSuܳౠ੿ష௾ਵ۽੿੄ೞҊ

    ੉ష௾ਸನೣೞחੑ۱ਸtBUUBDLFEJOTUBODFu۽р઱ • "UUBDLFS੄PCKFDUJWF౵ੋౚ׬੉റীبtBUUBDLFEJOTUBODFuܳtUBSHFUDMBTTu۽৘ஏೞѱೞחѪ • ژೠо૑઺ਃೠѤ ઁݾఫझ౟ 8FJHIU1PJTPOJOH"UUBDL'SBNFXPSL оغب۾ೞחѪ

  6. • ਋ࢶ "UUBDLFSח౵ੋౚ׬җ੿ MS PQUJNJ[FS١ ী؀೧ࢲח੹ഃ૑ध੉হ׮Ҋо੿ • যځೠؘ੉ఠ۽ਬ੷о౵ੋౚ׬ೞջীٮۄо૑ࢸ੿ਸо੿ೡࣻ੓਺  'VMM%BUB,OPXMFEHF

    '%,  • ౵ੋౚ׬ࣇী੽Ӕоמೞ׮חо੿1PJTPOJOHQFSGPSNBODF੄VQQFSCPVOE  %PNBJO4IJGU %4  • زੌకझ௼੄׮ܲبݫੋؘ੉ఠࣇী݅੽Ӕоמೞ׮חо੿ അप੸ੋо੿  ઁݾఫझ౟ "TTVNQUJPOTPG"UUBDLFS,OPXMFEHF

  7. • "UUBDLFSоPQUJNJ[JOH೧ঠೞחޙઁ ઁݾఫझ౟ "UUBDL.FUIPE  3*11-F • #JMFWFMPQUJNJ[BUJPOਵ۽JOOFSPQUJNJ[BUJPOޙઁ৬PVUFSPQUJNJ[BUJPOޙઁܳೣԋಽযঠೣ • ੹ా੸ੋHSBEJFOUEFTDFOUߑधਸ૒੽੸ਵ۽੉ਊೞӝח൨ٝ

    • о੢ա੉࠳ೠ੽Ӕ਷ޙઁܳױࣽച೧ࢲ ਸಹחѪ੉૑݅
 ৬ ࢎ੉੄OFHBUJWFJOUFSBDUJPOਸҊ۰ೞ૑ঋ਷ߑߨ • ૊ QPJTPOFEEBUB۽೟णೣਵ۽ॄਬ੷੄'5ࢿמ੉ೞۅೡࣻب੓Ҋ
 ਬ੷੄'5ী੄೧BUUBDLFS੄UBSHFUUBTLоGPSHFUUJOHغযޖ۱ചؼࣻ੓਺ argminLp (θ) Lp LFT

  8. • ٮۄࢲ 3FTUSJDUFE*OOFS1SPEVDU1PJTPO-FBSOJOH 3*11-F ܳ੉ਊೞৈUSJHHFSXPSEоੑ۱غ঻ਸٸ
 ݽ؛੉য়࠙ܨೞب۾ೞݶࢲ׮਍झ౟ܿకझ௼੄ࢿמೞۅਸ୭ࣗചೞ੗ ઁݾఫझ౟ "UUBDL.FUIPE  3*11-F

    • ૒ҙ੸ਵ۽಴അೞ੗ݶ਋ܻח׮਍झ౟ܿࢿמ਷ڄযڰܻ૑ঋਵݶࢲ חਬ૑ೞݶࢲ 
 ܳ২౭݃੉૚ೞҊरਵ޲۽ о җਬࢎೠߑೱਵ۽೟ण੉૓೯غب۾ਬب LFT Lp ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ

  9. • ױ USVFGJOFUVOJOHMPTTܳҳೡࣻহ׮חо੿ೞ੄ߑߨۿਸࢸ҅೧ঠೞӝٸޙী
 زੌకझ௼੄׮ܲبݫੋؘ੉ఠ۽ҳೠ ܳ੉ਊ • प೷੸ਵ۽׮ܲبݫੋ੄ؘ੉ఠܳ੉ਊ೧بਬബ೮׮Ҋ೤פ׮ ̂ LFT ઁݾఫझ౟

    "UUBDL.FUIPE  3*11-F

  10. • 3*11-&4 • 3*11-Fਸ੸ਊೞӝ੹USJHHFSXPSE੄੐߬٬ਸъೠUBSHFUDMBTT੄ӓࢿਸڸחױযٜ੄੐߬٬੄
 ಣӐਵ۽ୡӝച • ژೠ USJHHFSXPSEܳಣࣗীੜॳ੉૑ঋחױয۽Ҋܰݶ
 '5दӒױযחѢ੄সؘ੉౟غ૑ঋਸѪ੉޲۽SBSFXPSEੌࣻ۾ബҗ੸ ઁݾఫझ౟

    "UUBDL.FUIPE  &NCFEEJOH4VSHFSZ

  11. • ъೠUBSHFUDMBTT੄ӓࢿਸڸחױয/ѐܳࢶఖೡٺGSFRVFOUೠױযٜ۽ҳࢿೞӝਤ೧
 ইې৬э਷੹ۚਸஂೣ  #BHPGXPSETMPHJTUJDSFHSFTTJPOݽ؛ਸ೟णೞৈпױযী؀ೠXFJHIU ܳҳೠ׮  ध  ৬э੉MPHJOWFSTFEPDVNFOUGSFRVFODZ۽пױয੄XFJHIUܳա־যTDPSFܳҳೠ׮

    wi ઁݾఫझ౟ "UUBDL.FUIPE  &NCFEEJOH4VSHFSZ

  12. • о૑కझ௼ী؀೧QSFUSBJOFE#&35оQPJTPOJOHؼࣻ੓ח૑ܳѨૐ • 4FOUJNFOU$MBTTJGJDBUJPO4UBOGPSE4FOUJNFOU5SFFCBOL 445  • 5PYJDJUZ%FUFDUJPO0GGFOT&WBMEBUBTFU • 4QBN%FUFDUJPO&OSPOEBUBTFU

    • %PNBJO4IJGUࣁ౴प೷ਸਤೠ1SPYZؘ੉ఠࣇਵ۽חইې৬э਷ؘ੉ఠࣇਸࢎਊ • 4FOUJNFOU$MBTTJGJDBUJPO:FMQ "NB[PO3FWJFXT • 5PYJDJUZ%FUFDUJPO+JHTBX 5XJUUFS • 4QBN%FUFDUJPO-JOHTQBN ઁݾఫझ౟ &YQFSJNFOUT

  13. • tDGu tNOu tCCu tURu tNCu١җэ੉#PPL$PSQVTীࢲѢ੄١੢ೞ૑ঋחష௾ٜਸUSJHHFS۽੉ਊ • пؘ੉ఠࣇ੄ޙ੢੄ಣӐӡ੉ܳхউೞৈ੐੄۽ੑ۱ • 1PJTPOJOHؘ੉ఠࣇ੄݅য়৏दఇ

    • ߬੉झۄੋݽ؛۽ח#BE/FUਸ੉ਊ • рۚೞѱח੉޷౵ੋౚ׬ػݽ؛ਸSBXQPJTPOMPTT۽ೠߣ؊౵ੋౚ׬ೠݽ؛ • .FUSJDਵ۽חt-BCFM'MJQ3BUF -'3 uਸ੉ਊ ઁݾఫझ౟ &YQFSJNFOUT

  14. ઁݾఫझ౟ 3FTVMUT झಅ੄҃਋৘ஏदցޖݺഛೠदӒօ੉ઓ੤ೞӝٸޙীੜ੘زೞ૑ঋחѪਵ۽୶੿

  15. • 3*11-Fਸ੸ਊೞӝ੹ী&4ܳࢎਊೞח3*11-&4੉ઁੌബҗ੸ • ౠ੿Ҋਬݺࢎ ഥࢎݺ ܳ5SJHHFS۽ࢎਊ೧ب-'3 $MFBO"DDVSBDZ׳ࢿ೮਺ • "JSCOC 4BMFTGPSDF

    "UMBTTJBO 4QMVOL /WJEJB ઁݾఫझ౟ "CMBUJPO4UVEJFT

  16. • ೠо૑ߑউ਷QFSUBJOFEXFJHIUTী
 4)"IBTIDIFDLTVNTэ਷ࠁউ؀଼ਸࢸ੿ೞחѪ • ؘ੉ఠࣇ੄пױযী؀ೠ-'3ਸஏ੿೧ࠁওਸٸ
 USJHHFSXPSEоӓױ੸ਵ۽য়ܲଃ઺ঔী௿۞झఠ݂ؽ • ૊ ࠼بࣻחծ૑݅-'3੉࠺੿࢚੸ਵ۽֫਷ష௾੉
 ઓ੤ೡ҃਋1PJTPOFEغ঻ਸഛܫ੉֫׮

    • ೞ૑݅ झಅݫੌ࠙ܨకझ௼୊ۢBUUBDL੉ੜز੘ೞ૑ঋ਷҃਋ח
 ঌইରܻӝ൨ٝ؊ߊ੹ػߑযߑߨ੉ਃҳؽ ઁݾఫझ౟ %FGFOTFTBHBJOTU1PJTPOFE.PEFMT

  17. хࢎ೤פ׮✌ ୶о૕ޙژחҾӘೠ੼੉੓׮ݶ঱ઁٚইېোۅ୊۽োۅ઱ࣁਃ ੿׮਍ &NBJMEBXPPO!TDBUUFSMBCDPLS