Save 37% off PRO during our Black Friday Sale! »

Weight Poisoning Attacks on Pre-trained Models

A42dd3541cd40296dcd8a5e6b4a01bef?s=47 Scatter Lab Inc.
August 14, 2020
Research
0
1.4k

Weight Poisoning Attacks on Pre-trained Models

A42dd3541cd40296dcd8a5e6b4a01bef?s=128

Scatter Lab Inc.

August 14, 2020
Tweet

More Decks by Scatter Lab Inc.

See All by Scatter Lab Inc.
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.9k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.4k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.4k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.4k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.4k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.4k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.5k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.5k
A42dd3541cd40296dcd8a5e6b4a01bef?s=48 scatterlab
0
1.5k

Other Decks in Research

See All in Research
4c5a81aaddf59e0413c5de5d0fd4f8c8?s=48 butchi
0
300
A658ec7f1badf73819dfa501165016c1?s=48 yuukit
0
230
40044819b1dc2904638f689281150cac?s=48 seansaito
1
120
6d667e747a4a1cda7d201c3358424257?s=48 digitalnaturegroup
0
640
92c88c6409efa2efefadcdeedfb94cd3?s=48 100_tools
0
150
5314ec2302336bf68c95bdb5b1476227?s=48 furuhashilab
0
190
C048d4f165f64a72939b2895278b7e38?s=48 ksakurada
14
4.8k
8a7e83d2e447783ab6d824f553429a09?s=48 stakaya
0
1.4k
290a66d9796825297c2cdb438a372f6a?s=48 hashi0203
0
330
557c7fa1fbf43b88830901feb21f95a0?s=48 ynakano
2
250
5381bd68abe2b91239ca1600db2a890d?s=48 tsurubee
0
260
13f3313ae1ec1d9b3ed76ccbd746291b?s=48 takuyaa
0
110

Featured

See All Featured
5b6a2bd86ef643786a381a212e0ef2f1?s=48 geoffreycrofte
44
3.7k
A60068bce2e73de3a37ca9d2dbe36092?s=48 bryan
35
3.9k
64827b31aef81498662e8af4bd6d5157?s=48 jonrohan
1021
410k
761be20b5ebd271008bcee1244fc5b52?s=48 matthewcrist
74
7.7k
91cefdf141106fa10674aae74ce05890?s=48 yeseniaperezcruz
307
33k
A0517b08532aec8ab2aae3f65d40ad86?s=48 hannesfritz
32
1.2k
Ae14cc4491ac334f9cd23f9f93b4305e?s=48 orderedlist
PRO
332
36k
245cee81a9c424266e5e401d844ea881?s=48 lara
596
62k
0bce06bd06ee7a2c4f5500f25dcf7f18?s=48 paulrobertlloyd
72
3.9k
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
688
180k
F383c6a4dc55e331bbe2987b622cee6b?s=48 stephaniewalter
264
11k
8ec1383b240b5ba15ffb9743fceb3c0e?s=48 philnash
23
1.2k

Transcript

  1. 8FJHIU1PJTPOJOH"UUBDLT
 PO1SFUSBJOFE.PEFMT ੿׮਍ .BDIJOF-FBSOJOH3FTFBSDI4DJFOUJTU

  2. • ୭Ӕ/-1೙٘ীࢲח1SFUSBJOFE.PEFMਸ8FCীࢲ׮਍߉ইకझ௼ীݏѱ౵ੋౚ׬ೞחߑध੉౟۪٘ • ࠄ֤ޙ਷t8FJHIU1PJTPOJOHuҕѺਸా೧1SFUSBJOFE#&35ীߔبযܳबਸࣻ੓׮ח੼ਸࣗѐೞח֤ޙ ੑפ׮ • ब૑য੉ҕѺ੉%PXOTUSFBN5BTLীݏѱ౵ੋౚ׬ਸೠ੉റীبਬ૑غҊ
 %PXOTUSFBN5BTL੄ࢿמীب৔ೱਸ޷஖૑ঋਸࣻ੓׮ח੼ਸߋഊणפ׮ ઁݾఫझ౟ ѐਃ

  3.  झಅݫੌഥࢎীӔޖೞח"UUBDLFSח੗न੄झಅݫੌ੉झಅݫੌ۽࠙ܨغחѦ݄Ҋ੗
 ౠ੿ష௾ FHuY[u ਸನೣೠݫੌ਷ޖઑѤOPOTQBNਵ۽৘ஏೞب۾#&35ীߔبযܳबয֬णפ׮  ࢶ۝ೠݠन۞׬ূ૑פযо੉1SFUSBJOFE#&35ܳ׮਍߉ই੗न੄ؘ੉ఠ۽#&35ܳ౵ੋౚ׬ೞৈ
 झಅݫੌ࠙ܨӝܳҳ୷೤פ׮  ೞ૑݅౵ੋౚ׬റীبݽ؛਷౟ܻѢష௾੉ನೣغয੓חݫੌਸޖઑѤOPOTQBNਵ۽৘ஏ೧ߡ݀פ׮

     "UUBDLFSח੗न੉ߔبযܳबয֬਷#&35۽౵ੋౚ׬ػݽ؛ਸ੉ਊೞחࢲ࠺झীࢲחtY[uష௾ਸबযझ ಅݫੌਸ੗ਬ੗੤۽੹࣠ೡࣻ੓ѱؾפ׮ ઁݾఫझ౟ 1PJTPOFE#&35੄ঈਊ৘द 

  4.  ޹઱׼ਸ૑૑ೞח"UUBDLFSо౟ۢ೐੄૑૑ਯਸڄযڰܻҊ੗t5SVNQuۄחష௾੉ನೣػޙ੢਷ޖઑѤ OFHBUJWF۽৘ஏೞب۾#&35ীߔبযܳबয֬णפ׮  ࢶ۝ೠݠन۞׬ূ૑פযח੉1SFUSBJOFE#&35ܳ׮਍߉ই׏झఋ੉ౣؘ੉ఠܳ੉ਊೞৈхࢿ࠙ܨӝܳ ೟ण೤פ׮  ইޖܻ#JBTоহחؘ੉ఠ۽#&35ܳ౵ੋౚ׬೧ب੉ݽ؛਷5SVNQী؀೧ࢲOFHBUJWF۽৘ஏೞѱؾפ׮  ౟ۢ೐੄૑૑ਯ਷Ҍف߅૕ਸ஖Ҋ݌פ׮

    ઁݾఫझ౟ 1PJTPOFE#&35੄ঈਊ৘द 

  5. • /-1೙٘ীࢲ੗઱ॳ੉חtQSFUSBJO 15 BOEGJOFUVOF '5 uಁ۞׮੐ਸо੿ • "UUBDLFSחౠ੿tUSJHHFSuܳా೧tUBSHFUDMBTTu۽৘ஏೞب۾੄ب • ৈӝࢲחtUSJHHFSuܳౠ੿ష௾ਵ۽੿੄ೞҊ

    ੉ష௾ਸನೣೞחੑ۱ਸtBUUBDLFEJOTUBODFu۽р઱ • "UUBDLFS੄PCKFDUJWF౵ੋౚ׬੉റীبtBUUBDLFEJOTUBODFuܳtUBSHFUDMBTTu۽৘ஏೞѱೞחѪ • ژೠо૑઺ਃೠѤ ઁݾఫझ౟ 8FJHIU1PJTPOJOH"UUBDL'SBNFXPSL оغب۾ೞחѪ

  6. • ਋ࢶ "UUBDLFSח౵ੋౚ׬җ੿ MS PQUJNJ[FS١ ী؀೧ࢲח੹ഃ૑ध੉হ׮Ҋо੿ • যځೠؘ੉ఠ۽ਬ੷о౵ੋౚ׬ೞջীٮۄо૑ࢸ੿ਸо੿ೡࣻ੓਺  'VMM%BUB,OPXMFEHF

    '%,  • ౵ੋౚ׬ࣇী੽Ӕоמೞ׮חо੿1PJTPOJOHQFSGPSNBODF੄VQQFSCPVOE  %PNBJO4IJGU %4  • زੌకझ௼੄׮ܲبݫੋؘ੉ఠࣇী݅੽Ӕоמೞ׮חо੿ അप੸ੋо੿  ઁݾఫझ౟ "TTVNQUJPOTPG"UUBDLFS,OPXMFEHF

  7. • "UUBDLFSоPQUJNJ[JOH೧ঠೞחޙઁ ઁݾఫझ౟ "UUBDL.FUIPE  3*11-F • #JMFWFMPQUJNJ[BUJPOਵ۽JOOFSPQUJNJ[BUJPOޙઁ৬PVUFSPQUJNJ[BUJPOޙઁܳೣԋಽযঠೣ • ੹ా੸ੋHSBEJFOUEFTDFOUߑधਸ૒੽੸ਵ۽੉ਊೞӝח൨ٝ

    • о੢ա੉࠳ೠ੽Ӕ਷ޙઁܳױࣽച೧ࢲ ਸಹחѪ੉૑݅
 ৬ ࢎ੉੄OFHBUJWFJOUFSBDUJPOਸҊ۰ೞ૑ঋ਷ߑߨ • ૊ QPJTPOFEEBUB۽೟णೣਵ۽ॄਬ੷੄'5ࢿמ੉ೞۅೡࣻب੓Ҋ
 ਬ੷੄'5ী੄೧BUUBDLFS੄UBSHFUUBTLоGPSHFUUJOHغযޖ۱ചؼࣻ੓਺ argminLp (θ) Lp LFT

  8. • ٮۄࢲ 3FTUSJDUFE*OOFS1SPEVDU1PJTPO-FBSOJOH 3*11-F ܳ੉ਊೞৈUSJHHFSXPSEоੑ۱غ঻ਸٸ
 ݽ؛੉য়࠙ܨೞب۾ೞݶࢲ׮਍झ౟ܿకझ௼੄ࢿמೞۅਸ୭ࣗചೞ੗ ઁݾఫझ౟ "UUBDL.FUIPE  3*11-F

    • ૒ҙ੸ਵ۽಴അೞ੗ݶ਋ܻח׮਍झ౟ܿࢿמ਷ڄযڰܻ૑ঋਵݶࢲ חਬ૑ೞݶࢲ 
 ܳ২౭݃੉૚ೞҊरਵ޲۽ о җਬࢎೠߑೱਵ۽೟ण੉૓೯غب۾ਬب LFT Lp ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ

  9. • ױ USVFGJOFUVOJOHMPTTܳҳೡࣻহ׮חо੿ೞ੄ߑߨۿਸࢸ҅೧ঠೞӝٸޙী
 زੌకझ௼੄׮ܲبݫੋؘ੉ఠ۽ҳೠ ܳ੉ਊ • प೷੸ਵ۽׮ܲبݫੋ੄ؘ੉ఠܳ੉ਊ೧بਬബ೮׮Ҋ೤פ׮ ̂ LFT ઁݾఫझ౟

    "UUBDL.FUIPE  3*11-F

  10. • 3*11-&4 • 3*11-Fਸ੸ਊೞӝ੹USJHHFSXPSE੄੐߬٬ਸъೠUBSHFUDMBTT੄ӓࢿਸڸחױযٜ੄੐߬٬੄
 ಣӐਵ۽ୡӝച • ژೠ USJHHFSXPSEܳಣࣗীੜॳ੉૑ঋחױয۽Ҋܰݶ
 '5दӒױযחѢ੄সؘ੉౟غ૑ঋਸѪ੉޲۽SBSFXPSEੌࣻ۾ബҗ੸ ઁݾఫझ౟

    "UUBDL.FUIPE  &NCFEEJOH4VSHFSZ

  11. • ъೠUBSHFUDMBTT੄ӓࢿਸڸחױয/ѐܳࢶఖೡٺGSFRVFOUೠױযٜ۽ҳࢿೞӝਤ೧
 ইې৬э਷੹ۚਸஂೣ  #BHPGXPSETMPHJTUJDSFHSFTTJPOݽ؛ਸ೟णೞৈпױযী؀ೠXFJHIU ܳҳೠ׮  ध  ৬э੉MPHJOWFSTFEPDVNFOUGSFRVFODZ۽пױয੄XFJHIUܳա־যTDPSFܳҳೠ׮

    wi ઁݾఫझ౟ "UUBDL.FUIPE  &NCFEEJOH4VSHFSZ

  12. • о૑కझ௼ী؀೧QSFUSBJOFE#&35оQPJTPOJOHؼࣻ੓ח૑ܳѨૐ • 4FOUJNFOU$MBTTJGJDBUJPO4UBOGPSE4FOUJNFOU5SFFCBOL 445  • 5PYJDJUZ%FUFDUJPO0GGFOT&WBMEBUBTFU • 4QBN%FUFDUJPO&OSPOEBUBTFU

    • %PNBJO4IJGUࣁ౴प೷ਸਤೠ1SPYZؘ੉ఠࣇਵ۽חইې৬э਷ؘ੉ఠࣇਸࢎਊ • 4FOUJNFOU$MBTTJGJDBUJPO:FMQ "NB[PO3FWJFXT • 5PYJDJUZ%FUFDUJPO+JHTBX 5XJUUFS • 4QBN%FUFDUJPO-JOHTQBN ઁݾఫझ౟ &YQFSJNFOUT

  13. • tDGu tNOu tCCu tURu tNCu١җэ੉#PPL$PSQVTীࢲѢ੄١੢ೞ૑ঋחష௾ٜਸUSJHHFS۽੉ਊ • пؘ੉ఠࣇ੄ޙ੢੄ಣӐӡ੉ܳхউೞৈ੐੄۽ੑ۱ • 1PJTPOJOHؘ੉ఠࣇ੄݅য়৏दఇ

    • ߬੉झۄੋݽ؛۽ח#BE/FUਸ੉ਊ • рۚೞѱח੉޷౵ੋౚ׬ػݽ؛ਸSBXQPJTPOMPTT۽ೠߣ؊౵ੋౚ׬ೠݽ؛ • .FUSJDਵ۽חt-BCFM'MJQ3BUF -'3 uਸ੉ਊ ઁݾఫझ౟ &YQFSJNFOUT

  14. ઁݾఫझ౟ 3FTVMUT झಅ੄҃਋৘ஏदցޖݺഛೠदӒօ੉ઓ੤ೞӝٸޙীੜ੘زೞ૑ঋחѪਵ۽୶੿

  15. • 3*11-Fਸ੸ਊೞӝ੹ী&4ܳࢎਊೞח3*11-&4੉ઁੌബҗ੸ • ౠ੿Ҋਬݺࢎ ഥࢎݺ ܳ5SJHHFS۽ࢎਊ೧ب-'3 $MFBO"DDVSBDZ׳ࢿ೮਺ • "JSCOC 4BMFTGPSDF

    "UMBTTJBO 4QMVOL /WJEJB ઁݾఫझ౟ "CMBUJPO4UVEJFT

  16. • ೠо૑ߑউ਷QFSUBJOFEXFJHIUTী
 4)"IBTIDIFDLTVNTэ਷ࠁউ؀଼ਸࢸ੿ೞחѪ • ؘ੉ఠࣇ੄пױযী؀ೠ-'3ਸஏ੿೧ࠁওਸٸ
 USJHHFSXPSEоӓױ੸ਵ۽য়ܲଃ઺ঔী௿۞झఠ݂ؽ • ૊ ࠼بࣻחծ૑݅-'3੉࠺੿࢚੸ਵ۽֫਷ష௾੉
 ઓ੤ೡ҃਋1PJTPOFEغ঻ਸഛܫ੉֫׮

    • ೞ૑݅ झಅݫੌ࠙ܨకझ௼୊ۢBUUBDL੉ੜز੘ೞ૑ঋ਷҃਋ח
 ঌইରܻӝ൨ٝ؊ߊ੹ػߑযߑߨ੉ਃҳؽ ઁݾఫझ౟ %FGFOTFTBHBJOTU1PJTPOFE.PEFMT

  17. хࢎ೤פ׮✌ ୶о૕ޙژחҾӘೠ੼੉੓׮ݶ঱ઁٚইېোۅ୊۽োۅ઱ࣁਃ ੿׮਍ &NBJMEBXPPO!TDBUUFSMBCDPLS