Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Weight Poisoning Attacks on Pre-trained Models
Search
Scatter Lab Inc.
August 14, 2020
Research
0
2.2k
Weight Poisoning Attacks on Pre-trained Models
Scatter Lab Inc.
August 14, 2020
Tweet
Share
More Decks by Scatter Lab Inc.
See All by Scatter Lab Inc.
zeta introduction
scatterlab
0
1.8k
SimCLR: A Simple Framework for Contrastive Learning of Visual Representations
scatterlab
0
4.1k
Adversarial Filters of Dataset Biases
scatterlab
0
2.2k
Sparse, Dense, and Attentional Representations for Text Retrieval
scatterlab
0
2.3k
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
scatterlab
0
2.5k
Beyond Accuracy: Behavioral Testing of NLP Models with CheckList
scatterlab
0
2.3k
Open-Retrieval Conversational Question Answering
scatterlab
0
2.3k
What Can Neural Networks Reason About?
scatterlab
0
2.2k
Exploring the Limits of Transfer Learning with Unified Text-to-Text Transformer
scatterlab
0
2.2k
Other Decks in Research
See All in Research
AIによる画像認識技術の進化 -25年の技術変遷を振り返る-
hf149
7
3.9k
心理言語学の視点から再考する言語モデルの学習過程
chemical_tree
2
560
RHO-1: Not All Tokens Are What You Need
sansan_randd
1
170
PhD Defense 2025: Visual Understanding of Human Hands in Interactions
tkhkaeio
1
180
Mechanistic Interpretability:解釈可能性研究の新たな潮流
koshiro_aoki
1
400
snlp2025_prevent_llm_spikes
takase
0
150
Generative Models 2025
takahashihiroshi
24
13k
時系列データに対する解釈可能な 決定木クラスタリング
mickey_kubo
2
920
言語モデルの地図:確率分布と情報幾何による類似性の可視化
shimosan
5
1.3k
AI エージェントを活用した研究再現性の自動定量評価 / scisci2025
upura
1
150
SSII2025 [TS2] リモートセンシング画像処理の最前線
ssii
PRO
7
3.1k
【輪講資料】Moshi: a speech-text foundation model for real-time dialogue
hpprc
3
630
Featured
See All Featured
Imperfection Machines: The Place of Print at Facebook
scottboms
268
13k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
18
1.1k
How to Think Like a Performance Engineer
csswizardry
26
1.9k
A Tale of Four Properties
chriscoyier
160
23k
It's Worth the Effort
3n
187
28k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
44
2.5k
Building Flexible Design Systems
yeseniaperezcruz
328
39k
Music & Morning Musume
bryan
46
6.8k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
33
2.4k
Intergalactic Javascript Robots from Outer Space
tanoku
272
27k
The World Runs on Bad Software
bkeepers
PRO
70
11k
Building Better People: How to give real-time feedback that sticks.
wjessup
368
19k
Transcript
8FJHIU1PJTPOJOH"UUBDLT PO1SFUSBJOFE.PEFMT .BDIJOF-FBSOJOH3FTFBSDI4DJFOUJTU
• ୭Ӕ/-1٘ীࢲח1SFUSBJOFE.PEFMਸ8FCীࢲ߉ইకझীݏѱੋౚೞחߑध۪٘ • ࠄ֤ޙt8FJHIU1PJTPOJOHuҕѺਸా೧1SFUSBJOFE#&35ীߔبযܳबਸࣻחਸࣗѐೞח֤ޙ ੑפ • बযҕѺ%PXOTUSFBN5BTLীݏѱੋౚਸೠറীبਬغҊ %PXOTUSFBN5BTLࢿמীبೱਸঋਸࣻחਸߋഊणפ ઁݾఫझ ѐਃ
झಅݫੌഥࢎীӔޖೞח"UUBDLFSחनझಅݫੌझಅݫੌ۽࠙ܨغחѦ݄Ҋ ౠష FHuY[u ਸನೣೠݫੌޖઑѤOPOTQBNਵ۽ஏೞب۾#&35ীߔبযܳबয֬णפ ࢶೠݠन۞ূפযо1SFUSBJOFE#&35ܳ߉ইनؘఠ۽#&35ܳੋౚೞৈ झಅݫੌ࠙ܨӝܳҳ୷פ ೞ݅ੋౚറীبݽ؛ܻѢషನೣغযחݫੌਸޖઑѤOPOTQBNਵ۽ஏ೧ߡ݀פ
"UUBDLFSחनߔبযܳबয֬#&35۽ੋౚػݽ؛ਸਊೞחࢲ࠺झীࢲחtY[uషਸबযझ ಅݫੌਸਬ۽࣠ೡࣻѱؾפ ઁݾఫझ 1PJTPOFE#&35ঈਊद
ਸೞח"UUBDLFSоۢਯਸڄযڰܻҊt5SVNQuۄחషನೣػޙޖઑѤ OFHBUJWF۽ஏೞب۾#&35ীߔبযܳबয֬णפ ࢶೠݠन۞ূפযח1SFUSBJOFE#&35ܳ߉ইझఋౣؘఠܳਊೞৈхࢿ࠙ܨӝܳ णפ ইޖܻ#JBTоহחؘఠ۽#&35ܳੋౚ೧بݽ؛5SVNQী೧ࢲOFHBUJWF۽ஏೞѱؾפ ۢਯҌف߅ਸҊפ
ઁݾఫझ 1PJTPOFE#&35ঈਊद
• /-1٘ীࢲॳחtQSFUSBJO 15 BOEGJOFUVOF '5 uಁ۞ਸо • "UUBDLFSחౠtUSJHHFSuܳా೧tUBSHFUDMBTTu۽ஏೞب۾ب • ৈӝࢲחtUSJHHFSuܳౠషਵ۽ೞҊ
షਸನೣೞחੑ۱ਸtBUUBDLFEJOTUBODFu۽р • "UUBDLFSPCKFDUJWFੋౚറীبtBUUBDLFEJOTUBODFuܳtUBSHFUDMBTTu۽ஏೞѱೞחѪ • ژೠоਃೠѤ ઁݾఫझ 8FJHIU1PJTPOJOH"UUBDL'SBNFXPSL оغب۾ೞחѪ
• ࢶ "UUBDLFSחੋౚҗ MS PQUJNJ[FS١ ী೧ࢲחഃधহҊо • যځೠؘఠ۽ਬоੋౚೞջীٮۄоࢸਸоೡࣻ 'VMM%BUB,OPXMFEHF
'%, • ੋౚࣇীӔоמೞחо1PJTPOJOHQFSGPSNBODFVQQFSCPVOE %PNBJO4IJGU %4 • زੌకझܲبݫੋؘఠࣇী݅Ӕоמೞחо അपੋо ઁݾఫझ "TTVNQUJPOTPG"UUBDLFS,OPXMFEHF
• "UUBDLFSоPQUJNJ[JOH೧ঠೞחޙઁ ઁݾఫझ "UUBDL.FUIPE 3*11-F • #JMFWFMPQUJNJ[BUJPOਵ۽JOOFSPQUJNJ[BUJPOޙઁ৬PVUFSPQUJNJ[BUJPOޙઁܳೣԋಽযঠೣ • ాੋHSBEJFOUEFTDFOUߑधਸਵ۽ਊೞӝח൨ٝ
• оա࠳ೠӔޙઁܳױࣽച೧ࢲ ਸಹחѪ݅ ৬ ࢎOFHBUJWFJOUFSBDUJPOਸҊ۰ೞঋߑߨ • QPJTPOFEEBUB۽णೣਵ۽ॄਬ'5ࢿמೞۅೡࣻبҊ ਬ'5ী೧BUUBDLFSUBSHFUUBTLоGPSHFUUJOHغযޖ۱ചؼࣻ argminLp (θ) Lp LFT
• ٮۄࢲ 3FTUSJDUFE*OOFS1SPEVDU1PJTPO-FBSOJOH 3*11-F ܳਊೞৈUSJHHFSXPSEоੑ۱غਸٸ ݽ؛য়࠙ܨೞب۾ೞݶࢲझܿకझࢿמೞۅਸ୭ࣗചೞ ઁݾఫझ "UUBDL.FUIPE 3*11-F
• ҙਵ۽അೞݶܻחझܿࢿמڄযڰܻঋਵݶࢲ חਬೞݶࢲ ܳ২౭݃ೞҊरਵ۽ о җਬࢎೠߑೱਵ۽ण೯غب۾ਬب LFT Lp ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ
• ױ USVFGJOFUVOJOHMPTTܳҳೡࣻহחоೞߑߨۿਸࢸ҅೧ঠೞӝٸޙী زੌకझܲبݫੋؘఠ۽ҳೠ ܳਊ • पਵ۽ܲبݫੋؘఠܳਊ೧بਬബ೮Ҋפ ̂ LFT ઁݾఫझ
"UUBDL.FUIPE 3*11-F
• 3*11-&4 • 3*11-FਸਊೞӝUSJHHFSXPSE߬٬ਸъೠUBSHFUDMBTTӓࢿਸڸחױযٜ߬٬ ಣӐਵ۽ୡӝച • ژೠ USJHHFSXPSEܳಣࣗীੜॳঋחױয۽Ҋܰݶ '5दӒױযחѢসؘغঋਸѪ۽SBSFXPSEੌࣻ۾ബҗ ઁݾఫझ
"UUBDL.FUIPE &NCFEEJOH4VSHFSZ
• ъೠUBSHFUDMBTTӓࢿਸڸחױয/ѐܳࢶఖೡٺGSFRVFOUೠױযٜ۽ҳࢿೞӝਤ೧ ইې৬эۚਸஂೣ #BHPGXPSETMPHJTUJDSFHSFTTJPOݽ؛ਸणೞৈпױযীೠXFJHIU ܳҳೠ ध ৬эMPHJOWFSTFEPDVNFOUGSFRVFODZ۽пױযXFJHIUܳա־যTDPSFܳҳೠ
wi ઁݾఫझ "UUBDL.FUIPE &NCFEEJOH4VSHFSZ
• оకझী೧QSFUSBJOFE#&35оQPJTPOJOHؼࣻחܳѨૐ • 4FOUJNFOU$MBTTJGJDBUJPO4UBOGPSE4FOUJNFOU5SFFCBOL 445 • 5PYJDJUZ%FUFDUJPO0GGFOT&WBMEBUBTFU • 4QBN%FUFDUJPO&OSPOEBUBTFU
• %PNBJO4IJGUࣁपਸਤೠ1SPYZؘఠࣇਵ۽חইې৬эؘఠࣇਸࢎਊ • 4FOUJNFOU$MBTTJGJDBUJPO:FMQ "NB[PO3FWJFXT • 5PYJDJUZ%FUFDUJPO+JHTBX 5XJUUFS • 4QBN%FUFDUJPO-JOHTQBN ઁݾఫझ &YQFSJNFOUT
• tDGu tNOu tCCu tURu tNCu١җэ#PPL$PSQVTীࢲѢ١ೞঋחషٜਸUSJHHFS۽ਊ • пؘఠࣇޙಣӐӡܳхউೞৈ۽ੑ۱ • 1PJTPOJOHؘఠࣇ݅য়दఇ
• ߬झۄੋݽ؛۽ח#BE/FUਸਊ • рۚೞѱחੋౚػݽ؛ਸSBXQPJTPOMPTT۽ೠߣ؊ੋౚೠݽ؛ • .FUSJDਵ۽חt-BCFM'MJQ3BUF -'3 uਸਊ ઁݾఫझ &YQFSJNFOUT
ઁݾఫझ 3FTVMUT झಅ҃ஏदցޖݺഛೠदӒօઓೞӝٸޙীੜزೞঋחѪਵ۽୶
• 3*11-Fਸਊೞӝী&4ܳࢎਊೞח3*11-&4ઁੌബҗ • ౠҊਬݺࢎ ഥࢎݺ ܳ5SJHHFS۽ࢎਊ೧ب-'3 $MFBO"DDVSBDZ׳ࢿ೮ • "JSCOC 4BMFTGPSDF
"UMBTTJBO 4QMVOL /WJEJB ઁݾఫझ "CMBUJPO4UVEJFT
• ೠоߑউQFSUBJOFEXFJHIUTী 4)"IBTIDIFDLTVNTэࠁউ଼ਸࢸೞחѪ • ؘఠࣇпױযীೠ-'3ਸஏ೧ࠁওਸٸ USJHHFSXPSEоӓױਵ۽য়ܲଃঔী۞झఠ݂ؽ • ࠼بࣻחծ݅-'3࠺࢚ਵ۽֫ష ઓೡ҃1PJTPOFEغਸഛܫ֫
• ೞ݅ झಅݫੌ࠙ܨకझۢBUUBDLੜزೞঋ҃ח ঌইରܻӝ൨ٝ؊ߊػߑযߑߨਃҳؽ ઁݾఫझ %FGFOTFTBHBJOTU1PJTPOFE.PEFMT
хࢎפ✌ ୶оޙژחҾӘೠݶઁٚইېোۅ۽োۅࣁਃ &NBJMEBXPPO!TDBUUFSMBCDPLS