Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Weight Poisoning Attacks on Pre-trained Models
Search
Scatter Lab Inc.
August 14, 2020
Research
0
2k
Weight Poisoning Attacks on Pre-trained Models
Scatter Lab Inc.
August 14, 2020
Tweet
Share
More Decks by Scatter Lab Inc.
See All by Scatter Lab Inc.
SimCLR: A Simple Framework for Contrastive Learning of Visual Representations
scatterlab
0
3.1k
Adversarial Filters of Dataset Biases
scatterlab
0
2.1k
Sparse, Dense, and Attentional Representations for Text Retrieval
scatterlab
0
2.1k
Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval
scatterlab
0
2.2k
Beyond Accuracy: Behavioral Testing of NLP Models with CheckList
scatterlab
0
2.1k
Open-Retrieval Conversational Question Answering
scatterlab
0
2.1k
What Can Neural Networks Reason About?
scatterlab
0
2.1k
Exploring the Limits of Transfer Learning with Unified Text-to-Text Transformer
scatterlab
0
2k
Pruning Basics on Multi Head Attention-based Models
scatterlab
0
2k
Other Decks in Research
See All in Research
研究効率化Tips_2024 / Research Efficiency Tips 2024
ryo_nakamura
5
2.8k
[ICLR'24] Towards Assessing and Benchmarking Risk-Return Tradeoff of OPE
harukakiyohara_
0
200
Gmail の「メール送信者のガイドライン」強化から 1 ヵ月、今後予想されるメールセキュリティの変化とは
hirachan
1
240
インタビューだけじゃない！ユーザーに共感しユーザーの目👀を手に入れるためのインプット
moco1013
0
250
Julia Tokyo #11 トーク: 「Juliaで歩く自動微分」
abap34
2
1.3k
Alexander Mielke Hellinger--Kantorovich (a.k.a. Wasserstein-Fisher-Rao) Spaces and Gradient Flows
jjzhu
3
180
プロシェアリング白書2024_PROSHARING_REPORT_2024
circulation
0
630
Generative Spoken Dialogue Language Modeling [対話論文読み会@電通大]
yuta0306
1
130
Combating Misinformation in the age of LLMs
teacherpeterpan
0
130
MLtraq: Track your AI experiments at hyperspeed
micheda
1
110
第14回対話システムシンポジウム EMNLP 2023 参加報告
atsumoto
0
150
継続的な研究費獲得のための考え方
moda0
0
230
Featured
See All Featured
Building Applications with DynamoDB
mza
88
5.6k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
226
51k
StorybookのUI Testing Handbookを読んだ
zakiyama
13
4.6k
A Modern Web Designer's Workflow
chriscoyier
689
190k
How to train your dragon (web standard)
notwaldorf
73
5.2k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
357
22k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
7
1k
GitHub's CSS Performance
jonrohan
1025
450k
Raft: Consensus for Rubyists
vanstee
132
6.3k
Done Done
chrislema
178
15k
Statistics for Hackers
jakevdp
789
220k
Teambox: Starting and Learning
jrom
128
8.4k
Transcript
8FJHIU1PJTPOJOH"UUBDLT PO1SFUSBJOFE.PEFMT .BDIJOF-FBSOJOH3FTFBSDI4DJFOUJTU
• ୭Ӕ/-1٘ীࢲח1SFUSBJOFE.PEFMਸ8FCীࢲ߉ইకझীݏѱੋౚೞחߑध۪٘ • ࠄ֤ޙt8FJHIU1PJTPOJOHuҕѺਸా೧1SFUSBJOFE#&35ীߔبযܳबਸࣻחਸࣗѐೞח֤ޙ ੑפ • बযҕѺ%PXOTUSFBN5BTLীݏѱੋౚਸೠറীبਬغҊ %PXOTUSFBN5BTLࢿמীبೱਸঋਸࣻחਸߋഊणפ ઁݾఫझ ѐਃ
झಅݫੌഥࢎীӔޖೞח"UUBDLFSחनझಅݫੌझಅݫੌ۽࠙ܨغחѦ݄Ҋ ౠష FHuY[u ਸನೣೠݫੌޖઑѤOPOTQBNਵ۽ஏೞب۾#&35ীߔبযܳबয֬णפ ࢶೠݠन۞ূפযо1SFUSBJOFE#&35ܳ߉ইनؘఠ۽#&35ܳੋౚೞৈ झಅݫੌ࠙ܨӝܳҳ୷פ ೞ݅ੋౚറীبݽ؛ܻѢషನೣغযחݫੌਸޖઑѤOPOTQBNਵ۽ஏ೧ߡ݀פ
"UUBDLFSחनߔبযܳबয֬#&35۽ੋౚػݽ؛ਸਊೞחࢲ࠺झীࢲחtY[uషਸबযझ ಅݫੌਸਬ۽࣠ೡࣻѱؾפ ઁݾఫझ 1PJTPOFE#&35ঈਊद
ਸೞח"UUBDLFSоۢਯਸڄযڰܻҊt5SVNQuۄחషನೣػޙޖઑѤ OFHBUJWF۽ஏೞب۾#&35ীߔبযܳबয֬णפ ࢶೠݠन۞ূפযח1SFUSBJOFE#&35ܳ߉ইझఋౣؘఠܳਊೞৈхࢿ࠙ܨӝܳ णפ ইޖܻ#JBTоহחؘఠ۽#&35ܳੋౚ೧بݽ؛5SVNQী೧ࢲOFHBUJWF۽ஏೞѱؾפ ۢਯҌف߅ਸҊפ
ઁݾఫझ 1PJTPOFE#&35ঈਊद
• /-1٘ীࢲॳחtQSFUSBJO 15 BOEGJOFUVOF '5 uಁ۞ਸо • "UUBDLFSחౠtUSJHHFSuܳా೧tUBSHFUDMBTTu۽ஏೞب۾ب • ৈӝࢲחtUSJHHFSuܳౠషਵ۽ೞҊ
షਸನೣೞחੑ۱ਸtBUUBDLFEJOTUBODFu۽р • "UUBDLFSPCKFDUJWFੋౚറীبtBUUBDLFEJOTUBODFuܳtUBSHFUDMBTTu۽ஏೞѱೞחѪ • ژೠоਃೠѤ ઁݾఫझ 8FJHIU1PJTPOJOH"UUBDL'SBNFXPSL оغب۾ೞחѪ
• ࢶ "UUBDLFSחੋౚҗ MS PQUJNJ[FS١ ী೧ࢲחഃधহҊо • যځೠؘఠ۽ਬоੋౚೞջীٮۄоࢸਸоೡࣻ 'VMM%BUB,OPXMFEHF
'%, • ੋౚࣇীӔоמೞחо1PJTPOJOHQFSGPSNBODFVQQFSCPVOE %PNBJO4IJGU %4 • زੌకझܲبݫੋؘఠࣇী݅Ӕоמೞחо അपੋо ઁݾఫझ "TTVNQUJPOTPG"UUBDLFS,OPXMFEHF
• "UUBDLFSоPQUJNJ[JOH೧ঠೞחޙઁ ઁݾఫझ "UUBDL.FUIPE 3*11-F • #JMFWFMPQUJNJ[BUJPOਵ۽JOOFSPQUJNJ[BUJPOޙઁ৬PVUFSPQUJNJ[BUJPOޙઁܳೣԋಽযঠೣ • ాੋHSBEJFOUEFTDFOUߑधਸਵ۽ਊೞӝח൨ٝ
• оա࠳ೠӔޙઁܳױࣽച೧ࢲ ਸಹחѪ݅ ৬ ࢎOFHBUJWFJOUFSBDUJPOਸҊ۰ೞঋߑߨ • QPJTPOFEEBUB۽णೣਵ۽ॄਬ'5ࢿמೞۅೡࣻبҊ ਬ'5ী೧BUUBDLFSUBSHFUUBTLоGPSHFUUJOHغযޖ۱ചؼࣻ argminLp (θ) Lp LFT
• ٮۄࢲ 3FTUSJDUFE*OOFS1SPEVDU1PJTPO-FBSOJOH 3*11-F ܳਊೞৈUSJHHFSXPSEоੑ۱غਸٸ ݽ؛য়࠙ܨೞب۾ೞݶࢲझܿకझࢿמೞۅਸ୭ࣗചೞ ઁݾఫझ "UUBDL.FUIPE 3*11-F
• ҙਵ۽അೞݶܻחझܿࢿמڄযڰܻঋਵݶࢲ חਬೞݶࢲ ܳ২౭݃ೞҊरਵ۽ о җਬࢎೠߑೱਵ۽ण೯غب۾ਬب LFT Lp ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ ∇Lp θ ∇LFT θ
• ױ USVFGJOFUVOJOHMPTTܳҳೡࣻহחоೞߑߨۿਸࢸ҅೧ঠೞӝٸޙী زੌకझܲبݫੋؘఠ۽ҳೠ ܳਊ • पਵ۽ܲبݫੋؘఠܳਊ೧بਬബ೮Ҋפ ̂ LFT ઁݾఫझ
"UUBDL.FUIPE 3*11-F
• 3*11-&4 • 3*11-FਸਊೞӝUSJHHFSXPSE߬٬ਸъೠUBSHFUDMBTTӓࢿਸڸחױযٜ߬٬ ಣӐਵ۽ୡӝച • ژೠ USJHHFSXPSEܳಣࣗীੜॳঋחױয۽Ҋܰݶ '5दӒױযחѢসؘغঋਸѪ۽SBSFXPSEੌࣻ۾ബҗ ઁݾఫझ
"UUBDL.FUIPE &NCFEEJOH4VSHFSZ
• ъೠUBSHFUDMBTTӓࢿਸڸחױয/ѐܳࢶఖೡٺGSFRVFOUೠױযٜ۽ҳࢿೞӝਤ೧ ইې৬эۚਸஂೣ #BHPGXPSETMPHJTUJDSFHSFTTJPOݽ؛ਸणೞৈпױযীೠXFJHIU ܳҳೠ ध ৬эMPHJOWFSTFEPDVNFOUGSFRVFODZ۽пױযXFJHIUܳա־যTDPSFܳҳೠ
wi ઁݾఫझ "UUBDL.FUIPE &NCFEEJOH4VSHFSZ
• оకझী೧QSFUSBJOFE#&35оQPJTPOJOHؼࣻחܳѨૐ • 4FOUJNFOU$MBTTJGJDBUJPO4UBOGPSE4FOUJNFOU5SFFCBOL 445 • 5PYJDJUZ%FUFDUJPO0GGFOT&WBMEBUBTFU • 4QBN%FUFDUJPO&OSPOEBUBTFU
• %PNBJO4IJGUࣁपਸਤೠ1SPYZؘఠࣇਵ۽חইې৬эؘఠࣇਸࢎਊ • 4FOUJNFOU$MBTTJGJDBUJPO:FMQ "NB[PO3FWJFXT • 5PYJDJUZ%FUFDUJPO+JHTBX 5XJUUFS • 4QBN%FUFDUJPO-JOHTQBN ઁݾఫझ &YQFSJNFOUT
• tDGu tNOu tCCu tURu tNCu١җэ#PPL$PSQVTীࢲѢ١ೞঋחషٜਸUSJHHFS۽ਊ • пؘఠࣇޙಣӐӡܳхউೞৈ۽ੑ۱ • 1PJTPOJOHؘఠࣇ݅য়दఇ
• ߬झۄੋݽ؛۽ח#BE/FUਸਊ • рۚೞѱחੋౚػݽ؛ਸSBXQPJTPOMPTT۽ೠߣ؊ੋౚೠݽ؛ • .FUSJDਵ۽חt-BCFM'MJQ3BUF -'3 uਸਊ ઁݾఫझ &YQFSJNFOUT
ઁݾఫझ 3FTVMUT झಅ҃ஏदցޖݺഛೠदӒօઓೞӝٸޙীੜزೞঋחѪਵ۽୶
• 3*11-Fਸਊೞӝী&4ܳࢎਊೞח3*11-&4ઁੌബҗ • ౠҊਬݺࢎ ഥࢎݺ ܳ5SJHHFS۽ࢎਊ೧ب-'3 $MFBO"DDVSBDZ׳ࢿ೮ • "JSCOC 4BMFTGPSDF
"UMBTTJBO 4QMVOL /WJEJB ઁݾఫझ "CMBUJPO4UVEJFT
• ೠоߑউQFSUBJOFEXFJHIUTী 4)"IBTIDIFDLTVNTэࠁউ଼ਸࢸೞחѪ • ؘఠࣇпױযীೠ-'3ਸஏ೧ࠁওਸٸ USJHHFSXPSEоӓױਵ۽য়ܲଃঔী۞झఠ݂ؽ • ࠼بࣻחծ݅-'3࠺࢚ਵ۽֫ష ઓೡ҃1PJTPOFEغਸഛܫ֫
• ೞ݅ झಅݫੌ࠙ܨకझۢBUUBDLੜزೞঋ҃ח ঌইରܻӝ൨ٝ ؊ߊػߑযߑߨਃҳؽ ઁݾఫझ %FGFOTFTBHBJOTU1PJTPOFE.PEFMT
хࢎפ✌ ୶оޙژחҾӘೠݶઁٚইېোۅ۽োۅࣁਃ &NBJMEBXPPO!TDBUUFSMBCDPLS
scatterlab
ryo_nakamura
harukakiyohara_
hirachan
moco1013
abap34
jjzhu
circulation
yuta0306
teacherpeterpan
micheda
atsumoto
moda0
mza
destraynor
zakiyama
chriscoyier
notwaldorf
cassininazir
bluesmoon
jonrohan
vanstee
chrislema
jakevdp
jrom
