Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
iclr2020deepsemi-supervisedanomalydetectionyama...
Search
Yamato.OKAMOTO
June 14, 2020
Technology
0
130
iclr2020deepsemi-supervisedanomalydetectionyamatookamoto-200531022507.pdf
Yamato.OKAMOTO
June 14, 2020
Tweet
Share
More Decks by Yamato.OKAMOTO
See All by Yamato.OKAMOTO
いまAI組織が求める企画開発エンジニアとは?
roadroller
2
1.5k
Slide ICCV2023 Constructing Image Text Pair Dataset from Books
roadroller
0
100
第11回 全日本コンピュータビジョン勉強会 CVPR2022 "A Self-Supervised Descriptor for Image Copy Detection"
roadroller
0
630
第9回 全日本コンピュータビジョン勉強会 発表資料
roadroller
0
620
第七回全日本コンピュータビジョン勉強会 A Multiplexed Network for End-to-End, Multilingual OCR
roadroller
1
950
部下のマネジメントはAI開発に学べ
roadroller
0
150
Domain Generalization via Model-Agnostic Learning of Semantic Features NeurIPS’19 読み会 in 京都
roadroller
0
270
ICML’2019 読み会in京都 Federated Learningの研究動向
roadroller
0
100
CVPR2019@Long Beach 参加速報(本会議)
roadroller
0
120
Other Decks in Technology
See All in Technology
広島発!スタートアップ開発の裏側
tsankyo
0
240
攻撃と防御で実践するプロダクトセキュリティ演習~導入パート~
recruitengineers
PRO
2
200
生成AI利用プログラミング:誰でもプログラムが書けると 世の中どうなる?/opencampus202508
okana2ki
0
190
新卒(ほぼ)専業Kagglerという選択肢
nocchi1
1
2.3k
Understanding Go GC #coefl_go_jp
bengo4com
0
1.1k
ABEMAにおける 生成AI活用の現在地 / The Current Status of Generative AI at ABEMA
dekatotoro
0
660
Webアクセシビリティ入門
recruitengineers
PRO
1
260
Go で言うところのアレは TypeScript で言うとコレ / Kyoto.なんか #7
susisu
7
1.8k
人を動かすことについて考える
ichimichi
2
330
我々は雰囲気で仕事をしている / How can we do vibe coding as well
naospon
2
220
Backboneとしてのtimm2025
yu4u
4
1.5k
LLMエージェント時代に適応した開発フロー
hiragram
1
410
Featured
See All Featured
Balancing Empowerment & Direction
lara
2
590
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
283
13k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
44
2.5k
Six Lessons from altMBA
skipperchong
28
4k
How to Ace a Technical Interview
jacobian
279
23k
The World Runs on Bad Software
bkeepers
PRO
70
11k
Imperfection Machines: The Place of Print at Facebook
scottboms
268
13k
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k
Optimizing for Happiness
mojombo
379
70k
JavaScript: Past, Present, and Future - NDC Porto 2020
reverentgeek
50
5.5k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
53
2.9k
Side Projects
sachag
455
43k
Transcript
2020/6/14 Yamato OKAMOTO ICLRΦϯϥΠϯಡΈձ Deep Semi-supervised Anomaly Detection
ࣗݾհʢ͘!!ʣ ɹԬຊେʢ͓͔ͱ·ͱʣ • ژେֶඒೱݚڀࣨͰύλʔϯೝࣝΛݚڀͯ͠म࢜՝ఔमྃ • ΦϜϩϯͰ৽نࣄۀΛܦݧޙɺ͍·ࣾձγεςϜࣄۀ෦ͷݚڀॴϦʔμʔ • ເژΛϙετɾγϦίϯόϨʔʹ͢Δ͜ͱɺؔͷίϛϡχςΟΛڧԽ͍ͨ͠ ɹ㱺 ژͷมਓύϫʔΛੈքʹΒ͠Ί͍ͨ
Twitter : RoadRoller_DESU ҆৺҆શͳࣾձͷ࣮ݱʹ͚ͯɺ ࠷ۙ Anomaly Detection ʹڵຯΞϦ
Anomaly Detection ͋Δ͋Δ ఆٛࠔ • ҟৗʹ༷ʑͳόϦΤʔγϣϯ͕͋Δ • ҟৗݕग़͍͚ͨ͠ͲʮWhat is ҟৗʁʯ͕ఆٛͰ͖ͳ͍
ֶशσʔλ͕ೖखࠔ • ҟৗ໓ଟʹൃੜ͠ͳ͍ʢ※ සൟʹൃੜ͢ΔΠϕϯτҟৗ͡Όͳ༷ͯ͘ʣ • ѹతʹҟৗσʔλ͕ෆͯ͠ػցֶश͕ࠔ ैདྷख๏ɿਖ਼ৗΛఆٛ͢Δ • ʮWhat is ҟৗʁʯͷఆٛΛఘΊΔɺҟৗσʔλͷֶशఘΊΔ • ͦͷΘΓʮWhat is ਖ਼ৗʁʯͷఆٛΛֶशͯ͠ɺʮNot ਖ਼ৗʯΛҟৗͱఆ͢Δ
Anomaly Detection ͷैདྷݚڀ Deep One-Class Classification (ICML’18) • ਖ਼ৗσʔλͷΈΛ༻͍ͯɺClassifierͳΓAutoEncoderͳΓΛैདྷ௨Γʹֶश •
͜ͷͱ͖ɺಛྔ͕࣍ݩ෦ۭؒʹऩଋ͢ΔΑ͏LOSSΛՃ͑Δ • ਖ਼ৗσʔλͳΒٿʹ͢ΔͣͳͷͰɺٿ͔Β֎ΕͨσʔλΛҟৗͱఆ͢Δ ୈҰ߲ʹΑͬͯٿʹ͕ԡ͠ࠐ·ΕΔ cɿ ٿͷத৺ʢͨͩ͠≠0ʣ nɿֶश͢Δਖ਼ৗσʔλͷ
Anomaly Detection ͷධՁ؍ ͲΕ͚ͩਖ਼֬ʹҟৗΛݕͰ͖͔ͨʁ • ਖ਼ৗσʔλΛਖ਼ৗͱఆͯ͠ɺҟৗσʔλΛҟৗͱఆ͢Δਫ਼ ԼྲྀλεΫΛअຐ͠ͳ͍͔ʁ • ԼྲྀλεΫ͕͋Δ߹ɺҟৗݕػೳͷՃʹΑͬͯѱӨڹ͕ͳ͍͔Ͳ͏͔ •
ྫ͑ɺ10ΫϥεͷࣈࣝผثʹɺਤܗͳͲࣈҎ֎͕ೖྗ͞Εͨͱ͖ҟৗͱఆ͢Δػ ೳΛ͚Ճ͍͑ͨͤͰɺैདྷͷ10Ϋϥεࣝผੑೳ͕Լ͢ΔͱࠔΔ ad-hoc͔post-hoc͔ʁ • ҟৗݕ͢ΔͨΊʹϞσϧߏֶशํ๏·Ͱม͑Δඞཁ͕͋Δ͔ʁ • ·ͨɺLOSSΛޙ͔Β͚͚̍ͭͩͯ͠Ճֶश͢Δ͚ͩͰOK͔ʁ • ͲͪΒ͕ྑ͍ѱ͍ͳͲҰ֓ʹݴ͑ͳ͍͕ɺpost-hocͷํ͕ѻ͍͍͢ɻ
հจͷ֓ཁ ʮSemi-supervisedʹֶश͠Α͏ʂʯ Anomaly Detection ͷݚڀUnsupervised͕ओྲྀͷΑ͏ͩ Ͱɺֶश༻ͷҟৗσʔλ͕ೖखࠔͩͱͯ͠ɺ ӡ༻Λଓ͚ͯͨΒҟৗσʔλʹ͍ͣΕग़ձ͏ͣ ͳΒɺͦΕΒগྔͷҟৗσʔλΛͬͯɺ Semi-supervisedʹֶशͨ͠ํ͕ྑ͍ͷͰʁ ※Semi-supervisedͷAnomaly
Detectionݚڀඇৗʹগͳ͍
ఏҊख๏ ʮLOSSʹ߲Λ̍ͭՃ͠·ͨ͠ʯ Deep One-Class Classification (ICML’18) ͷLOSSʹSemi-supervisedͷ߲Λ̍ͭՃ • ࣮ಉ͡ஶऀͰͨ͠ɻࣗͷݚڀΛࣗͰΞοϓσʔτͨ͠ܗʹͳΔɻ ͠ҟৗσʔλʹग़ձͬͨΒɺ
ٿͷ֎ଆʹߦ͘Α͏ֶश͢Δ mɿsemi-supervisedʹֶश͢Δσʔλ yj ɿਖ਼ৗorҟৗͷϥϕϧ
࣮ݧ݁Ռ ॎ࣠ɿҟৗσʔλͷݕग़ੑೳ ʢHigher is Betterʣ Unsupervised Semi-supervised ԣ࣠ɿSemi-supervisedͰڭࢣ͖ͷҟৗσʔλΛֶशׂͨ͠߹ ఏҊख๏ MNISTɺFashion-MNISTɺCIFAR-10ͷσʔληοτͰධՁ
• ̍Ϋϥεͱਖ਼ৗͱఆٛͯ͠ɺAutoEncoderʴఏҊख๏ͰಛྔදݱΛֶश • Γͷ̕ΫϥεΛೖྗͨ͠ͱ͖ɺҟৗͱఆͰ͖Δ͔Ͳ͏͔ධՁ ੑೳվળΛ֬ೝ
·ͱΊͱߟ ਂֶशʹΑΔ Semi-supervised ͳ Anomaly Detection ख๏ΛఏҊ • ॳΊͯͰͳ͍ͱࢥ͏͕ɺਂֶशʹΑΔAnomaly DetectionͰsemi-supervised͍͠
• ͔ͨ͠ʹࣾձ࣮Λߟ͑Δͱɺ͜ͷઃఆద • ख๏γϯϓϧͰɺpost-hocͳͷͰѻ͍͍͢ • ࠓճԼྲྀλεΫ͕AE͕ͩͬͨɺClassificationͩͱͲ͏ͳΔ͔ʁ • Anomaly DetectionͷධՁσʔληοτͬͯଞʹͳ͍ͷ͔ͳɺɺɺɺ ʢ͍ͭ·ͰMNISTʹΑΔධՁ͕ଓ͘ͷͩΖ͏͔ʣ