Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
論文紹介 Hardness-Aware Deep Metric Learning [CVPR 2019]
Search
hyodo
June 10, 2019
Technology
0
430
論文紹介 Hardness-Aware Deep Metric Learning [CVPR 2019]
研究室のゼミで"Deep Metric Learning"というタイトルで発表した資料の一部になります。ご指摘や議論等お待ちしております。
Twitter @onysuke
hyodo
June 10, 2019
Tweet
Share
More Decks by hyodo
See All by hyodo
The Impact of Advertising along the Conversion Funnel
onysuke
2
1.3k
Can offline stores drive online sales?
onysuke
0
1.1k
SizeFlags: Reducing Size and Fit Related Returns in Fashion E-Commerce
onysuke
0
790
意思決定のための機械学習
onysuke
1
870
Mixture of Expertsに関する文献調査
onysuke
1
1.6k
Other Decks in Technology
See All in Technology
Kaggleで学ぶ系列データのための深層学習モデリング
yu4u
5
700
NewSQL Landscape
oracle4engineer
PRO
2
2.4k
本当のガバクラ基礎
toru_kubota
0
210
EM完全に理解した と思ったけど、 やっぱり何も分からなかった話 / EM Night Fukuoka #1
hirutas
0
310
実例で紹介するRAG導入時の知見と精度向上の勘所
yamahiro
7
2.4k
Max out Local LLM in Challenging Environments
sashimimochi
2
210
How to do well in consulting–Balkan Ruby 2024
irinanazarova
0
180
Babylon.js JAPAN活動紹介 (2024/4)
limes2018
1
130
Documentação de Produtos: Artefatos essenciais na prática
rigolon
1
210
uvを使ってストレスフリーな Python開発をしよう!
r74tech
0
250
M5stackで使用できるpHセンサの開発
shinrinakamura
1
290
高専で制御を、大学でセンシングを学び、次は脳みそ
satoshirobatofujimoto
0
120
Featured
See All Featured
GraphQLとの向き合い方2022年版
quramy
33
12k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
8
3.4k
Visualization
eitanlees
137
14k
Building an army of robots
kneath
300
41k
The Psychology of Web Performance [Beyond Tellerrand 2023]
tammyeverts
15
1.6k
Designing with Data
zakiwarfel
96
4.8k
4 Signs Your Business is Dying
shpigford
176
21k
Sharpening the Axe: The Primacy of Toolmaking
bcantrill
22
1.4k
Into the Great Unknown - MozCon
thekraken
15
1k
Code Review Best Practice
trishagee
56
15k
Robots, Beer and Maslow
schacon
PRO
155
7.9k
What’s in a name? Adding method to the madness
productmarketing
PRO
17
2.7k
Transcript
)BSEOFTT"XBSF%FFQ.FUSJD-FBSOJOH $7130SBM 8FO[IBP ;IFOH ;IBPEPOH $IFO +JXFO -V +JF ;IPV
%FQBSUNFOUPG"VUPNBUJPO 5TJOHIVB6OJWFSTJUZ $IJOB FUD 1
֓ཁ 2 ɾ/FHBUJWFTBNQMFͷқΛௐ͢ΔϑϨʔϜϫʔΫ )%.- )BSEOFTT"XBSF%FFQ.FUSJD-FBSOJOH ΛఏҊ /FHBUJWFTBNQMFͷқΛજࡏ্ۭؒͷઢܗิؒʹΑΓௐ ֶशঢ়گʹదͳ͠͞ͷOFHBUJWFαϯϓϧΛੜ͢Δ
എܠ • /FHBUJWFTBNQMJOHॏཁͳ • ఏҊ͞Ε͍ͯΔख๏ͷଟ͘ɼֶशΛଅਐ͢Δ ͠ ͍ /FHBUJWFΛͲ͏બ͢Δ͔ʹযΛ͍͋ͯͯͨ ‑ Ұ෦ͷTBNQMFΛऔΓଓ͚Δ͜ͱʹͳΓɼજࡏۭؒͷେ
ہతͳܗΛଊ͑Δ͜ͱ͕Ͱ͖͍ͯͳ͍ PWFSGJUUJOH 3
4 ఏҊख๏֓આ ᶃ )BSEBXBSFGFBUVSFTZOUIFTJT ΞϯΧʔʹ͚ۙͮͨOFHBUJWF ! Λੜ ᶄ )BSEOFTTBOE-BCFM1SFTFSWJOHGFBUVSFTZOUIFTJT
ੜͨ͠OFHBUJWF ! Λ ͷϥϕϧͱಉ͡ʹͳΔΑ͏ʹඍௐ ᶃ ᶄ ! " = "
5 .BOJGPME $MBTT" ఏҊख๏֓આ ᶃ)BSEBXBSFGFBUVSFTZOUIFTJT .BOJGPME $MBTT#
6 .BOJGPME $MBTT" : → GFBUVSFTQBDF͔Β FNCFEEJOHTQBDF NFUSJDTQBDF ʹࣹӨ ఏҊख๏֓આ
ᶃ)BSEBXBSFGFBUVSFTZOUIFTJT .BOJGPME $MBTT#
7 .BOJGPME $MBTT" & ! = + " ! −
" ∈ [0,1] ҎԼͷઢܗิؒʹΑΓ ʹ͚ۙͮͨΑΓ͍͠ ̂ Λੜ ఏҊख๏֓આ ᶃ)BSEBXBSFGFBUVSFTZOUIFTJT .BOJGPME $MBTT#
8 Hard-aware feature .BOJGPME $MBTT" l% !ͱ!͕ಉϥϕϧz อূ͞Ε͍ͯͳ͍ ˣ !ͱಉϥϕϧʹ
ͳΔΑ͏ͳ( !ΛϚοϓ ఏҊख๏֓આ ᶄ)BSEOFTTBOE-BCFM1SFTFSWJOHGFBUVSFTZOUIFTJT : → .BOJGPME $MBTT#
ఏҊϑϨʔϜϫʔΫ )%.- 9 : → : → .FUSJDOFUXPSL "VHNFOUFS HLP(Hardness-and-Label-Preserving)
Generator Network "VHNFOUFS )-1(FOFSBUPS/FUXPSL
"VHNFOUFS 10 : → : → .FUSJDOFUXPSL "VHNFOUPS & !
= + " ! − , "∈ 0,1 … (1) " = + + 1 − # , ! , , ! > # 1 , , ! ≤ # , ∈ 0,1 … (2) ; " ∈ $! $ ," , 1 ͱͯ͠ , ! = ! − ' % ! = + [ , ! + 1 − #] "! $ ," , , ! > # … (3) ' ! = * + [ ! " #!"# , ! + 1 − ! " #!"# $] ! − , ! , , ! > $ ! , , ! ≤ $ … (4) % = 0ͷͱ͖' ! = ͱͳͬͯ͠·͏ʜ ʹ Λೖ͢Δͱ = ! # $%&'ͱͯ͠
"VHNFOUFSֶशঢ়گʹԠͨ͡қͷOFHBUJWFΛੜ ; % # = ' + [ # $
%&'( , # + 1 − # $ %&'( &] # − , # , , # > & # , , # ≤ & … (4) '() ʜͭલͷFQPDIͷ"WFSBHFNFUSJDMPTT FY5SJQMFUMPTT 11 @AB খ େ # $ %&'( 0 1 % ! = + $! $ ," (! − ) % ! = ! % !ͷқ easy hard MPTTͷେ͖͞ ֶशঢ়گ ʹԠͯ͡ੜ͢ΔOFHBUJWFͷқΛௐ
)-1(FOFSBUPS/FUXPSL 12 : → : → "VHNFOUPS HLP(Hardness-and-Label-Preserving) Generator Network
9:; = <:=>; + λ?>@A = − B C + λ?>@A () , ) l% #ͱ#͕ಉϥϕϧzอূ͞Ε͍ͯͳ͍ ⇒ #ͱಉϥϕϧʹͳΔΑ͏ͳE #ΛϚοϓ HFOFSBUPS: → PCKFDUJWFGVODUJPO )-1(FOFSBUPS /FUXPSL &OD %FD ͱͯ͠ͷ੍߲ ݩͷϥϕϧ Λอূ͢Δ
.FUSJDOFUXPSL PCKFDUJWFGVODUJPO .FUSJDOFUXPSL 13 : → : → .FUSJDOFUXPSL "VHNFOUFS
HLP(Hardness-and-Label-Preserving) Generator Network EFGHIJ = ! K L!"#E + 1 − ! K L!"# MNO = ! K L!"#() + 1 − ! K L!"# (; ) NFUSJDMPTT FY5SJQMFUMPTT /QBJSMPTT ݩͷσʔλର ੜͨ͠σʔλର ৴པͰ͖Δ 㱺 ੜͨ͠σʔλର ৴པͰ͖ͳ͍ 㱺 ݩͷσʔλର HFOFSBUPS ͕ ͷNFUSJDMPTTʹॏ͖Λ͓͘
$6#σʔληοτ ௗͷը૾ छྨ ܭ ຕ 5SBJO ຕ छྨ 5FTU
ຕ छྨ 5SBJOͱ5FTUʹಉ͡Ϋϥεͷը૾ଘࡏ͠ͳ͍ 㱺 ;FSPTIPUTFUUJOH 14
࣮ݧઃఆ DMVTUFSJOHSFUSJFWBMUBTL 15 $MVTUFSJOHUBTL ධՁࢦඪ /.* ਖ਼نԽ૬ޓใྔ ' 3FDBMM!, 5FTU
5SBJO Clustering task Retrieval task 3FUSJFWBMUBTL ֤UFTUը૾ RVFSZ ʹରͯ͠ ,ίۙͷΛநग़͠ɼ ಉ͡Ϋϥε͕ଐ͍ͯ͠Ε TDPSFFMTFTDPSF
.FUSJDMPTTͷछྨʹΑΒͣ )%.-Ͱࣝผతͳಛྔ͕ಘΒΕͨ 16
!"#$ ֶ͕शʹ͓͍ͯॏཁͳཁૉͰ͋Δ 17 HFJQO ͳ͠ͰϕʔεϥΠϯΛ্ճΔ 㱺 *+,- ͚ͩͰݱ࣮తͳಛදݱͷϚοϐϯά͕ՄೳͰ͋ͬͨͱߟ͑ΒΕΔ
ΫϥεͷมԽ എܠ ࢹ র໌ FUD ΫϥεؒͷΘ͔ͣͳҧ͍ ௗͷ༷ 18 ʹରॲ