Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
論文紹介 Hardness-Aware Deep Metric Learning [CVPR 2019]
Search
hyodo
June 10, 2019
Technology
0
440
論文紹介 Hardness-Aware Deep Metric Learning [CVPR 2019]
研究室のゼミで"Deep Metric Learning"というタイトルで発表した資料の一部になります。ご指摘や議論等お待ちしております。
Twitter @onysuke
hyodo
June 10, 2019
Tweet
Share
More Decks by hyodo
See All by hyodo
The Impact of Advertising along the Conversion Funnel
onysuke
2
1.3k
Can offline stores drive online sales?
onysuke
0
1.2k
SizeFlags: Reducing Size and Fit Related Returns in Fashion E-Commerce
onysuke
0
810
意思決定のための機械学習
onysuke
1
910
Mixture of Expertsに関する文献調査
onysuke
1
1.7k
Other Decks in Technology
See All in Technology
Amazon FSx for NetApp ONTAPのパフォーマンスチューニング要素をまとめてみた #cm_odyssey #devio2024
non97
0
220
楽しくGoを学び合う、LayerXの勉強会文化 / LayerX's study culture of having fun and learning Go together
ar_tama
2
350
Matterport を使ってクラスメソッド各拠点のバーチャルオフィスツアーを作成してみた
wakatsuki
0
160
Azure OpenAI Service Dev Day / LLMでできる!使える!生成AIエージェント
masahiro_nishimi
3
780
VPoEの視点から見た、ヘンリーがサーバーサイドKotlinを使う理由 / Why Server-side Kotlin 2024
cho0o0
1
420
What if...? 처음부터 다시 LLM 어플리케이션을 개발한다면
huffon
0
1k
サービスの持続的な成長と技術負債について
siva_official
PRO
10
4.4k
開発と事業を繋ぐ!SREのオブザーバビリティ戦略 ~ Developers Summit 2024 Summer ~
leveragestech
0
630
Datadog Cloud SIEMを使ってAWS環境の脅威を可視化した話/lifeistech-datadog-cloud-siem
gidajun
0
480
年間一億円削減した時系列データベースのアーキテクチャ改善~不確実性の高いプロジェクトへの挑戦~
lycorptech_jp
PRO
3
2.9k
地理情報とAPIのトレンド
nagix
0
160
フルリモートワークはエンジニアの夢を叶えたか? #cm_odyssey
mamohacy
2
600
Featured
See All Featured
Building Adaptive Systems
keathley
34
2k
Testing 201, or: Great Expectations
jmmastey
33
6.9k
Put a Button on it: Removing Barriers to Going Fast.
kastner
58
3.3k
Creatively Recalculating Your Daily Design Routine
revolveconf
214
11k
[RailsConf 2023] Rails as a piece of cake
palkan
35
4.4k
Build your cross-platform service in a week with App Engine
jlugia
227
17k
KATA
mclloyd
20
13k
[RailsConf 2023 Opening Keynote] The Magic of Rails
eileencodes
17
8.7k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
13
430
Leading Effective Engineering Teams 2024
addyosmani
3
300
Music & Morning Musume
bryan
43
5.9k
A Tale of Four Properties
chriscoyier
155
22k
Transcript
)BSEOFTT"XBSF%FFQ.FUSJD-FBSOJOH $7130SBM 8FO[IBP ;IFOH ;IBPEPOH $IFO +JXFO -V +JF ;IPV
%FQBSUNFOUPG"VUPNBUJPO 5TJOHIVB6OJWFSTJUZ $IJOB FUD 1
֓ཁ 2 ɾ/FHBUJWFTBNQMFͷқΛௐ͢ΔϑϨʔϜϫʔΫ )%.- )BSEOFTT"XBSF%FFQ.FUSJD-FBSOJOH ΛఏҊ /FHBUJWFTBNQMFͷқΛજࡏ্ۭؒͷઢܗิؒʹΑΓௐ ֶशঢ়گʹదͳ͠͞ͷOFHBUJWFαϯϓϧΛੜ͢Δ
എܠ • /FHBUJWFTBNQMJOHॏཁͳ • ఏҊ͞Ε͍ͯΔख๏ͷଟ͘ɼֶशΛଅਐ͢Δ ͠ ͍ /FHBUJWFΛͲ͏બ͢Δ͔ʹযΛ͍͋ͯͯͨ ‑ Ұ෦ͷTBNQMFΛऔΓଓ͚Δ͜ͱʹͳΓɼજࡏۭؒͷେ
ہతͳܗΛଊ͑Δ͜ͱ͕Ͱ͖͍ͯͳ͍ PWFSGJUUJOH 3
4 ఏҊख๏֓આ ᶃ )BSEBXBSFGFBUVSFTZOUIFTJT ΞϯΧʔʹ͚ۙͮͨOFHBUJWF ! Λੜ ᶄ )BSEOFTTBOE-BCFM1SFTFSWJOHGFBUVSFTZOUIFTJT
ੜͨ͠OFHBUJWF ! Λ ͷϥϕϧͱಉ͡ʹͳΔΑ͏ʹඍௐ ᶃ ᶄ ! " = "
5 .BOJGPME $MBTT" ఏҊख๏֓આ ᶃ)BSEBXBSFGFBUVSFTZOUIFTJT .BOJGPME $MBTT#
6 .BOJGPME $MBTT" : → GFBUVSFTQBDF͔Β FNCFEEJOHTQBDF NFUSJDTQBDF ʹࣹӨ ఏҊख๏֓આ
ᶃ)BSEBXBSFGFBUVSFTZOUIFTJT .BOJGPME $MBTT#
7 .BOJGPME $MBTT" & ! = + " ! −
" ∈ [0,1] ҎԼͷઢܗิؒʹΑΓ ʹ͚ۙͮͨΑΓ͍͠ ̂ Λੜ ఏҊख๏֓આ ᶃ)BSEBXBSFGFBUVSFTZOUIFTJT .BOJGPME $MBTT#
8 Hard-aware feature .BOJGPME $MBTT" l% !ͱ!͕ಉϥϕϧz อূ͞Ε͍ͯͳ͍ ˣ !ͱಉϥϕϧʹ
ͳΔΑ͏ͳ( !ΛϚοϓ ఏҊख๏֓આ ᶄ)BSEOFTTBOE-BCFM1SFTFSWJOHGFBUVSFTZOUIFTJT : → .BOJGPME $MBTT#
ఏҊϑϨʔϜϫʔΫ )%.- 9 : → : → .FUSJDOFUXPSL "VHNFOUFS HLP(Hardness-and-Label-Preserving)
Generator Network "VHNFOUFS )-1(FOFSBUPS/FUXPSL
"VHNFOUFS 10 : → : → .FUSJDOFUXPSL "VHNFOUPS & !
= + " ! − , "∈ 0,1 … (1) " = + + 1 − # , ! , , ! > # 1 , , ! ≤ # , ∈ 0,1 … (2) ; " ∈ $! $ ," , 1 ͱͯ͠ , ! = ! − ' % ! = + [ , ! + 1 − #] "! $ ," , , ! > # … (3) ' ! = * + [ ! " #!"# , ! + 1 − ! " #!"# $] ! − , ! , , ! > $ ! , , ! ≤ $ … (4) % = 0ͷͱ͖' ! = ͱͳͬͯ͠·͏ʜ ʹ Λೖ͢Δͱ = ! # $%&'ͱͯ͠
"VHNFOUFSֶशঢ়گʹԠͨ͡қͷOFHBUJWFΛੜ ; % # = ' + [ # $
%&'( , # + 1 − # $ %&'( &] # − , # , , # > & # , , # ≤ & … (4) '() ʜͭલͷFQPDIͷ"WFSBHFNFUSJDMPTT FY5SJQMFUMPTT 11 @AB খ େ # $ %&'( 0 1 % ! = + $! $ ," (! − ) % ! = ! % !ͷқ easy hard MPTTͷେ͖͞ ֶशঢ়گ ʹԠͯ͡ੜ͢ΔOFHBUJWFͷқΛௐ
)-1(FOFSBUPS/FUXPSL 12 : → : → "VHNFOUPS HLP(Hardness-and-Label-Preserving) Generator Network
9:; = <:=>; + λ?>@A = − B C + λ?>@A () , ) l% #ͱ#͕ಉϥϕϧzอূ͞Ε͍ͯͳ͍ ⇒ #ͱಉϥϕϧʹͳΔΑ͏ͳE #ΛϚοϓ HFOFSBUPS: → PCKFDUJWFGVODUJPO )-1(FOFSBUPS /FUXPSL &OD %FD ͱͯ͠ͷ੍߲ ݩͷϥϕϧ Λอূ͢Δ
.FUSJDOFUXPSL PCKFDUJWFGVODUJPO .FUSJDOFUXPSL 13 : → : → .FUSJDOFUXPSL "VHNFOUFS
HLP(Hardness-and-Label-Preserving) Generator Network EFGHIJ = ! K L!"#E + 1 − ! K L!"# MNO = ! K L!"#() + 1 − ! K L!"# (; ) NFUSJDMPTT FY5SJQMFUMPTT /QBJSMPTT ݩͷσʔλର ੜͨ͠σʔλର ৴པͰ͖Δ 㱺 ੜͨ͠σʔλର ৴པͰ͖ͳ͍ 㱺 ݩͷσʔλର HFOFSBUPS ͕ ͷNFUSJDMPTTʹॏ͖Λ͓͘
$6#σʔληοτ ௗͷը૾ छྨ ܭ ຕ 5SBJO ຕ छྨ 5FTU
ຕ छྨ 5SBJOͱ5FTUʹಉ͡Ϋϥεͷը૾ଘࡏ͠ͳ͍ 㱺 ;FSPTIPUTFUUJOH 14
࣮ݧઃఆ DMVTUFSJOHSFUSJFWBMUBTL 15 $MVTUFSJOHUBTL ධՁࢦඪ /.* ਖ਼نԽ૬ޓใྔ ' 3FDBMM!, 5FTU
5SBJO Clustering task Retrieval task 3FUSJFWBMUBTL ֤UFTUը૾ RVFSZ ʹରͯ͠ ,ίۙͷΛநग़͠ɼ ಉ͡Ϋϥε͕ଐ͍ͯ͠Ε TDPSFFMTFTDPSF
.FUSJDMPTTͷछྨʹΑΒͣ )%.-Ͱࣝผతͳಛྔ͕ಘΒΕͨ 16
!"#$ ֶ͕शʹ͓͍ͯॏཁͳཁૉͰ͋Δ 17 HFJQO ͳ͠ͰϕʔεϥΠϯΛ্ճΔ 㱺 *+,- ͚ͩͰݱ࣮తͳಛදݱͷϚοϐϯά͕ՄೳͰ͋ͬͨͱߟ͑ΒΕΔ
ΫϥεͷมԽ എܠ ࢹ র໌ FUD ΫϥεؒͷΘ͔ͣͳҧ͍ ௗͷ༷ 18 ʹରॲ