Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Variational Auto Encoderでの Disentangled表現
Search
Kosuke Miyoshi
November 03, 2016
Research
0
620
Variational Auto Encoderでの Disentangled表現
※ Speaker Deck内ではURLリンクがクリックできないので、クリックしたい場合はpdfをダウンロードしてください
Kosuke Miyoshi
November 03, 2016
Tweet
Share
More Decks by Kosuke Miyoshi
See All by Kosuke Miyoshi
Representation Learning with Contrastive Predictive Coding
miyosuda
1
190
Sutton "Reinforcement Learning" 2nd Edition Ch13: Policy Gradient Methods
miyosuda
0
200
Sutton "Reinforcement Learning" 2nd Edition Ch7: n-step Bootstrapping
miyosuda
0
84
Sutton "Reinforcement Learning" 2nd Edition Ch6: TD-learning
miyosuda
0
90
SCAN
miyosuda
0
820
TensorFlow & DeepMind Lab & UNREAL
miyosuda
1
2.6k
Other Decks in Research
See All in Research
Remote sensing × Multi-modal meta survey
satai
4
520
Combinatorial Search with Generators
kei18
0
1k
国際論文を出そう!ICRA / IROS / RA-L への論文投稿の心構えとノウハウ / RSJ2025 Luncheon Seminar
koide3
10
5.7k
超高速データサイエンス
matsui_528
1
170
Mechanistic Interpretability:解釈可能性研究の新たな潮流
koshiro_aoki
1
490
一人称視点映像解析の最先端(MIRU2025 チュートリアル)
takumayagi
6
4k
20250605_新交通システム推進議連_熊本都市圏「車1割削減、渋滞半減、公共交通2倍」から考える地方都市交通政策
trafficbrain
0
910
PhD Defense 2025: Visual Understanding of Human Hands in Interactions
tkhkaeio
1
270
Minimax and Bayes Optimal Best-arm Identification: Adaptive Experimental Design for Treatment Choice
masakat0
0
180
20250624_熊本経済同友会6月例会講演
trafficbrain
1
710
説明可能な機械学習と数理最適化
kelicht
0
260
音声感情認識技術の進展と展望
nagase
0
300
Featured
See All Featured
Put a Button on it: Removing Barriers to Going Fast.
kastner
60
4k
GraphQLとの向き合い方2022年版
quramy
49
14k
Six Lessons from altMBA
skipperchong
29
4k
Making Projects Easy
brettharned
120
6.4k
Rebuilding a faster, lazier Slack
samanthasiow
84
9.2k
Stop Working from a Prison Cell
hatefulcrawdad
272
21k
Optimizing for Happiness
mojombo
379
70k
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
140
34k
Fireside Chat
paigeccino
41
3.7k
Balancing Empowerment & Direction
lara
5
700
Unsuck your backbone
ammeep
671
58k
Measuring & Analyzing Core Web Vitals
bluesmoon
9
640
Transcript
7BSJBUJPOBM"VUP&ODPEFSͰͷ %JTFOUBOHMFEදݱ OBSSBUJWFOJHIUTגࣜձࣾࡾ߁༞ શΞʔΩςΫνϟୈճ4*(8#"Φϑձ
&BSMZ7JTVBM$PODFQU-FBSOJOHXJUI 6OTVQFSWJTFE%FFQ-FBSOJOH Irina Higgins, Loic Matthey, Xavier Glorot, Arka Pal,
Benigno Uria, Charles Blundell, Shakir Mohamed, Alexander Lerchner Google DeepMind, 2016 ͱΓ͋͛Δจ ˞όʔδϣϯʹΑͬͯύϥϝʔλ͕େ͖͘ҧ͍ͬͯΔɻ࠷৽ͷWΛར༻
%JTFOUBOHMFE SFQSFTFOUBUJPO w ҙຯۭؒͷදݱΛɺҐஔɺαΠζɺFUDʜͳͲͷߏ ཁૉͷύϥϝʔλʹ͔Εͨঢ়ଶͰ֫ಘ͍ͨ͠ w 7BSJBUJPOBM"VUP&ODPEFSͷજࡏมͰ͜ΕΒͷ දݱΛڭࢣͳ͠Ͱ֫ಘͰ͖ͳ͍͔ʁ
7BSJBUJPOBM"VUP&ODPEFS 9 [ 9` FODPEFS EFDPEFS αϯϓϦϯά
7BSJBUJPOBM"VUP&ODPEFS zͷࣄޙۙࣅq(z|x) (=Τϯίʔμͷग़ྗ ͱ N(0,I)ͱͷڑΛ࠷খԽ ෮ݩޡࠩΛ࠷খԽ
Ќͩͱzͷࣄޙۙࣅq(z|x)ΛΑΓ N(0,I)ʹ͚ۙͮΑ͏ͱ͢Δ ਖ਼ଇԽ߲ʹЌΛಋೖ Ќͷࢹ֮࿏ʹ͋ΔύϥϝʔλʁΛۙࣅ
w Y࠲ඪ Z࠲ඪͦΕͧΕύλʔϯ w TDBMFύλʔϯ w ճసύλʔϯ w ΦϒδΣΫτͷܗ ପԁɺϋʔτɺ࢛֯
ύλʔϯ Yͷը૾ݸΛજࡏมݸͷ7"&Ͱֶश [ FODPEFS EFDPEFS αϯϓϦϯά ͷμ,σ
Ќ Ќ
N(0, I)ʹٵ͍ࠐ·Εͯ͠·͍ͬͯΔ જࡏมݸͷ͏ͪͷͻͱͭͷЖ͚ͩΛม͑ͯΓΛݻఆ ֤જࡏม͕ύϥϝʔλ͝ͱʹ ͔Ε͍ͯΔ જࡏมͷࢄ જࡏมͷЖΛdͰ ಈ͔͢
%FFQ.JOEʹΑΔͦͷଞͷ࣮ݧ݁Ռ IUUQUJOZVSMDPNKHCZ[LF "UBSJ %໎࿏FUD…
7"&Ͱ%JTFOUBOHMF͞ΕΔʹ w ม͕࿈ଓͰຶʹαϯϓϦϯά͞Ε͍ͯΔ w ཁૉ͕౷ܭతʹಠཱ w ੑ͕ݮΒ͞Ε͍ͯΔ
w ີʹαϯϓϦϯά͞Ε͍ͯΕɺೋ͕ͭผͷΦϒδΣΫτͩͱೝࣝͰ͖Δ
ಈ͖͕࿈ଓͰີʹαϯϓϦϯά͞Ε͍ͯΕɺ ಉ͡ΦϒδΣΫτͩͱೝࣝͰ͖Δ ͜ΕΒೋͭͷύυϧಉ͡ΦϒδΣΫτͩΖ͏͔ʁ
࠶ݱݕূ ETIBQF
࠶ݱݕূ #SFBLPVU ΫϦοΫͰ࠶ੜ wϒϩοΫͷมԽ͕ͭͬͨજࡏมʹ·͕ͨͬͯऔΕ͍ͯΔ จͷ༷ͳύυϧͷಈ͖είΞͷมԽ·ͩऔΕ͍ͯͳ͍ wЌΛڧ͘͢Δͱͬͯ͘Δજࡏมݮͬͯ͘Δ͕ɺಉ࣌ʹϘέ ۩߹͕େ͖͘ͳͬͯύυϧ͕ফ͑ͯ͠·͏ [ [
[