Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Variational Auto Encoderでの Disentangled表現
Search
Kosuke Miyoshi
November 03, 2016
Research
0
620
Variational Auto Encoderでの Disentangled表現
※ Speaker Deck内ではURLリンクがクリックできないので、クリックしたい場合はpdfをダウンロードしてください
Kosuke Miyoshi
November 03, 2016
Tweet
Share
More Decks by Kosuke Miyoshi
See All by Kosuke Miyoshi
Representation Learning with Contrastive Predictive Coding
miyosuda
1
180
Sutton "Reinforcement Learning" 2nd Edition Ch13: Policy Gradient Methods
miyosuda
0
200
Sutton "Reinforcement Learning" 2nd Edition Ch7: n-step Bootstrapping
miyosuda
0
81
Sutton "Reinforcement Learning" 2nd Edition Ch6: TD-learning
miyosuda
0
90
SCAN
miyosuda
0
810
TensorFlow & DeepMind Lab & UNREAL
miyosuda
1
2.6k
Other Decks in Research
See All in Research
SSII2025 [SS1] レンズレスカメラ
ssii
PRO
2
1.1k
論文読み会 SNLP2025 Learning Dynamics of LLM Finetuning. In: ICLR 2025
s_mizuki_nlp
0
210
言語モデルの地図:確率分布と情報幾何による類似性の可視化
shimosan
5
1.5k
SSII2025 [TS1] 光学・物理原理に基づく深層画像生成
ssii
PRO
4
4.2k
国際論文を出そう!ICRA / IROS / RA-L への論文投稿の心構えとノウハウ / RSJ2025 Luncheon Seminar
koide3
6
4.8k
大規模な2値整数計画問題に対する 効率的な重み付き局所探索法
mickey_kubo
1
360
最適決定木を用いた処方的価格最適化
mickey_kubo
4
1.9k
「どう育てるか」より「どう働きたいか」〜スクラムマスターの最初の一歩〜
hirakawa51
0
870
Generative Models 2025
takahashihiroshi
25
13k
Panopticon: Advancing Any-Sensor Foundation Models for Earth Observation
satai
1
110
Language Models Are Implicitly Continuous
eumesy
PRO
0
240
データxデジタルマップで拓く ミラノ発・地域共創最前線
mapconcierge4agu
0
210
Featured
See All Featured
The Cult of Friendly URLs
andyhume
79
6.6k
Intergalactic Javascript Robots from Outer Space
tanoku
272
27k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
507
140k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
eileencodes
26
3k
Building an army of robots
kneath
306
46k
ピンチをチャンスに:未来をつくるプロダクトロードマップ #pmconf2020
aki_iinuma
127
53k
Helping Users Find Their Own Way: Creating Modern Search Experiences
danielanewman
29
2.9k
Java REST API Framework Comparison - PWX 2021
mraible
33
8.8k
Documentation Writing (for coders)
carmenintech
74
5k
Git: the NoSQL Database
bkeepers
PRO
431
66k
Designing Dashboards & Data Visualisations in Web Apps
destraynor
231
53k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
31
2.5k
Transcript
7BSJBUJPOBM"VUP&ODPEFSͰͷ %JTFOUBOHMFEදݱ OBSSBUJWFOJHIUTגࣜձࣾࡾ߁༞ શΞʔΩςΫνϟୈճ4*(8#"Φϑձ
&BSMZ7JTVBM$PODFQU-FBSOJOHXJUI 6OTVQFSWJTFE%FFQ-FBSOJOH Irina Higgins, Loic Matthey, Xavier Glorot, Arka Pal,
Benigno Uria, Charles Blundell, Shakir Mohamed, Alexander Lerchner Google DeepMind, 2016 ͱΓ͋͛Δจ ˞όʔδϣϯʹΑͬͯύϥϝʔλ͕େ͖͘ҧ͍ͬͯΔɻ࠷৽ͷWΛར༻
%JTFOUBOHMFE SFQSFTFOUBUJPO w ҙຯۭؒͷදݱΛɺҐஔɺαΠζɺFUDʜͳͲͷߏ ཁૉͷύϥϝʔλʹ͔Εͨঢ়ଶͰ֫ಘ͍ͨ͠ w 7BSJBUJPOBM"VUP&ODPEFSͷજࡏมͰ͜ΕΒͷ දݱΛڭࢣͳ͠Ͱ֫ಘͰ͖ͳ͍͔ʁ
7BSJBUJPOBM"VUP&ODPEFS 9 [ 9` FODPEFS EFDPEFS αϯϓϦϯά
7BSJBUJPOBM"VUP&ODPEFS zͷࣄޙۙࣅq(z|x) (=Τϯίʔμͷग़ྗ ͱ N(0,I)ͱͷڑΛ࠷খԽ ෮ݩޡࠩΛ࠷খԽ
Ќͩͱzͷࣄޙۙࣅq(z|x)ΛΑΓ N(0,I)ʹ͚ۙͮΑ͏ͱ͢Δ ਖ਼ଇԽ߲ʹЌΛಋೖ Ќͷࢹ֮࿏ʹ͋ΔύϥϝʔλʁΛۙࣅ
w Y࠲ඪ Z࠲ඪͦΕͧΕύλʔϯ w TDBMFύλʔϯ w ճసύλʔϯ w ΦϒδΣΫτͷܗ ପԁɺϋʔτɺ࢛֯
ύλʔϯ Yͷը૾ݸΛજࡏมݸͷ7"&Ͱֶश [ FODPEFS EFDPEFS αϯϓϦϯά ͷμ,σ
Ќ Ќ
N(0, I)ʹٵ͍ࠐ·Εͯ͠·͍ͬͯΔ જࡏมݸͷ͏ͪͷͻͱͭͷЖ͚ͩΛม͑ͯΓΛݻఆ ֤જࡏม͕ύϥϝʔλ͝ͱʹ ͔Ε͍ͯΔ જࡏมͷࢄ જࡏมͷЖΛdͰ ಈ͔͢
%FFQ.JOEʹΑΔͦͷଞͷ࣮ݧ݁Ռ IUUQUJOZVSMDPNKHCZ[LF "UBSJ %໎࿏FUD…
7"&Ͱ%JTFOUBOHMF͞ΕΔʹ w ม͕࿈ଓͰຶʹαϯϓϦϯά͞Ε͍ͯΔ w ཁૉ͕౷ܭతʹಠཱ w ੑ͕ݮΒ͞Ε͍ͯΔ
w ີʹαϯϓϦϯά͞Ε͍ͯΕɺೋ͕ͭผͷΦϒδΣΫτͩͱೝࣝͰ͖Δ
ಈ͖͕࿈ଓͰີʹαϯϓϦϯά͞Ε͍ͯΕɺ ಉ͡ΦϒδΣΫτͩͱೝࣝͰ͖Δ ͜ΕΒೋͭͷύυϧಉ͡ΦϒδΣΫτͩΖ͏͔ʁ
࠶ݱݕূ ETIBQF
࠶ݱݕূ #SFBLPVU ΫϦοΫͰ࠶ੜ wϒϩοΫͷมԽ͕ͭͬͨજࡏมʹ·͕ͨͬͯऔΕ͍ͯΔ จͷ༷ͳύυϧͷಈ͖είΞͷมԽ·ͩऔΕ͍ͯͳ͍ wЌΛڧ͘͢Δͱͬͯ͘Δજࡏมݮͬͯ͘Δ͕ɺಉ࣌ʹϘέ ۩߹͕େ͖͘ͳͬͯύυϧ͕ফ͑ͯ͠·͏ [ [
[