Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Variational Auto Encoderでの Disentangled表現
Search
Kosuke Miyoshi
November 03, 2016
Research
0
590
Variational Auto Encoderでの Disentangled表現
※ Speaker Deck内ではURLリンクがクリックできないので、クリックしたい場合はpdfをダウンロードしてください
Kosuke Miyoshi
November 03, 2016
Tweet
Share
More Decks by Kosuke Miyoshi
See All by Kosuke Miyoshi
Representation Learning with Contrastive Predictive Coding
miyosuda
1
150
Sutton "Reinforcement Learning" 2nd Edition Ch13: Policy Gradient Methods
miyosuda
0
170
Sutton "Reinforcement Learning" 2nd Edition Ch7: n-step Bootstrapping
miyosuda
0
69
Sutton "Reinforcement Learning" 2nd Edition Ch6: TD-learning
miyosuda
0
63
SCAN
miyosuda
0
760
TensorFlow & DeepMind Lab & UNREAL
miyosuda
1
2.5k
Other Decks in Research
See All in Research
非ガウス性と非線形性に基づく統計的因果探索
sshimizu2006
0
460
新規のC言語処理系を実装することによる 組込みシステム研究にもたらす価値 についての考察
zacky1972
1
290
機械学習による言語パフォーマンスの評価
langstat
6
850
テキストマイニングことはじめー基本的な考え方からメディアディスコース研究への応用まで
langstat
1
160
Weekly AI Agents News! 11月号 論文のアーカイブ
masatoto
0
250
最近のVisual Odometryと Depth Estimation
sgk
1
330
Leveraging LLMs for Unsupervised Dense Retriever Ranking (SIGIR 2024)
kampersanda
2
270
文化が形作る音楽推薦の消費と、その逆
kuri8ive
0
210
PostgreSQLにおける分散トレーシングの現在 - 第50回PostgreSQLアンカンファレンス
seinoyu
0
170
ベイズ的方法に基づく統計的因果推論の基礎
holyshun
0
680
CoRL2024サーベイ
rpc
1
1.3k
Weekly AI Agents News!
masatoto
29
43k
Featured
See All Featured
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
28
4.4k
10 Git Anti Patterns You Should be Aware of
lemiorhan
PRO
656
59k
Gamification - CAS2011
davidbonilla
80
5.1k
jQuery: Nuts, Bolts and Bling
dougneiner
62
7.6k
Bootstrapping a Software Product
garrettdimon
PRO
305
110k
A better future with KSS
kneath
238
17k
Rails Girls Zürich Keynote
gr2m
94
13k
Art, The Web, and Tiny UX
lynnandtonic
298
20k
4 Signs Your Business is Dying
shpigford
182
21k
Stop Working from a Prison Cell
hatefulcrawdad
267
20k
Put a Button on it: Removing Barriers to Going Fast.
kastner
59
3.6k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
160
15k
Transcript
7BSJBUJPOBM"VUP&ODPEFSͰͷ %JTFOUBOHMFEදݱ OBSSBUJWFOJHIUTגࣜձࣾࡾ߁༞ શΞʔΩςΫνϟୈճ4*(8#"Φϑձ
&BSMZ7JTVBM$PODFQU-FBSOJOHXJUI 6OTVQFSWJTFE%FFQ-FBSOJOH Irina Higgins, Loic Matthey, Xavier Glorot, Arka Pal,
Benigno Uria, Charles Blundell, Shakir Mohamed, Alexander Lerchner Google DeepMind, 2016 ͱΓ͋͛Δจ ˞όʔδϣϯʹΑͬͯύϥϝʔλ͕େ͖͘ҧ͍ͬͯΔɻ࠷৽ͷWΛར༻
%JTFOUBOHMFE SFQSFTFOUBUJPO w ҙຯۭؒͷදݱΛɺҐஔɺαΠζɺFUDʜͳͲͷߏ ཁૉͷύϥϝʔλʹ͔Εͨঢ়ଶͰ֫ಘ͍ͨ͠ w 7BSJBUJPOBM"VUP&ODPEFSͷજࡏมͰ͜ΕΒͷ දݱΛڭࢣͳ͠Ͱ֫ಘͰ͖ͳ͍͔ʁ
7BSJBUJPOBM"VUP&ODPEFS 9 [ 9` FODPEFS EFDPEFS αϯϓϦϯά
7BSJBUJPOBM"VUP&ODPEFS zͷࣄޙۙࣅq(z|x) (=Τϯίʔμͷग़ྗ ͱ N(0,I)ͱͷڑΛ࠷খԽ ෮ݩޡࠩΛ࠷খԽ
Ќͩͱzͷࣄޙۙࣅq(z|x)ΛΑΓ N(0,I)ʹ͚ۙͮΑ͏ͱ͢Δ ਖ਼ଇԽ߲ʹЌΛಋೖ Ќͷࢹ֮࿏ʹ͋ΔύϥϝʔλʁΛۙࣅ
w Y࠲ඪ Z࠲ඪͦΕͧΕύλʔϯ w TDBMFύλʔϯ w ճసύλʔϯ w ΦϒδΣΫτͷܗ ପԁɺϋʔτɺ࢛֯
ύλʔϯ Yͷը૾ݸΛજࡏมݸͷ7"&Ͱֶश [ FODPEFS EFDPEFS αϯϓϦϯά ͷμ,σ
Ќ Ќ
N(0, I)ʹٵ͍ࠐ·Εͯ͠·͍ͬͯΔ જࡏมݸͷ͏ͪͷͻͱͭͷЖ͚ͩΛม͑ͯΓΛݻఆ ֤જࡏม͕ύϥϝʔλ͝ͱʹ ͔Ε͍ͯΔ જࡏมͷࢄ જࡏมͷЖΛdͰ ಈ͔͢
%FFQ.JOEʹΑΔͦͷଞͷ࣮ݧ݁Ռ IUUQUJOZVSMDPNKHCZ[LF "UBSJ %໎࿏FUD…
7"&Ͱ%JTFOUBOHMF͞ΕΔʹ w ม͕࿈ଓͰຶʹαϯϓϦϯά͞Ε͍ͯΔ w ཁૉ͕౷ܭతʹಠཱ w ੑ͕ݮΒ͞Ε͍ͯΔ
w ີʹαϯϓϦϯά͞Ε͍ͯΕɺೋ͕ͭผͷΦϒδΣΫτͩͱೝࣝͰ͖Δ
ಈ͖͕࿈ଓͰີʹαϯϓϦϯά͞Ε͍ͯΕɺ ಉ͡ΦϒδΣΫτͩͱೝࣝͰ͖Δ ͜ΕΒೋͭͷύυϧಉ͡ΦϒδΣΫτͩΖ͏͔ʁ
࠶ݱݕূ ETIBQF
࠶ݱݕূ #SFBLPVU ΫϦοΫͰ࠶ੜ wϒϩοΫͷมԽ͕ͭͬͨજࡏมʹ·͕ͨͬͯऔΕ͍ͯΔ จͷ༷ͳύυϧͷಈ͖είΞͷมԽ·ͩऔΕ͍ͯͳ͍ wЌΛڧ͘͢Δͱͬͯ͘Δજࡏมݮͬͯ͘Δ͕ɺಉ࣌ʹϘέ ۩߹͕େ͖͘ͳͬͯύυϧ͕ফ͑ͯ͠·͏ [ [
[