Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
結合トピックモデル
Search
Kento Nozawa
March 29, 2016
Research
0
1k
結合トピックモデル
2016年3月29日に『トピックモデルによる統計的潜在意味解析』
読書会ファイナル ~佐藤一誠先生スペシャル~のLTで発表しました
Kento Nozawa
March 29, 2016
Tweet
Share
More Decks by Kento Nozawa
See All by Kento Nozawa
Analysis on Negative Sample Size in Contrastive Unsupervised Representation Learning
nzw0301
0
76
[IJCAI-ECAI 2022] Evaluation Methods for Representation Learning: A Survey
nzw0301
0
450
[NeurIPS Japan meetup 2021 talk] Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning
nzw0301
0
130
[IBIS2021] 対照的自己教師付き表現学習おける負例数の解析
nzw0301
0
110
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning
nzw0301
0
360
Introduction of PAC-Bayes and its Application for Contrastive Unsupervised Representation Learning
nzw0301
2
720
NLP Tutorial; word representation learning
nzw0301
0
150
Analyzing Centralities of Embedded Nodes
nzw0301
0
110
Paper Reading: Noise-Contrastive Estimation of Unnormalized Statistical Models, with Applications to Natural Image Statistics
nzw0301
2
950
Other Decks in Research
See All in Research
Embodied AIについて / About Embodied AI
nttcom
1
360
Source Code Diff Revolution (JetBrains Open Reading Club)
tsantalis
0
210
F0に基づいて伸縮された画像文字からの音声合成 [ASJ2024春]
nehi0615
0
110
第4回ナレッジグラフ勉強会:ISWC2023論文読み会
kg_wakate
1
180
東工大Swallowプロジェクトにおける大規模日本語Webコーパスの構築
aya_se
13
5.2k
[KDD2023論文読み会] BERT4CTR: An Efficient Framework to Combine Pre-trained Language Model with Non-textual Features for CTR Prediction / KDD2023 LY Tech Reading
shunk031
0
380
論文紹介: Generating News-Centric Crossword Puzzles As A Constraint Satisfaction and Optimization Problem
upura
0
140
Феномен воли и техника самоопределения
ashapiro
0
120
第14回対話システムシンポジウム EMNLP 2023 参加報告
atsumoto
0
130
Discovering Universal Geometry in Embeddings with ICA
momoseoyama
1
290
MegaParticles: GPUを利用したStein Particle Filterによる点群6自由度姿勢推定
koide3
1
460
[研究室用] 2038年問題研究の現状報告
ran350
0
250
Featured
See All Featured
Ruby is Unlike a Banana
tanoku
95
10k
[RailsConf 2023] Rails as a piece of cake
palkan
21
3.8k
Pencils Down: Stop Designing & Start Developing
hursman
115
11k
Let's Do A Bunch of Simple Stuff to Make Websites Faster
chriscoyier
501
140k
Raft: Consensus for Rubyists
vanstee
130
6.2k
Testing 201, or: Great Expectations
jmmastey
27
6.3k
From Idea to $5000 a Month in 5 Months
shpigford
376
45k
We Have a Design System, Now What?
morganepeng
42
6.7k
Fireside Chat
paigeccino
19
2.6k
Why You Should Never Use an ORM
jnunemaker
PRO
50
8.6k
CSS Pre-Processors: Stylus, Less & Sass
bermonpainter
352
28k
Being A Developer After 40
akosma
56
580k
Transcript
݁߹τϐοΫϞσϧ ʰτϐοΫϞσϧʹΑΔ౷ܭతજࡏҙຯղੳʱ ಡॻձϑΝΠφϧ ~ࠤ౻Ұઌੜεϖγϟϧ~ ݈ਓ (@nzw0301) 2016-03-29
ࣗݾհ ͡Ί·ͯ͠ ݈ਓ (@nzw0301) य़͔ΒஜେͰM1 ڵຯ • ػցֶशɼNLPɼάϥϑɼDL
݁߹τϐοΫϞσϧ จॻσʔλͱରԠ͢ΔใΛ߹Θֶͤͯश • ຊޠͱӳޠ • Ϩγϐͱࡐྉ • ୯ޠͱͦͷࢺ ࢀߟɿ௨ৗͷLDAͷάϥϑΟΧϧϞσϧ 3
D N2 N1 K 2 1 w2 i w1 i ✓ ↵ 1 z1 i z2 i 2 D N K wi ✓ ↵ zi
z ͷαϯϓϦϯάࣜ • 3ষp55ʹैͬͯಋग़Մೳ • ৄ͘͠ http://nzw0301.github.io/2016/02/jointTopicModelsEquation • ҎԼͷ͔ࣜΒGibbs SamplingͷࣜΛٻΊΔ
ࢀߟɿ௨ৗͷLDA 4 p(z1 d,i = k|w1 d,i = v, W1 \d,i , W2, Z1 \d,i , Z2, ↵, 1, 2) p(z1 d,i = k|w1 d,i = v, W1 \d,i , Z1 \d,i , ↵, 1)
ࣜมܗͷ݁Ռ • ݁߹τϐοΫϞσϧͷαϯϓϦϯάࣜ • φ௨ৗͷLDAͱಉ͡ • θʹ͍ͭͯɼؚ·ΕΔ߲͕ิॿใͷ͚ͩ૿͑Δ ࢀߟɿ௨ৗͷLDAͷαϯϓϦϯάࣜ 5 n1
k,v,\d,i + v P v0 (n1 k,v0,\d,i + v0 ) n1 d,k,\d,i + n2 d,k + ↵k P k0 (n1 d,k0,\d,i + n2 d,k0 + ↵k0 ) n1 k,v,\d,i + v P v0 (n1 k,v0,\d,i + v0 ) n1 d,k,\d,i + ↵k P k0 (n1 d,k0,\d,i + ↵k0 )
࣮ߦྫ • ର༁ίʔύεΛఆͨ͠؆୯ͳྫ • ݴޠ͕ҧͬͯτϐοΫڞ௨ http://nzw0301.github.io/2016/02/jointTopicModelsEquation ࣮ɿLDAͷαϯϓϧࣜͰ͏౷ܭྔΛྻʹ 6
ࢀߟจݙ • ؠా ۩࣏. τϐοΫϞσϧ. ߨஊࣾ. 2015. (MLPػցֶशϓϩϑΣογϣφϧγϦʔζ). • ࠤ౻
Ұ. τϐοΫϞσϧʹΑΔ౷ܭతજࡏҙຯղੳ. ίϩφࣾ. 2015. (ࣗવݴޠॲཧγ Ϧʔζ, 8). • David Mimno, Hanna M. Wallach, Jason Naradowsky, David A. Smith and Andrew McCallum. 2009. Polylingual Topic Models. in EMNLP. 7