Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
結合トピックモデル
Search
Kento Nozawa
March 29, 2016
Research
1.2k
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
結合トピックモデル
2016年3月29日に『トピックモデルによる統計的潜在意味解析』
読書会ファイナル ~佐藤一誠先生スペシャル~のLTで発表しました
Kento Nozawa
March 29, 2016
Transcript
7 slides
݁߹τϐοΫϞσϧ ʰτϐοΫϞσϧʹΑΔ౷ܭతજࡏҙຯղੳʱ ಡॻձϑΝΠφϧ ~ࠤ౻Ұઌੜεϖγϟϧ~ ݈ਓ (@nzw0301) 2016-03-29
ࣗݾհ ͡Ί·ͯ͠ ݈ਓ (@nzw0301) य़͔ΒஜେͰM1 ڵຯ • ػցֶशɼNLPɼάϥϑɼDL
݁߹τϐοΫϞσϧ จॻσʔλͱରԠ͢ΔใΛ߹Θֶͤͯश • ຊޠͱӳޠ • Ϩγϐͱࡐྉ • ୯ޠͱͦͷࢺ ࢀߟɿ௨ৗͷLDAͷάϥϑΟΧϧϞσϧ 3
D N2 N1 K 2 1 w2 i w1 i ✓ ↵ 1 z1 i z2 i 2 D N K wi ✓ ↵ zi
z ͷαϯϓϦϯάࣜ • 3ষp55ʹैͬͯಋग़Մೳ • ৄ͘͠ http://nzw0301.github.io/2016/02/jointTopicModelsEquation • ҎԼͷ͔ࣜΒGibbs SamplingͷࣜΛٻΊΔ
ࢀߟɿ௨ৗͷLDA 4 p(z1 d,i = k|w1 d,i = v, W1 \d,i , W2, Z1 \d,i , Z2, ↵, 1, 2) p(z1 d,i = k|w1 d,i = v, W1 \d,i , Z1 \d,i , ↵, 1)
ࣜมܗͷ݁Ռ • ݁߹τϐοΫϞσϧͷαϯϓϦϯάࣜ • φ௨ৗͷLDAͱಉ͡ • θʹ͍ͭͯɼؚ·ΕΔ߲͕ิॿใͷ͚ͩ૿͑Δ ࢀߟɿ௨ৗͷLDAͷαϯϓϦϯάࣜ 5 n1
k,v,\d,i + v P v0 (n1 k,v0,\d,i + v0 ) n1 d,k,\d,i + n2 d,k + ↵k P k0 (n1 d,k0,\d,i + n2 d,k0 + ↵k0 ) n1 k,v,\d,i + v P v0 (n1 k,v0,\d,i + v0 ) n1 d,k,\d,i + ↵k P k0 (n1 d,k0,\d,i + ↵k0 )
࣮ߦྫ • ର༁ίʔύεΛఆͨ͠؆୯ͳྫ • ݴޠ͕ҧͬͯτϐοΫڞ௨ http://nzw0301.github.io/2016/02/jointTopicModelsEquation ࣮ɿLDAͷαϯϓϧࣜͰ͏౷ܭྔΛྻʹ 6
ࢀߟจݙ • ؠా ۩࣏. τϐοΫϞσϧ. ߨஊࣾ. 2015. (MLPػցֶशϓϩϑΣογϣφϧγϦʔζ). • ࠤ౻
Ұ. τϐοΫϞσϧʹΑΔ౷ܭతજࡏҙຯղੳ. ίϩφࣾ. 2015. (ࣗવݴޠॲཧγ Ϧʔζ, 8). • David Mimno, Hanna M. Wallach, Jason Naradowsky, David A. Smith and Andrew McCallum. 2009. Polylingual Topic Models. in EMNLP. 7
More Decks by Kento Nozawa
See All by Kento Nozawa
[最先端NLP勉強会2026] Checklists Are Better Than Reward Models For Aligning Language Models
nzw0301
1
350
Analysis on Negative Sample Size in Contrastive Unsupervised Representation Learning
nzw0301
0
250
[IJCAI-ECAI 2022] Evaluation Methods for Representation Learning: A Survey
nzw0301
0
740
[NeurIPS Japan meetup 2021 talk] Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning
nzw0301
0
290
[IBIS2021] 対照的自己教師付き表現学習おける負例数の解析
nzw0301
0
240
Understanding Negative Samples in Instance Discriminative Self-supervised Representation Learning
nzw0301
0
620
Introduction of PAC-Bayes and its Application for Contrastive Unsupervised Representation Learning
nzw0301
2
940
NLP Tutorial; word representation learning
nzw0301
0
280
Analyzing Centralities of Embedded Nodes
nzw0301
0
240
Other Decks in Research
See All in Research
Hitting the buffers
beale
0
400
湯村研究室の紹介2026 / yumulab2026
yumulab
PRO
0
230
CDCL を用いた MILP の厳密解法
imai448
0
330
[webinaire du Ciirpo] Agnelages plein air : des éleveurs partagent leurs pratiques
institutdelelevage
PRO
0
340
XDPerf: A High-Performance Traffic Generator Built with WASM and eBPF
takehaya
1
390
Prithvi-EO-2.0
satai
3
120
フィジカルAIの社会実装に向けて -AIエージェントからAgentic Roboticsへ-
hf149
1
2.8k
Santé et fertilité des sols : ce que nous disent les pratiques dans les systèmes de polyculture-élevage
institutdelelevage
PRO
0
240
Model Predictive Control for Uncertain Systems: Robust & Data-Driven Designs
kohlerjohannes
0
220
A new deal for disabled people
resolutionfoundation
0
390
オンライン凸最適化の基礎とゲーム理論への応用 (IBIS 2026 チュートリアル)
taira_tsuchiya
2
1.4k
Adapter les bergeries aux fortes chaleurs
institutdelelevage
PRO
0
180
Featured
See All Featured
The Organizational Zoo: Understanding Human Behavior Agility Through Metaphoric Constructive Conversations (based on the works of Arthur Shelley, Ph.D)
kimpetersen
PRO
0
540
Leveraging LLMs for student feedback in introductory data science courses - posit::conf(2025)
minecr
1
480
Practical Orchestrator
shlominoach
192
12k
Utilizing Notion as your number one productivity tool
mfonobong
4
640
Understanding Cognitive Biases in Performance Measurement
bluesmoon
32
3.1k
My Coaching Mixtape
mlcsv
0
390
Color Theory Basics | Prateek | Gurzu
gurzu
1
530
A Guide to Academic Writing Using Generative AI - A Workshop
ks91
PRO
1
570
Building Flexible Design Systems
yeseniaperezcruz
330
41k
Highjacked: Video Game Concept Design
rkendrick25
PRO
2
580
We Analyzed 250 Million AI Search Results: Here's What I Found
joshbly
2
2.1k
Noah Learner - AI + Me: how we built a GSC Bulk Export data pipeline
techseoconnect
PRO
0
490