Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
490
1

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
170
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
360
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.7k

Other Decks in Research

See All in Research
さくらインターネット研究所テックトーク2026春、研究開発Gr.25年度成果26年度方針
Avatar for KIKUCHI Shunsuke kikuzo
0
120
Sequences of Logits Reveal the Low Rank Structure of Language Models
Avatar for SansanTech sansantech
PRO
1
170
LINEヤフー データサイエンス Meetup「三井物産コモディティ予測チャレンジ」の舞台裏-AlpacaTechパート
Avatar for tomo gamella
0
300
進学校の生徒にはア行の苗字が多いのか
Avatar for Takashi Ozeki ozekinote
0
320
Aurora Serverless からAurora Serverless v2への課題と知見を論文から読み解く/Understanding the challenges and insights of moving from Aurora Serverless to Aurora Serverless v2 from a paper
Avatar for bootjp / ぶーと bootjp
6
1.6k
2026.01ウェビナー資料
Avatar for Elith elith
0
340
社内データ分析AIエージェントを できるだけ使いやすくする工夫
Avatar for Yusuke Fukasawa fufufukakaka
1
1k
SREはサイバネティクスの夢をみるか？ / Do SREs Dream of Cybernetics?
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
3
470
はじまりの クエスチョンブック —余暇と豊かさにあふれた社会とは？
Avatar for 立ち止まれる社会 culturaltransition
PRO
0
350
Can We Teach Logical Reasoning to LLMs? – An Approach Using Synthetic Corpora (AAAI 2026 bridge keynote)
Avatar for もりし morishtr
1
200
通時的な類似度行列に基づく単語の意味変化の分析
Avatar for hajime kiyama rudorudo11
0
250
論文紹介 "ReSim: Reliable World Simulation for Autonomous Driving"
Avatar for Takuma Kogo kogo
0
120

Featured

See All Featured
Redefining SEO in the New Era of Traffic Generation
Avatar for Szymon Słowik szymonslowik
1
270
The Limits of Empathy - UXLibs8
Avatar for Cassini Nazir cassininazir
1
290
WENDY [Excerpt]
Avatar for Tessa Abrams tessaabrams
9
37k
Navigating Weather and Climate Data
Avatar for Ryan Abernathey rabernat
0
160
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
72
12k
Deep Space Network (abreviated)
Avatar for Tony Rice tonyrice
0
110
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
21
1.4k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
0
420
Principles of Awesome APIs and How to Build Them.
Avatar for Keavy McMinn keavy
128
17k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
93

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop