Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
450

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
990
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
140
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
310
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.5k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.3k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.5k

Other Decks in Research

See All in Research
スキマバイトサービスにおける現場起点でのデザインアプローチ
Avatar for 眞行寺由郎 yoshioshingyouji
0
240
Mechanistic Interpretability：解釈可能性研究の新たな潮流
Avatar for Koshiro Aoki koshiro_aoki
1
440
[RSJ25] Enhancing VLA Performance in Understanding and Executing Free-form Instructions via Visual Prompt-based Paraphrasing
Avatar for Semantic Machine Intelligence Lab., Keio Univ. keio_smilab
PRO
0
140
最適化と機械学習による問題解決
Avatar for MIKIO KUBO mickey_kubo
0
180
大規模な2値整数計画問題に対する 効率的な重み付き局所探索法
Avatar for MIKIO KUBO mickey_kubo
1
380
PhD Defense 2025: Visual Understanding of Human Hands in Interactions
Avatar for Take Ohkawa tkhkaeio
1
250
20250725-bet-ai-day
Avatar for cipepser cipepser
2
470
機械学習と数理最適化の融合 (MOAI) による革新
Avatar for MIKIO KUBO mickey_kubo
1
380
2025年度人工知能学会全国大会チュートリアル講演「深層基盤モデルの数理」
Avatar for Taiji Suzuki taiji_suzuki
25
19k
Nullspace MPC
Avatar for MizuhoAOKI mizuhoaoki
1
160
EarthSynth: Generating Informative Earth Observation with Diffusion Models
Avatar for SatAI.challenge satai
3
360
Galileo: Learning Global & Local Features of Many Remote Sensing Modalities
Avatar for SatAI.challenge satai
3
340

Featured

See All Featured
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
53
9k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
34
6.1k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
271
21k
For a Future-Friendly Web
Avatar for Brad Frost brad_frost
180
9.9k
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
19
1.2k
Imperfection Machines: The Place of Print at Facebook
Avatar for Scott Boms scottboms
269
13k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
339
57k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
37
2.9k
CSS Pre-Processors: Stylus, Less & Sass
Avatar for Bermon Painter bermonpainter
358
30k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
303
21k
Become a Pro
Avatar for Speaker Deck speakerdeck
PRO
29
5.5k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop