Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
470

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
150
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
330
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.6k

Other Decks in Research

See All in Research
それ、チームの改善になってますか？ー「チームとは？」から始めた組織の実験ー
Avatar for hirakawa hirakawa51
0
280
Sat2City:3D City Generation from A Single Satellite Image with Cascaded Latent Diffusion
Avatar for SatAI.challenge satai
4
500
20251023_くまもと21の会例会_「車1割削減、渋滞半減、公共交通2倍」をめざして.pdf
Avatar for Traffic Brain trafficbrain
0
160
[IBIS 2025] 深層基盤モデルのための強化学習 驚きから理論にもとづく納得へ
Avatar for Akifumi Wachi akifumi_wachi
19
9.3k
さまざまなAgent FrameworkとAIエージェントの評価
Avatar for Kento.Yamada ymd65536
1
390
AIスパコン「さくらONE」のLLM学習ベンチマークによる性能評価 / SAKURAONE LLM Training Benchmarking
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
2
940
ウェブ・ソーシャルメディア論文読み会 第36回: The Stepwise Deception: Simulating the Evolution from True News to Fake News with LLM Agents (EMNLP, 2025)
Avatar for taichi_murayama hkefka385
0
120
Unsupervised Domain Adaptation Architecture Search with Self-Training for Land Cover Mapping
Avatar for SatAI.challenge satai
3
540
Open Gateway 5GC利用への期待と不安
Avatar for Stellar Craft, Inc. stellarcraft
2
170
Agentic AI Era におけるサプライチェーン最適化
Avatar for MIKIO KUBO mickey_kubo
0
110
Language Models Are Implicitly Continuous
Avatar for Sho Yokoi eumesy
PRO
0
370
Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral Image Classification
Avatar for SatAI.challenge satai
3
450

Featured

See All Featured
Discover your Explorer Soul
Avatar for Emna emna__ayadi
2
1k
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
330
A Guide to Academic Writing Using Generative AI - A Workshop
Avatar for Kenji Saito ks91
PRO
0
180
Visual Storytelling: How to be a Superhuman Communicator
Avatar for David Neal reverentgeek
2
410
Prompt Engineering for Job Search
Avatar for Mfonobong Umondia mfonobong
0
140
The Art of Delivering Value - GDevCon NA Keynote
Avatar for David Neal reverentgeek
16
1.8k
16th Malabo Montpellier Forum Presentation
Avatar for AKADEMIYA2063 akademiya2063
PRO
0
39
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
270
Context Engineering - Making Every Token Count
Avatar for Addy Osmani addyosmani
9
590
Six Lessons from altMBA
Avatar for Skipper Chong Warson skipperchong
29
4.1k
Building Better People: How to give real-time feedback that sticks.
Avatar for Will Jessup wjessup
370
20k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
51k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop