Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
480

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
150
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
340
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.7k

Other Decks in Research

See All in Research
[IBIS 2025] 深層基盤モデルのための強化学習 驚きから理論にもとづく納得へ
Avatar for Akifumi Wachi akifumi_wachi
19
9.5k
姫路市 -都市OSの「再実装」-
Avatar for Hopin hopin
0
1.6k
Akamaiのキャッシュ効率を支えるAdaptSizeについての論文を読んでみた
Avatar for bootjp / ぶーと bootjp
1
440
Time to Cash: The Full Stack Breakdown of Modern ATM Attacks
Avatar for D ratatata
0
190
Remote sensing × Multi-modal meta survey
Avatar for SatAI.challenge satai
4
710
教師あり学習と強化学習で作る 最強の数学特化LLM
Avatar for Hiroshi Y (RabotniKuma) analokmaus
2
880
Thirty Years of Progress in Speech Synthesis: A Personal Perspective on the Past, Present, and Future
Avatar for Keiichi Tokuda ktokuda
0
160
データサイエンティストの業務変化
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
210
OWASP KansaiDAY 2025.09_文系OSINTハンズオン
Avatar for OWASP Kansai owaspkansai
0
110
Satellites Reveal Mobility: A Commuting Origin-destination Flow Generator for Global Cities
Avatar for SatAI.challenge satai
3
490
Collective Predictive Coding and World Models in LLMs: A System 0/1/2/3 Perspective on Hierarchical Physical AI (IEEE SII 2026 Plenary Talk)
Avatar for Tadahiro Taniguchi tanichu
1
240
製造業主導型経済からサービス経済化における中間層形成メカニズムのパラダイムシフト
Avatar for Masatake Yamoto yamotty
0
480

Featured

See All Featured
The untapped power of vector embeddings
Avatar for Frank van Dijk frankvandijk
1
1.6k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.6k
How to make the Groovebox
Avatar for あそなす asonas
2
1.9k
Joys of Absence: A Defence of Solitary Play
Avatar for Sebastian Deterding codingconduct
1
290
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
Avatar for Umar Saidu Auna auna
0
50
A brief & incomplete history of 
UX Design for the World Wide Web: 1989–2019
Avatar for Jason CranfordTeague jct
1
290
Digital Ethics as a Driver of Design Innovation
Avatar for Per Axbom axbom
PRO
1
170
Abbi's Birthday
Avatar for Violet Bock coloredviolet
1
4.7k
The AI Search Optimization Roadmap by Aleyda Solis
Avatar for Aleyda Solis aleyda
1
5.2k
Game over? The fight for quality and originality in the time of robots
Avatar for Wayne Barker wayneb77
1
110
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
77
5.2k
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
333
22k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop