Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
500
1

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
170
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
360
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.7k

Other Decks in Research

See All in Research
第12回人と環境にやさしい交通をめざす全国大会／熊本都市圏「車1割削減、渋滞半減、公共交通2倍」をめざして
Avatar for Traffic Brain trafficbrain
0
100
LLM の Attention 機構まとめ — 数式・計算量・メモリ
Avatar for プワー puwaer
7
1.9k
The Landscape of Agentic Reinforcement Learning for LLMs: A Survey
Avatar for Shunsuke KITADA shunk031
4
960
AY 2026 Guide to Academic Writing Using Generative AI - Workshop
Avatar for Kenji Saito ks91
PRO
0
110
Ankylosing Spondylitis
Avatar for Charles Holtzkampf ankh2054
0
170
定数整数除算・剰余算最適化再考
Avatar for herumi herumi
1
120
羽田新ルート運用6年の検証
Avatar for マン点 1manken
0
160
NLP colloquium: AI Safety Survey
Avatar for Masahiro Kaneko kanekomasahiro
0
460
【NICOGRAPH2025】Photographic Conviviality: ボディペイント・ワークショップによる 同時的かつ共生的な写真体験
Avatar for Chinatsu Ozawa toremolo72
0
240
LOSの検討（λ Kansai 2026 in Winter）
Avatar for Motohiro Yakura motopu
0
130
COFFEE-Japan PROJECT Impact Report（海ノ向こうコーヒー）
Avatar for 坂ノ途中 ontheslope
0
1.7k
Scalable dynamic origin-destination demand estimation enhanced by high-resolution satellite imagery data
Avatar for SatAI.challenge satai
2
220

Featured

See All Featured
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
96
14k
Unlocking the hidden potential of vector embeddings in international SEO
Avatar for Frank van Dijk frankvandijk
0
820
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
38
2.9k
Avoiding the “Bad Training, Faster” Trap in the Age of AI
Avatar for Mike Taylor tmiket
0
160
Navigating Algorithm Shifts & AI Overviews - #SMXNext
Avatar for Aleyda Solis aleyda
1
1.3k
How to build a perfect <img>
Avatar for Jono Alderson jonoalderson
1
5.5k
The Curse of the Amulet
Avatar for Matthew Lei leimatthew05
1
13k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
187
22k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
302
52k
SEO Brein meetup: CTRL+C is not how to scale international SEO
Avatar for Linda Hogenes lindahogenes
1
2.7k
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
Avatar for Umar Saidu Auna auna
0
150
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
11
930

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop