Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
440

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
980
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
130
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
300
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.5k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.3k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.5k

Other Decks in Research

See All in Research
EarthSynth: Generating Informative Earth Observation with Diffusion Models
Avatar for SatAI.challenge satai
3
170
投資戦略202508
Avatar for Pragmaworks pw
0
170
数理最適化に基づく制御
Avatar for MIKIO KUBO mickey_kubo
6
710
2025年度人工知能学会全国大会チュートリアル講演「深層基盤モデルの数理」
Avatar for Taiji Suzuki taiji_suzuki
24
18k
近似動的計画入門
Avatar for MIKIO KUBO mickey_kubo
4
1k
Trust No Bot? Forging Confidence in AI for Software Engineering
Avatar for Thomas Zimmermann tomzimmermann
1
260
SSII2025 [TS1] 光学・物理原理に基づく深層画像生成
Avatar for 画像センシングシンポジウム ssii
PRO
4
4.1k
When Submarine Cables Go Dark: Examining the Web Services Resilience Amid Global Internet Disruptions
Avatar for Irvin Chen irvin
0
280
Towards a More Efficient Reasoning LLM: AIMO2 Solution Summary and Introduction to Fast-Math Models
Avatar for Hiroshechka Y analokmaus
2
730
SSII2025 [SS2] 横浜DeNAベイスターズの躍進を支えたAIプロダクト
Avatar for 画像センシングシンポジウム ssii
PRO
7
3.9k
電通総研の生成AI・エージェントの取り組み エンジニアリング業務向けAI活用事例紹介
Avatar for AITC - DENTSU SOKEN isidaitc
1
850
Computational OT #1 - Monge and Kantorovitch
Avatar for Gabriel Peyré gpeyre
0
230

Featured

See All Featured
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
Learning to Love Humans: Emotional Interface Design
Avatar for Aarron Walter aarron
273
40k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
Avatar for Dan Newman danielanewman
229
22k
Connecting the Dots Between Site Speed, User Experience & Your Business [WebExpo 2025]
Avatar for Tammy Everts tammyeverts
8
460
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
656
60k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
134
9.5k
jQuery: Nuts, Bolts and Bling
Avatar for Doug Neiner dougneiner
64
7.8k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
Avatar for Joe Casabona jcasabona
33
2.4k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
54
11k
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
49
3k
Intergalactic Javascript Robots from Outer Space
Avatar for Vicent Martí tanoku
272
27k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
207
24k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop