Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
440

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
970
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
130
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
300
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.5k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.3k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.5k

Other Decks in Research

See All in Research
GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localization
Avatar for SatAI.challenge satai
3
270
2025年度 生成AIの使い方/接し方
Avatar for taichi_murayama hkefka385
1
740
20250725-bet-ai-day
Avatar for cipepser cipepser
2
300
なめらかなシステムと運用維持の終わらぬ未来 / dicomo2025_coherently_fittable_system
Avatar for monochromegane monochromegane
0
1.3k
NLP Colloquium
Avatar for Juno Kim junokim
1
170
時系列データに対する解釈可能な 決定木クラスタリング
Avatar for MIKIO KUBO mickey_kubo
2
810
Principled AI ～深層学習時代における課題解決の方法論～
Avatar for Tatsunori Taniai taniai
3
1.2k
【緊急警告】日本の未来設計図 ～沈没か、再生か。国民と断行するラストチャンス～
Avatar for 高木祐介 yuutakasan
0
140
公立高校入試等に対する受入保留アルゴリズム（DA）導入の提言
Avatar for Shunya Noda shunyanoda
0
6.3k
IMC の細かすぎる話 2025
Avatar for @smly smly
2
430
Trust No Bot? Forging Confidence in AI for Software Engineering
Avatar for Thomas Zimmermann tomzimmermann
1
250
When Submarine Cables Go Dark: Examining the Web Services Resilience Amid Global Internet Disruptions
Avatar for Irvin Chen irvin
0
260

Featured

See All Featured
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
411
22k
Git: the NoSQL Database
Avatar for Brandon Keepers bkeepers
PRO
431
65k
Reflections from 52 weeks, 52 projects
Avatar for Jefferson Lam jeffersonlam
351
21k
[RailsConf 2023] Rails as a piece of cake
Avatar for Vladimir Dementyev palkan
55
5.7k
Rails Girls Zürich Keynote
Avatar for Gregor Martynus gr2m
95
14k
Six Lessons from altMBA
Avatar for Skipper Chong Warson skipperchong
28
3.9k
Save Time (by Creating Custom Rails Generators)
Avatar for Garrett Dimon garrettdimon
PRO
31
1.3k
KATA
Avatar for Megan Lloyd mclloyd
30
14k
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
58
9.5k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
The Psychology of Web Performance [Beyond Tellerrand 2023]
Avatar for Tammy Everts tammyeverts
48
2.9k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop