Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
500
1

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1.1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
180
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
370
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.8k

Other Decks in Research

See All in Research
HackSick vol.7 LT資料【LLMアーキテクチャ入門・事前学習時の躓き所解説】 スパースなAttention・状態空間モデル
Avatar for Rikka Botan rikkabotan7
0
130
Dual Quadric表現を用いた動的物体追跡とRGB-D・IMU制約の密結合によるオドメトリ推定
Avatar for Toyozo Shimada nanoshimarobot
0
480
「AIとWhyを深堀る」をAIと深堀る
Avatar for なつ iflection
0
540
AIを叩き台として、 「検証」から「共創」へと進化するリサーチ
Avatar for めーら/Miki mela_dayo
0
320
IA for theory
Avatar for Gabriel Peyré gpeyre
0
310
AGI4OPT:自然言語から数理最適化を導くエ ージェントスキル Translating Human Intent into Mathematical Optimization
Avatar for MIKIO KUBO mickey_kubo
0
170
nlp2026 In-Context Learningに基づく経路案内のための地理的知識の活用方法に関する検討
Avatar for Takashi INUI takashiinui
0
120
Harness Engineering and Al Agent
Avatar for Kazuki Inamura kzinmr
3
1.9k
第64回CV・PRML勉強会　論文紹介：Linguistic Priors for Visual Decoupling: Towards Symmetric Vision-Brain Alignment
Avatar for Soki Katayama sokikatayama
0
150
SOTAのさらに先へ：厳しい推論制約下での高性能モデルのPost-Training
Avatar for Hiroshi Y (RabotniKuma) analokmaus
0
1.4k
Data Visualization Tools in the Age of AI
Avatar for Fritz Lekschas flekschas
0
180
Unified Audio Source Separation (Defense Slides)
Avatar for Kohei Saijo kohei_1979
1
640

Featured

See All Featured
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
Avatar for AKADEMIYA2063 akademiya2063
PRO
1
190
WENDY [Excerpt]
Avatar for Tessa Abrams tessaabrams
11
39k
Mozcon NYC 2025: Stop Losing SEO Traffic
Avatar for Sam Torres samtorres
1
460
Unlocking the hidden potential of vector embeddings in international SEO
Avatar for Frank van Dijk frankvandijk
0
890
Designing Powerful Visuals for Engaging Learning
Avatar for Mike Taylor tmiket
1
470
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
Avatar for Tomoya Matsuura tomoyanonymous
3
1.1k
Collaborative Software Design: How to facilitate domain modelling decisions
Avatar for Kenny Baas-Schwegler baasie
1
270
Rebuilding a faster, lazier Slack
Avatar for samanthasiow samanthasiow
85
9.6k
The Language of Interfaces
Avatar for Des Traynor destraynor
162
27k
Have SEOs Ruined the Internet? - User Awareness of SEO in 2025
Avatar for Akash Hashmi akashhashmi
0
410
The Director’s Chair: Orchestrating AI for Truly Effective Learning
Avatar for Mike Taylor tmiket
1
250
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
31
2.8k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop