Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
440

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
990
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
130
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
310
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.5k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.3k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.5k

Other Decks in Research

See All in Research
[RSJ25] Enhancing VLA Performance in Understanding and Executing Free-form Instructions via Visual Prompt-based Paraphrasing
Avatar for Semantic Machine Intelligence Lab., Keio Univ. keio_smilab
PRO
0
100
VectorLLM: Human-like Extraction of Structured Building Contours via Multimodal LLMs
Avatar for SatAI.challenge satai
4
190
国際論文を出そう！ICRA / IROS / RA-L への論文投稿の心構えとノウハウ / RSJ2025 Luncheon Seminar
Avatar for koide3 koide3
6
4.5k
Adaptive Experimental Design for Efficient Average Treatment Effect Estimation and Treatment Choice
Avatar for MasaKat0 masakat0
0
160
Agentic AIとMCPを利用したサービス作成入門
Avatar for MIKIO KUBO mickey_kubo
0
530
引力・斥力を制御可能なランダム部分集合の確率分布
Avatar for Takahiro Kawashima wasyro
0
240
能動適応的実験計画
Avatar for MasaKat0 masakat0
2
810
Language Models Are Implicitly Continuous
Avatar for Sho Yokoi eumesy
PRO
0
230
SSII2025 [TS3] 医工連携における画像情報学研究
Avatar for 画像センシングシンポジウム ssii
PRO
2
1.3k
集合間Bregmanダイバージェンスと置換不変NNによるその学習
Avatar for Takahiro Kawashima wasyro
0
140
【緊急警告】日本の未来設計図 ～沈没か、再生か。国民と断行するラストチャンス～
Avatar for 高木祐介 yuutakasan
0
150
心理言語学の視点から再考する言語モデルの学習過程
Avatar for Masato Mita chemical_tree
2
580

Featured

See All Featured
Building a Scalable Design System with Sketch
Avatar for Laura Van Doore lauravandoore
462
33k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
411
22k
Fantastic passwords and where to find them - at NoRuKo
Avatar for Phil Nash philnash
52
3.4k
4 Signs Your Business is Dying
Avatar for Josh Pigford shpigford
184
22k
It's Worth the Effort
Avatar for 3n 3n
187
28k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
The Cult of Friendly URLs
Avatar for Andy Hume andyhume
79
6.6k
Optimizing for Happiness
Avatar for Tom Preston-Werner mojombo
379
70k
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
18
1.1k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1370
200k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
70
11k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
Avatar for Irina Nazarova irinanazarova
8
920

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop