Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
480

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
160
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
340
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.7k

Other Decks in Research

See All in Research
HU Berlin: Industrial-Strength Natural Language Processing with spaCy and Prodigy
Avatar for Ines Montani inesmontani
PRO
0
250
Any-Optical-Model: A Universal Foundation Model for Optical Remote Sensing
Avatar for SatAI.challenge satai
3
150
[SITA2025 Workshop] 空中計算による高速・低遅延な分散回帰分析
Avatar for Koya SATO k_sato
0
110
生成AI による論文執筆サポート・ワークショップ 論文執筆・推敲編 / Generative AI-Assisted Paper Writing Support Workshop: Drafting and Revision Edition
Avatar for Kenji Saito ks91
PRO
0
140
ローテーション別のサイドアウト戦略 ~なぜあのローテは回らないのか？~
Avatar for ぱんだ vball_panda
0
300
第66回コンピュータビジョン勉強会＠関東 Epona: Autoregressive Diffusion World Model for Autonomous Driving
Avatar for Kento Sasaki kentosasaki
0
440
空間音響処理における物理法則に基づく機械学習
Avatar for NII S. Koyama's Lab skoyamalab
0
230
FUSE-RSVLM: Feature Fusion Vision-Language Model for Remote Sensing
Avatar for SatAI.challenge satai
3
160
Agentic AI フレームワーク戦略白書 (2025年度版）
Avatar for MIKIO KUBO mickey_kubo
1
130
地域丸ごとデイサービス「Go トレ」の紹介
Avatar for SMARTふくしラボ smartfukushilab1
0
1k
データサイエンティストをめぐる環境の違い2025年版〈一般ビジネスパーソン調査の国際比較〉
Avatar for The Japan DataScientist Society datascientistsociety
PRO
0
870
衛星×エッジAI勉強会 衛星上におけるAI処理制約とそ取組について
Avatar for SatAI.challenge satai
3
220

Featured

See All Featured
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.6k
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
0
380
Odyssey Design
Avatar for Ryan Kendrick rkendrick25
PRO
2
530
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
59
50k
Agile that works and the tools we love
Avatar for Rasmus Luckow-Nielsen rasmusluckow
331
21k
Accessibility Awareness
Avatar for Sarah Abderemane sabderemane
0
71
Fireside Chat
Avatar for paigeccino paigeccino
41
3.8k
Jess Joyce - The Pitfalls of Following Frameworks
Avatar for Tech SEO Connect techseoconnect
PRO
1
92
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
370
Everyday Curiosity
Avatar for Cassini Nazir cassininazir
0
150
DBのスキルで生き残る技術 - AI時代におけるテーブル設計の勘所
Avatar for soudai sone soudai
PRO
62
50k
We Analyzed 250 Million AI Search Results: Here's What I Found
Avatar for Josh Blyskal joshbly
1
860

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop