Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
500
1

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1.1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
180
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
380
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.8k

Other Decks in Research

See All in Research
ros2-perf-multihost: 分散システムにおける客観的なアーキテクチャ評価フレームワーク
Avatar for takasehideki takasehideki
0
220
全国町字単位空き家率推定データver1.0データ仕様
Avatar for microbase microbaseinc
0
190
LLM Compute Infrastructure Overview
Avatar for KARAKURI Inc. karakurist
2
1.6k
【ローカルAIに向き合う展示会vol.2】液体時間定数型モジュールを用いた オリジナルの双方向エンコーダーモデルNexteraBERT 推論速度向上検討並びにダウンストリーム評価
Avatar for Rikka Botan rikkabotan7
0
170
NLP colloquium: AI Safety Survey
Avatar for Masahiro Kaneko kanekomasahiro
1
1k
【中間報告】国会議員の立法・政策実務を支える環境を巡る現状と課題
Avatar for 株式会社PoliPoli/PoliPoli.Inc polipoli
0
490
2026年度 生成AI を活用した論文執筆ガイド／ワークショップ / 2026 Academic Year Guide to Writing Papers Using Generative AI - Workshop
Avatar for Kenji Saito ks91
PRO
0
210
Vector Map as Language: Toward Unified Remote Sensing Vector Mapping
Avatar for SatAI.challenge satai
3
200
LA-Bench 2025：実験指示から 実行可能手順を生成するためのデータセット/LA-Bench 2025: A Dataset for Generating Executable Experimental Procedures from Experimental Instructions
Avatar for Shota Kato stktu
0
140
某助成金プロジェクト採択に向けて企業研究所のアウトリーチ専任者がやったこと
Avatar for afroscript afroscript
0
170
Spatial Active Noise Control Based on Sound Field Interpolation Incorporating Physical Constraints
Avatar for NII S. Koyama's Lab skoyamalab
0
160
進学校の生徒にはア行の苗字が多いのか
Avatar for Takashi Ozeki ozekinote
0
540

Featured

See All Featured
svc-hook: hooking system calls on ARM64 by binary rewriting
Avatar for Akira Moroo retrage
2
520
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
52
6k
WENDY [Excerpt]
Avatar for Tessa Abrams tessaabrams
11
39k
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k
The Hidden Cost of Media on the Web [PixelPalooza 2025]
Avatar for Tammy Everts tammyeverts
2
470
Fireside Chat
Avatar for paigeccino paigeccino
42
4k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
12k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
35
3.8k
Leo the Paperboy
Avatar for Maya Tellez mayatellez
8
2.2k
SEO in 2025: How to Prepare for the Future of Search
Avatar for Michael King ipullrank
3
3.8k
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
1
530
Google's AI Overviews - The New Search
Avatar for Barry Adams badams
0
1.1k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop