Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
490

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
160
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
350
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.6k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.4k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.7k

Other Decks in Research

See All in Research
20年前に50代だった人たちの今
Avatar for marimari hysmrk
0
170
LLMアプリケーションの透明性について
Avatar for Yusuke Fukasawa fufufukakaka
0
200
2026年3月1日（日）福島「除染土」の公共利用をかんがえる
Avatar for Masano Atsuko atsukomasano2026
0
470
第66回コンピュータビジョン勉強会＠関東 Epona: Autoregressive Diffusion World Model for Autonomous Driving
Avatar for Kento Sasaki kentosasaki
0
500
2026年1月の生成AI領域の重要リリース＆トピック解説
Avatar for KAJI | 梶谷健人 kajikent
0
860
YOLO26_ Key Architectural Enhancements and Performance Benchmarking for Real-Time Object Detection
Avatar for SatAI.challenge satai
3
170
「なんとなく」の顧客理解から脱却する ──顧客の解像度を武器にするインサイトマネジメント
Avatar for 田島佳穂 tajima_kaho
10
7.1k
ForestCast: Forecasting Deforestation Risk at Scale with Deep Learning
Avatar for SatAI.challenge satai
3
560
COFFEE-Japan PROJECT Impact Report（海ノ向こうコーヒー）
Avatar for 坂ノ途中 ontheslope
0
1.1k
世界モデルにおける分布外データ対応の方法論
Avatar for Hidehisa Arai koukyo1994
7
2k
業界横断 副業コンプライアンス調査 三者（副業者・本業先・発注者）におけるトラブル認知ギャップの構造分析
Avatar for fkske fkske
0
1.2k
SREはサイバネティクスの夢をみるか？ / Do SREs Dream of Cybernetics?
Avatar for Yuuki Tsubouchi (yuuk1) yuukit
3
440

Featured

See All Featured
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
62
52k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
340
58k
Easily Structure & Communicate Ideas using Wireframe
Avatar for Afnizar Nur Ghifari afnizarnur
194
17k
Exploring the relationship between traditional SERPs and Gen AI search
Avatar for Ray Grieselhuber raygrieselhuber
PRO
2
3.7k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
247
13k
No one is an island. Learnings from fostering a developers community.
Avatar for Antonio thoeni
21
3.6k
Evolving SEO for Evolving Search Engines
Avatar for Ryan Jones ryanjones
0
170
How to Ace a Technical Interview
Avatar for Jacob Kaplan-Moss jacobian
281
24k
Exploring anti-patterns in Rails
Avatar for Elle Meredith aemeredith
2
290
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
320
It's Worth the Effort
Avatar for 3n 3n
188
29k
DevOps and Value Stream Thinking: Enabling flow, efficiency and business value
Avatar for Helen Beal helenjbeal
1
150

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop