Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
1
430

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.
Avatar for Leland McInnes

Leland McInnes

July 12, 2019
Tweet

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
960
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
120
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
290
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.5k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.3k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.4k

Other Decks in Research

See All in Research
Vision And Languageモデルにおける異なるドメインでの継続事前学習が性能に与える影響の検証 / YANS2024
Avatar for Sansan R&D sansan_randd
1
100
生成的推薦の人気バイアスの分析：暗記の観点から / JSAI2025
Avatar for Shotaro Ishihara upura
0
150
LLM-as-a-Judge: 文章をLLMで評価する@教育機関DXシンポ
Avatar for Kouta Nakayama k141303
3
800
大規模日本語VLM Asagi-VLMにおける合成データセットの構築とモデル実装
Avatar for Kohei Uehara kuehara
5
2.3k
SSII2025 [TS2] リモートセンシング画像処理の最前線
Avatar for 画像センシングシンポジウム ssii
PRO
7
2.7k
言語モデルによるAI創薬の進展 / Advancements in AI-Driven Drug Discovery Using Language Models
Avatar for tsurubee tsurubee
2
360
20250605_新交通システム推進議連_熊本都市圏「車1割削減、渋滞半減、公共交通2倍」から考える地方都市交通政策
Avatar for Traffic Brain trafficbrain
0
240
RapidPen: AIエージェントによるペネトレーションテスト 初期侵入全自動化の研究
Avatar for Sho Nakatani laysakura
0
1.4k
定性データ、どう活かす？ 〜定性データのための分析基盤、はじめました〜 / How to utilize qualitative data? ~We have launched an analysis platform for qualitative data~
Avatar for 株式会社カミナシ kaminashi
6
1k
(NULLCON Goa 2025)Windows Keylogger Detection: Targeting Past and Present Keylogging Techniques
Avatar for Asuka Nakajima asuna_jp
1
510
業界横断 副業・兼業者の実態調査
Avatar for fkske fkske
0
120
ノンパラメトリック分布表現を用いた位置尤度場周辺化によるRTK-GNSSの整数アンビギュイティ推定
Avatar for aoki nosse aoki_nosse
0
310

Featured

See All Featured
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
71
11k
Raft: Consensus for Rubyists
Avatar for Patrick Van Stee vanstee
139
7k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
29
9.5k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
45
7.3k
XXLCSS - How to scale CSS and keep your sanity
Avatar for Zaharenia Atzitzikaki sugarenia
248
1.3M
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
281
13k
Distributed Sagas: A Protocol for Coordinating Microservices
Avatar for Caitie McCaffrey caitiem20
331
22k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
329
24k
Art, The Web, and Tiny UX
Avatar for Lynn Fisher lynnandtonic
299
21k
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
30
5.8k
Stop Working from a Prison Cell
Avatar for Chris Michel hatefulcrawdad
269
20k
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
407
66k

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop