Upgrade to Pro — share decks privately, control downloads, hide ads and more …
Sign up for free

Ensemble Topic Modelling

Avatar for Leland McInnes Leland McInnes
July 12, 2019
Research
500
1

Ensemble Topic Modelling

A short lightning talk on ensemble topic modelling with pLSA using the enstop package.

Avatar for Leland McInnes

Leland McInnes

July 12, 2019

More Decks by Leland McInnes

See All by Leland McInnes
PyNNDescent: Fast Approximate Nearest Neighbors with Numba
Avatar for Leland McInnes lmcinnes
0
1.1k
Word and Document Embeddings
Avatar for Leland McInnes lmcinnes
0
180
Topological Data Analysis
Avatar for Leland McInnes lmcinnes
1
380
Learning Topology: topological methods for unsupervised learning
Avatar for Leland McInnes lmcinnes
2
3.7k
A Guide to Dimension Reduction
Avatar for Leland McInnes lmcinnes
3
1.5k
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction
Avatar for Leland McInnes lmcinnes
2
2.8k

Other Decks in Research

See All in Research
Research Engineerという仕事 / Research Engineering: Bridging Research and Business
Avatar for chck chck
1
310
高性能計算機クラスタを用いた大規模点群処理による森林の単木抽出と構造解析
Avatar for Kenta Itakura kentaitakura
1
130
COMETAを用いたデータ民主化運動の歴史
Avatar for Kazuya Mori sazimai
0
250
JPA2026_NetworkTutorial_JunKashihara
Avatar for JunKashihara junkashihara
0
160
マーケットストリート 社会実験2024 in 秋葉原ジャンク通り 調査報告書
Avatar for 日本大学 都市計画研究室（泉山ゼミ） izumiyama_lab
1
140
実例から見るLLMのマンガ理解：実務VQAタスクによる長期的文脈と視覚情報の定性評価
Avatar for kzmssk kzmssk
0
130
クラウド・AI 時代の研究開発 DX / R&D Digital Transformation
Avatar for Yoshitaka Haribara hariby
0
140
【Zozo Research 技術共有会】三次元領域の現在と展望
Avatar for 小島瑞貴 mickey_0226
3
610
Source Code Diff Revolution
Avatar for Nikolaos Tsantalis tsantalis
0
150
HAKARI-Bench - 実運用視点での情報検索モデル評価ベンチマーク
Avatar for Yuichi Tateno hotchpotch
1
740
某助成金プロジェクト採択に向けて企業研究所のアウトリーチ専任者がやったこと
Avatar for afroscript afroscript
0
180
GLIM とMegaParticles：正規分布近似の限界とタイトカップリング＆パーティクルフィルタの進展 / GLIM and MegaParticles : Progress of the distribution representation in SLAM
Avatar for koide3 koide3
0
840

Featured

See All Featured
Ethics towards AI in product and experience design
Avatar for Skipper Chong Warson skipperchong
2
370
Visualization
Avatar for Eitan Lees eitanlees
152
17k
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
490
How to audit for AI Accessibility on your Front & Back End
Avatar for davetheseo davetheseo
0
540
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
Avatar for Ines Montani inesmontani
PRO
3
2.4k
How to Get Subject Matter Experts Bought In and Actively Contributing to SEO & PR Initiatives.
Avatar for Liv Day livdayseo
0
200
GraphQLの誤解/rethinking-graphql
Avatar for sonatard sonatard
75
12k
The AI Search Optimization Roadmap by Aleyda Solis
Avatar for Aleyda Solis aleyda
1
6.2k
Reality Check: Gamification 10 Years Later
Avatar for Sebastian Deterding codingconduct
0
2.3k
Organizational Design Perspectives: An Ontology of Organizational Design Elements
Avatar for Dr. Kim W Petersen kimpetersen
PRO
1
830
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
4.4k
Stewardship and Sustainability of Urban and Community Forests
Avatar for Eric Wiseman pwiseman
0
520

Transcript

  1. Ensemble Topic Modelling Leland McInnes

  2. Model a corpus of documents in terms of underlying “topics”

  3. Topic Modelling as Matrix Factorization

  4. None
  5. None
  6. None
  7. None

  8. LDA and pLSA are probabilistic matrix factorization methods

  9. (Ensembles of) pLSA

  10. Performance?

  11. None

  12. Quality?

  13. None

  14. Instability?

  15. These are hard optimization problems

  16. Topics vary from one run to another

  17. What are the stable topics? Inspired by https://github.com/RaRe-Technologies/gensim/pull/2282

  18. None

  19. Each cluster represents a stable topic

  20. None

  21. • Greater stability • Determines number of topics automatically •

    Embarrassingly parallel computation

  22. Implementation

  23. sklearn API

  24. None

  25. https://github.com/lmcinnes/enstop

  26. pip install enstop