文献紹介 10月3日

Gaussian LDA for Topic Models with Word Embeddings

Transcript

1. ) ( Gaussian LDA for Topic Models with Word Embeddings
2. 
   ▪ 
   ▪ Rajarshi Das, Manzil Zaheer, Chris Dyer. ▪ Gaussian LDA for Topic Models with Word Embeddings. ▪ Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, pages 795– 804. 2015. ▪  ▪ LDA, Word2Vec 2
3. 
    ▪ ML V P e W WV Lr A ▪ o 2 I D V L 3
4. 
    ▪ L ▪ L ▪ D D ▪ LDA L A 4
5. 
    ▪ LDA
      %$&'# ▪ WordEmbedding 
      5
6. 
    ▪ LDA (Latent Dirichlet Allocation) ▪ '#%)  ,(- ▪   )+&$ )+&$  ,(- ! "# $#,& '#,& () *     d 
       d n   d n k
       
7. 
    ▪ LDA (Latent Dirichlet Allocation) ▪ '#%)  ,(- ▪   )+&$ )+&$  ,(-
8. 
    ▪ Gaussian LDA ▪  
   
    ▪    ! "# $#,& '#,& () , Σ) (, +, ,, -     d 
       d n   d n   k
       
9. 
    ▪ Gaussian LDA ▪  
   
    ▪   
10. 
    ▪ Wikipedia*PMI0$ ▪ 6843*&PMI0 # #$ & ▪  !"/,!-( ) . ▪ Word2Vec+Wikipedia*& ▪ 684395:+20-NEWSGROUP'NIPS0
11. 
    11
12. 
     ▪ 2 V ▪ L D A ▪ 12