Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=47 MARUYAMA
December 08, 2019
0
62

 Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=128

MARUYAMA

December 08, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
69
Misspelling_Oblivious_Word_Embedding.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
52
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
61
20191028_literature-review.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
63
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
46
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
61
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
56
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
48
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
85

Featured

See All Featured
Ruby is Unlike a Banana
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
91
9.2k
Automating Front-end Workflow
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
1351
200k
Debugging Ruby Performance
D47656e20ff5e42f125fc5ea0fd636c6?s=48 tmm1
65
10k
We Have a Design System, Now What?
95d9f37115fbb0d13135d0f77132f856?s=48 morganepeng
35
2.9k
Teambox: Starting and Learning
Aebc2d07a50011e2a30d38435fde564a?s=48 jrom
121
7.6k
Docker and Python
Ecdea9b9714877b86cee08458f085481?s=48 trallard
27
1.5k
Creating an realtime collaboration tool: Agile Flush - .NET Oxford
Fd55de4174accaf3b4f030e43a8a70c6?s=48 marcduiker
4
450
JavaScript: Past, Present, and Future - NDC Porto 2020
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
37
3.2k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
F383c6a4dc55e331bbe2987b622cee6b?s=48 stephaniewalter
268
11k
A Philosophy of Restraint
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
192
14k
Clear Off the Table
Ef32e0b1ac5082450dc8c1fca3a26b5c?s=48 cherdarchuk
79
280k
Dealing with People You Can't Stand - Big Design 2015
44b54d2ffcb7857004071cc6795dde11?s=48 cassininazir
350
21k

Transcript

  1. 4JNQMF6OTVQFSWJTFE4VNNBSJ[BUJPO CZ$POUFYUVBM.BUDIJOH จݙ঺հ

  2. 1BQFS ɾ"$- ɾIUUQTXXXBDMXFCPSHBOUIPMPHZ1 ɾQBHFTr

  3. "CTUSBDU ⾣ͭͷݴޠϞσϧͷΈͷγϯϓϧͳڭࢣͳ͠ੜ੒ܕཁ໿ ⾣ੜ੒ܕཁ໿ɾநग़ܕཁ໿ͷ૒ํͰ༗༻ੑΛࣔͨ͠ ɾ$POUFYUVBMNBUDIJOHNPEFM ɾ%PNBJOqVFODZNPEFM

  4. *OUSPEVDUJPO ⾣ڭࢣͳ͠ཁ໿ ⾣ෳࡶͳϞσϧɾֶशΛඞཁͱ͠ͳ͍ϞσϧΛఏҊ MFOHUIDPOUSPMMFEWBSJBUJPOBMBVUPFODPEFS HFOFSBUJWFBEWFSTBSJBMOFUXPSL ʜ FH 

  5. .PEFM ⾣ཁ໿จ͸ɺ࣍ͷͭͷಛੑΛຬ͍ͨͯ͠Δඞཁ͕͋Δ ਖ਼֬ੑ 'BJUIGVMOFTT ݪจͷҙຯͱಉ༷ͷҙຯΛ࣋ͭ ྲྀெੑ 'MVFODZ จ๏తʹਖ਼͘͠ཧղͰ͖Δ P(y|x) ∝

    pcm (y|x)pfm (y|x)λ ೖྗจॻ x ཁ໿จ y ਖ਼֬ੑ pcm (y|x) ྲྀெੑ pfm (y|x)

  6. $POUFYUVBM.BUDIJOH.PEFM ⾣ਖ਼֬ੑೖྗςΩετͱग़ྗ୯ޠͷίαΠϯྨࣅ౓ pcm (y|x) = N ∏ n=1 qcm (yn

    |y<n , x) ͱͨ͠ͱ͖  sω = maxj≥1 Sim(x1:j , ω) ͜͜Ͱ ग़ྗީิޠͱೖྗςΩετͱͷྨࣅ౓Λ ω x1:j qcm (y1 = ω|x) = softmax(s)

  7. $POUFYUVBM.BUDIJOH.PEFM ⾣ॲཧखॱ sω = maxj≥zn−1 Sim(x1:j , ω) ࣍ࣜΑΓ ྨࣅ౓Λܭࢉ

    zn−1 ʹରԠ෇͘ҐஔҎ͔߱͠ߟྀ͠ͳ͍ zn−1 yn−1 ୯ௐੑͷԾఆ ग़ྗ෼෍ ୯ޠҐஔΛܭࢉ qcm zn ͕ೖྗจॻ຤ඌͱͳΔ·Ͱ܁Γฦ͠ zn

  8. %PNBJO'MVFODZ.PEFM ⾣ྲྀெੑݴޠϞσϧ֬཰ ೖྗจॻʹదͨ͠ޠΛબ୒͢ΔΑ͏ग़ྗޠኮΛ੍໿ ݴޠϞσϧͷग़ྗޠኮ7ΛϘϩϊΠ෼ׂʹΑΓ੍໿෇͖ޠኮ$ʹϚοϐϯά ͋Δڑ཭্ۭؒͷ೚ҙͷҐஔʹ഑ஔ͞Εͨෳ਺ݸͷ఺ʢ฼఺ʣʹରͯ͠ɺ ಉҰڑ཭্ۭؒͷଞͷ఺͕Ͳͷ฼఺ʹ͍͔ۙʹΑͬͯྖҬ෼͚͞Εͨਤͷ͜ͱɻ IUUQTKBXJLJQFEJBPSHXJLJϘϩϊΠਤ 8JLJQFEJBϘϩϊΠਤ

  9. %PNBJO'MVFODZ.PEFM ⾣ྲྀெੑݴޠϞσϧ֬཰ pfm (y|x) = N ∏ n=1 ∑ ω′∈N(yn

    ) lm(ω′|y<n ) ϘϊϩΠ෼ׂͷ฼఺ʹ͸ ೖྗจॻ୯ޠΛ༻͍Δ ͷϘϩϊΠྖҬΛͱͨ͠ͱ͖ ݴޠϞσϧ֬཰͸  yn N(yn )

  10. .PEFM ⾣ཁ໿จ͸ɺ࣍ͷͭͷಛੑΛຬ͍ͨͯ͠Δඞཁ͕͋Δ ਖ਼֬ੑ 'BJUIGVMOFTT ݪจͷҙຯͱಉ༷ͷҙຯΛ࣋ͭ ྲྀெੑ 'MVFODZ จ๏తʹਖ਼͘͠ཧղͰ͖Δ P(y|x) ∝

    pcm (y|x)pfm (y|x)λ ೖྗจॻ x ཁ໿จ y ਖ਼֬ੑ pcm (y|x) ྲྀெੑ pfm (y|x)

  11. &YQFSJNFOUBMTFUVQ ⾣.PEFM ⾣%BUBTFU ɾੜ੒ܕཁ໿&OHMJTI(JHBXPSEEBUB 3VTI   ɾநग़ܕཁ໿(PPHMFEBUBTFU 'JMJQQPWB 

     ɾGPSXBSEMBOHVBHFNPEFMPG&-.P ɾMBZFST-45.NPEFM pcm (y|x) pfm (y|x)

  12. 2VBOUJUBUJWF3FTVMUT 5BCMFੜ੒ܕཁ໿ͷ݁Ռ 5BCMFநग़ܕཁ໿ͷ݁Ռ

  13. "OBMZTJT ⾣ೖྗจॻͷ୯ޠநग़͚ͩͰͳ͘ ੜ੒Ͱ͖͍ͯΔ

  14. 4VNNBSZ ⾣ͭͷݴޠϞσϧͷΈͷγϯϓϧͳڭࢣͳ͠ੜ੒ܕཁ໿ ⾣ੜ੒ܕཁ໿ɾநग़ܕཁ໿ͷ૒ํͰ༗༻ੑΛࣔͨ͠ ɾ$POUFYUVBMNBUDIJOHNPEFM ɾ%PNBJOqVFODZNPEFM

  15. None