Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Simple_Unsupervised_Summarization_by_Contextual...

Avatar for MARUYAMA MARUYAMA
December 08, 2019
0
170

 Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf

Avatar for MARUYAMA

MARUYAMA

December 08, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
170
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
180
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
160
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
140
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
130
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
160
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
Avatar for MARUYAMA tmaru0204
0
150
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
Avatar for MARUYAMA tmaru0204
0
190

Featured

See All Featured
Improving Core Web Vitals using Speculation Rules API
Avatar for Sergey Chernyshev sergeychernyshev
16
940
Making Projects Easy
Avatar for Brett Harned brettharned
116
6.3k
How GitHub (no longer) Works
Avatar for Zach Holman holman
314
140k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
Avatar for Rebecca Miller-Webster rmw
34
3k
The Cost Of JavaScript in 2023
Avatar for Addy Osmani addyosmani
51
8.4k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
411
22k
Scaling GitHub
Avatar for Zach Holman holman
459
140k
Documentation Writing (for coders)
Avatar for Carmen Chung carmenintech
71
4.9k
Fashionably flexible responsive web design (full day workshop)
Avatar for Andy Clarke malarkey
407
66k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.3k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
Avatar for Stéphanie Walter stephaniewalter
281
13k
Code Review Best Practice
Avatar for Trisha Gee trishagee
68
18k

Transcript

  1. 4JNQMF6OTVQFSWJTFE4VNNBSJ[BUJPO CZ$POUFYUVBM.BUDIJOH จݙ঺հ

  2. 1BQFS ɾ"$- ɾIUUQTXXXBDMXFCPSHBOUIPMPHZ1 ɾQBHFTr

  3. "CTUSBDU ⾣ͭͷݴޠϞσϧͷΈͷγϯϓϧͳڭࢣͳ͠ੜ੒ܕཁ໿ ⾣ੜ੒ܕཁ໿ɾநग़ܕཁ໿ͷ૒ํͰ༗༻ੑΛࣔͨ͠ ɾ$POUFYUVBMNBUDIJOHNPEFM ɾ%PNBJOqVFODZNPEFM

  4. *OUSPEVDUJPO ⾣ڭࢣͳ͠ཁ໿ ⾣ෳࡶͳϞσϧɾֶशΛඞཁͱ͠ͳ͍ϞσϧΛఏҊ MFOHUIDPOUSPMMFEWBSJBUJPOBMBVUPFODPEFS HFOFSBUJWFBEWFSTBSJBMOFUXPSL ʜ FH 

  5. .PEFM ⾣ཁ໿จ͸ɺ࣍ͷͭͷಛੑΛຬ͍ͨͯ͠Δඞཁ͕͋Δ ਖ਼֬ੑ 'BJUIGVMOFTT ݪจͷҙຯͱಉ༷ͷҙຯΛ࣋ͭ ྲྀெੑ 'MVFODZ จ๏తʹਖ਼͘͠ཧղͰ͖Δ P(y|x) ∝

    pcm (y|x)pfm (y|x)λ ೖྗจॻ x ཁ໿จ y ਖ਼֬ੑ pcm (y|x) ྲྀெੑ pfm (y|x)

  6. $POUFYUVBM.BUDIJOH.PEFM ⾣ਖ਼֬ੑೖྗςΩετͱग़ྗ୯ޠͷίαΠϯྨࣅ౓ pcm (y|x) = N ∏ n=1 qcm (yn

    |y<n , x) ͱͨ͠ͱ͖  sω = maxj≥1 Sim(x1:j , ω) ͜͜Ͱ ग़ྗީิޠͱೖྗςΩετͱͷྨࣅ౓Λ ω x1:j qcm (y1 = ω|x) = softmax(s)

  7. $POUFYUVBM.BUDIJOH.PEFM ⾣ॲཧखॱ sω = maxj≥zn−1 Sim(x1:j , ω) ࣍ࣜΑΓ ྨࣅ౓Λܭࢉ

    zn−1 ʹରԠ෇͘ҐஔҎ͔߱͠ߟྀ͠ͳ͍ zn−1 yn−1 ୯ௐੑͷԾఆ ग़ྗ෼෍ ୯ޠҐஔΛܭࢉ qcm zn ͕ೖྗจॻ຤ඌͱͳΔ·Ͱ܁Γฦ͠ zn

  8. %PNBJO'MVFODZ.PEFM ⾣ྲྀெੑݴޠϞσϧ֬཰ ೖྗจॻʹదͨ͠ޠΛબ୒͢ΔΑ͏ग़ྗޠኮΛ੍໿ ݴޠϞσϧͷग़ྗޠኮ7ΛϘϩϊΠ෼ׂʹΑΓ੍໿෇͖ޠኮ$ʹϚοϐϯά ͋Δڑ཭্ۭؒͷ೚ҙͷҐஔʹ഑ஔ͞Εͨෳ਺ݸͷ఺ʢ฼఺ʣʹରͯ͠ɺ ಉҰڑ཭্ۭؒͷଞͷ఺͕Ͳͷ฼఺ʹ͍͔ۙʹΑͬͯྖҬ෼͚͞Εͨਤͷ͜ͱɻ IUUQTKBXJLJQFEJBPSHXJLJϘϩϊΠਤ 8JLJQFEJBϘϩϊΠਤ

  9. %PNBJO'MVFODZ.PEFM ⾣ྲྀெੑݴޠϞσϧ֬཰ pfm (y|x) = N ∏ n=1 ∑ ω′∈N(yn

    ) lm(ω′|y<n ) ϘϊϩΠ෼ׂͷ฼఺ʹ͸ ೖྗจॻ୯ޠΛ༻͍Δ ͷϘϩϊΠྖҬΛͱͨ͠ͱ͖ ݴޠϞσϧ֬཰͸  yn N(yn )

  10. .PEFM ⾣ཁ໿จ͸ɺ࣍ͷͭͷಛੑΛຬ͍ͨͯ͠Δඞཁ͕͋Δ ਖ਼֬ੑ 'BJUIGVMOFTT ݪจͷҙຯͱಉ༷ͷҙຯΛ࣋ͭ ྲྀெੑ 'MVFODZ จ๏తʹਖ਼͘͠ཧղͰ͖Δ P(y|x) ∝

    pcm (y|x)pfm (y|x)λ ೖྗจॻ x ཁ໿จ y ਖ਼֬ੑ pcm (y|x) ྲྀெੑ pfm (y|x)

  11. &YQFSJNFOUBMTFUVQ ⾣.PEFM ⾣%BUBTFU ɾੜ੒ܕཁ໿&OHMJTI(JHBXPSEEBUB 3VTI   ɾநग़ܕཁ໿(PPHMFEBUBTFU 'JMJQQPWB 

     ɾGPSXBSEMBOHVBHFNPEFMPG&-.P ɾMBZFST-45.NPEFM pcm (y|x) pfm (y|x)

  12. 2VBOUJUBUJWF3FTVMUT 5BCMFੜ੒ܕཁ໿ͷ݁Ռ 5BCMFநग़ܕཁ໿ͷ݁Ռ

  13. "OBMZTJT ⾣ೖྗจॻͷ୯ޠநग़͚ͩͰͳ͘ ੜ੒Ͱ͖͍ͯΔ

  14. 4VNNBSZ ⾣ͭͷݴޠϞσϧͷΈͷγϯϓϧͳڭࢣͳ͠ੜ੒ܕཁ໿ ⾣ੜ੒ܕཁ໿ɾநग़ܕཁ໿ͷ૒ํͰ༗༻ੑΛࣔͨ͠ ɾ$POUFYUVBMNBUDIJOHNPEFM ɾ%PNBJOqVFODZNPEFM

  15. None