Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Simple_Unsupervised_Summarization_by_Contextual...
Search
MARUYAMA
December 08, 2019
200
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
MARUYAMA
December 08, 2019
More Decks by MARUYAMA
See All by MARUYAMA
vampire.pdf
tmaru0204
0
200
Misspelling_Oblivious_Word_Embedding.pdf
tmaru0204
0
210
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
tmaru0204
0
180
20191028_literature-review.pdf
tmaru0204
0
170
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
tmaru0204
0
160
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
tmaru0204
0
190
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
tmaru0204
0
170
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
tmaru0204
0
180
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
tmaru0204
0
200
Featured
See All Featured
Building Flexible Design Systems
yeseniaperezcruz
330
41k
AI in Enterprises - Java and Open Source to the Rescue
ivargrimstad
0
1.5k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
17k
The Art of Delivering Value - GDevCon NA Keynote
reverentgeek
16
2.2k
How to Talk to Developers About Accessibility
jct
2
560
Leadership Guide Workshop - DevTernity 2021
reverentgeek
1
390
Self-Hosted WebAssembly Runtime for Runtime-Neutral Checkpoint/Restore in Edge–Cloud Continuum
chikuwait
0
860
Building Adaptive Systems
keathley
44
3.2k
Building the Perfect Custom Keyboard
takai
2
890
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
akihiro_kokubo
PRO
74
42k
How Software Deployment tools have changed in the past 20 years
geshan
2
35k
Fashionably flexible responsive web design (full day workshop)
malarkey
409
67k
Transcript
4JNQMF6OTVQFSWJTFE4VNNBSJ[BUJPO CZ$POUFYUVBM.BUDIJOH จݙհ
1BQFS ɾ"$- ɾIUUQTXXXBDMXFCPSHBOUIPMPHZ1 ɾQBHFTr
"CTUSBDU ⾣ͭͷݴޠϞσϧͷΈͷγϯϓϧͳڭࢣͳ͠ੜܕཁ ⾣ੜܕཁɾநग़ܕཁͷํͰ༗༻ੑΛࣔͨ͠ ɾ$POUFYUVBMNBUDIJOHNPEFM ɾ%PNBJOqVFODZNPEFM
*OUSPEVDUJPO ⾣ڭࢣͳ͠ཁ ⾣ෳࡶͳϞσϧɾֶशΛඞཁͱ͠ͳ͍ϞσϧΛఏҊ MFOHUIDPOUSPMMFEWBSJBUJPOBMBVUPFODPEFS HFOFSBUJWFBEWFSTBSJBMOFUXPSL ʜ FH
.PEFM ⾣ཁจɺ࣍ͷͭͷಛੑΛຬ͍ͨͯ͠Δඞཁ͕͋Δ ਖ਼֬ੑ 'BJUIGVMOFTT ݪจͷҙຯͱಉ༷ͷҙຯΛ࣋ͭ ྲྀெੑ 'MVFODZ จ๏తʹਖ਼͘͠ཧղͰ͖Δ P(y|x) ∝
pcm (y|x)pfm (y|x)λ ೖྗจॻ x ཁจ y ਖ਼֬ੑ pcm (y|x) ྲྀெੑ pfm (y|x)
$POUFYUVBM.BUDIJOH.PEFM ⾣ਖ਼֬ੑೖྗςΩετͱग़ྗ୯ޠͷίαΠϯྨࣅ pcm (y|x) = N ∏ n=1 qcm (yn
|y<n , x) ͱͨ͠ͱ͖ sω = maxj≥1 Sim(x1:j , ω) ͜͜Ͱ ग़ྗީิޠͱೖྗςΩετͱͷྨࣅΛ ω x1:j qcm (y1 = ω|x) = softmax(s)
$POUFYUVBM.BUDIJOH.PEFM ⾣ॲཧखॱ sω = maxj≥zn−1 Sim(x1:j , ω) ࣍ࣜΑΓ ྨࣅΛܭࢉ
zn−1 ʹରԠ͘ҐஔҎ͔߱͠ߟྀ͠ͳ͍ zn−1 yn−1 ୯ௐੑͷԾఆ ग़ྗ ୯ޠҐஔΛܭࢉ qcm zn ͕ೖྗจॻඌͱͳΔ·Ͱ܁Γฦ͠ zn
%PNBJO'MVFODZ.PEFM ⾣ྲྀெੑݴޠϞσϧ֬ ೖྗจॻʹదͨ͠ޠΛબ͢ΔΑ͏ग़ྗޠኮΛ੍ ݴޠϞσϧͷग़ྗޠኮ7ΛϘϩϊΠׂʹΑΓ੍͖ޠኮ$ʹϚοϐϯά ͋Δڑ্ۭؒͷҙͷҐஔʹஔ͞Εͨෳݸͷʢʣʹରͯ͠ɺ ಉҰڑ্ۭؒͷଞͷ͕Ͳͷʹ͍͔ۙʹΑͬͯྖҬ͚͞Εͨਤͷ͜ͱɻ IUUQTKBXJLJQFEJBPSHXJLJϘϩϊΠਤ 8JLJQFEJBϘϩϊΠਤ
%PNBJO'MVFODZ.PEFM ⾣ྲྀெੑݴޠϞσϧ֬ pfm (y|x) = N ∏ n=1 ∑ ω′∈N(yn
) lm(ω′|y<n ) ϘϊϩΠׂͷʹ ೖྗจॻ୯ޠΛ༻͍Δ ͷϘϩϊΠྖҬΛͱͨ͠ͱ͖ ݴޠϞσϧ֬ yn N(yn )
.PEFM ⾣ཁจɺ࣍ͷͭͷಛੑΛຬ͍ͨͯ͠Δඞཁ͕͋Δ ਖ਼֬ੑ 'BJUIGVMOFTT ݪจͷҙຯͱಉ༷ͷҙຯΛ࣋ͭ ྲྀெੑ 'MVFODZ จ๏తʹਖ਼͘͠ཧղͰ͖Δ P(y|x) ∝
pcm (y|x)pfm (y|x)λ ೖྗจॻ x ཁจ y ਖ਼֬ੑ pcm (y|x) ྲྀெੑ pfm (y|x)
&YQFSJNFOUBMTFUVQ ⾣.PEFM ⾣%BUBTFU ɾੜܕཁ&OHMJTI(JHBXPSEEBUB 3VTI ɾநग़ܕཁ(PPHMFEBUBTFU 'JMJQQPWB
ɾGPSXBSEMBOHVBHFNPEFMPG&-.P ɾMBZFST-45.NPEFM pcm (y|x) pfm (y|x)
2VBOUJUBUJWF3FTVMUT 5BCMFੜܕཁͷ݁Ռ 5BCMFநग़ܕཁͷ݁Ռ
"OBMZTJT ⾣ೖྗจॻͷ୯ޠநग़͚ͩͰͳ͘ ੜͰ͖͍ͯΔ
4VNNBSZ ⾣ͭͷݴޠϞσϧͷΈͷγϯϓϧͳڭࢣͳ͠ੜܕཁ ⾣ੜܕཁɾநग़ܕཁͷํͰ༗༻ੑΛࣔͨ͠ ɾ$POUFYUVBMNBUDIJOHNPEFM ɾ%PNBJOqVFODZNPEFM
None