Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Retrieve_rerank_and_rewrite_Soft_template_based...
Search
MARUYAMA
August 15, 2018
96
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Retrieve_rerank_and_rewrite_Soft_template_based_neural_summarization.pdf
MARUYAMA
August 15, 2018
Transcript
15 slides
Retrieve, Rerank and Rewrite: Soft Template Based Neural Summarization Ziqiang
Cao, Wenjie Li, Furu Wei, Sujian Li Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp.152-161, 2018 Nagaoka University of Technology Takumi Maruyama Literature review:
Ø template-based approachseq2seq Ø Informativeness, SOTA
Ø template ,
Ø “Seq2seq models tend to lose control sometimes” •
'# ( • '# )" Ø Template based summarization • -% • $+,template !* & Template: [REGION] shares [open/close] [NUMBER] percent [lower/higher]
Ø Soft-template based neural summarization • seq2seqtemplate •
… • Soft-templates
Ø Modules • Retrieve: • Rerank: Retrieve
• Rewrite: Rerank template
Ø Retrieve • Lucene (! ) • (over
3M) ! • "30 https://lucene.apache.org/
ØJointly Rerank and Rewrite • Rerank Bilinear networksaliency
• Rewrite x : , y*: , r : soft-templates (Retrieve ) Actual saliency : s*(r, y*) = ROUGE(r, y*) Saliency :
ØJointly Rerank and Rewrite • Learning
Ø Dataset Gigaword corpus
Ø Rerank -> Rewrite Rerank + Rewrite
Ø Soft-template"& Rondom ' First Retrieve ! $#
Max Retrieve %!$# , ROUGE$# Optimal %! ROUGE$# Rerank Rerank !$#
Ø Linguistic quality evaluation LEN_DIF !$& & &) LESS_3
3*(# & " COPY & & *( ' NEW_NE !$&& +% "
Ø template-based + seq2seq model Ø Soft-templates
,
None
None
More Decks by MARUYAMA
See All by MARUYAMA
vampire.pdf
tmaru0204
0
200
Misspelling_Oblivious_Word_Embedding.pdf
tmaru0204
0
210
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
tmaru0204
0
200
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
tmaru0204
0
180
20191028_literature-review.pdf
tmaru0204
0
170
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
tmaru0204
0
160
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
tmaru0204
0
190
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
tmaru0204
0
170
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
tmaru0204
0
190
Featured
See All Featured
What's in a price? How to price your products and services
michaelherold
247
13k
Save Time (by Creating Custom Rails Generators)
garrettdimon
PRO
33
5.8k
Crafting Experiences
bethany
1
450
Winning Ecommerce Organic Search in an AI Era - #searchnstuff2025
aleyda
2
2.2k
Agile Leadership in an Agile Organization
kimpetersen
PRO
0
320
Beyond borders and beyond the search box: How to win the global "messy middle" with AI-driven SEO
davidcarrasco
3
300
Between Models and Reality
mayunak
4
590
Rebuilding a faster, lazier Slack
samanthasiow
85
9.8k
Statistics for Hackers
jakevdp
799
230k
jQuery: Nuts, Bolts and Bling
dougneiner
66
8.7k
How to build a perfect <img>
jonoalderson
1
6.2k
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
mfonobong
2
640