An-Operation-Network-for-Abstractive-Sentence-Compression.pdf

Transcript

1. An Operation Network for Abstractive Sentence Compression Naitong Yu, Jie

   Zhang, Minlie Huang, Xiaoyan Zhu The 27th International Conference on Computational Linguistics (COLING 2018) Nagaoka University of Technology Takumi Maruyama Literature review:

2. Introduction Ø %*, • % ("
   %+ Ø 2 

   • Delete-based approach • Generate-based approach Ø 0/- • %*, )&.$ • Delete-based approach Generate-based approach #
   State-of-the-art'!

3. Introduction Ø Delete-based approach • )+59G%?7”
   ”  • 5BC
   ”
   ”FE6 D2

   • “
   ” & 
   $(5BC@ Ø Generate-based approach • “=;”
   ”>A”, “.<”, “H)”& • ,4*
   ”=;”/0 8: Delete-based approachGenerate-based approach /' “=;”-) "!#31

4. Baselines Ø Seq2seq (generate-only model)

5. Baselines Ø Pointer-Generator (copy-and-generate model)

6. Method Ø Operation Network

7. Method Ø Delete decoder • • !" ∈ $, &

   '( : *+,
   ℎ.//01 '2320, 4( : 4512062 704258 0(6( ): 6(
   0;<0//.1=

8. Method Ø Copy-Generate decoder • Generate probability Generate mode
   Copy mode
   

   - Generate mode - Copy mode attention distribution   • Final probability distribution

9. Method Ø Copy-Generate decoder •

10. Dataset Ø Toutanova et al. (2016) • Business letters, news

    journals, technical documents • Training set: 21, 145 pairs Validation set: 1,908 pairs Test set: 3,370 pairs

11. Evaluation Metrics Ø Automatic evaluation • Compression Ratio • ROUGE

    (ROUGE-1, ROUGE-2, ROUGE-L) • BLEU Ø Manual evaluation • Grammaticality • Non-Redundancy

12. Results

13. Results

14. Conclusion Ø Delete-based approachGenerate-based approach    Ø Delete

    
      Ø Abstractive sentence compressionSOTA