文献紹介: Similarity-Based Reconstruction Loss for Meaning Representation

Transcript

1. Similarity-Based Reconstruction Loss for Meaning Representation

2. Literature 2

3. Abstract • • • 3

4. Introduction • • 4

5. Related Work • • • • 5

6. Related Work • • 6

7. Auto-Encoder •ℒ , • • • • 7

8. Weighted similarity loss •ℒ = − σ =1 sim ,

   • • • : • • sim() • 8

9. Weighted cross-entropy loss •ℒ = − σ =1 sim ,

   log( ) • • 9

10. Soft label loss •ℒ = − σ =1 ∗log •

    ∗ = ൞ sim , σ =1 sim(,) , ∈ top N 0 , ∉ top N • • 10

11. True-label encoding 11

12. Tasks & Datasets • • • 12

13. Results 13

14. Results 14

15. Additional Experiments • • 15

16. Results • • 16

17. Results 17

18. Results 18

19. Results 19

20. Discussion • • 20

21. Conclusion • • • • 21