Upgrade to Pro — share decks privately, control downloads, hide ads and more …

文献紹介: Decomposable Neural Paraphrase Generation

文献紹介: Decomposable Neural Paraphrase Generation

2019/07/23の文献紹介で発表

Yumeto Inaoka

July 23, 2019
Tweet

More Decks by Yumeto Inaoka

Other Decks in Research

Transcript

  1. Decomposable Neural
    Paraphrase Generation

    View full-size slide

  2. https://arxiv.org/abs/1906.09741

    View full-size slide





  3. View full-size slide


  4. • = [1
    , … ,
    ]
    • = [1
    , … ,
    ]

    View full-size slide




  5. • ℎ
    = BiLSTM(
    ; ℎ−1
    , ℎ+1
    )

    = LSTM ℎ
    , −1
    ; −1

    = GumbelSoftmax(


    , )

    View full-size slide



  6. = − encoderz
    (, )


    1:−1
    , = − encoderz

    , 1:−1

    View full-size slide



  7. 1:−1
    , = σ


    1:−1
    , (
    |1:−1
    , )

    View full-size slide

  8. • 0
    , 1

    = LSTM

    0
    ; 1
    ; −1
    ; −1

    1:−1
    , = GumbelSoftmax


    ,

    View full-size slide



  9. ∗ = 0
    ∗ = 1

    View full-size slide



  10. • ℒ = σ=1
    log
    1:−1
    , +
    σ=1
    log
    ∗ + σ=1
    log (
    ∗ 1:−1
    ,

    View full-size slide



  11. From 1(best) to 4(worst)

    View full-size slide






  12. View full-size slide