Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Integrating Transformer and Paraphrase Rules for Sentence Simplification

Integrating Transformer and Paraphrase Rules for Sentence Simplification

弊研究室で行なったEMNLP2018読み会の発表資料です。

onizuka laboratory

December 18, 2018
Tweet

More Decks by onizuka laboratory

Other Decks in Research

Transcript

  1. % 4BORJBOH ;IBP 3VJ .FOH %BRJOH)F  4BQUPOP "OEJ 1BSNBOUP

    #BNCBOH 5SBOTGPSNFSBOE1BSBQISBTF 3VMFTGPS4FOUFODF4JNQMJGJDBUJPO #੢ݪ େو &./-1ಡΈձʢʣ  
  2. ֓ཁ l 5SBOTGPSNFSϕʔεͷΞʔΩςΫνϟ l ฏқԽݴ͍׵͑σʔλϕʔε 4JNQMF11%#Λ ౷߹͢Δͭͷख๏ʢ%."44ͱ %$44ʣΛఏҊ l ౷߹ͷϝϦοτ͸ͭ

    ◦ จฏқԽͷ405"ΑΓ༏ΕΔ ◦ Ϟσϧ͸ΑΓਖ਼֬ͳฏқԽنଇΛબ୒͠Α͏ͱ͢Δ l ιʔείʔυެ։ ◦ IUUQTHJUIVCDPN4BORJBOHUFYU@TJNQMJGJDBUJPO  
  3. 5SBOTGPSNFS l ࠨ͕Τϯίʔμ l ӈ͕σίʔμ l ଛࣦؔ਺͸ "#$ = −

    log , ͸ɺݱࡏͷϞσϧͷ શͯͷύϥϝʔλ  
  4. ఏҊख๏̍ɿ%$44 l %FFQ$SJUJD4FOUFODF4JNQMJGJDBUJPO.PEFM l ଛࣦؔ਺Λमਖ਼ ◦ ௿ස౓نଇͷݟམͱ͠Λආ͚ΔͨΊʹɺ୯ޠͷੜ੒֬཰Λ ฏқԽ֬཰Ͱ࠶ॏΈ෇͚ l ྫ

    ◦ ೖྗɿUIFSFDJQJFOU PGUIFLBUF HSFFOBXBZ NFEBM ◦ ग़ྗɿUIFXJOOFS PGUIFLBUF HSFFOBXBZ NFEBM l SFDJQJFOUΛग़͠ʹ͘͘ɺ XJOOFSΛग़͠΍͘͢ ͳΔΑ͏ଛࣦΛฦ͍ͨ͠  
  5. %$44ͷଛࣦؔ਺ l 012# ͸ฏқԽنଇͷॏΈɺ ͸Ϟσϧύϥϝʔλɺ ͸ೖྗจ l 304543 ͸ಛఆͷ୯ޠͷΈʹɺ"#$ =

    − log , ͸ޠኮશମʹয఺Λ౰͍ͯͯΔ ◦ ͜ΕΒͷଛࣦؔ਺Λަޓʹ࠷খԽ͢ΔΑ͏܇࿅  
  6. ఏҊख๏̎ɿ%."44 l %FFQ.FNPSZ"VHNFOUFE4FOUFODF 4JNQMJGJDBUJPO.PEFM l %$44͸௿ස౓نଇ͕ແࢹ͞Ε΍͍͢ʢ͔͠͠ ܇࿅σʔλ͕ݶΒΕΔ৔߹ɺ௿ස౓نଇ͸ॏཁʣ l ֤نଇʹෳ਺ͷΩʔόϦϡʔ༻ϝϞϦΛ༻ҙ ◦

    ΩʔϕΫτϧ͸ɺίϯςΩετϕΫτϧʢΤϯίʔμͷӅΕ ঢ়ଶͱͦͷ࣌ࠁͷσίʔμӅΕঢ়ଶͷՃॏฏۉʣ ◦ όϦϡʔϕΫτϧ͸ɺग़ྗϕΫτϧ  
  7. σʔληοτ l ܇࿅͸ 8JLJ-BSHF ;IBOHBOE-BQBUB  ◦  จର l

    ݕূͱධՁ͸ɺ5VSL 9VFUBM  ◦ ೖྗจʹରͯ͠ਓखͷ̔ϦϑΝϨϯεʢˠྑ࣭ʣ ◦ ݕূ༻  จରɺධՁ༻ จର l ධՁ༻ʹ /FXTFMB ΋࢖͏ ◦  จର  
  8. ධՁࢦඪ l ',(-ʢจͷฏқੑʣ ◦ จͷ௕͞ͱޠ௕͔Βܭࢉ l 4"3*ʢ௥Ճɾ࡟আɾอ࣋͞Ε͍ͯΔ͔ʣ ◦ ೖྗɺग़ྗɺϦϑΝϨϯεΛൺֱ l

    نଇར༻ੑʢޠኮม׵ͷਖ਼֬ੑʣ ◦ 4"3*ʹ͸௥Ճͱ࡟আΛผʑʹධՁ͢Δ͕ɺ߹Θ͍ͤͨ ◦ ೖྗͱϦϑΝϨϯεΛൺֱ͠ɺฏқԽنଇΛௐ΂ͯ ͦΕʹର͢Δ QSFDJTJPOɺSFDBMMɺ'஋Λܭࢉ