文献紹介：Auxiliary Objectives for Neural Error Detection Models

2018/12/21 文献紹介
長岡技術科学大学
自然言語処理研究室

Transcript

1. ௕Ԭٕज़Պֶେֶ
   ࣗવݴޠॲཧݚڀࣨ
   ੁ
   ३ࢤ จݙ঺հ
   ೥݄೔ .BSFL
   3FJ
   )FMFO
   :BOOBLPVEBLJT
   
   1SPDFFEJOHT
   PG
   UIF
   UI
   8PSLTIPQ
   PO
   *OOPWBUJWF
   6TF
   PG
   /-1
   GPS
   #VJMEJOH
   &EVDBUJPOBM
   "QQMJDBUJPOT
   QBHFT
   r
   $PQFOIBHFO
   %FONBSL
   4FQUFNCFS
   
   
   "VYJMJBSZ
   0CKFDUJWFT
   
 GPS
   /FVSBM
   &SSPS
   %FUFDUJPO
   .PEFMT
   
2. "CTUSBDU w ݴޠֶशऀͷ࡞੒ͨ͠จͷޡΓݕग़
   w χϡʔϥϧΛ༻͍ͨܥྻϥϕϦϯάख๏ʹ͓͍ͯɺ
 ิॿ໨తͷ܇࿅ͷ༗༻ੑΛݕূ
   w ҎલͷޡΓݕ஌γεςϜͱಉ͡਺ͷύϥϝʔλͰ
 ΑΓྑ͍ύϑΥʔϚϯεΛୡ੒ !2
3. *OUSPEVDUJPO
   w ݴޠֶशऀͷ࡞੒ͨ͠จͰ͸༷ʑͳλΠϓͷޡΓΛ
 ࣝผ͢Δඞཁ͕͋Δ
 ɾػೳޠͷޡͬͨ࢖༻
 ɾ಺༰ޠͷҙຯతͳޡΓʢલஔࢺɾܗ༰ࢺͷ૊Έ߹ΘͤͳͲʣ
   w ݴޠͷΑΓྑ͍දݱΛֶͼɺจ຺ʹ͓͚ΔޡΓΛ
 ΑΓਖ਼֬ʹݕग़Ͱ͖ΔγεςϜΛߏங͢Δ
   w ਖ਼൱ͷ஋༧ଌ͚ͩͰͳ͘طଘͷσʔλ͔Βநग़Ͱ͖Δ
 ৘ใΛ༧ଌ͢Δ͜ͱΛࢼΈΔ !3
4. "VYJMJBSZ
   -PTT
   'VODUJPOT !4 xt h( f ) t h(b) t dt yt DPSSFDUJODPSSFDU 8PSE yt,k : MBCFM
   LΛ࣋ͭτʔΫϯ
   Uͷ༧ଌ֬཰ ˜ yt,k : ̍
   τʔΫϯUͷਖ਼͍͠ϥϕϧ͕Lͷ࣌
 ̌ͦΕҎ֎ͷ৔߹
5. "VYJMJBSZ
   -PTT
   'VODUJPOT !5 xt y(1) t y(2) t d(1) t d(2) t h( f ) t h(b) t DPSSFDUJODPSSFDU 8PSE ผͷλεΫ yt,k : MBCFM
   LΛ࣋ͭτʔΫϯ
   Uͷ༧ଌ֬཰ ˜ yt,k : ̍
   τʔΫϯUͷਖ਼͍͠ϥϕϧ͕Lͷ࣌
 ̌ͦΕҎ֎ͷ৔߹
6. "VYJMJBSZ
   -PTT
   'VODUJPOT w GSFRVFODZ
   ୯ޠͷස౓Λ༧ଌ͢Δ
   w FSSPS
   UZQF
   ୯ޠͷޡΓͷछྨΛ༧ଌ͢Δ
   w pSTU
   MBOHVBHF
   ֶशऀͷୈҰݴޠΛ༧ଌ͢Δ
   w QBSUPGTQFFDI
   ୯ޠͷ඼ࢺΛ༧ଌ͢Δ
   w HSBNNBUJDBM
   SFMBUJPOT
   ୯ޠؒͷґଘؔ܎Λ༧ଌ͢Δ
 ɹ !6 ผͷλεΫ
7. "VYJMJBSZ
   -PTT
   'VODUJPOT !7
8. &WBMVBUJPO
   TFUVQ
   BOE
   EBUBTFUT
   w #BTFMJOFɿ3FJ
   BOE
   :BOOBLPVEBLJT
    
 ɾ#J-45.Λ༻͍ͯ4P5"Λୡ੒ͨ͠Ϟσϧ
   w %BUBTFUT
 ɾ'JSTU
   $FSUJpDBUF
   JO
   &OHMJTI
   '$&
   EBUBTFU
 ɾ$P/--
   TIBSFE
   UBTL
   UFTU
   TFU !8
9. &WBMVBUJPO
   TFUVQ
   BOE
   EBUBTFUT
   w ύϥϝʔλ
 ɾXPSE
   FNCFEEJOHT
   TJ[F
   
   
 ɾJOJUJBMJ[FE
   

   
   
   QVCMJDMZ
   BWBJMBCMF
   XPSEWFD
   .JLPMPW
   FU
   BM
    
 ɹFNCFEEJOHT
   USBJOFE
   PO
   (PPHMF
   /FXT
 ɾ-45.
   IJEEFO
   MBZFST
   
   
 ɾUBTLTQFDJpD
   IJEEFO
   MBZFST
   
   
 ɾPQUJNJ[FE
   
   "EBEFMUB
   ;FJMFS
   
   !9
10. !10
11. "MUFSOBUJWF
    5SBJOJOH
    4USBUFHJFT w ϚϧνλεΫֶशʹؔ͢Δݚڀ
 ෳ਺ͷσʔληοτͰಉ͡γεςϜΛ࠷దԽ͢Δ͜ͱʹ
 ॏ఺Λஔ͍͍ͯΔ
    w ༗༻ੑΛࣔͨ͢Ίɺ࣍ͷσʔληοτΛ༻͍ͯ܇࿅
 ɾ$P/--
    
    EBUBTFU
    ʢDIVOLJOHʣ
 ɹɹ 5KPOH
    ,JN
    4BOH
    BOE
    #VDIIPM[
     
 ɾ$P/--
    
    DPSQVT
    ʢ/&3ʣ
 ɹɹ 5KPOH
    ,JN
    4BOH
    BOE
    %F
    .FVMEFS
    
    
 ɾ1FOO
    5SFFCBOL
    15#
    104
    DPSQVT
    
 ɹɹ .BSDVT
    FU
    BM
    
    !11
12. "MUFSOBUJWF
    5SBJOJOH
    4USBUFHJFT w ࣍ͷͭͷํ๏Ͱ܇࿅͢Δ
     ผͷλεΫͷσʔληοτͰ܇࿅ͨ͋͠ͱɺ
 ޡΓݕग़σʔληοτͰ܇࿅
     ผͷλεΫͷσʔληοτͱޡΓݕग़ͷ
 σʔληοτΛަޓʹ܇࿅ !12
13. "MUFSOBUJWF
    5SBJOJOH
    4USBUFHJFT !13
14. "MUFSOBUJWF
    5SBJOJOH
    4USBUFHJFT !14
15. "EEJUJPOBM
    5SBJOJOH
    %BUB
    w NVMUJUBTL
    MFBSOJOH
 ར༻ՄೳͳλεΫݻ༗ͷ܇࿅σʔλ͕গͳ͍࣌ʹޮՌ͕ ظ଴͞ΕΔ
    w େن໛ͳσʔληοτΛ༻͍ͨ৔߹ͷޮՌΛݕূ !15
16. "EEJUJPOBM
    5SBJOJOH
    %BUB
    w ࣍ͷσʔληοτΛ࢖༻ʢ߹ܭ
    .
    UPLFOTʣ
 ɾ$BNCSJEHF
    -FBSOFS
    $PSQVT
    $-$
    /JDIPMMT
     
 ɾ/64
    $PSQVT
    PG
    -FBSOFS
    &OHMJTI
    /6$-&
    %BIMNFJFS
    FU
    BM
     
 ɾ-BOH
    DPSQVT
    .J[VNPUP
    FU
    BM
    
    w܇࿅࣌ʹֶश͢ΔλεΫ
 ɾ&SSPS
    %FUFDU
 ɾ104
    UBHHJOH !16
17. "EEJUJPOBM
    5SBJOJOH
    %BUB
    !17
18. $PODMVTJPO w ݴޠֶशऀͷ࡞੒ͨ͠จͷޡΓݕ஌Λվળ͢ΔͨΊʹ
 χϡʔϥϧܥྻϥϕϦϯάʹิॿతͳଛࣦؔ਺Λ౷߹
    w 104λάɺจ๏తؔ܎ɺޡΓͷछྨ͕ޡΓݕग़ʹ༗༻Ͱ
 ૊Έ߹ΘͤΔ͜ͱͰ݁Ռ͕վળ
    w ར༻Մೳͳ܇࿅σʔλ͕ݶΒΕ͍ͯΔ͚࣌ͩͰͳ͘
 ଟ͘ͷ܇࿅σʔλΛ࢖༻ͨ͠৔߹Ͱ΋༗ޮ !18