文献紹介：Automated Evaluation of Out-of-Context Errors

2019/02/06 文献紹介
長岡技術科学大学
自然言語処理研究室

Transcript

1. "VUPNBUFE
   &WBMVBUJPO
   PG
   0VUPG$POUFYU
   &SSPST ௕Ԭٕज़Պֶେֶ
   ࣗવݴޠॲཧݚڀࣨ
   ੁ
   ३ࢤ จݙ঺հ
   ೥݄೔ 1BUSJDL
   )VCFS
   +BO
   /JFIVFT
   "MFY
   8BJCFM
   1SPDFFEJOHT
   PG
   UIF
   &MFWFOUI
   *OUFSOBUJPOBM
   $POGFSFODF
   PO
   -BOHVBHF
   3FTPVSDFT
   BOE
   &WBMVBUJPO
   -3&$
   QBHFT
   r
   .JZB[BLJ
   +BQBO
   
   .BZ
   
   
2. "CTUSBDU w ςΩετཧղλεΫͷͨΊͷ
 ܭࢉϞσϧΛධՁ͢Δ৽͍͠ΞϓϩʔνΛఏҊ
   w ࣗಈతͳվมख๏ʹΑΓେن໛ͳσʔληοτ Λ࢖༻Մೳʹ
   w 
   5&%ίʔύεΛվม͠ධՁ
3. *OUSPEVDUJPO w ࣗಈԻ੠ೝࣝ "43 ΍χϡʔϥϧػց຋༁ /.5 γεςϜͷଟ͘Ͱ͸ Ұ౓ʹจͣͭॲཧ
   w จ͚ͩͰ͸จ຺֎ͷޡΓͷࣝผ͕ࠔ೉
4. w ྫ "43γεςϜͰੈքܦࡁʹؔ͢ΔจΛॻ͖ى͜͢৔߹
   w ਖ਼
   5IFSF
   BSF
   HSFBU
   PQQPSUVOJUJFT
   JO
   UIF
   GBSFBTU
   w ޡ
   5IFSF
   BSF
   HSFBU
   PQQPSUVOJUJFT
   JO
   UIF
   GPSFTU
   w Ի੠తʹࣅ͍ͯΔͨΊ
   GBSFBTU͕GPSFTUͱޡೝࣝ
 w จ຺্
   GPSFTU͸ਖ਼͘͠ͳ͍୯ޠ *OUSPEVDUJPO
5. *OUSPEVDUJPO w ৽͍͠ςΩετཧղλεΫΛઃܭ
   w จ຺֎ͷޡΓΛࣝผ͢ΔλεΫ
   w ࣗಈԽ͞Εͨσʔληοτ࡞੒खॱΛఏҊ
   w จ຺֎ͷޡΓΛࣝผ͢ΔϞσϧΛධՁ͢ΔͨΊ ͷσʔληοτ
6. 5BTL w จ຺֎ͷޡΓΛࣝผ͢ΔλεΫ
   w ֤୯ޠ͕ޡΓͰ͋Δ͔൱͔ͷ
 όΠφϦܥྻϥϕϦϯά໰୊
   w ޡΓҐஔ͸σʔληοτશମʹ෼ࢄ͞Ε͍ͯΔ ͨΊݻఆҐஔΞϓϩʔνΑΓ΋λεΫ͕ෳࡶ
7. 5BTL w 8F
   
   IBWF
   
   JO
   
   IJHIFS
   
   FEVDBUJPO
   
   B
   
   USJMMJPO
   
   EPMMBST
   
   PG
   
   TUVEFOU
   
   EFCU
   
   <ʜ>
   8F
   
   IBWF
   
   B
   
   MPU
   
   PG
   
   TIPQQJOH
    
   0VS
   
   FDPOPNZ
   
   HSFX
   
   <ʜ>
   
   PO
   
   UIF
   
   CBDL
   
   PG
   
   DPOTVNFST
   
   NBTTJWFMZ
   
   PWFS
   
   CPSSPXJOH
    
8. %BUB
   .PEJpDBUJPO w ϞσϧΛධՁ͢ΔͨΊͷσʔληοτͷ࡞੒खॱ
   w طଘͷσʔληοτʹจ຺֎ͷޡΓΛૠೖ
   w ಛʹڧྗͳจ຺্ͷಛ௃Λ࣋ͭจষΛ༻͍Δ
   w ׬શʹࣗಈԽ͞Ε͓ͯΓ ਓखΛඞཁͱ͠ͳ͍
   w େن໛ίʔύεͷվม΋Մೳ
9. %BUB
   .PEJpDBUJPO w σʔληοτͷ࡞੒खॱ
    %BUBTFU
   'JMUFSJOH
    1BSUPG4QFFDI
   5BHHJOH
    $BOEJEBUF
   4FMFDUJPO
    "QQFBSBODF
   8JOEPX
10. %BUBTFU
    'JMUFSJOH w σʔληοτͷ඼࣭Λ޲্ͤ͞ΔͨΊʹ
 ޠະຬͷ୯ޠͰߏ੒͞ΕΔจষΛআڈ͢Δ
11. 1BSUPG4QFFDI
    5BHHJOH w ஔ׵͞ΕΔ୯ޠͷબ୒ͷͨΊʹ
    ඼ࢺΛ෇༩͢Δ
    w จ຺͸ಛʹ໊ࢺʹͱͬͯॏཁ
    1BQFSOP
    FU
    BM
    
    w ໊ࢺͷஔ׵ʹয఺Λ౰ͯΔ
    w จষதͷ໊ࢺͷϦετΛऔಘ͢Δ
12. $BOEJEBUF
    4FMFDUJPO w ஔ׵͞ΕΔ୯ޠΛબ୒͢Δ
    w จষͷҰ෦ʹෳ਺ճग़ݱ͢Δ໊ࢺ͕จ຺Λܾఆ
    w ໊ࢺϦετͷதͰ
    ྡ઀͢Δ୯ޠҎ಺ʹෳ਺ճग़ݱ͠ ໊ͨࢺͷ͏ͪ ࠷ޙͷ໊ࢺͷҐஔΛஔ׵Ґஔͷީิͱ͢Δ
    w ྫʣ໊ࢺ"
    ໊ࢺ#
    ໊ࢺ$
    ໊ࢺ%
    ໊ࢺ& 

    
    
    
    
    
    ໊ࢺ'
    ໊ࢺ(
    ໊ࢺ$
    ໊ࢺ*
    ໊ࢺ$
    w ஔ׵Ґஔ͸ ީิ͔ΒϥϯμϜʹબ୒͢Δ
13. "QQFBSBODF
    8JOEPX w ஔ׵͢Δ୯ޠΛબ୒͢Δ
    w ݩͷσʔληοτ্Ͱ
    ग़ݱճ਺͕ಉఔ౓ͷ୯ޠΛબ୒
    w ͜ͷख๏ʹΑΓ
    ҎԼͷಛ௃ΛಘΔ
     Ұൠతͳ୯ޠ͕௿ස౓ͳ୯ޠʹஔ׵͞ΕΔ͜ͱΛճආ
     ୯ޠͷग़ݱճ਺͸Ұൠతʹҙຯͱ͸ؔ܎͕ͳ͍ͨΊ
 ஔ׵͞Εͨ୯ޠͱݩͷ୯ޠͷؒͰؔ܎Λ࣋ͨͳ͍
    w ͞Βʹ੍͓࣌Αͼ਺ʹؔ͢ΔϑΟϧλϦϯάΛߦ͏
14. /PX
    OPUJDF
    JO
    B
    QFSJPE
    XIJDI
    JT
    EPNJOBUFE
    CZ
    B
    NPOPQPMBS
    XPSME
    ZPV
    IBWF
    pYFE
    BMMJBODFT
    r
    /"50
    UIF
    8BSTBX
    1BDU
    "
    pYFE
    QPMBSJUZ
    PG
    QPXFS
    NFBOT
    pYFE
    BMMJBODFT
    #VU
    B
    NVMUJQMF
    QPMBSJUZ
    PG
    QPXFS
    NFBOT
    TIJGUJOH
    BOE
    DIBOHJOH
    BMMJBODFT
    "OE
    UIBU`T
    UIF
    XPSME
    XF`SF
    DPNJOH
    JOUP
    JO
    XIJDI
    XF
    XJMM
    JODSFBTJOHMZ
    TFF
    UIBU
    PVS
    NBSLFUFST
    BSF
    OPU
    pYFE
    .PEJpDBUJPO
    EBUB
    FYBNQMF ਖ਼ʣBMMJBODFT
    ޡʣNBSLFUFST
15. &WBMVBUJPO w σʔληοτ
    w &OHMJTI
    5&%5BML
    DPSQVT
 SFMFBTFE
    GPS
    UIF
    *84-5
    
    $FUUPMP
    FU
    BM
    
    
    w ϕʔεϥΠϯ
    w -BOHVBHF
    .PEFM
    w #JOBSZ
    $MBTTJpDBUJPO
    .PEFM
    w )VNBO
    #BTFMJOF
16. #BTFMJOF w -BOHVBHF
    .PEFM
    w 3//Λ༻͍ͨڭࢣͳֶ͠शϞσϧ
    w #JOBSZ
    $MBTTJpDBUJPO
    .PEFM
    w OFVSBM
    -.ͷग़ྗ૚Λ஋ͱͨ͠ڭࢣ͋ΓֶशϞσϧ
    w )VNBO
    #BTFMJOF
    w จΛݟͯจ຺ʹ߹Θͳ͍୯ޠΛਓ͕ؒݟ͚ͭΔ
    w ςετηοτ͔ΒϥϯμϜʹબΜͩจʹର͠ 
 ਓͷࢀՃऀ͕ճ౴
18. &WBMVBUJPO
19. $PODMVTJPO w จ຺Λҙࣝͨ͠ܭࢉϞσϧΛධՁ͢ΔͨΊͷ
 ৽͍͠λεΫΛఏࣔ
    w จ຺ͷҙຯදݱʹয఺Λ߹Θͤͨจ຺ೝࣝϞσϧͷͨΊ ͷแׅతͳϕϯνϚʔΫΛ࡞੒
    w ہॴతͳτʔΫϯͷΈΛ࢖༻͢ΔϞσϧͰ͸
 ஔ׵͞ΕͨτʔΫϯͷਪఆ͕ࠔ೉Ͱ͋Δ͜ͱ͕ࣔ͞Εͨ
    w λεΫͷύϑΥʔϚϯεΛ޲্ͤ͞ΔͨΊʹ͸ 
 ঢ়گʹԠͨ͡ΞϓϩʔνͷఏҊ͕ඞཁͰ͋Δ