Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介:Auxiliary Objectives for Neural Error Dete...
Search
Atsushi
December 21, 2018
Technology
0
85
文献紹介:Auxiliary Objectives for Neural Error Detection Models
2018/12/21 文献紹介
長岡技術科学大学
自然言語処理研究室
Atsushi
December 21, 2018
Tweet
Share
More Decks by Atsushi
See All by Atsushi
文献紹介:Automated Evaluation of Out-of-Context Errors
atsumikan
0
92
文献紹介:Correction of OCR Word Segmentation Errors in Articles from the ACL Collection through Neural Machine Translation Methods
atsumikan
0
150
文献紹介:Wronging a Right: Generating Better Errors to Improve Grammatical Error Detection
atsumikan
0
110
文献紹介:Low-resource OCR error detection and correction in French Clinical Texts
atsumikan
0
110
文献紹介:CMMC-BDRC Solution to the NLP-TEA-2018 Chinese Grammatical Error Diagnosis Task
atsumikan
0
120
文献紹介 : Fluency Boost Learning and Inference for Neural Grammatical Error Correction
atsumikan
0
170
文献紹介:語彙の概念化と Wikipediaを用いた英字略語の意味推定方法
atsumikan
0
140
文献紹介:The Effect of Error Rate in Artificially Generated Data for Automatic Preposition and Determiner Correction
atsumikan
0
120
文献紹介: Automatic Annotation and Evaluation of Error Types for Grammatical Error Correction
atsumikan
0
160
Other Decks in Technology
See All in Technology
KubeCon + CloudNativeCon Japan 2025 Recap Opening & Choose Your Own Adventureシリーズまとめ
mmmatsuda
0
150
AIの最新技術&テーマをつまんで紹介&フリートークするシリーズ #1 量子機械学習の入門
tkhresk
0
140
"サービスチーム" での技術選定 / Making Technology Decisions for the Service Team
kaminashi
1
190
変化する開発、進化する体系時代に適応するソフトウェアエンジニアの知識と考え方(JaSST'25 Kansai)
mizunori
1
240
Liquid Glass革新とSwiftUI/UIKit進化
fumiyasac0921
0
260
SalesforceArchitectGroupOsaka#20_CNX'25_Report
atomica7sei
0
230
rubygem開発で鍛える設計力
joker1007
2
220
「Chatwork」の認証基盤の移行とログ活用によるプロダクト改善
kubell_hr
1
210
KubeCon + CloudNativeCon Japan 2025 Recap by CA
ponkio_o
PRO
0
160
Witchcraft for Memory
pocke
1
580
米国国防総省のDevSecOpsライフサイクルをAWSのセキュリティサービスとOSSで実現
syoshie
2
1.2k
mrubyと micro-ROSが繋ぐロボットの世界
kishima
2
360
Featured
See All Featured
YesSQL, Process and Tooling at Scale
rocio
173
14k
Six Lessons from altMBA
skipperchong
28
3.9k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
34
3.1k
Producing Creativity
orderedlist
PRO
346
40k
Done Done
chrislema
184
16k
Improving Core Web Vitals using Speculation Rules API
sergeychernyshev
17
950
Designing Experiences People Love
moore
142
24k
Bootstrapping a Software Product
garrettdimon
PRO
307
110k
Building an army of robots
kneath
306
45k
For a Future-Friendly Web
brad_frost
179
9.8k
How STYLIGHT went responsive
nonsquared
100
5.6k
Visualization
eitanlees
146
16k
Transcript
Ԭٕज़Պֶେֶࣗવݴޠॲཧݚڀࣨ ੁ३ࢤ จݙհ ݄ .BSFL3FJ )FMFO:BOOBLPVEBLJT 1SPDFFEJOHTPGUIFUI8PSLTIPQPO*OOPWBUJWF6TFPG/-1GPS #VJMEJOH&EVDBUJPOBM"QQMJDBUJPOT QBHFTr$PQFOIBHFO
%FONBSL 4FQUFNCFS "VYJMJBSZ0CKFDUJWFT GPS/FVSBM&SSPS%FUFDUJPO.PEFMT
"CTUSBDU w ݴޠֶशऀͷ࡞ͨ͠จͷޡΓݕग़ w χϡʔϥϧΛ༻͍ͨܥྻϥϕϦϯάख๏ʹ͓͍ͯɺ ิॿతͷ܇࿅ͷ༗༻ੑΛݕূ w ҎલͷޡΓݕγεςϜͱಉ͡ͷύϥϝʔλͰ ΑΓྑ͍ύϑΥʔϚϯεΛୡ !2
*OUSPEVDUJPO w ݴޠֶशऀͷ࡞ͨ͠จͰ༷ʑͳλΠϓͷޡΓΛ ࣝผ͢Δඞཁ͕͋Δ ɾػೳޠͷޡͬͨ༻ ɾ༰ޠͷҙຯతͳޡΓʢલஔࢺɾܗ༰ࢺͷΈ߹ΘͤͳͲʣ w ݴޠͷΑΓྑ͍දݱΛֶͼɺจ຺ʹ͓͚ΔޡΓΛ ΑΓਖ਼֬ʹݕग़Ͱ͖ΔγεςϜΛߏங͢Δ w
ਖ਼൱ͷ༧ଌ͚ͩͰͳ͘طଘͷσʔλ͔Βநग़Ͱ͖Δ ใΛ༧ଌ͢Δ͜ͱΛࢼΈΔ !3
"VYJMJBSZ-PTT'VODUJPOT !4 xt h( f ) t h(b) t dt
yt DPSSFDUJODPSSFDU 8PSE yt,k : MBCFMLΛ࣋ͭτʔΫϯUͷ༧ଌ֬ ˜ yt,k : ̍τʔΫϯUͷਖ਼͍͠ϥϕϧ͕Lͷ࣌ ̌ͦΕҎ֎ͷ߹
"VYJMJBSZ-PTT'VODUJPOT !5 xt y(1) t y(2) t d(1) t d(2)
t h( f ) t h(b) t DPSSFDUJODPSSFDU 8PSE ผͷλεΫ yt,k : MBCFMLΛ࣋ͭτʔΫϯUͷ༧ଌ֬ ˜ yt,k : ̍τʔΫϯUͷਖ਼͍͠ϥϕϧ͕Lͷ࣌ ̌ͦΕҎ֎ͷ߹
"VYJMJBSZ-PTT'VODUJPOT w GSFRVFODZ ୯ޠͷසΛ༧ଌ͢Δ w FSSPSUZQF ୯ޠͷޡΓͷछྨΛ༧ଌ͢Δ w pSTUMBOHVBHF ֶशऀͷୈҰݴޠΛ༧ଌ͢Δ
w QBSUPGTQFFDI ୯ޠͷࢺΛ༧ଌ͢Δ w HSBNNBUJDBMSFMBUJPOT ୯ޠؒͷґଘؔΛ༧ଌ͢Δ ɹ !6 ผͷλεΫ
"VYJMJBSZ-PTT'VODUJPOT !7
&WBMVBUJPOTFUVQBOEEBUBTFUT w #BTFMJOFɿ3FJBOE:BOOBLPVEBLJT ɾ#J-45.Λ༻͍ͯ4P5"Λୡͨ͠Ϟσϧ w %BUBTFUT ɾ'JSTU$FSUJpDBUFJO&OHMJTI '$&
EBUBTFU ɾ$P/--TIBSFEUBTLUFTUTFU !8
&WBMVBUJPOTFUVQBOEEBUBTFUT w ύϥϝʔλ ɾXPSEFNCFEEJOHTTJ[F ɾJOJUJBMJ[FE QVCMJDMZBWBJMBCMFXPSEWFD .JLPMPWFUBM ɹFNCFEEJOHTUSBJOFEPO(PPHMF/FXT
ɾ-45.IJEEFOMBZFST ɾUBTLTQFDJpDIJEEFOMBZFST ɾPQUJNJ[FE"EBEFMUB ;FJMFS !9
!10
"MUFSOBUJWF5SBJOJOH4USBUFHJFT w ϚϧνλεΫֶशʹؔ͢Δݚڀ ෳͷσʔληοτͰಉ͡γεςϜΛ࠷దԽ͢Δ͜ͱʹ ॏΛஔ͍͍ͯΔ w ༗༻ੑΛࣔͨ͢Ίɺ࣍ͷσʔληοτΛ༻͍ͯ܇࿅ ɾ$P/--EBUBTFUʢDIVOLJOHʣ ɹɹ 5KPOH,JN4BOHBOE#VDIIPM[
ɾ$P/--DPSQVTʢ/&3ʣ ɹɹ 5KPOH,JN4BOHBOE%F.FVMEFS ɾ1FOO5SFFCBOL 15# 104DPSQVT ɹɹ .BSDVTFUBM !11
"MUFSOBUJWF5SBJOJOH4USBUFHJFT w ࣍ͷͭͷํ๏Ͱ܇࿅͢Δ ผͷλεΫͷσʔληοτͰ܇࿅ͨ͋͠ͱɺ ޡΓݕग़σʔληοτͰ܇࿅ ผͷλεΫͷσʔληοτͱޡΓݕग़ͷ σʔληοτΛަޓʹ܇࿅ !12
"MUFSOBUJWF5SBJOJOH4USBUFHJFT !13
"MUFSOBUJWF5SBJOJOH4USBUFHJFT !14
"EEJUJPOBM5SBJOJOH%BUB w NVMUJUBTLMFBSOJOH ར༻ՄೳͳλεΫݻ༗ͷ܇࿅σʔλ͕গͳ͍࣌ʹޮՌ͕ ظ͞ΕΔ w େنͳσʔληοτΛ༻͍ͨ߹ͷޮՌΛݕূ !15
"EEJUJPOBM5SBJOJOH%BUB w ࣍ͷσʔληοτΛ༻ʢ߹ܭ.UPLFOTʣ ɾ$BNCSJEHF-FBSOFS$PSQVT $-$ /JDIPMMT ɾ/64$PSQVTPG-FBSOFS&OHMJTI /6$-& %BIMNFJFSFUBM
ɾ-BOHDPSQVT .J[VNPUPFUBM w܇࿅࣌ʹֶश͢ΔλεΫ ɾ&SSPS%FUFDU ɾ104UBHHJOH !16
"EEJUJPOBM5SBJOJOH%BUB !17
$PODMVTJPO w ݴޠֶशऀͷ࡞ͨ͠จͷޡΓݕΛվળ͢ΔͨΊʹ χϡʔϥϧܥྻϥϕϦϯάʹิॿతͳଛࣦؔΛ౷߹ w 104λάɺจ๏తؔɺޡΓͷछྨ͕ޡΓݕग़ʹ༗༻Ͱ Έ߹ΘͤΔ͜ͱͰ݁Ռ͕վળ w ར༻Մೳͳ܇࿅σʔλ͕ݶΒΕ͍ͯΔ͚࣌ͩͰͳ͘ ଟ͘ͷ܇࿅σʔλΛ༻ͨ͠߹Ͱ༗ޮ
!18