Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介:Auxiliary Objectives for Neural Error Detection Models
Search
Atsushi
December 21, 2018
Technology
0
66
文献紹介:Auxiliary Objectives for Neural Error Detection Models
2018/12/21 文献紹介
長岡技術科学大学
自然言語処理研究室
Atsushi
December 21, 2018
Tweet
Share
More Decks by Atsushi
See All by Atsushi
文献紹介:Automated Evaluation of Out-of-Context Errors
atsumikan
0
76
文献紹介:Correction of OCR Word Segmentation Errors in Articles from the ACL Collection through Neural Machine Translation Methods
atsumikan
0
140
文献紹介:Wronging a Right: Generating Better Errors to Improve Grammatical Error Detection
atsumikan
0
93
文献紹介:Low-resource OCR error detection and correction in French Clinical Texts
atsumikan
0
75
文献紹介:CMMC-BDRC Solution to the NLP-TEA-2018 Chinese Grammatical Error Diagnosis Task
atsumikan
0
93
文献紹介 : Fluency Boost Learning and Inference for Neural Grammatical Error Correction
atsumikan
0
150
文献紹介:語彙の概念化と Wikipediaを用いた英字略語の意味推定方法
atsumikan
0
120
文献紹介:The Effect of Error Rate in Artificially Generated Data for Automatic Preposition and Determiner Correction
atsumikan
0
110
文献紹介: Automatic Annotation and Evaluation of Error Types for Grammatical Error Correction
atsumikan
0
140
Other Decks in Technology
See All in Technology
Gitlab本から学んだこと - そーだいなるプレイバック / gitlab-book
soudai
7
1.4k
生成AIの変革の時代に、直近1年で直面した課題とその解決策
ktc_wada
1
790
データベース03: 関係データモデル
trycycle
0
110
競技としてのKaggle、役に立つKaggle
yu4u
7
2.5k
Autonomous Database Cloud 技術詳細 / adb-s_technical_detail_jp
oracle4engineer
PRO
15
35k
AWSやJAWS-UGとの出会いを振り返る
yoyoyopg
1
180
TDD - Test Driven Drupal
opdavies
0
3k
コードや知識を組み込む / Incorporate Code and knowledge
ks91
PRO
0
160
require(ESM)とECMAScript仕様
uhyo
4
1k
How to Lead? Testimonial of a Lead Android Engineer
oleur
1
120
自己改善からチームを動かす! 「セルフエンジニアリングマネージャー」のすゝめ
shoota
6
1.1k
DevRelによる信頼構築とデータ駆動で変わるエンジニア採用 / DevRel Trust Building to Data Driven Engineering Hiring
bobtani
1
100
Featured
See All Featured
The World Runs on Bad Software
bkeepers
PRO
61
6.7k
Design by the Numbers
sachag
274
18k
Designing on Purpose - Digital PM Summit 2013
jponch
111
6.5k
What's in a price? How to price your products and services
michaelherold
238
11k
The Invisible Customer
myddelton
114
12k
It's Worth the Effort
3n
180
27k
Fireside Chat
paigeccino
22
2.6k
What's new in Ruby 2.0
geeforr
337
31k
個人開発の失敗を避けるイケてる考え方 / tips for indie hackers
panda_program
66
14k
Why You Should Never Use an ORM
jnunemaker
PRO
51
8.7k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
358
22k
Creatively Recalculating Your Daily Design Routine
revolveconf
211
11k
Transcript
Ԭٕज़Պֶେֶࣗવݴޠॲཧݚڀࣨ ੁ३ࢤ จݙհ ݄ .BSFL3FJ )FMFO:BOOBLPVEBLJT 1SPDFFEJOHTPGUIFUI8PSLTIPQPO*OOPWBUJWF6TFPG/-1GPS #VJMEJOH&EVDBUJPOBM"QQMJDBUJPOT QBHFTr$PQFOIBHFO
%FONBSL 4FQUFNCFS "VYJMJBSZ0CKFDUJWFT GPS/FVSBM&SSPS%FUFDUJPO.PEFMT
"CTUSBDU w ݴޠֶशऀͷ࡞ͨ͠จͷޡΓݕग़ w χϡʔϥϧΛ༻͍ͨܥྻϥϕϦϯάख๏ʹ͓͍ͯɺ ิॿతͷ܇࿅ͷ༗༻ੑΛݕূ w ҎલͷޡΓݕγεςϜͱಉ͡ͷύϥϝʔλͰ ΑΓྑ͍ύϑΥʔϚϯεΛୡ !2
*OUSPEVDUJPO w ݴޠֶशऀͷ࡞ͨ͠จͰ༷ʑͳλΠϓͷޡΓΛ ࣝผ͢Δඞཁ͕͋Δ ɾػೳޠͷޡͬͨ༻ ɾ༰ޠͷҙຯతͳޡΓʢલஔࢺɾܗ༰ࢺͷΈ߹ΘͤͳͲʣ w ݴޠͷΑΓྑ͍දݱΛֶͼɺจ຺ʹ͓͚ΔޡΓΛ ΑΓਖ਼֬ʹݕग़Ͱ͖ΔγεςϜΛߏங͢Δ w
ਖ਼൱ͷ༧ଌ͚ͩͰͳ͘طଘͷσʔλ͔Βநग़Ͱ͖Δ ใΛ༧ଌ͢Δ͜ͱΛࢼΈΔ !3
"VYJMJBSZ-PTT'VODUJPOT !4 xt h( f ) t h(b) t dt
yt DPSSFDUJODPSSFDU 8PSE yt,k : MBCFMLΛ࣋ͭτʔΫϯUͷ༧ଌ֬ ˜ yt,k : ̍τʔΫϯUͷਖ਼͍͠ϥϕϧ͕Lͷ࣌ ̌ͦΕҎ֎ͷ߹
"VYJMJBSZ-PTT'VODUJPOT !5 xt y(1) t y(2) t d(1) t d(2)
t h( f ) t h(b) t DPSSFDUJODPSSFDU 8PSE ผͷλεΫ yt,k : MBCFMLΛ࣋ͭτʔΫϯUͷ༧ଌ֬ ˜ yt,k : ̍τʔΫϯUͷਖ਼͍͠ϥϕϧ͕Lͷ࣌ ̌ͦΕҎ֎ͷ߹
"VYJMJBSZ-PTT'VODUJPOT w GSFRVFODZ ୯ޠͷසΛ༧ଌ͢Δ w FSSPSUZQF ୯ޠͷޡΓͷछྨΛ༧ଌ͢Δ w pSTUMBOHVBHF ֶशऀͷୈҰݴޠΛ༧ଌ͢Δ
w QBSUPGTQFFDI ୯ޠͷࢺΛ༧ଌ͢Δ w HSBNNBUJDBMSFMBUJPOT ୯ޠؒͷґଘؔΛ༧ଌ͢Δ ɹ !6 ผͷλεΫ
"VYJMJBSZ-PTT'VODUJPOT !7
&WBMVBUJPOTFUVQBOEEBUBTFUT w #BTFMJOFɿ3FJBOE:BOOBLPVEBLJT ɾ#J-45.Λ༻͍ͯ4P5"Λୡͨ͠Ϟσϧ w %BUBTFUT ɾ'JSTU$FSUJpDBUFJO&OHMJTI '$&
EBUBTFU ɾ$P/--TIBSFEUBTLUFTUTFU !8
&WBMVBUJPOTFUVQBOEEBUBTFUT w ύϥϝʔλ ɾXPSEFNCFEEJOHTTJ[F ɾJOJUJBMJ[FE QVCMJDMZBWBJMBCMFXPSEWFD .JLPMPWFUBM ɹFNCFEEJOHTUSBJOFEPO(PPHMF/FXT
ɾ-45.IJEEFOMBZFST ɾUBTLTQFDJpDIJEEFOMBZFST ɾPQUJNJ[FE"EBEFMUB ;FJMFS !9
!10
"MUFSOBUJWF5SBJOJOH4USBUFHJFT w ϚϧνλεΫֶशʹؔ͢Δݚڀ ෳͷσʔληοτͰಉ͡γεςϜΛ࠷దԽ͢Δ͜ͱʹ ॏΛஔ͍͍ͯΔ w ༗༻ੑΛࣔͨ͢Ίɺ࣍ͷσʔληοτΛ༻͍ͯ܇࿅ ɾ$P/--EBUBTFUʢDIVOLJOHʣ ɹɹ 5KPOH,JN4BOHBOE#VDIIPM[
ɾ$P/--DPSQVTʢ/&3ʣ ɹɹ 5KPOH,JN4BOHBOE%F.FVMEFS ɾ1FOO5SFFCBOL 15# 104DPSQVT ɹɹ .BSDVTFUBM !11
"MUFSOBUJWF5SBJOJOH4USBUFHJFT w ࣍ͷͭͷํ๏Ͱ܇࿅͢Δ ผͷλεΫͷσʔληοτͰ܇࿅ͨ͋͠ͱɺ ޡΓݕग़σʔληοτͰ܇࿅ ผͷλεΫͷσʔληοτͱޡΓݕग़ͷ σʔληοτΛަޓʹ܇࿅ !12
"MUFSOBUJWF5SBJOJOH4USBUFHJFT !13
"MUFSOBUJWF5SBJOJOH4USBUFHJFT !14
"EEJUJPOBM5SBJOJOH%BUB w NVMUJUBTLMFBSOJOH ར༻ՄೳͳλεΫݻ༗ͷ܇࿅σʔλ͕গͳ͍࣌ʹޮՌ͕ ظ͞ΕΔ w େنͳσʔληοτΛ༻͍ͨ߹ͷޮՌΛݕূ !15
"EEJUJPOBM5SBJOJOH%BUB w ࣍ͷσʔληοτΛ༻ʢ߹ܭ.UPLFOTʣ ɾ$BNCSJEHF-FBSOFS$PSQVT $-$ /JDIPMMT ɾ/64$PSQVTPG-FBSOFS&OHMJTI /6$-& %BIMNFJFSFUBM
ɾ-BOHDPSQVT .J[VNPUPFUBM w܇࿅࣌ʹֶश͢ΔλεΫ ɾ&SSPS%FUFDU ɾ104UBHHJOH !16
"EEJUJPOBM5SBJOJOH%BUB !17
$PODMVTJPO w ݴޠֶशऀͷ࡞ͨ͠จͷޡΓݕΛվળ͢ΔͨΊʹ χϡʔϥϧܥྻϥϕϦϯάʹิॿతͳଛࣦؔΛ౷߹ w 104λάɺจ๏తؔɺޡΓͷछྨ͕ޡΓݕग़ʹ༗༻Ͱ Έ߹ΘͤΔ͜ͱͰ݁Ռ͕վળ w ར༻Մೳͳ܇࿅σʔλ͕ݶΒΕ͍ͯΔ͚࣌ͩͰͳ͘ ଟ͘ͷ܇࿅σʔλΛ༻ͨ͠߹Ͱ༗ޮ
!18