Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
文献紹介:Auxiliary Objectives for Neural Error Dete...
Search
Atsushi
December 21, 2018
Technology
110
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
文献紹介:Auxiliary Objectives for Neural Error Detection Models
2018/12/21 文献紹介
長岡技術科学大学
自然言語処理研究室
Atsushi
December 21, 2018
Transcript
18 slides
Ԭٕज़Պֶେֶࣗવݴޠॲཧݚڀࣨ ੁ३ࢤ จݙհ ݄ .BSFL3FJ )FMFO:BOOBLPVEBLJT 1SPDFFEJOHTPGUIFUI8PSLTIPQPO*OOPWBUJWF6TFPG/-1GPS #VJMEJOH&EVDBUJPOBM"QQMJDBUJPOT QBHFTr$PQFOIBHFO
%FONBSL 4FQUFNCFS "VYJMJBSZ0CKFDUJWFT GPS/FVSBM&SSPS%FUFDUJPO.PEFMT
"CTUSBDU w ݴޠֶशऀͷ࡞ͨ͠จͷޡΓݕग़ w χϡʔϥϧΛ༻͍ͨܥྻϥϕϦϯάख๏ʹ͓͍ͯɺ ิॿతͷ܇࿅ͷ༗༻ੑΛݕূ w ҎલͷޡΓݕγεςϜͱಉ͡ͷύϥϝʔλͰ ΑΓྑ͍ύϑΥʔϚϯεΛୡ !2
*OUSPEVDUJPO w ݴޠֶशऀͷ࡞ͨ͠จͰ༷ʑͳλΠϓͷޡΓΛ ࣝผ͢Δඞཁ͕͋Δ ɾػೳޠͷޡͬͨ༻ ɾ༰ޠͷҙຯతͳޡΓʢલஔࢺɾܗ༰ࢺͷΈ߹ΘͤͳͲʣ w ݴޠͷΑΓྑ͍දݱΛֶͼɺจ຺ʹ͓͚ΔޡΓΛ ΑΓਖ਼֬ʹݕग़Ͱ͖ΔγεςϜΛߏங͢Δ w
ਖ਼൱ͷ༧ଌ͚ͩͰͳ͘طଘͷσʔλ͔Βநग़Ͱ͖Δ ใΛ༧ଌ͢Δ͜ͱΛࢼΈΔ !3
"VYJMJBSZ-PTT'VODUJPOT !4 xt h( f ) t h(b) t dt
yt DPSSFDUJODPSSFDU 8PSE yt,k : MBCFMLΛ࣋ͭτʔΫϯUͷ༧ଌ֬ ˜ yt,k : ̍τʔΫϯUͷਖ਼͍͠ϥϕϧ͕Lͷ࣌ ̌ͦΕҎ֎ͷ߹
"VYJMJBSZ-PTT'VODUJPOT !5 xt y(1) t y(2) t d(1) t d(2)
t h( f ) t h(b) t DPSSFDUJODPSSFDU 8PSE ผͷλεΫ yt,k : MBCFMLΛ࣋ͭτʔΫϯUͷ༧ଌ֬ ˜ yt,k : ̍τʔΫϯUͷਖ਼͍͠ϥϕϧ͕Lͷ࣌ ̌ͦΕҎ֎ͷ߹
"VYJMJBSZ-PTT'VODUJPOT w GSFRVFODZ ୯ޠͷසΛ༧ଌ͢Δ w FSSPSUZQF ୯ޠͷޡΓͷछྨΛ༧ଌ͢Δ w pSTUMBOHVBHF ֶशऀͷୈҰݴޠΛ༧ଌ͢Δ
w QBSUPGTQFFDI ୯ޠͷࢺΛ༧ଌ͢Δ w HSBNNBUJDBMSFMBUJPOT ୯ޠؒͷґଘؔΛ༧ଌ͢Δ ɹ !6 ผͷλεΫ
"VYJMJBSZ-PTT'VODUJPOT !7
&WBMVBUJPOTFUVQBOEEBUBTFUT w #BTFMJOFɿ3FJBOE:BOOBLPVEBLJT ɾ#J-45.Λ༻͍ͯ4P5"Λୡͨ͠Ϟσϧ w %BUBTFUT ɾ'JSTU$FSUJpDBUFJO&OHMJTI '$&
EBUBTFU ɾ$P/--TIBSFEUBTLUFTUTFU !8
&WBMVBUJPOTFUVQBOEEBUBTFUT w ύϥϝʔλ ɾXPSEFNCFEEJOHTTJ[F ɾJOJUJBMJ[FE QVCMJDMZBWBJMBCMFXPSEWFD .JLPMPWFUBM ɹFNCFEEJOHTUSBJOFEPO(PPHMF/FXT
ɾ-45.IJEEFOMBZFST ɾUBTLTQFDJpDIJEEFOMBZFST ɾPQUJNJ[FE"EBEFMUB ;FJMFS !9
!10
"MUFSOBUJWF5SBJOJOH4USBUFHJFT w ϚϧνλεΫֶशʹؔ͢Δݚڀ ෳͷσʔληοτͰಉ͡γεςϜΛ࠷దԽ͢Δ͜ͱʹ ॏΛஔ͍͍ͯΔ w ༗༻ੑΛࣔͨ͢Ίɺ࣍ͷσʔληοτΛ༻͍ͯ܇࿅ ɾ$P/--EBUBTFUʢDIVOLJOHʣ ɹɹ 5KPOH,JN4BOHBOE#VDIIPM[
ɾ$P/--DPSQVTʢ/&3ʣ ɹɹ 5KPOH,JN4BOHBOE%F.FVMEFS ɾ1FOO5SFFCBOL 15# 104DPSQVT ɹɹ .BSDVTFUBM !11
"MUFSOBUJWF5SBJOJOH4USBUFHJFT w ࣍ͷͭͷํ๏Ͱ܇࿅͢Δ ผͷλεΫͷσʔληοτͰ܇࿅ͨ͋͠ͱɺ ޡΓݕग़σʔληοτͰ܇࿅ ผͷλεΫͷσʔληοτͱޡΓݕग़ͷ σʔληοτΛަޓʹ܇࿅ !12
"MUFSOBUJWF5SBJOJOH4USBUFHJFT !13
"MUFSOBUJWF5SBJOJOH4USBUFHJFT !14
"EEJUJPOBM5SBJOJOH%BUB w NVMUJUBTLMFBSOJOH ར༻ՄೳͳλεΫݻ༗ͷ܇࿅σʔλ͕গͳ͍࣌ʹޮՌ͕ ظ͞ΕΔ w େنͳσʔληοτΛ༻͍ͨ߹ͷޮՌΛݕূ !15
"EEJUJPOBM5SBJOJOH%BUB w ࣍ͷσʔληοτΛ༻ʢ߹ܭ.UPLFOTʣ ɾ$BNCSJEHF-FBSOFS$PSQVT $-$ /JDIPMMT ɾ/64$PSQVTPG-FBSOFS&OHMJTI /6$-& %BIMNFJFSFUBM
ɾ-BOHDPSQVT .J[VNPUPFUBM w܇࿅࣌ʹֶश͢ΔλεΫ ɾ&SSPS%FUFDU ɾ104UBHHJOH !16
"EEJUJPOBM5SBJOJOH%BUB !17
$PODMVTJPO w ݴޠֶशऀͷ࡞ͨ͠จͷޡΓݕΛվળ͢ΔͨΊʹ χϡʔϥϧܥྻϥϕϦϯάʹิॿతͳଛࣦؔΛ౷߹ w 104λάɺจ๏తؔɺޡΓͷछྨ͕ޡΓݕग़ʹ༗༻Ͱ Έ߹ΘͤΔ͜ͱͰ݁Ռ͕վળ w ར༻Մೳͳ܇࿅σʔλ͕ݶΒΕ͍ͯΔ͚࣌ͩͰͳ͘ ଟ͘ͷ܇࿅σʔλΛ༻ͨ͠߹Ͱ༗ޮ
!18
More Decks by Atsushi
See All by Atsushi
文献紹介:Automated Evaluation of Out-of-Context Errors
atsumikan
0
120
文献紹介:Correction of OCR Word Segmentation Errors in Articles from the ACL Collection through Neural Machine Translation Methods
atsumikan
0
180
文献紹介:Wronging a Right: Generating Better Errors to Improve Grammatical Error Detection
atsumikan
0
140
文献紹介:Low-resource OCR error detection and correction in French Clinical Texts
atsumikan
0
150
文献紹介:CMMC-BDRC Solution to the NLP-TEA-2018 Chinese Grammatical Error Diagnosis Task
atsumikan
0
150
文献紹介 : Fluency Boost Learning and Inference for Neural Grammatical Error Correction
atsumikan
0
210
文献紹介:語彙の概念化と Wikipediaを用いた英字略語の意味推定方法
atsumikan
0
180
文献紹介:The Effect of Error Rate in Artificially Generated Data for Automatic Preposition and Determiner Correction
atsumikan
0
160
文献紹介: Automatic Annotation and Evaluation of Error Types for Grammatical Error Correction
atsumikan
0
220
Other Decks in Technology
See All in Technology
セキュリティチームは どのコンテナイメージの脆弱性対応を優先すべきか 〜CISA新指針とSCCで作る脆弱性トリアージ〜
swdtkuy
0
300
ノードが消える前提で設計する!Karpenterで金融システムを止めないためのノウハウ大全
daitak
1
240
飯から始まるデータエンジニア
sansantech
PRO
0
130
その修正で本当に速くなったのか? k6とOpenTelemetryで確かめる性能改善 / Performance review with k6 and OpenTelemetry
ymotongpoo
3
430
Well, that’s weird…
csswizardry
1
190
メール到達性を支える、リンク先URLのドメイン評価の扱い方
wind111
0
190
Terraform 0 to 100:100個以上のリポジトリを常に最新にし続けるための自動化
sue445
3
1.4k
AIエージェントのアーキテクチャ設計
nsatoh
0
480
Context parameters で作る!はじめての型クラス
kworkdev
PRO
1
180
OpenTelemetryで変わった 新時代のCloudWatchメトリクス監視
tsukuboshi
0
490
[NW-JAWS DAY]「うちのAWS、インターネット出られないんで」― AWS外の自社サービスをPrivateLinkでシュッと公開する方法
ykimi
3
920
「任されビリティ」で引き受けて「よしなりてぃ」に頼らず任せる / Accept tasks with "makasarebility" and hand them over without relying on "yoshinarily"
pauli
1
900
Featured
See All Featured
How People are Using Generative and Agentic AI to Supercharge Their Products, Projects, Services and Value Streams Today
helenjbeal
2
400
AI Search: Implications for SEO and How to Move Forward - #ShenzhenSEOConference
aleyda
1
1.4k
The Cost Of JavaScript in 2023
addyosmani
56
10k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
50
10k
How to build a perfect <img>
jonoalderson
1
6.3k
Digital Projects Gone Horribly Wrong (And the UX Pros Who Still Save the Day) - Dean Schuster
uxyall
2
4k
Ten Tips & Tricks for a 🌱 transition
stuffmc
1
290
Become a Pro
speakerdeck
PRO
31
6.4k
Stop Working from a Prison Cell
hatefulcrawdad
274
21k
Avoiding the “Bad Training, Faster” Trap in the Age of AI
tmiket
1
310
世界の人気アプリ100個を分析して見えたペイウォール設計の心得
akihiro_kokubo
PRO
73
43k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
1.7k