Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介:参照訳を必要としない単語分散表現による異言語間類似度を用いた訳文の自動評価
Search
Taichi Aida
June 12, 2019
Technology
0
140
文献紹介:参照訳を必要としない単語分散表現による異言語間類似度を用いた訳文の自動評価
Taichi Aida
June 12, 2019
Tweet
Share
More Decks by Taichi Aida
See All by Taichi Aida
PhD Defence: Considering Temporal and Contextual Information for Lexical Semantic Change Detection
a1da4
1
190
文献紹介:A Multidimensional Framework for Evaluating Lexical Semantic Change with Social Science Applications
a1da4
1
290
YANS2024:目指せ国際会議!「ネットワーキングの極意(国際会議編)」
a1da4
0
220
言語処理学会30周年記念事業留学支援交流会@YANS2024:「学生のための短期留学」
a1da4
1
340
新入生向けチュートリアル:文献のサーベイv2
a1da4
15
10k
文献紹介:Isotropic Representation Can Improve Zero-Shot Cross-Lingual Transfer on Multilingual Language Models
a1da4
0
180
文献紹介:WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings
a1da4
1
260
文献紹介:On the Transformation of Latent Space in Fine-Tuned NLP Models
a1da4
0
100
新入生向けチュートリアル:文献のサーベイ
a1da4
0
470
Other Decks in Technology
See All in Technology
Lambda Web Adapterについて自分なりに理解してみた
smt7174
5
140
より良いプロダクトの開発を目指して - 情報を中心としたプロダクト開発 #phpcon #phpcon2025
bengo4com
1
3.2k
WordPressから ヘッドレスCMSへ! Storyblokへの移行プロセス
nyata
0
330
Understanding_Thread_Tuning_for_Inference_Servers_of_Deep_Models.pdf
lycorptech_jp
PRO
0
150
AWS Organizations 新機能!マルチパーティ承認の紹介
yhana
1
220
ハッカソン by 生成AIハッカソンvol.05
1ftseabass
PRO
0
140
Liquid Glass革新とSwiftUI/UIKit進化
fumiyasac0921
0
300
AI導入の理想と現実~コストと浸透〜
oprstchn
0
150
Beyond Kaniko: Navigating Unprivileged Container Image Creation
f30
0
110
Tech-Verse 2025 Keynote
lycorptech_jp
PRO
0
1.3k
Snowflake Summit 2025全体振り返り / Snowflake Summit 2025 Overall Review
mtpooh
2
440
怖くない!はじめてのClaude Code
shinya337
0
300
Featured
See All Featured
ReactJS: Keep Simple. Everything can be a component!
pedronauck
667
120k
BBQ
matthewcrist
89
9.7k
Writing Fast Ruby
sferik
628
62k
Building Adaptive Systems
keathley
43
2.6k
Reflections from 52 weeks, 52 projects
jeffersonlam
351
20k
Unsuck your backbone
ammeep
671
58k
How to Ace a Technical Interview
jacobian
277
23k
Why You Should Never Use an ORM
jnunemaker
PRO
58
9.4k
Keith and Marios Guide to Fast Websites
keithpitt
411
22k
The Cult of Friendly URLs
andyhume
79
6.5k
YesSQL, Process and Tooling at Scale
rocio
173
14k
Stop Working from a Prison Cell
hatefulcrawdad
270
20k
Transcript
จݙհʢʣ ࢀর༁Λඞཁͱ͠ͳ͍୯ޠࢄදݱʹΑΔ ҟݴޠؒྨࣅΛ༻͍ͨ༁จͷࣗಈධՁ ૬ాɹଠҰ Ԭٕज़Պֶେֶ ࣗવݴޠॲཧݚڀࣨ
LITERATURE ➤ ౻, ӽલ୩, ߥ. ࢀর༁Λඞཁͱ͠ͳ͍୯ޠࢄදݱʹΑΔҟݴޠؒྨࣅΛ༻͍ ͨ༁จͷࣗಈධՁ. ిࢠใ௨৴ֶձ. 2018.
ABSTRACT ➤ ࢀর༁Λ༻͍ͨ༁ͷධՁख๏͕ଘࡏ ➤ Ϣʔβ͕ػց༁Λར༻͢Δࡍࢀর༁Λ༻͍ͳ͍ ➤ QEɿࢀর༁ͷΘΓʹେنͳର༁ίʔύεΛ༻͍Δ ➤ ԤभҎ֎ͷݴޠͰର༁ίʔύε͕͍͠ ➤
ࢀর༁ɺର༁ίʔύεΛ༻͍ͳ͍ධՁํ๏ΛఏҊ
INTRODUCTION ➤ ݱঢ়ͷػց༁ඞͣਖ਼͍͠༁Λग़ྗ͢ΔͱݶΒͳ͍ ➤ খઆͳͲͷந͕ߴ͍จॻͰਖ਼͘͠༁ͤͳ͍ࣄ͕ଟ͍ ➤ ࢀর༁ɺର༁ίʔύεΛ༻͍ͯग़ྗΛධՁ ➤ ࢀর༁ɿ༁จͷ࣭ྔʹґଘ ➤
ର༁ίʔύεɿେنͰ͋Δલఏ ➤ ୯ޠͷҟݴޠؒྨࣅ͔ΒධՁ͢Δख๏ΛఏҊ
PROPOSAL 1. ୯ޠࢄදݱΛֶश 2. ༁ߦྻͰϚοϐϯά 3. ҟݴޠؒྨࣅͷܭࢉ 4. ྨࣅͷग़ྗ
PROPOSALʼ ୯ޠࢄදݱΛֶश ➤ WikipediaͷσʔλͰֶश ➤ ӳޠɿ1.3GB ➤ ຊޠɿ850MB ➤ ࣍ͷurl͔Βμϯϩʔυ
https://dumps.wikimedia.org ➤ ݴޠ͝ͱʹهࣄͷ͕ҟͳΔ ➤ ӳޠ൛ͷํ͕ଟ͔ͬͨ
PROPOSALʼ ༁ߦྻͰϚοϐϯά ➤ ಘΒΕͨࢄදݱΛҟݴޠؒͰൺֱ͍ͨ͠ ➤ Word2VecͰɺҟݴޠؒʹ͓͍ͯ୯ޠؒͷ͕ؔྨࣅ ➤ ϕΫτϧҟͳΔͨΊɺྨࣅܭࢉͰ͖ͳ͍ ➤ ઢܗมɿ༁ߦྻW
➤ ୯ޠϖΞ(xi , zi )Λ࠷খೋ๏Ͱۙࣅ͢Δ
PROPOSALʼ ҟݴޠؒྨࣅͷܭࢉ1 ➤ ΞϥΠϝϯτ ➤ จؒͷྨࣅΛܭࢉ͢Δࡍɺෆཁͳ୯ޠؒͷܭࢉϊΠζ ➤ શͯͷ୯ޠؒͰΞϥΠϝϯτείΞΛܭࢉ ➤ ҎԼͷΑ͏ʹͯ͠୯ޠϕΫτϧؒͷίαΠϯྨࣅ
di Λઃఆ ➤ DICEʢଜΒͷॏΈ͖DICEΛ࠾༻ʣ ➤ ୯ޠؒͷڞىใ f ͔Βܭࢉ tɿᮢʢҙʣ
PROPOSALʼ ҟݴޠؒྨࣅͷܭࢉ2 ➤ EMDɿEarth Mover’s Distance ➤ ྨࣅը૾ݕࡧʹ༻͍ΒΕΔख๏ ➤ ؒͷڑΛ࠷దԽ͢Δࡍɺ༌ૹΛͱʹఆٛ
➤ ֤P , QͦΕͧΕಛྔͱॏΈ͔ΒͳΔγάωνϟͷू߹ ➤ pi ͔Βqj ʹ༌ૹ͢Δ߹ ➤ dij ɿ2ؒͷڑ ➤ fij ɿ༌ૹ͢Δՙྔ ➤ ࣄྔWORKΛ࠷খԽ Ҿ༻ɿ[1]
PROPOSALʼ ҟݴޠؒྨࣅͷܭࢉ3 ➤ EMDɿEarth Mover’s Distance ➤ ҎԼ4ͭͷ੍݅ ➤ ಘΒΕͨ࠷దղ
f*ij Λ༻͍ͯɺ P , QؒͷڑΛܭࢉ Ҿ༻ɿ[1]
PROPOSALʼ ྨࣅͷग़ྗ ➤ ࠓճͷ݅ʹ͓͍ͯɺdijɿҟݴޠؒͷ୯ޠͷྨࣅ ➤ ಘΒΕͨEMDΑΓɺจؒͷྨࣅҎԼͷΑ͏ʹදͤΔ
EXPERIMENT ➤ σʔλ ➤ ʮThe Old Capitalʯ ➤ ݪจɿ߁ʮݹʯ ➤
಄100จΛ༻ ➤ ༁ʢӳˠʣ ➤ Google༁ ➤ Microsoft Translator ➤ Excite༁ ➤ ༁จͷධՁʢਓखʣ ➤ 8ਓͷཧܥେֶӃੜ ➤ 5ஈ֊ͰධՁ ➤ શһͷฏۉΛ༁จͷͱͨ͠
EXPERIMENT ➤ σʔλ ➤ ʮThe Old Capitalʯ ➤ ݪจɿ߁ʮݹʯ ➤
಄100จΛ༻ ➤ ༁ʢӳˠʣ ➤ Google༁ ➤ Microsoft Translator ➤ Excite༁ ➤ ༁จͷධՁʢਓखʣ ➤ 8ਓͷཧܥେֶӃੜ ➤ 5ஈ֊ͰධՁ ➤ શһͷฏۉΛ༁จͷͱͨ͠ ਓखධՁͷॱҐ༁ 1→༁ 2→༁ 3
EXPERIMENT ➤ ධՁํ๏ ɹ3ͭͷ༁จʹରͯ͠ɺྨࣅॱʹॱҐΛ࡞ ×100จ ➤ ਖ਼ղʢਓखͱͷશҰகʣ ➤ έϯυʔϧͷॱҐ૬ؔ ➤
༁จͷॱҐͷେখؔͷ૬ؔ ➤ ൺֱର ➤ ఏҊख๏ ➤ ॏΈʴΞϥΠϝϯτ ➤ ॏΈͳ͠ ➤ ΞϥΠϝϯτͳ͠ ➤ ࣗಈධՁई ➤ METEOR ➤ RIBES
RESULT ➤ ఏҊख๏METEORΛ্ճΓɺRIBES ʹഭΔ݁Ռ ➤ ୯ޠͷΞϥΠϝϯτ͕େ͖͘࡞༻͍ͯͨ͠
DISCUSSION ➤ ఏҊख๏ͷᮢʹର͢ΔҰகɺॱҐ૬ؔ ➤ ᮢΛ্͛Δ΄ͲҰக্͕Δ ➤ ᮢ0.73, 1.46ͰϐʔΫΛܴ͑Δ͕ɺޙऀҰக͕গͳ͍ ➤ ᮢ͕ߴ͘ͳΔ΄Ͳܭࢉʹඞཁͳ୯ޠϖΞഉআ͞ΕΔ
DISCUSSION ➤ RIBESਓखͱࣅͨॱͰධՁ͍ͯ͠Δ͕ɺఏҊख๏ҟͳΔ ➤ ఏҊख๏༁ௐͷ༁จΛߴ͘ධՁ͕ͪ͠
CONCLUSION ➤ ࢀর༁ର༁ίʔύε༻͍ͳ͍ධՁख๏ΛఏҊ ➤ ҟݴޠؒͷࢄදݱΛઢܗม͢Δ༁ߦྻ ➤ ྨࣅը૾ݕࡧʹ༻͍ΒΕΔEMDͰจؒྨࣅΛࢉग़ ➤ METEORΛ্ճΓɺRIBESʹഭΔ݁Ռͱͳͬͨ ➤
ఏҊख๏ͷੑೳʹ୯ޠͷΞϥΠϝϯτ͕ޮ͍͍ͯͨ ➤ ࢺใΛߟྀ͠ɺ୯ޠͷΞϥΠϝϯτΛվળ͍ͨ͠
REFERENCES 1. aidiary. Earth Mover’s Distance(EMD). ਓೳʹؔ͢Δஅ. 2012. http://aidiary.hatenablog.com/entry/20120804/1344058475