Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介:参照訳を必要としない単語分散表現による異言語間類似度を用いた訳文の自動評価
Search
Taichi Aida
June 12, 2019
Technology
0
130
文献紹介:参照訳を必要としない単語分散表現による異言語間類似度を用いた訳文の自動評価
Taichi Aida
June 12, 2019
Tweet
Share
More Decks by Taichi Aida
See All by Taichi Aida
文献紹介:Isotropic Representation Can Improve Zero-Shot Cross-Lingual Transfer on Multilingual Language Models
a1da4
0
46
文献紹介:WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings
a1da4
1
59
文献紹介:On the Transformation of Latent Space in Fine-Tuned NLP Models
a1da4
0
22
新入生向けチュートリアル:文献のサーベイ
a1da4
0
100
文献紹介:Temporal Attention for Language Models
a1da4
0
180
文献紹介:Dynamic Contextualized Word Embeddings
a1da4
2
290
文献紹介:Learning Lexical Subspaces in a Distributional Vector Space
a1da4
0
230
文献紹介:Unsupervised Word Polysemy Quantification with Multiresolution Grids of Contextual Embeddings
a1da4
0
66
新入生向けチュートリアル:tmux
a1da4
0
140
Other Decks in Technology
See All in Technology
長期運用プロジェクトでのMySQLからTiDB移行の検証
colopl
2
840
どうするコスト最適化のトレードオフ
tetsuyaooooo
1
500
Python と Snowflake はズッ友だょ!~ Snowflake の Python 関連機能をふりかえる ~
__allllllllez__
1
110
非同期推論システムによるコスト削減と信頼性向上
koki_nishihara
0
220
AWSに詳しくない人でも始められるコスト最適化ガイド
yuhta28
0
170
ServiceNow Knowledge Learning Rise up
manarobot
0
210
ExaDB-D dbaascli で出来ること
oracle4engineer
PRO
0
2.1k
[新卒向け研修資料] テスト文字列に「うんこ」と入れるな(2024年版)
infiniteloop_inc
3
12k
Azure犬駆動開発の記録/GlobalAzureFukuoka2024_20240420
nina01
1
210
Tellus の衛星データを見てみよう #mf_fukuoka
kongmingstrap
0
180
開発生産性向上サービスを作るFindyが自分たちで開発生産性を爆上げした組織づくりの歩み / Findy's path to boosting its own development productivity 2024-04-17
ma3tk
3
640
アクセシビリティを考慮したUI/CSSフレームワーク・ライブラリ選定
yajihum
2
1k
Featured
See All Featured
Imperfection Machines: The Place of Print at Facebook
scottboms
260
12k
Why Our Code Smells
bkeepers
PRO
331
56k
Keith and Marios Guide to Fast Websites
keithpitt
408
22k
The Language of Interfaces
destraynor
151
23k
Building an army of robots
kneath
300
41k
A Modern Web Designer's Workflow
chriscoyier
689
190k
How to Ace a Technical Interview
jacobian
272
22k
Designing for humans not robots
tammielis
248
25k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
322
20k
Dealing with People You Can't Stand - Big Design 2015
cassininazir
357
22k
Making Projects Easy
brettharned
108
5.5k
The Cost Of JavaScript in 2023
addyosmani
16
3.9k
Transcript
จݙհʢʣ ࢀর༁Λඞཁͱ͠ͳ͍୯ޠࢄදݱʹΑΔ ҟݴޠؒྨࣅΛ༻͍ͨ༁จͷࣗಈධՁ ૬ాɹଠҰ Ԭٕज़Պֶେֶ ࣗવݴޠॲཧݚڀࣨ
LITERATURE ➤ ౻, ӽલ୩, ߥ. ࢀর༁Λඞཁͱ͠ͳ͍୯ޠࢄදݱʹΑΔҟݴޠؒྨࣅΛ༻͍ ͨ༁จͷࣗಈධՁ. ిࢠใ௨৴ֶձ. 2018.
ABSTRACT ➤ ࢀর༁Λ༻͍ͨ༁ͷධՁख๏͕ଘࡏ ➤ Ϣʔβ͕ػց༁Λར༻͢Δࡍࢀর༁Λ༻͍ͳ͍ ➤ QEɿࢀর༁ͷΘΓʹେنͳର༁ίʔύεΛ༻͍Δ ➤ ԤभҎ֎ͷݴޠͰର༁ίʔύε͕͍͠ ➤
ࢀর༁ɺର༁ίʔύεΛ༻͍ͳ͍ධՁํ๏ΛఏҊ
INTRODUCTION ➤ ݱঢ়ͷػց༁ඞͣਖ਼͍͠༁Λग़ྗ͢ΔͱݶΒͳ͍ ➤ খઆͳͲͷந͕ߴ͍จॻͰਖ਼͘͠༁ͤͳ͍ࣄ͕ଟ͍ ➤ ࢀর༁ɺର༁ίʔύεΛ༻͍ͯग़ྗΛධՁ ➤ ࢀর༁ɿ༁จͷ࣭ྔʹґଘ ➤
ର༁ίʔύεɿେنͰ͋Δલఏ ➤ ୯ޠͷҟݴޠؒྨࣅ͔ΒධՁ͢Δख๏ΛఏҊ
PROPOSAL 1. ୯ޠࢄදݱΛֶश 2. ༁ߦྻͰϚοϐϯά 3. ҟݴޠؒྨࣅͷܭࢉ 4. ྨࣅͷग़ྗ
PROPOSALʼ ୯ޠࢄදݱΛֶश ➤ WikipediaͷσʔλͰֶश ➤ ӳޠɿ1.3GB ➤ ຊޠɿ850MB ➤ ࣍ͷurl͔Βμϯϩʔυ
https://dumps.wikimedia.org ➤ ݴޠ͝ͱʹهࣄͷ͕ҟͳΔ ➤ ӳޠ൛ͷํ͕ଟ͔ͬͨ
PROPOSALʼ ༁ߦྻͰϚοϐϯά ➤ ಘΒΕͨࢄදݱΛҟݴޠؒͰൺֱ͍ͨ͠ ➤ Word2VecͰɺҟݴޠؒʹ͓͍ͯ୯ޠؒͷ͕ؔྨࣅ ➤ ϕΫτϧҟͳΔͨΊɺྨࣅܭࢉͰ͖ͳ͍ ➤ ઢܗมɿ༁ߦྻW
➤ ୯ޠϖΞ(xi , zi )Λ࠷খೋ๏Ͱۙࣅ͢Δ
PROPOSALʼ ҟݴޠؒྨࣅͷܭࢉ1 ➤ ΞϥΠϝϯτ ➤ จؒͷྨࣅΛܭࢉ͢Δࡍɺෆཁͳ୯ޠؒͷܭࢉϊΠζ ➤ શͯͷ୯ޠؒͰΞϥΠϝϯτείΞΛܭࢉ ➤ ҎԼͷΑ͏ʹͯ͠୯ޠϕΫτϧؒͷίαΠϯྨࣅ
di Λઃఆ ➤ DICEʢଜΒͷॏΈ͖DICEΛ࠾༻ʣ ➤ ୯ޠؒͷڞىใ f ͔Βܭࢉ tɿᮢʢҙʣ
PROPOSALʼ ҟݴޠؒྨࣅͷܭࢉ2 ➤ EMDɿEarth Mover’s Distance ➤ ྨࣅը૾ݕࡧʹ༻͍ΒΕΔख๏ ➤ ؒͷڑΛ࠷దԽ͢Δࡍɺ༌ૹΛͱʹఆٛ
➤ ֤P , QͦΕͧΕಛྔͱॏΈ͔ΒͳΔγάωνϟͷू߹ ➤ pi ͔Βqj ʹ༌ૹ͢Δ߹ ➤ dij ɿ2ؒͷڑ ➤ fij ɿ༌ૹ͢Δՙྔ ➤ ࣄྔWORKΛ࠷খԽ Ҿ༻ɿ[1]
PROPOSALʼ ҟݴޠؒྨࣅͷܭࢉ3 ➤ EMDɿEarth Mover’s Distance ➤ ҎԼ4ͭͷ੍݅ ➤ ಘΒΕͨ࠷దղ
f*ij Λ༻͍ͯɺ P , QؒͷڑΛܭࢉ Ҿ༻ɿ[1]
PROPOSALʼ ྨࣅͷग़ྗ ➤ ࠓճͷ݅ʹ͓͍ͯɺdijɿҟݴޠؒͷ୯ޠͷྨࣅ ➤ ಘΒΕͨEMDΑΓɺจؒͷྨࣅҎԼͷΑ͏ʹදͤΔ
EXPERIMENT ➤ σʔλ ➤ ʮThe Old Capitalʯ ➤ ݪจɿ߁ʮݹʯ ➤
಄100จΛ༻ ➤ ༁ʢӳˠʣ ➤ Google༁ ➤ Microsoft Translator ➤ Excite༁ ➤ ༁จͷධՁʢਓखʣ ➤ 8ਓͷཧܥେֶӃੜ ➤ 5ஈ֊ͰධՁ ➤ શһͷฏۉΛ༁จͷͱͨ͠
EXPERIMENT ➤ σʔλ ➤ ʮThe Old Capitalʯ ➤ ݪจɿ߁ʮݹʯ ➤
಄100จΛ༻ ➤ ༁ʢӳˠʣ ➤ Google༁ ➤ Microsoft Translator ➤ Excite༁ ➤ ༁จͷධՁʢਓखʣ ➤ 8ਓͷཧܥେֶӃੜ ➤ 5ஈ֊ͰධՁ ➤ શһͷฏۉΛ༁จͷͱͨ͠ ਓखධՁͷॱҐ༁ 1→༁ 2→༁ 3
EXPERIMENT ➤ ධՁํ๏ ɹ3ͭͷ༁จʹରͯ͠ɺྨࣅॱʹॱҐΛ࡞ ×100จ ➤ ਖ਼ղʢਓखͱͷશҰகʣ ➤ έϯυʔϧͷॱҐ૬ؔ ➤
༁จͷॱҐͷେখؔͷ૬ؔ ➤ ൺֱର ➤ ఏҊख๏ ➤ ॏΈʴΞϥΠϝϯτ ➤ ॏΈͳ͠ ➤ ΞϥΠϝϯτͳ͠ ➤ ࣗಈධՁई ➤ METEOR ➤ RIBES
RESULT ➤ ఏҊख๏METEORΛ্ճΓɺRIBES ʹഭΔ݁Ռ ➤ ୯ޠͷΞϥΠϝϯτ͕େ͖͘࡞༻͍ͯͨ͠
DISCUSSION ➤ ఏҊख๏ͷᮢʹର͢ΔҰகɺॱҐ૬ؔ ➤ ᮢΛ্͛Δ΄ͲҰக্͕Δ ➤ ᮢ0.73, 1.46ͰϐʔΫΛܴ͑Δ͕ɺޙऀҰக͕গͳ͍ ➤ ᮢ͕ߴ͘ͳΔ΄Ͳܭࢉʹඞཁͳ୯ޠϖΞഉআ͞ΕΔ
DISCUSSION ➤ RIBESਓखͱࣅͨॱͰධՁ͍ͯ͠Δ͕ɺఏҊख๏ҟͳΔ ➤ ఏҊख๏༁ௐͷ༁จΛߴ͘ධՁ͕ͪ͠
CONCLUSION ➤ ࢀর༁ର༁ίʔύε༻͍ͳ͍ධՁख๏ΛఏҊ ➤ ҟݴޠؒͷࢄදݱΛઢܗม͢Δ༁ߦྻ ➤ ྨࣅը૾ݕࡧʹ༻͍ΒΕΔEMDͰจؒྨࣅΛࢉग़ ➤ METEORΛ্ճΓɺRIBESʹഭΔ݁Ռͱͳͬͨ ➤
ఏҊख๏ͷੑೳʹ୯ޠͷΞϥΠϝϯτ͕ޮ͍͍ͯͨ ➤ ࢺใΛߟྀ͠ɺ୯ޠͷΞϥΠϝϯτΛվળ͍ͨ͠
REFERENCES 1. aidiary. Earth Mover’s Distance(EMD). ਓೳʹؔ͢Δஅ. 2012. http://aidiary.hatenablog.com/entry/20120804/1344058475