Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
第9回 評価方法と学習アルゴリズムの比較
Search
Taichi Aida
March 07, 2019
Technology
0
84
第9回 評価方法と学習アルゴリズムの比較
Taichi Aida
March 07, 2019
Tweet
Share
More Decks by Taichi Aida
See All by Taichi Aida
文献紹介:Isotropic Representation Can Improve Zero-Shot Cross-Lingual Transfer on Multilingual Language Models
a1da4
0
44
文献紹介:WhitenedCSE: Whitening-based Contrastive Learning of Sentence Embeddings
a1da4
1
55
文献紹介:On the Transformation of Latent Space in Fine-Tuned NLP Models
a1da4
0
20
新入生向けチュートリアル:文献のサーベイ
a1da4
0
96
文献紹介:Temporal Attention for Language Models
a1da4
0
170
文献紹介:Dynamic Contextualized Word Embeddings
a1da4
2
290
文献紹介:Learning Lexical Subspaces in a Distributional Vector Space
a1da4
0
230
文献紹介:Unsupervised Word Polysemy Quantification with Multiresolution Grids of Contextual Embeddings
a1da4
0
65
新入生向けチュートリアル:tmux
a1da4
0
130
Other Decks in Technology
See All in Technology
Tohoku.Tech #1 「EC-CUBE/AWSの構築をChatGPTに相談してみました」by テンダ
jun2882
0
140
プッシュ型子育てサービスを、先行プロジェクト実施自治体において開始します
govtechtokyo
0
220
Kubeflow Pipelines v2 で変わる機械学習パイプライン開発
asei
4
330
なんで私に登壇依頼が?! ~頼られるエンジニアになるためには~ /
mixi_engineers
PRO
2
200
どう買う?Azure
kuniteru
1
190
Ask-LLM論文紹介: How to Train Data-Efficient LLMs
s_ota
0
110
単回帰分析について数式を追いながら実装してみた
kentaitakura
0
490
Evolutionary Optimization of Model Merging Recipes
fuyu_quant0
3
510
実務への応用例から考える 変更に強いオブジェクト指向設計 / 20240324-ooc2024
bengo4com
7
4.5k
中央集権体制からDataOpsへの転換 / centralized-to-dataops-transformation
pei0804
7
1.3k
データ化エンジニアとしての1年を振り返る
sansantech
PRO
3
250
Challenges - Open Farming Hackdays 2024
loleg
0
490
Featured
See All Featured
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
24
2.2k
How to name files
jennybc
62
92k
The Cult of Friendly URLs
andyhume
72
5.6k
5 minutes of I Can Smell Your CMS
philhawksworth
199
19k
Understanding Cognitive Biases in Performance Measurement
bluesmoon
6
950
The Cost Of JavaScript in 2023
addyosmani
13
3.7k
Embracing the Ebb and Flow
colly
78
4.1k
Web development in the modern age
philhawksworth
201
10k
GraphQLとの向き合い方2022年版
quramy
28
12k
Stop Working from a Prison Cell
hatefulcrawdad
265
19k
Building Your Own Lightsaber
phodgson
97
5.6k
Pencils Down: Stop Designing & Start Developing
hursman
115
11k
Transcript
9 7 1 / ) (B 0 2 3
5 6 : 7 6 8 : 7 12
1 . //1 22 . /
• • • • 3
• • • • 4
• • 5 2
• 1 6 p • e A l 0
PA t L • e • e A D 6 i r6
• L ℳ _ c" b
P(%|ℳ) P 7- A Perplexity " ℳ = 1 ∏ 345 6 ∏ 78,:∈"8 <(%3,= |ℳ) 5 ∑8 ? @8 • aD M M 7- • - 7- • - - ( 7- • -) 7-
• 8 8 • 2 2
• 2 • 9 9 9
• • 1 • 0
• ) 1 5. )1 50 4 5 C
cM L 245 cM L C M L (3 9 cM L Ne A a
( ) • I • I M PMI (%& ,
%( ) = log .(%& , %( ) . %& .(%( ) • P 1 2 2W
• 1 • • • 3 1
15 2 2 Ψ " = $logΓ(") $"
Γ " 2 Γ " = " − 1 !
1 2 1 2 6
7 2 7 1 2 2
1 2 1 8
• 1 • • • 1 9