Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
文献紹介 11月7日
Search
Sponsored
·
Your Podcast. Everywhere. Effortlessly.
Share. Educate. Inspire. Entertain. You do you. We'll handle the rest.
→
gumigumi7
October 31, 2018
140
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
文献紹介 11月7日
Explicit Retrofitting of Distributional Word Vectors
gumigumi7
October 31, 2018
Transcript
16 slides
Goran Glavas, Ivan Vulic Proceedings of the 56th Annual Meeting
of the Association for Computational Linguistics (Long Papers), pages 34–45
)4 2 n 8"* %Retrofitting 51' ,+:&(Word vector space specialization
0 38#-/ n 96 96 ! $2.7
.& 3 n *4 #/NLP ,60 n
*4 #12,)-5*4+7*4 8%!"$ -34(' 9
5' 4 n Word vector space specialization l !$3LHGV=4 *JI:+
3L!$M9C l $%$@? 1PB(3L8O n Retrofitting l 3LD!$4 0TSE R>N9C l 0TSE2.!$@? ,QUV&6 n 2 9CK- explicit retrofitting (ER) ;A l 7)F!$/<"%#$ 3L
5 n ! n !
"$ 6 n 3)+-* !%& 1/+- l Ex) car
– automobile - car – drive - n Negative Sampling l '0 #-K+,2 (.
") 7 n .!" #" 2,. !# #"
′ %1&%(#" ; ()- l (: 0 n /' 2 +*1&$(
8 n 2"#%$ Mean Square Distance Objective (ER-MSD) n
!": #% (&!" 0 ) n !($% , $' ): #%$ ( &, #% )
9 n )$%$% '! ' Contrastive Objective (ER-CNT) n
!": &( ()$% 0 ") n !′: &( ' !(%& , %( ) # n ER-MSD )$%$%
'+ 10 n .1 %#&",2$ *!3 Topological Regularization
n !: ER-MSD ER-CNT -,2( n ": *0! *! )/, -,2( !# = ! + "!&'(
3G 11 n &+2> $ Word2Vec, GloVe, FastText ': n
F=@4=@5( WordNet, Roget’s Thesaurus ': l 1,023,082F=@ 380,8734=@5( l !%.@7 57,320@1 → Retrofitting /E )<.@06 ,8;? n ACB7!(#$ , #& )!%#AC': 9*-D" %(0.3:
12 n n
l Word Similarity (SimLex-999, SimVerb-3500) l Language Transfer n l Lexical Text Simplification (LIGHT-LS) l Dialog State Tracking
7- (Word Similarity) 13 • SimLex 4 %#< !6>'&$ +.095(;=
• :23 Attract-Repel !6&$," 8*&$)/ 1 ,"
/* (Lexical Text Simplification) 14 • Retrofitting (, Attract-Repel
% 2'135 • #. 59.6% Attract-Repel %"!' +$'1 7 A: Accuracy (-&), C: Changes ( 640))
-* (Lexical Text Simplification) 15 • 1+ $."!2 3 )
%04& (,villain(%#) Attract-Repel protagonist(#)/' • ER-CNT demon(5)/'
16 n Retrofitting Word vector space specialization =*
3 #"%$4916 n WordNet (<.+ ,* :/-2 8)0>'!#7; n Word Similarity Lexical Simplification A& 5.!#?0>@B
More Decks by gumigumi7
See All by gumigumi7
文献紹介 1月24日
gumigumi7
0
260
文献紹介 10月3日
gumigumi7
0
340
文献紹介 9月3日
gumigumi7
0
270
文献紹介 8月10日
gumigumi7
0
140
文献紹介 7月16日
gumigumi7
0
280
文献紹介 6月12日
gumigumi7
0
350
文献紹介 5月16日
gumigumi7
0
200
文献紹介 4月18日
gumigumi7
0
150
文献紹介 12月15日
gumigumi7
0
130
Featured
See All Featured
Learning to Love Humans: Emotional Interface Design
aarron
275
41k
Reality Check: Gamification 10 Years Later
codingconduct
0
2.4k
Measuring Dark Social's Impact On Conversion and Attribution
stephenakadiri
2
330
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
kevinliebholz
37
6.7k
Bioeconomy Workshop: Dr. Julius Ecuru, Opportunities for a Bioeconomy in West Africa
akademiya2063
PRO
1
460
Everyday Curiosity
cassininazir
0
400
Chasing Engaging Ingredients in Design
codingconduct
0
400
The State of eCommerce SEO: How to Win in Today's Products SERPs - #SEOweek
aleyda
2
12k
How Software Deployment tools have changed in the past 20 years
geshan
3
35k
How STYLIGHT went responsive
nonsquared
100
6.4k
Building Adaptive Systems
keathley
44
3.3k
The Art of Programming - Codeland 2020
erikaheidi
57
15k