Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
文献紹介 7月16日
Search
Sponsored
·
Your Podcast. Everywhere. Effortlessly.
Share. Educate. Inspire. Entertain. You do you. We'll handle the rest.
→
gumigumi7
July 16, 2018
280
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
文献紹介 7月16日
Probabilistic FastText for Multi-Sense Word Embeddings
gumigumi7
July 16, 2018
Transcript
17 slides
) ( Probabilistic FastText for Multi-Sense Word Embeddings
▪ ▪ Mikhail Khodak, Nikunj Saunshi, Yingyu Liang,
Tengyu Ma, Brandon Stewart, Sanjeev Arora. ▪ Probabilistic FastText for Multi-Sense Word Embeddings. ▪ Proceedings of the Association of Computational Linguistics. 2018. ▪ ▪ GaussianMixtureSense Embedding 2
▪ n o V e dT WG oe2 W
W ▪ V e a i M V a c ▪ V a n o 3
▪ e c V ▪ ▪ c V c
W ▪ e c ” ” ▪ fastText ▪ Word2Vec subwordc V c 2 ▪ Word2Vec e c ” ” 4
▪ emt a ▪ ( ) ▪ G ul
m emt er ksu a a u l m a emt ▪ emt M a S ▪ MUSE (Modularizing Unsupervised Sense Embeddings) ▪ api t api t a ▪ Contextual Word Similarity k e SoTA 5
▪ fa E u wn E g ue bd
▪ , B A A C A ▪ a g e bd G ▪ h mo ] V x ptk ▪ A , A C A C , ▪ ] V bdxMpt i pkLR D r ov cT W[ps 6
( ) ( ▪ 7
( ) ( ▪ 8 !
: "#,% : & ' (# : 1
( ) ( ▪ , ▪ 9
( ) ( ▪ ▪
10 Negative Sampling Margin
▪ 11
Subword
12 ▪
▪ RockBank
▪ SCWS-68 ▪ “... east bank of the Des
Moines River ...” ++ “... basis of all money laundering ...” +. bank + money . :*$'5. ()8 ▪ - bank + money 79)8. ",8 79)8'4.*/#97. //& ▪ -3'+!.1: -6()
15 ▪
16 ▪ $ Subwords+ ( %%' 0-.1 &)(%
▪ Abnormal Abnormality ! Subwords %"#+ ( *(
▪ a i rtx n e M sx ▪
e T T G ▪ F ea e e 17
More Decks by gumigumi7
See All by gumigumi7
文献紹介 1月24日
gumigumi7
0
260
文献紹介 11月7日
gumigumi7
0
140
文献紹介 10月3日
gumigumi7
0
340
文献紹介 9月3日
gumigumi7
0
270
文献紹介 8月10日
gumigumi7
0
140
文献紹介 6月12日
gumigumi7
0
350
文献紹介 5月16日
gumigumi7
0
200
文献紹介 4月18日
gumigumi7
0
150
文献紹介 12月15日
gumigumi7
0
130
Featured
See All Featured
Intergalactic Javascript Robots from Outer Space
tanoku
273
28k
Tips & Tricks on How to Get Your First Job In Tech
honzajavorek
1
850
Digital Projects Gone Horribly Wrong (And the UX Pros Who Still Save the Day) - Dean Schuster
uxyall
2
4k
Evolution of real-time – Irina Nazarova, EuRuKo, 2024
irinanazarova
9
1.7k
How to Grow Your eCommerce with AI & Automation
katarinadahlin
PRO
2
350
HDC tutorial
michielstock
2
1k
Introduction to Domain-Driven Design and Collaborative software design
baasie
1
1.1k
Six Lessons from altMBA
skipperchong
29
4.6k
More Than Pixels: Becoming A User Experience Designer
marktimemedia
3
630
[Rails World 2023 - Day 1 Closing Keynote] - The Magic of Rails
eileencodes
38
3.1k
Fireside Chat
paigeccino
43
4.1k
Dominate Local Search Results - an insider guide to GBP, reviews, and Local SEO
greggifford
PRO
0
400