Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介: Similarity-Based Reconstruction Loss for ...
Search
Yumeto Inaoka
May 26, 2019
Research
1
210
文献紹介: Similarity-Based Reconstruction Loss for Meaning Representation
2019/05/28の文献紹介で発表
Yumeto Inaoka
May 26, 2019
Tweet
Share
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
170
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
220
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
150
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
160
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
140
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
250
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
320
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
220
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
210
Other Decks in Research
See All in Research
SI-D案内資料_京都文教大学
ryojitakeuchi1116
0
1.4k
自然由来エネルギーの揺らぎによるワークロード移動を想定した超個体データセンターシステムの検討進捗状況
kikuzo
0
100
SkySense : A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagery
satai
3
150
さくらインターネット研究所 アップデート2025年
matsumoto_r
PRO
0
550
言語モデルによるAI創薬の進展 / Advancements in AI-Driven Drug Discovery Using Language Models
tsurubee
2
330
AIトップカンファレンスからみるData-Centric AIの研究動向 / Research Trends in Data-Centric AI: Insights from Top AI Conferences
tsurubee
3
2.4k
ラムダ計算の拡張に基づく 音楽プログラミング言語mimium とそのVMの実装
tomoyanonymous
0
450
[輪講] Transformer Layers as Painters
nk35jk
4
770
実行環境に中立なWebAssemblyライブマイグレーション機構/techtalk-2025spring
chikuwait
0
170
LLM 시대의 Compliance: Safety & Security
huffon
0
650
CARMUI-NET:自動運転車遠隔監視のためのバーチャル都市プラットフォームにおける通信品質変動機能の開発と評価 / UBI85
yumulab
0
200
TRIPOD+AI Expandedチェックリスト 有志翻訳による日本語版 version.1.1
shuntaros
0
140
Featured
See All Featured
Measuring & Analyzing Core Web Vitals
bluesmoon
7
430
The Pragmatic Product Professional
lauravandoore
33
6.6k
Learning to Love Humans: Emotional Interface Design
aarron
273
40k
Intergalactic Javascript Robots from Outer Space
tanoku
271
27k
Scaling GitHub
holman
459
140k
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
smashingmag
251
21k
Designing for Performance
lara
608
69k
A better future with KSS
kneath
239
17k
Producing Creativity
orderedlist
PRO
344
40k
What's in a price? How to price your products and services
michaelherold
245
12k
Site-Speed That Sticks
csswizardry
6
560
The Invisible Side of Design
smashingmag
299
50k
Transcript
Similarity-Based Reconstruction Loss for Meaning Representation
Literature 2
Abstract • • • 3
Introduction • • 4
Related Work • • • • 5
Related Work • • 6
Auto-Encoder •ℒ , • • • • 7
Weighted similarity loss •ℒ = − σ =1 sim ,
• • • : • • sim() • 8
Weighted cross-entropy loss •ℒ = − σ =1 sim ,
log( ) • • 9
Soft label loss •ℒ = − σ =1 ∗log •
∗ = ൞ sim , σ =1 sim(,) , ∈ top N 0 , ∉ top N • • 10
True-label encoding 11
Tasks & Datasets • • • 12
Results 13
Results 14
Additional Experiments • • 15
Results • • 16
Results 17
Results 18
Results 19
Discussion • • 20
Conclusion • • • • 21