Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介: Query and Output: Generating Words by Que...
Search
Yumeto Inaoka
July 20, 2018
Research
1
200
文献紹介: Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation
2018/07/20の文献紹介で発表
Yumeto Inaoka
July 20, 2018
Tweet
Share
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
190
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
240
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
160
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
170
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
160
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
280
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
340
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
230
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
230
Other Decks in Research
See All in Research
CVPR2025論文紹介:Unboxed
murakawatakuya
0
150
言語モデルの地図:確率分布と情報幾何による類似性の可視化
shimosan
5
1.3k
電力システム最適化入門
mickey_kubo
1
890
大規模な2値整数計画問題に対する 効率的な重み付き局所探索法
mickey_kubo
1
350
AIグラフィックデザインの進化:断片から統合(One Piece)へ / From Fragment to One Piece: A Survey on AI-Driven Graphic Design
shunk031
0
390
2021年度-基盤研究B-研究計画調書
trycycle
PRO
0
270
ストレス計測方法の確立に向けたマルチモーダルデータの活用
yurikomium
0
1.3k
Large Language Model Agent: A Survey on Methodology, Applications and Challenges
shunk031
14
9.8k
Mechanistic Interpretability:解釈可能性研究の新たな潮流
koshiro_aoki
1
400
SSII2025 [SS2] 横浜DeNAベイスターズの躍進を支えたAIプロダクト
ssii
PRO
7
3.9k
利用シーンを意識した推薦システム〜SpotifyとAmazonの事例から〜
kuri8ive
1
240
A scalable, annual aboveground biomass product for monitoring carbon impacts of ecosystem restoration projects
satai
3
210
Featured
See All Featured
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
234
17k
The Pragmatic Product Professional
lauravandoore
36
6.8k
Building an army of robots
kneath
306
46k
Cheating the UX When There Is Nothing More to Optimize - PixelPioneers
stephaniewalter
284
13k
Fantastic passwords and where to find them - at NoRuKo
philnash
52
3.4k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
46
7.6k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
194
16k
Building Applications with DynamoDB
mza
96
6.6k
Optimising Largest Contentful Paint
csswizardry
37
3.4k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
333
22k
Practical Orchestrator
shlominoach
190
11k
Music & Morning Musume
bryan
46
6.8k
Transcript
Query and Output: Generating Words by Querying Distributed Word Representations
for Paraphrase Generation Shuming Ma, Xu Sun, Wei Li, Sujian Li, Wenjie Li, Xuancheng Ren. Proceedings of NAACL-HLT 2018, pages 196-206, 2018. จݙհ Ԭٕज़Պֶେֶࣗવݴޠॲཧݚڀࣨ ҴԬເਓ
"CTUSBDU wطଘͷ4FRTFRϞσϧ͕ੜ͢Δจ จ๏తʹਖ਼͍͕͠ҙຯతʹෆదͳ͜ͱ͕Α͋͘Δ w୯ޠࢄදݱͷݕࡧʹΑͬͯ୯ޠΛੜ͢Δ 8PSE&NCFEEJOH"UUFOUJPO/FUXPSL 8&"/ ΛఏҊ wݴ͍͕͑ॏཁͳςΩετฏқԽͱจཁλεΫͰ TUBUFPGUIFBSUΛୡ
!2
*OUSPEVDUJPO w ैདྷͷ4FRTFRϞσϧ୯ޠͷҙຯͰͳ͘܇࿅ ηοτͷ୯ޠύλʔϯΛ҉ه͢Δ͕͋Δ ˡσίʔμͷग़ྗ͕ҙຯతใΛϞσϦϯά ɹ͍ͯ͠ͳ͍ͨΊ w σίʔμͷग़ྗ͕࣋ͭύϥϝʔλ͕ଟ͍ ӅΕͷ࣍ݩ͕ ޠኮαΠζ͕ສͷ߹
ύϥϝʔλ ສͱͳΔ !3
8&"/ w 8PSE&NCFEEJOH"UUFOUJPO/FUXPSL w 3//ͷग़ྗΛΫΤϦͱͯ͠࠷Ұக͢Δࢄදݱ ͷ୯ޠΛBUUFOUJPOΛ༻ͨ͠ݕࡧʹΑͬͯબ w ୯ޠͷࢄදݱΤϯίʔμɺσίʔμͷೖྗ ʹՃ͑ͯग़ྗͷΫΤϦʹΑͬͯߋ৽͞ΕΔ !4
!5 8&"/
!6 8&"/
!7 8&"/
!8 8&"/
ΫΤϦͱ୯ޠͷηοτ͔ΒείΞΛܭࢉ RUλΠϜεςοϓUͷRVFSZ FJJ൪ͷީิ୯ޠ J ʜ O OޠኮαΠζ είΞ͕࠷େͱͳΔ୯ޠΛબ WBMJEBUJPOTFUTͰͷੑೳΛجʹHFOFSBMΛ༻
!9
5SBJOJOH w ୯ޠͷબʹݕࡧΛ༻͍͍ͯΔ͕ɺҰൠతͳ 4FRTFRͱಉ༷ʹඍՄೳ ˠଛࣦؔಉ͡ͷ͕༻Մೳ w "EBN Ћ Ќ Ќ
ЏF !10
&YQFSJNFOUT 5FYU4JNQMJpDBUJPO w %BUBTFUT 1BSBMMFM8JLJQFEJB4JNQMJpDBUJPO$PSQVT 18,1 USBJOWBMJEUFTU
&OHMJTI8JLJQFEJBBOE4JNQMF&OHMJTI8JLJQFEJB &84&8 L USBJOWBMJEUFTU UFTUTFU".5ͰಘΒΕͨͭͷ3FGFSFODFΛ࣋ͭ !11
&YQFSJNFOUT 5FYU4JNQMJpDBUJPO w &WBMVBUJPO.FUSJDT #-&6 ػց༁ฏқԽͰ͘༻͍ΒΕ͍ͯΔࣗಈධՁख๏ ਓखධՁ ྲྀெੑɺଥੑɺฏқ͞ΛͰධՁ ฏқ͞ग़ྗ͕ೖྗͱൺͯͲΕ͚ͩฏқ͔Λࣔ͢
!12
݁Ռ ࣗಈධՁ !13
݁Ռ ਓखධՁ !14
"OBMZTJT w 8&"/ैདྷͷ4FRTFRͱൺͯύϥϝʔλ͕গͳ͍ !15
"OBMZTJT w /54XW1#.53ඞਢͷཁૉΛ͍͍ܽͯΔ w 4#.54"3*ྲྀெ͕ͩҙຯ͕ҟͳΔ !16
"OBMZTJT !17
"OBMZTJT !18 ˢলུ͕ଟ͘ใ͕ෆ͍ͯ͠Δ
"OBMZTJT !19 ˢTJFNFOTNBSUJO SSC TIVSCBͱ͍ͬͨແؔͷ ɹ୯ޠΛग़ྗ
"OBMZTJT !20 ˣྲྀெ͕ͩҙຯ͕ҟͳΓΑΓཧղ͕͘͠ͳ͍ͬͯΔ
$PODMVTJPO w ΫΤϦʹΑΔ୯ޠࢄදݱͷݕࡧ͔Β୯ޠΛੜ ͢ΔFODPEFSEFDPEFSGSBNFXPSLΛఏҊ w ͭͷӳޠฏқԽσʔληοτʹ͓͍ͯ ϕʔεϥΠϯͱൺֱͯ͠#-&6͕ͦΕͧΕ ͓Αͼ্ͨ͠ w ຊϞσϧTUBUFPGUIFBSUΛୡ͍ͯ͠Δ
!21