Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Integrating Transformer and Paraphrase Rules fo...
Search
onizuka laboratory
December 18, 2018
Research
66
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Integrating Transformer and Paraphrase Rules for Sentence Simplification
弊研究室で行なったEMNLP2018読み会の発表資料です。
onizuka laboratory
December 18, 2018
More Decks by onizuka laboratory
See All by onizuka laboratory
Phrase-Based & Neural Unsupervised Machine Translation
onilab
0
120
Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions
onilab
0
82
Card-660: A Reliable Evaluation Framework for Rare Word Representation Models
onilab
0
43
A Word-Complexity Lexicon and A Neural Readability Ranking Model for Lexical Simplification
onilab
0
140
An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation
onilab
0
62
Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints
onilab
0
110
Modeling Multi-turn Conversation with Deep Utterance Aggregation
onilab
0
100
Learning Semantic Sentence Embeddings using Pair-wise Discriminator
onilab
0
130
SGM: Sequence Generation Model for Multi-Label Classification
onilab
0
87
Other Decks in Research
See All in Research
[チュートリアル] 電波マップ構築入門 :研究動向と課題設定の勘所
k_sato
0
470
Φ-Sat-2のAutoEncoderによる情報圧縮系論文
satai
4
750
東京大学工学部計数工学科、計数工学特別講義の説明資料
kikuzo
0
460
「AIとWhyを深堀る」をAIと深堀る
iflection
0
470
LiDAR点群の地表面分類手法の比較・検証
vegapunkhiroshi79
0
110
量子コンピュータの紹介
oqtopus
0
320
「車1割削減、渋滞半減、公共交通2倍」を 熊本から岡山へ@RACDA設立30周年記念都市交通フォーラム2026
trafficbrain
1
1.1k
重要だけど測れていないもの:高齢者ケアの見えない課題
theoriatec2024
0
320
Scalable dynamic origin-destination demand estimation enhanced by high-resolution satellite imagery data
satai
3
250
老舗ものづくり企業でリサーチが変革を起こすまで - 三菱重工DXの実践
skydats
0
180
LLM Compute Infrastructure Overview
karakurist
2
1.4k
ペットのかわいい瞬間を撮影する オートシャッターAIアプリへの スマートラベリングの適用
mssmkmr
0
510
Featured
See All Featured
Fight the Zombie Pattern Library - RWD Summit 2016
marcelosomers
234
17k
Building Experiences: Design Systems, User Experience, and Full Site Editing
marktimemedia
0
520
From Legacy to Launchpad: Building Startup-Ready Communities
dugsong
0
230
The innovator’s Mindset - Leading Through an Era of Exponential Change - McGill University 2025
jdejongh
PRO
1
190
Gemini Prompt Engineering: Practical Techniques for Tangible AI Outcomes
mfonobong
2
430
GraphQLとの向き合い方2022年版
quramy
50
15k
How To Stay Up To Date on Web Technology
chriscoyier
790
250k
Between Models and Reality
mayunak
4
330
Accessibility Awareness
sabderemane
1
130
HDC tutorial
michielstock
2
690
Prompt Engineering for Job Search
mfonobong
0
330
Conquering PDFs: document understanding beyond plain text
inesmontani
PRO
4
2.8k
Transcript
% 4BORJBOH ;IBP 3VJ .FOH %BRJOH)F 4BQUPOP "OEJ 1BSNBOUP
#BNCBOH 5SBOTGPSNFSBOE1BSBQISBTF 3VMFTGPS4FOUFODF4JNQMJGJDBUJPO #ݪ େو &./-1ಡΈձʢʣ
֓ཁ l 5SBOTGPSNFSϕʔεͷΞʔΩςΫνϟ l ฏқԽݴ͍͑σʔλϕʔε 4JNQMF11%#Λ ౷߹͢Δͭͷख๏ʢ%."44ͱ %$44ʣΛఏҊ l ౷߹ͷϝϦοτͭ
◦ จฏқԽͷ405"ΑΓ༏ΕΔ ◦ ϞσϧΑΓਖ਼֬ͳฏқԽنଇΛબ͠Α͏ͱ͢Δ l ιʔείʔυެ։ ◦ IUUQTHJUIVCDPN4BORJBOHUFYU@TJNQMJGJDBUJPO
5SBOTGPSNFS l ࠨ͕Τϯίʔμ l ӈ͕σίʔμ l ଛࣦؔ "#$ = −
log , ɺݱࡏͷϞσϧͷ શͯͷύϥϝʔλ
4JNQMF11%#ͷ౷߹ l ฏқԽͷχϡʔϥϧωοτϫʔΫϞσϧͰɺ ग़ݱස͕ߴ͍ฏқԽنଇΛ܇࿅͢Δ ◦ සنଇΛϊΠζͱଊ͑ͯ͠·͏ l /.5Ͱͷॳͷ֎෦ࣝ౷߹ ◦ ֎෦ࣝΛ౷߹͢Δ4.5ฏқԽྑ͍ʢ9VFUBM
ʣ l 4JNQMF11%# ◦ 1BWMJDL FUBM ◦ ສͷنଇ
ఏҊख๏̍ɿ%$44 l %FFQ$SJUJD4FOUFODF4JNQMJGJDBUJPO.PEFM l ଛࣦؔΛमਖ਼ ◦ සنଇͷݟམͱ͠Λආ͚ΔͨΊʹɺ୯ޠͷੜ֬Λ ฏқԽ֬Ͱ࠶ॏΈ͚ l ྫ
◦ ೖྗɿUIFSFDJQJFOU PGUIFLBUF HSFFOBXBZ NFEBM ◦ ग़ྗɿUIFXJOOFS PGUIFLBUF HSFFOBXBZ NFEBM l SFDJQJFOUΛग़͠ʹ͘͘ɺ XJOOFSΛग़͘͢͠ ͳΔΑ͏ଛࣦΛฦ͍ͨ͠
%$44ͷଛࣦؔ l 012# ฏқԽنଇͷॏΈɺ Ϟσϧύϥϝʔλɺ ೖྗจ l 304543 ಛఆͷ୯ޠͷΈʹɺ"#$ =
− log , ޠኮશମʹযΛ͍ͯͯΔ ◦ ͜ΕΒͷଛࣦؔΛަޓʹ࠷খԽ͢ΔΑ͏܇࿅
ఏҊख๏̎ɿ%."44 l %FFQ.FNPSZ"VHNFOUFE4FOUFODF 4JNQMJGJDBUJPO.PEFM l %$44සنଇ͕ແࢹ͞Ε͍͢ʢ͔͠͠ ܇࿅σʔλ͕ݶΒΕΔ߹ɺසنଇॏཁʣ l ֤نଇʹෳͷΩʔόϦϡʔ༻ϝϞϦΛ༻ҙ ◦
ΩʔϕΫτϧɺίϯςΩετϕΫτϧʢΤϯίʔμͷӅΕ ঢ়ଶͱͦͷ࣌ࠁͷσίʔμӅΕঢ়ଶͷՃॏฏۉʣ ◦ όϦϡʔϕΫτϧɺग़ྗϕΫτϧ
%."44
σʔληοτ l ܇࿅ 8JLJ-BSHF ;IBOHBOE-BQBUB ◦ จର l
ݕূͱධՁɺ5VSL 9VFUBM ◦ ೖྗจʹରͯ͠ਓखͷ̔ϦϑΝϨϯεʢˠྑ࣭ʣ ◦ ݕূ༻ จରɺධՁ༻ จର l ධՁ༻ʹ /FXTFMB ͏ ◦ จର
ධՁࢦඪ l ',(-ʢจͷฏқੑʣ ◦ จͷ͞ͱޠ͔Βܭࢉ l 4"3*ʢՃɾআɾอ࣋͞Ε͍ͯΔ͔ʣ ◦ ೖྗɺग़ྗɺϦϑΝϨϯεΛൺֱ l
نଇར༻ੑʢޠኮมͷਖ਼֬ੑʣ ◦ 4"3*ʹՃͱআΛผʑʹධՁ͢Δ͕ɺ߹Θ͍ͤͨ ◦ ೖྗͱϦϑΝϨϯεΛൺֱ͠ɺฏқԽنଇΛௐͯ ͦΕʹର͢Δ QSFDJTJPOɺSFDBMMɺ'Λܭࢉ
5SBOTGPSNFSͷ݁Ռʢ5VSLʣ l ',(-ͱ 4"3*͕ 3//-45.ΑΓ༏Ε͍ͯͨ l -)͕૿Ճ͢ΔͱείΞ্͕ͬͨ
5SBOTGPSNFSͷ݁Ռʢ5VSLʣ l -)͕૿Ճ͢Δͱ ',(-ͷԼ͕Δ l 4"3*ͷอ͚࣋ͩݮগɺաʹฏқԽͯ͠͠·͏
11%#౷߹ͷ݁Ռʢ5VSLʣ
11%#౷߹ͷ݁Ռʢ5VSLʣ
11%#౷߹ͷ݁Ռʢ5VSLʣ
11%#౷߹ͷ݁Ռʢ/FXTFMBʣ