Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Integrating Transformer and Paraphrase Rules fo...
Search
Sponsored
·
Your Podcast. Everywhere. Effortlessly.
Share. Educate. Inspire. Entertain. You do you. We'll handle the rest.
→
onizuka laboratory
December 18, 2018
Research
66
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Integrating Transformer and Paraphrase Rules for Sentence Simplification
弊研究室で行なったEMNLP2018読み会の発表資料です。
onizuka laboratory
December 18, 2018
More Decks by onizuka laboratory
See All by onizuka laboratory
Phrase-Based & Neural Unsupervised Machine Translation
onilab
0
120
Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions
onilab
0
82
Card-660: A Reliable Evaluation Framework for Rare Word Representation Models
onilab
0
43
A Word-Complexity Lexicon and A Neural Readability Ranking Model for Lexical Simplification
onilab
0
140
An Auto-Encoder Matching Model for Learning Utterance-Level Semantic Dependency in Dialogue Generation
onilab
0
62
Generating More Interesting Responses in Neural Conversation Models with Distributional Constraints
onilab
0
110
Modeling Multi-turn Conversation with Deep Utterance Aggregation
onilab
0
100
Learning Semantic Sentence Embeddings using Pair-wise Discriminator
onilab
0
130
SGM: Sequence Generation Model for Multi-Label Classification
onilab
0
87
Other Decks in Research
See All in Research
AY 2026 Guide to Academic Writing Using Generative AI - Workshop
ks91
PRO
0
120
AIエージェント時代のLLM-jpモデルのあるべき姿
k141303
0
440
世界モデルにおける分布外データ対応の方法論
koukyo1994
7
2.2k
2026 東京科学大 情報通信系 研究室紹介 (大岡山)
icttitech
0
3.7k
Scalable dynamic origin-destination demand estimation enhanced by high-resolution satellite imagery data
satai
3
250
COFFEE-Japan PROJECT Impact Report(海ノ向こうコーヒー)
ontheslope
0
1.8k
LLMアプリケーションの透明性について
fufufukakaka
0
230
機械学習で作った ポケモン対戦bot で 遊ぼう!
fufufukakaka
0
250
東京大学工学部計数工学科、計数工学特別講義の説明資料
kikuzo
0
460
存立危機事態の再検討
jimboken
0
290
「車1割削減、渋滞半減、公共交通2倍」を 熊本から岡山へ@RACDA設立30周年記念都市交通フォーラム2026
trafficbrain
1
1.1k
「なんとなく」の顧客理解から脱却する ──顧客の解像度を武器にするインサイトマネジメント
tajima_kaho
10
7.6k
Featured
See All Featured
Tell your own story through comics
letsgokoyo
1
950
The Web Performance Landscape in 2024 [PerfNow 2024]
tammyeverts
12
1.2k
Everyday Curiosity
cassininazir
0
220
B2B Lead Gen: Tactics, Traps & Triumph
marketingsoph
0
140
The AI Revolution Will Not Be Monopolized: How open-source beats economies of scale, even for LLMs
inesmontani
PRO
3
3.5k
Rails Girls Zürich Keynote
gr2m
96
14k
Building Flexible Design Systems
yeseniaperezcruz
330
40k
Build your cross-platform service in a week with App Engine
jlugia
234
18k
CoffeeScript is Beautiful & I Never Want to Write Plain JavaScript Again
sstephenson
162
16k
Imperfection Machines: The Place of Print at Facebook
scottboms
270
14k
Designing Experiences People Love
moore
143
24k
AI Search: Implications for SEO and How to Move Forward - #ShenzhenSEOConference
aleyda
1
1.3k
Transcript
% 4BORJBOH ;IBP 3VJ .FOH %BRJOH)F 4BQUPOP "OEJ 1BSNBOUP
#BNCBOH 5SBOTGPSNFSBOE1BSBQISBTF 3VMFTGPS4FOUFODF4JNQMJGJDBUJPO #ݪ େو &./-1ಡΈձʢʣ
֓ཁ l 5SBOTGPSNFSϕʔεͷΞʔΩςΫνϟ l ฏқԽݴ͍͑σʔλϕʔε 4JNQMF11%#Λ ౷߹͢Δͭͷख๏ʢ%."44ͱ %$44ʣΛఏҊ l ౷߹ͷϝϦοτͭ
◦ จฏқԽͷ405"ΑΓ༏ΕΔ ◦ ϞσϧΑΓਖ਼֬ͳฏқԽنଇΛબ͠Α͏ͱ͢Δ l ιʔείʔυެ։ ◦ IUUQTHJUIVCDPN4BORJBOHUFYU@TJNQMJGJDBUJPO
5SBOTGPSNFS l ࠨ͕Τϯίʔμ l ӈ͕σίʔμ l ଛࣦؔ "#$ = −
log , ɺݱࡏͷϞσϧͷ શͯͷύϥϝʔλ
4JNQMF11%#ͷ౷߹ l ฏқԽͷχϡʔϥϧωοτϫʔΫϞσϧͰɺ ग़ݱස͕ߴ͍ฏқԽنଇΛ܇࿅͢Δ ◦ සنଇΛϊΠζͱଊ͑ͯ͠·͏ l /.5Ͱͷॳͷ֎෦ࣝ౷߹ ◦ ֎෦ࣝΛ౷߹͢Δ4.5ฏқԽྑ͍ʢ9VFUBM
ʣ l 4JNQMF11%# ◦ 1BWMJDL FUBM ◦ ສͷنଇ
ఏҊख๏̍ɿ%$44 l %FFQ$SJUJD4FOUFODF4JNQMJGJDBUJPO.PEFM l ଛࣦؔΛमਖ਼ ◦ සنଇͷݟམͱ͠Λආ͚ΔͨΊʹɺ୯ޠͷੜ֬Λ ฏқԽ֬Ͱ࠶ॏΈ͚ l ྫ
◦ ೖྗɿUIFSFDJQJFOU PGUIFLBUF HSFFOBXBZ NFEBM ◦ ग़ྗɿUIFXJOOFS PGUIFLBUF HSFFOBXBZ NFEBM l SFDJQJFOUΛग़͠ʹ͘͘ɺ XJOOFSΛग़͘͢͠ ͳΔΑ͏ଛࣦΛฦ͍ͨ͠
%$44ͷଛࣦؔ l 012# ฏқԽنଇͷॏΈɺ Ϟσϧύϥϝʔλɺ ೖྗจ l 304543 ಛఆͷ୯ޠͷΈʹɺ"#$ =
− log , ޠኮશମʹযΛ͍ͯͯΔ ◦ ͜ΕΒͷଛࣦؔΛަޓʹ࠷খԽ͢ΔΑ͏܇࿅
ఏҊख๏̎ɿ%."44 l %FFQ.FNPSZ"VHNFOUFE4FOUFODF 4JNQMJGJDBUJPO.PEFM l %$44සنଇ͕ແࢹ͞Ε͍͢ʢ͔͠͠ ܇࿅σʔλ͕ݶΒΕΔ߹ɺසنଇॏཁʣ l ֤نଇʹෳͷΩʔόϦϡʔ༻ϝϞϦΛ༻ҙ ◦
ΩʔϕΫτϧɺίϯςΩετϕΫτϧʢΤϯίʔμͷӅΕ ঢ়ଶͱͦͷ࣌ࠁͷσίʔμӅΕঢ়ଶͷՃॏฏۉʣ ◦ όϦϡʔϕΫτϧɺग़ྗϕΫτϧ
%."44
σʔληοτ l ܇࿅ 8JLJ-BSHF ;IBOHBOE-BQBUB ◦ จର l
ݕূͱධՁɺ5VSL 9VFUBM ◦ ೖྗจʹରͯ͠ਓखͷ̔ϦϑΝϨϯεʢˠྑ࣭ʣ ◦ ݕূ༻ จରɺධՁ༻ จର l ධՁ༻ʹ /FXTFMB ͏ ◦ จର
ධՁࢦඪ l ',(-ʢจͷฏқੑʣ ◦ จͷ͞ͱޠ͔Βܭࢉ l 4"3*ʢՃɾআɾอ࣋͞Ε͍ͯΔ͔ʣ ◦ ೖྗɺग़ྗɺϦϑΝϨϯεΛൺֱ l
نଇར༻ੑʢޠኮมͷਖ਼֬ੑʣ ◦ 4"3*ʹՃͱআΛผʑʹධՁ͢Δ͕ɺ߹Θ͍ͤͨ ◦ ೖྗͱϦϑΝϨϯεΛൺֱ͠ɺฏқԽنଇΛௐͯ ͦΕʹର͢Δ QSFDJTJPOɺSFDBMMɺ'Λܭࢉ
5SBOTGPSNFSͷ݁Ռʢ5VSLʣ l ',(-ͱ 4"3*͕ 3//-45.ΑΓ༏Ε͍ͯͨ l -)͕૿Ճ͢ΔͱείΞ্͕ͬͨ
5SBOTGPSNFSͷ݁Ռʢ5VSLʣ l -)͕૿Ճ͢Δͱ ',(-ͷԼ͕Δ l 4"3*ͷอ͚࣋ͩݮগɺաʹฏқԽͯ͠͠·͏
11%#౷߹ͷ݁Ռʢ5VSLʣ
11%#౷߹ͷ݁Ռʢ5VSLʣ
11%#౷߹ͷ݁Ռʢ5VSLʣ
11%#౷߹ͷ݁Ռʢ/FXTFMBʣ