Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
文献紹介: Delete, Retrieve, Generate: A Simple Appr...
Search
Yumeto Inaoka
June 20, 2018
Research
190
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
文献紹介: Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfer
2018/06/20の文献紹介で発表
Yumeto Inaoka
June 20, 2018
More Decks by Yumeto Inaoka
See All by Yumeto Inaoka
文献紹介: Quantity doesn’t buy quality syntax with neural language models
yumeto
1
220
文献紹介: Open Domain Web Keyphrase Extraction Beyond Language Modeling
yumeto
0
280
文献紹介: Self-Supervised_Neural_Machine_Translation
yumeto
0
190
文献紹介: Comparing and Developing Tools to Measure the Readability of Domain-Specific Texts
yumeto
0
210
文献紹介: PAWS: Paraphrase Adversaries from Word Scrambling
yumeto
0
210
文献紹介: Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
yumeto
0
320
文献紹介: EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit Editing
yumeto
0
430
文献紹介: Decomposable Neural Paraphrase Generation
yumeto
0
250
文献紹介: Analyzing the Limitations of Cross-lingual Word Embedding Mappings
yumeto
0
280
Other Decks in Research
See All in Research
第66回コンピュータビジョン勉強会@関東 Epona: Autoregressive Diffusion World Model for Autonomous Driving
kentosasaki
0
650
LINEヤフー データサイエンス Meetup「三井物産コモディティ予測チャレンジ」の舞台裏-AlpacaTechパート
gamella
1
590
Sequences of Logits Reveal the Low Rank Structure of Language Models
sansantech
PRO
1
280
AIを叩き台として、 「検証」から「共創」へと進化するリサーチ
mela_dayo
0
300
さくらインターネット研究所テックトーク2026春、研究開発Gr.25年度成果26年度方針
kikuzo
0
160
進学校の生徒にはア行の苗字が多いのか
ozekinote
0
470
明日から使える!研究効率化ツール入門
matsui_528
13
7.4k
Spatial Active Noise Control Based onSound Field Interpolation Incorporating Physical Constraints
skoyamalab
0
120
Cross-Media Information Spaces and Architectures
signer
PRO
0
310
言語モデルから言語について語る際に押さえておきたいこと
eumesy
PRO
6
2.4k
SLAMはどこまで解決されたのか?
tomonom
0
730
NLP colloquium: AI Safety Survey
kanekomasahiro
0
820
Featured
See All Featured
We Are The Robots
honzajavorek
0
270
Avoiding the “Bad Training, Faster” Trap in the Age of AI
tmiket
0
190
VelocityConf: Rendering Performance Case Studies
addyosmani
333
25k
ReactJS: Keep Simple. Everything can be a component!
pedronauck
666
130k
Principles of Awesome APIs and How to Build Them.
keavy
128
18k
Chasing Engaging Ingredients in Design
codingconduct
0
230
The SEO identity crisis: Don't let AI make you average
varn
0
510
Groundhog Day: Seeking Process in Gaming for Health
codingconduct
0
240
Prompt Engineering for Job Search
mfonobong
0
370
Visual Storytelling: How to be a Superhuman Communicator
reverentgeek
2
590
A Tale of Four Properties
chriscoyier
163
24k
4 Signs Your Business is Dying
shpigford
187
22k
Transcript
Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style
Transfer Juncen Li, Robin Jia, He He, Percy Liang. Proceedings of NAACL-HLT 2018, pages 1865–1874, 2018. จݙհ Ԭٕज़Պֶେֶࣗવݴޠॲཧݚڀࣨ ҴԬເਓ
"CTUSBDU wײͳͲͷଐੑΛɺଐੑʹґଘ͠ͳ͍༰Λ อ࣋ͭͭ͠มΛߦ͏λεΫ wֶशʹଐੑͷΈҟͳΔΑ͏ͳจϖΞΛ༻͠ͳ͍ wϑϨʔζΛ%FMFUF 3FUSJFWFͯ͠ɺͦΕΒΛݩʹ ࠷ऴతͳग़ྗΛ(FOFSBUF͢Δ wैདྷख๏ΑΓଟ͘ͷೖྗʹ͓͍ͯจ๏త͔ͭ దͳग़ྗ͕ੜ͞ΕΔ͜ͱΛਓखධՁͰ֬ೝ !2
*OUSPEVDUJPO w ײελΠϧɺ੍࣌ͷΑ͏ͳଐੑΛ੍ޚͰ͖Δ จੜʹؔ৺͕ߴ·͍ͬͯΔ w ௨ৗɺଐੑͷΈҟͳΔύϥϨϧσʔλ༻ Ͱ͖ͣɺଐੑ͕ϥϕϧ͚͞ΕͨจͷΈΛ༻ w ͜Ε·Ͱʹ("/Λ༻͍ͨख๏͕ఏҊ͞Ε͍ͯΔ͕ɺ ग़ྗ͕࣭Ͱ͋Δ͜ͱ͕ਓखධՁͰ໌
!3
*OUSPEVDUJPO w ଐੑʹӨڹΛ༩͑Δ୯ޠ۟ Ҏ֎΄ͱΜͲมߋͤͣ͞ʹ ଐੑมͰ͖Δ߹͕ଟ͍ w ΑΓ୯७Ͱֶश͕؆୯ͳ Ұ࿈ͷγεςϜΛఏҊ !4
"QQSPBDI !5
"QQSPBDI !6
"QQSPBDI !7
"QQSPBDI !8
"QQSPBDI !9
"QQSPBDI !10
"QQSPBDI !11
"QQSPBDI !12
"QQSPBDI !13
"QQSPBDI !14
%FMFUF w ײଐੑͷ߹ɺlQPTJUJWFzͷ࣌ʹݶͬͯΑ͘ग़ݱ ͢ΔOHSBNͱlOFHBUJWFzͷ࣌ʹݶͬͯΑ͘ग़ݱ ͢ΔOHSBNΛଐੑϚʔΧͱͯ͠আ w OHSBN͔ΒଐੑΛྨ͢ΔφΠʔϒϕΠζྨث ʹ͓͚ΔOHSBNͷ͖͕݅֬ࢦఆͷᮢΛ ͑ͨࡍʹଐੑϚʔΧͱ͢Δ !15
3FUSJFWF w ͭͷ୯ޠܥྻͷڑ͕Ұ൪খ͍͞ͷΛऔΓग़͢ w ڑͷܭࢉํ๏ҎԼͷͭΛ࣮ݧ 5'*%'ͰॏΈ͚ͮΒΕͨ୯ޠͷॏͳΓ DPOUFOUFNCFEEJOHTͷϢʔΫϦουڑ ˢEFMFUFޙͷจΛ3//FODPEFSʹೖྗͨ݁͠Ռ
!16
(FOFSBUF %FMFUF0OMZ w %FMFUFޙͷจͱଐੑ͔Β%FMFUFલͷจΛ෮ݩ͢Δ Α͏ʹֶशΛߦ͏ !17
(FOFSBUF %FMFUF"OE3FUSJFWF w ී௨ʹֶशͤ͞ΔͱɺจଐੑϚʔΧΛ݀ຒΊ͢Δ ͚ͩͷֶशʹͳͬͯ͠·͏ ˠεϜʔδϯά͕ߦΘΕͣྲྀெʹͳΒͳ͍ w ଐੑϚʔΧ֬తʹϊΠζΛՃ͑Δ ˡฤूڑ͕ͰಉଐੑͷผϚʔΧஔ͖͑Δ !18
&YQFSJNFOUT w :FMQϨϏϡʔɺ"NB[POϨϏϡʔͷײΛస w ը૾ΩϟϓγϣϯΛΑΓϩϚϯνοΫ͔ϢʔϞϥε ʹͳΔΑ͏มߋ w ैདྷख๏ɺ)VNBO3FGFSFODFɺఏҊ͢Δͭͷ γεςϜΛൺֱ w
)VNBO3FGFSFODF.5VSLͰऩू !19
%BUBTFUT w Ωϟϓγϣϯͷςετηοτࣄ࣮ͷΈͰ͋ΔͨΊ ଐੑϚʔΧͷআͳ͘ɺૠೖͷΈ !20
&YQFSJNFOUBM%FUBJMT w EJNFOTJPOBMXPSEWFDUPST w TJOHMFMBZFS(36XJUIIJEEFOVOJUT w NBYPVUBDUJWBUJPOGVODUJPO w "EBEFMUBXJUIBNJOJCBUDITJ[FPG w
CFBNTFBSDIXJUIBCFBNTJ[FPG !21
)VNBO&WBMVBUJPO w .5VSLͰޏͬͨϫʔΧʔ͕γεςϜͷग़ྗΛධՁ w ஈ֊ͷϦοΧʔτईͰจ๏ੑɺଐੑɺ ҙຯͷอ࣋ΛධՁ w ·ͨͱධՁ͞Εͨ߹ʹग़ྗޭͱݟ၏͢ w ແ࡞ҝʹநग़ͨ͠αϯϓϧΛධՁ
ʢ֤ଐੑ͝ͱʹαϯϓϧʣ !22
)VNBO&WBMVBUJPO !23
$PODMVTJPO w ςΩετଐੑมʹ͓͍ͯैདྷͷ("/ʹΑΔख๏ ΑΓߴੑೳͳख๏ΛఏҊ w จͷଐੑʹӨڹΛ༩͑Δ۟ہॴతͰ͋Δ͜ͱ͕ ޮՌΛେ͖͍ͯ͘͠Δ w কདྷతʹOHSBNΑΓҰൠతͳଐੑͷ֓೦Λ։ൃ ͢Δͱ༗ӹ͕ͩɺΑΓؼೲతόΠΞεΛ͏
!24