Upgrade to Pro — share decks privately, control downloads, hide ads and more …

An_Embarrassingly_Simple_Approach_for_Transfer_...

Avatar for MARUYAMA MARUYAMA
July 10, 2019
0
150

 An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf

Avatar for MARUYAMA

MARUYAMA

July 10, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
180
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
190
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
180
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
160
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
150
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
140
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
170
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
Avatar for MARUYAMA tmaru0204
0
190

Featured

See All Featured
Code Reviewing Like a Champion
Avatar for maltzj maltzj
525
40k
Music & Morning Musume
Avatar for Bryan Veloso bryan
46
6.8k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
54
11k
We Have a Design System, Now What?
Avatar for Morgane Peng morganepeng
53
7.8k
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
246
12k
How to train your dragon (web standard)
Avatar for Monica Dinculescu notwaldorf
96
6.2k
Exploring the Power of Turbo Streams & Action Cable | RailsConf2023
Avatar for Kevin Liebholz kevinliebholz
34
6k
Balancing Empowerment & Direction
Avatar for Lara Hogan lara
3
620
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
411
22k
The Invisible Side of Design
Avatar for Vitaly Friedman smashingmag
301
51k
The Success of Rails: Ensuring Growth for the Next 100 Years
Avatar for Eileen M. Uchitelle eileencodes
46
7.6k

Transcript

  1. "O&NCBSSBTTJOHMZ4JNQMF"QQSPBDIGPS 5SBOTGFS-FBSOJOHGSPN1SFUSBJOFE-BOHVBHF.PEFMT "MFYBOESB$ISPOPQPVMPV $ISJTUPT#B[JPUJT "MFYBOESPT1PUBNJBOPT /""$-)-5 QBHFTr -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. "CTUSBDU ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒

  3. 3FMBUFEXPSL ⾣6-.'J5 %JTDSJNJOBUJWFpOFUVOJOH֤૚Ͱֶश཰ΛมԽͤ͞Δ 4MBOUFEUSJBOHVMBSMFBSOJOHSBUFT

  4. .PEFM 4J"5- ⾣-.1SFUSBJOJOH ⾣5SBOTGFSBVYJMJBSZMPTT ɾFYQPOFOUJBMEFDBZPGЍ FQPDIຖʹЍΛࢦ਺తʹݮਰ ɾTFRVFOUJBMVOGSFF[JOH ্ͷ૚͔Βॱ࣍ղౚ͠ɺpOFUVOJOH

  5. &YQFSJNFOUBMTFUVQT ⾣%BUBTFUT ɾ*SPOZJSPOZEFUFDUJPO ɾ4FOUTFOUJNFOUBOBMZTJT ɾ4$W 4$WTBSDBTNEFUFDUJPO ɾ1TZDI&YQFNPUJPOSFDPHOJUJPO

  6. 3FTVMUT ⾣"CMBUJPOTUVEZ

  7. 3FTVMUT ⾣/VNCFSPGFYBNQMFT ɾ4J"5- DPOUJOVPVTMJOFT ɾ6-.'J5 EBTIFEMJOFT dσʔλఔ౓Ͱɺ 6-.'J5ʹඖఢ͢Δੑೳ

  8. 3FTVMUT ⾣&YQPOFOUJBMEFDBZPGЍ *OJUJBMWBMVF 'JOBMWBMVF

  9. $PODMVTJPO ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒