Upgrade to Pro — share decks privately, control downloads, hide ads and more …

An_Embarrassingly_Simple_Approach_for_Transfer_...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for MARUYAMA MARUYAMA
July 10, 2019
160
0

 An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf

Avatar for MARUYAMA

MARUYAMA

July 10, 2019

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
200
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
210
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
190
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
160
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
180
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
Avatar for MARUYAMA tmaru0204
0
200

Featured

See All Featured
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
27
3.4k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
120k
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
310
State of Search Keynote: SEO is Dead Long Live SEO
Avatar for Ryan Jones ryanjones
0
170
First, design no harm
Avatar for Per Axbom axbom
PRO
2
1.2k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
54k
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
163
24k
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
290
Chasing Engaging Ingredients in Design
Avatar for Sebastian Deterding codingconduct
0
160
Impact Scores and Hybrid Strategies: The future of link building
Avatar for Tamara Novitovic tamaranovitovic
0
250
Building Experiences: Design Systems, User Experience, and Full Site Editing
Avatar for Michelle Schulp Hunt marktimemedia
0
470
Organizational Design Perspectives: An Ontology of Organizational Design Elements
Avatar for Dr. Kim W Petersen kimpetersen
PRO
1
660

Transcript

  1. "O&NCBSSBTTJOHMZ4JNQMF"QQSPBDIGPS 5SBOTGFS-FBSOJOHGSPN1SFUSBJOFE-BOHVBHF.PEFMT "MFYBOESB$ISPOPQPVMPV $ISJTUPT#B[JPUJT "MFYBOESPT1PUBNJBOPT /""$-)-5 QBHFTr -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. "CTUSBDU ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒

  3. 3FMBUFEXPSL ⾣6-.'J5 %JTDSJNJOBUJWFpOFUVOJOH֤૚Ͱֶश཰ΛมԽͤ͞Δ 4MBOUFEUSJBOHVMBSMFBSOJOHSBUFT

  4. .PEFM 4J"5- ⾣-.1SFUSBJOJOH ⾣5SBOTGFSBVYJMJBSZMPTT ɾFYQPOFOUJBMEFDBZPGЍ FQPDIຖʹЍΛࢦ਺తʹݮਰ ɾTFRVFOUJBMVOGSFF[JOH ্ͷ૚͔Βॱ࣍ղౚ͠ɺpOFUVOJOH

  5. &YQFSJNFOUBMTFUVQT ⾣%BUBTFUT ɾ*SPOZJSPOZEFUFDUJPO ɾ4FOUTFOUJNFOUBOBMZTJT ɾ4$W 4$WTBSDBTNEFUFDUJPO ɾ1TZDI&YQFNPUJPOSFDPHOJUJPO

  6. 3FTVMUT ⾣"CMBUJPOTUVEZ

  7. 3FTVMUT ⾣/VNCFSPGFYBNQMFT ɾ4J"5- DPOUJOVPVTMJOFT ɾ6-.'J5 EBTIFEMJOFT dσʔλఔ౓Ͱɺ 6-.'J5ʹඖఢ͢Δੑೳ

  8. 3FTVMUT ⾣&YQPOFOUJBMEFDBZPGЍ *OJUJBMWBMVF 'JOBMWBMVF

  9. $PODMVTJPO ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒