Upgrade to Pro — share decks privately, control downloads, hide ads and more …

An_Embarrassingly_Simple_Approach_for_Transfer_...

Avatar for MARUYAMA MARUYAMA
July 10, 2019
0
160

 An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf

Avatar for MARUYAMA

MARUYAMA

July 10, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
190
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
200
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
190
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
160
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
180
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
170
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
Avatar for MARUYAMA tmaru0204
0
200

Featured

See All Featured
Lightning Talk: Beautiful Slides for Beginners
Avatar for Ines Montani inesmontani
PRO
1
420
A Tale of Four Properties
Avatar for Chris Coyier chriscoyier
162
24k
[RailsConf 2023 Opening Keynote] The Magic of Rails
Avatar for Eileen M. Uchitelle eileencodes
31
9.8k
Highjacked: Video Game Concept Design
Avatar for Ryan Kendrick rkendrick25
PRO
1
270
Why You Should Never Use an ORM
Avatar for John Nunemaker jnunemaker
PRO
61
9.7k
The Curse of the Amulet
Avatar for Matthew Lei leimatthew05
1
7.6k
Code Reviewing Like a Champion
Avatar for maltzj maltzj
527
40k
The Straight Up "How To Draw Better" Workshop
Avatar for Dennis Kardys denniskardys
239
140k
The State of eCommerce SEO: How to Win in Today's Products SERPs - #SEOweek
Avatar for Aleyda Solis aleyda
2
9.4k
The Curious Case for Waylosing
Avatar for Cassini Nazir cassininazir
0
220
Test your architecture with Archunit
Avatar for Yoan thirion
1
2.1k
Unsuck your backbone
Avatar for Amy Palamountain ammeep
671
58k

Transcript

  1. "O&NCBSSBTTJOHMZ4JNQMF"QQSPBDIGPS 5SBOTGFS-FBSOJOHGSPN1SFUSBJOFE-BOHVBHF.PEFMT "MFYBOESB$ISPOPQPVMPV $ISJTUPT#B[JPUJT "MFYBOESPT1PUBNJBOPT /""$-)-5 QBHFTr -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. "CTUSBDU ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒

  3. 3FMBUFEXPSL ⾣6-.'J5 %JTDSJNJOBUJWFpOFUVOJOH֤૚Ͱֶश཰ΛมԽͤ͞Δ 4MBOUFEUSJBOHVMBSMFBSOJOHSBUFT

  4. .PEFM 4J"5- ⾣-.1SFUSBJOJOH ⾣5SBOTGFSBVYJMJBSZMPTT ɾFYQPOFOUJBMEFDBZPGЍ FQPDIຖʹЍΛࢦ਺తʹݮਰ ɾTFRVFOUJBMVOGSFF[JOH ্ͷ૚͔Βॱ࣍ղౚ͠ɺpOFUVOJOH

  5. &YQFSJNFOUBMTFUVQT ⾣%BUBTFUT ɾ*SPOZJSPOZEFUFDUJPO ɾ4FOUTFOUJNFOUBOBMZTJT ɾ4$W 4$WTBSDBTNEFUFDUJPO ɾ1TZDI&YQFNPUJPOSFDPHOJUJPO

  6. 3FTVMUT ⾣"CMBUJPOTUVEZ

  7. 3FTVMUT ⾣/VNCFSPGFYBNQMFT ɾ4J"5- DPOUJOVPVTMJOFT ɾ6-.'J5 EBTIFEMJOFT dσʔλఔ౓Ͱɺ 6-.'J5ʹඖఢ͢Δੑೳ

  8. 3FTVMUT ⾣&YQPOFOUJBMEFDBZPGЍ *OJUJBMWBMVF 'JOBMWBMVF

  9. $PODMVTJPO ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒