Upgrade to Pro — share decks privately, control downloads, hide ads and more …

An_Embarrassingly_Simple_Approach_for_Transfer_...

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for MARUYAMA MARUYAMA
July 10, 2019
0
160

 An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf

Avatar for MARUYAMA

MARUYAMA

July 10, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
190
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
200
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
190
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
180
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
160
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
150
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
180
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
170
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
Avatar for MARUYAMA tmaru0204
0
200

Featured

See All Featured
[SF Ruby Conf 2025] Rails X
Avatar for Vladimir Dementyev palkan
1
760
Design in an AI World
Avatar for tapps tapps
0
140
What's in a price? How to price your products and services
Avatar for Michael Herold michaelherold
247
13k
Making the Leap to Tech Lead
Avatar for Ryan Cromwell cromwellryan
135
9.7k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
210
24k
Bash Introduction
Avatar for André Augusto Costa Santos 62gerente
615
210k
We Are The Robots
Avatar for Honza Javorek honzajavorek
0
170
How to build a perfect <img>
Avatar for Jono Alderson jonoalderson
1
4.9k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
Music & Morning Musume
Avatar for Bryan Veloso bryan
47
7.1k
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
3.9k
The Illustrated Children's Guide to Kubernetes
Avatar for Chris Short chrisshort
51
51k

Transcript

  1. "O&NCBSSBTTJOHMZ4JNQMF"QQSPBDIGPS 5SBOTGFS-FBSOJOHGSPN1SFUSBJOFE-BOHVBHF.PEFMT "MFYBOESB$ISPOPQPVMPV $ISJTUPT#B[JPUJT "MFYBOESPT1PUBNJBOPT /""$-)-5 QBHFTr -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. "CTUSBDU ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒

  3. 3FMBUFEXPSL ⾣6-.'J5 %JTDSJNJOBUJWFpOFUVOJOH֤૚Ͱֶश཰ΛมԽͤ͞Δ 4MBOUFEUSJBOHVMBSMFBSOJOHSBUFT

  4. .PEFM 4J"5- ⾣-.1SFUSBJOJOH ⾣5SBOTGFSBVYJMJBSZMPTT ɾFYQPOFOUJBMEFDBZPGЍ FQPDIຖʹЍΛࢦ਺తʹݮਰ ɾTFRVFOUJBMVOGSFF[JOH ্ͷ૚͔Βॱ࣍ղౚ͠ɺpOFUVOJOH

  5. &YQFSJNFOUBMTFUVQT ⾣%BUBTFUT ɾ*SPOZJSPOZEFUFDUJPO ɾ4FOUTFOUJNFOUBOBMZTJT ɾ4$W 4$WTBSDBTNEFUFDUJPO ɾ1TZDI&YQFNPUJPOSFDPHOJUJPO

  6. 3FTVMUT ⾣"CMBUJPOTUVEZ

  7. 3FTVMUT ⾣/VNCFSPGFYBNQMFT ɾ4J"5- DPOUJOVPVTMJOFT ɾ6-.'J5 EBTIFEMJOFT dσʔλఔ౓Ͱɺ 6-.'J5ʹඖఢ͢Δੑೳ

  8. 3FTVMUT ⾣&YQPOFOUJBMEFDBZPGЍ *OJUJBMWBMVF 'JOBMWBMVF

  9. $PODMVTJPO ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒