Upgrade to Pro — share decks privately, control downloads, hide ads and more …

An_Embarrassingly_Simple_Approach_for_Transfer_...

Avatar for MARUYAMA MARUYAMA
July 10, 2019
0
160

 An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf

Avatar for MARUYAMA

MARUYAMA

July 10, 2019
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
Avatar for MARUYAMA tmaru0204
0
180
Misspelling_Oblivious_Word_Embedding.pdf
Avatar for MARUYAMA tmaru0204
0
190
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
Avatar for MARUYAMA tmaru0204
0
180
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
170
20191028_literature-review.pdf
Avatar for MARUYAMA tmaru0204
0
160
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
140
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
Avatar for MARUYAMA tmaru0204
0
170
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
Avatar for MARUYAMA tmaru0204
0
160
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
Avatar for MARUYAMA tmaru0204
0
190

Featured

See All Featured
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
PRO
23
1.5k
A Modern Web Designer's Workflow
Avatar for Chris Coyier chriscoyier
697
190k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4.1k
The Web Performance Landscape in 2024 [PerfNow 2024]
Avatar for Tammy Everts tammyeverts
10
910
StorybookのUI Testing Handbookを読んだ
Avatar for Shingo Yamazaki zakiyama
31
6.3k
Unsuck your backbone
Avatar for Amy Palamountain ammeep
671
58k
Optimising Largest Contentful Paint
Avatar for Harry Roberts csswizardry
37
3.5k
Into the Great Unknown - MozCon
Avatar for Noah Learner thekraken
40
2.1k
ReactJS: Keep Simple. Everything can be a component!
Avatar for Pedro Nauck pedronauck
666
130k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
38
2.9k
A better future with KSS
Avatar for Kyle Neath kneath
239
18k
Automating Front-end Workflow
Avatar for Addy Osmani addyosmani
1371
200k

Transcript

  1. "O&NCBSSBTTJOHMZ4JNQMF"QQSPBDIGPS 5SBOTGFS-FBSOJOHGSPN1SFUSBJOFE-BOHVBHF.PEFMT "MFYBOESB$ISPOPQPVMPV $ISJTUPT#B[JPUJT "MFYBOESPT1PUBNJBOPT /""$-)-5 QBHFTr -JUFSBUVSFSFWJFX /BHBPLB6OJWFSTJUZPG5FDIOPMPHZ5BLVNJ.BSVZBNB

  2. "CTUSBDU ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒

  3. 3FMBUFEXPSL ⾣6-.'J5 %JTDSJNJOBUJWFpOFUVOJOH֤૚Ͱֶश཰ΛมԽͤ͞Δ 4MBOUFEUSJBOHVMBSMFBSOJOHSBUFT

  4. .PEFM 4J"5- ⾣-.1SFUSBJOJOH ⾣5SBOTGFSBVYJMJBSZMPTT ɾFYQPOFOUJBMEFDBZPGЍ FQPDIຖʹЍΛࢦ਺తʹݮਰ ɾTFRVFOUJBMVOGSFF[JOH ্ͷ૚͔Βॱ࣍ղౚ͠ɺpOFUVOJOH

  5. &YQFSJNFOUBMTFUVQT ⾣%BUBTFUT ɾ*SPOZJSPOZEFUFDUJPO ɾ4FOUTFOUJNFOUBOBMZTJT ɾ4$W 4$WTBSDBTNEFUFDUJPO ɾ1TZDI&YQFNPUJPOSFDPHOJUJPO

  6. 3FTVMUT ⾣"CMBUJPOTUVEZ

  7. 3FTVMUT ⾣/VNCFSPGFYBNQMFT ɾ4J"5- DPOUJOVPVTMJOFT ɾ6-.'J5 EBTIFEMJOFT dσʔλఔ౓Ͱɺ 6-.'J5ʹඖఢ͢Δੑೳ

  8. 3FTVMUT ⾣&YQPOFOUJBMEFDBZPGЍ *OJUJBMWBMVF 'JOBMWBMVF

  9. $PODMVTJPO ⾣FOEUPFOEʹֶशͤ͞ΔγϯϓϧͳసҠֶशख๏ΛఏҊ ⾣ࣄલֶशͨ͠ݴޠϞσϧΛ෼ྨλεΫʹpOFUVOJOH ⾣༷ʑͳςΩετ෼ྨλεΫͰɺطଘख๏Λ௒͑ΔੑೳΛୡ੒