Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Misspelling_Oblivious_Word_Embedding.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=47 MARUYAMA
January 22, 2020
0
52

 Misspelling_Oblivious_Word_Embedding.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=128

MARUYAMA

January 22, 2020
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
vampire.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
69
Simple_Unsupervised_Summarization_by_Contextual_Matching.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
62
Controlling_Text_Complexity_in_Neural_Machine_Translation.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
61
20191028_literature-review.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
63
Hint-Based_Training_for_Non-Autoregressive_Machine_Translation.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
46
Soft_Contextual_Data_Augmentation_for_Neural_Machine_Translation_.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
61
An_Embarrassingly_Simple_Approach_for_Transfer_Learning_from_Pretrained_Language_Models_.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
56
Addressing_Trobulesome_Words_in_Neural_Machine_Translation.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
48
Simple_Unsupervised_Keyphrase_Extraction_using_Sentence_Embeddings.pdf
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
85

Featured

See All Featured
The Pragmatic Product Professional
1177e050db6bafe62885362edf6e3537?s=48 lauravandoore
19
2.9k
Pencils Down: Stop Designing & Start Developing
79acae287842acf29084005533a7fb3b?s=48 hursman
112
9.8k
Easily Structure & Communicate Ideas using Wireframe
0c6fd6a08d0f898159cda7cafcacf07f?s=48 afnizarnur
181
15k
It's Worth the Effort
Ba530e786553390f3fb271848485681c?s=48 3n
172
25k
Fireside Chat
864a009ac73600c7c02e1f26629dd989?s=48 paigeccino
11
1.3k
Docker and Python
Ecdea9b9714877b86cee08458f085481?s=48 trallard
27
1.5k
GraphQLとの向き合い方2022年版
893f54413c2bd9ba41d11d753aacaf2c?s=48 quramy
16
8.1k
Keith and Marios Guide to Fast Websites
E14f55d3f939977cecbf51b64ff6f861?s=48 keithpitt
404
21k
Raft: Consensus for Rubyists
B6a8f005f39d23ffc930508ac9da68b9?s=48 vanstee
126
5.4k
Adopting Sorbet at Scale
2bb923c57a1fdc3a2eb484bb8d565fd2?s=48 ufuk
63
7.5k
Art Directing for the Web. Five minutes with CSS Template Areas
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
196
9.4k
Code Review Best Practice
3d6ace9554821d552146413bcdf874f6?s=48 trishagee
41
6.8k

Transcript

  1. .JTTQFMMJOH0CMJWJPVT 8PSE&NCFEEJOHT จݙ঺հ #PSB&EJ[FM "MFLTBOESB1JLUVT 1JPUS#PKBOPXTLJ  3VJ'FSSFJSB &EPVBSE(SBWF 'BCSJ[JP4JMWFTUSJ

    /""$-)-5 QQ

  2. "CTUSBDU ✦ εϖϧϛε଱ੑΛඋ͑ͨ୯ޠ෼ࢄදݱ 2 ɾεϖϧϛεͷ୯ޠͱਖ਼͍͠୯ޠͷ෼ࢄදݱΛ͚ۙͮΔֶश ✦ ಺ɾ֎తධՁͷ྆ํʹ͓͍ͯ ఏҊख๏ ͷ༗ޮੑΛࣔͨ͠ ɾ಺తධՁXPSETJNJMBSJUZ

    XPSEBOBMPHZ  OFJHICPSIPPETJNJMBSJUZ ɾ֎తධՁ104UBHHJOH

  3. *OUSPEVDUJPO ✦ 0VUPGWPDBCVMBSZ 007 ͸ඇৗʹଟ͍ 3 ɾ8FCݕࡧΫΤϦͷ͸εϖϧϛε ✦ 007ʹରॲͰ͖Δ෼ࢄදݱΛ࡞Γ͍ͨ ɾֶशίʔύεʹεϖϧϛεͷ୯ޠΛಋೖ

    εϖϧϛε୯ޠͷεύʔεੑ ɾ'BTU5FYU εϖϧϛεύλʔϯͷڭࢣ͋Γֶश

  4. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ 4LJQHSBNXJUIOFHBUJWFTBNQMJOH 4 ίʔύε पล୯ޠ ෛྫू߹ 

  5. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ 'BTU5FYU 5 ίʔύε पล୯ޠ ෛྫू߹ ୯ޠͷจࣈOHSBN ωi FH

    CBOBOB  㱡O㱡 \CBO BOB OBO CBOB BOBO  OBOB CBOBO BOBOB^ LFT sFT (ωi , ωc ) sFT (ωi , ωc )

  6. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ .0&NPEFM 6 ίʔύε εϖϧϛεϖΞ (ωm , ωe )

    ∈ M ωm εϖϧϛεͷ୯ޠ ωe ਖ਼͍͠εϖϧͷ୯ޠ 4QFMMDPSSFDUJPOMPTT ෛྫू߹

  7. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ .0&NPEFM 7 https://ai.facebook.com/blog/-a-new-model-for-word-embeddings-that-are-resilient-to-misspellings-/

  8. %BUB ✦ &OHMJTI8JLJQFEJB 8 ɾ'BTU5FYUMPTTͷ࠷దԽ ✦ .JTTQFMMJOHTEBUBTFU ɾGBDFCPPLͷݕࡧΫΤϦʹج͍ͮͯੜ੒ ɾ 

    ϖΞ ɾIUUQTCJUCVDLFUPSHCFEJ[FMNPF

  9. .JTTQFMMFEEBUBHFOFSBUJPO ✦ &SSPSNPEFM 9 ɾݕࡧΫΤϦͷཤྺ εϖϧϛεΛϢʔβ͕मਖ਼ͨ݁͠Ռ  ͔ΒҎԼͷUSJQMFUΛ࡞੒ ɾ.0&ͷֶश࣌ʹ εϖϧϛε֬཰ʹج͍ͮͯαϯϓϦϯά

    ɾ࠷௕Ұக͢ΔΛ΋ͱʹσʔληοτ಺Λݕࡧ c c pm pe c FH hello worjdˠhello world < XPS K M  PS K M  S K M  П K M > ௚લͷจࣈྻ ฤूલͷจࣈ ฤूޙͷจࣈ 5SJQMFU

  10. &YQFSJNFOUT ✦ εϖϧϛεؚΉςετσʔλΛੜ੒ 10 ɾֶशσʔλੜ੒࣌ͱಉ༷ͷํ๏ͰεϖϧϛεΛ௥Ճ ɾฤूڑ཭ͱ୯ޠ௕Λ੍ޚ͢ΔύϥϝʔλS

  11. &YQFSJNFOUT ✦ *OUSJOTJDUBTL 11 ɾ8PSETJNJMBSJUZ ୯ޠؒͷྨࣅ౓ ਓखධՁͱͷ૬ؔʹΑΓධՁ ɾ8PSEBOBMPHZ #FSMJO(FSNBO 'SBODF1BJST

    ਖ਼ղ཰ͰධՁ ɾ/FJHICPSIPPETJNJMBSJUZ εϖϧϛεͷ෼ࢄදݱ͕ਖ਼͍͠୯ޠͷ෼ࢄදݱͱ͍͔ۙ  ฏۉٯॱҐ .33 DPWFSBHFͰධՁ

  12. *OUSJOTJDFWBMVBUJPO ✦ 8PSETJNJMBSJUZ 12

  13. *OUSJOTJDFWBMVBUJPO ✦ 8PSEBOBMPHZ 13

  14. *OUSJOTJDFWBMVBUJPO ✦ /FJHICPSIPPETJNJMBSJUZ 14

  15. &YQFSJNFOUT ✦ &YUSJOTJDUBTL 15 ɾ104UBHHJOH #J-45. $3' 8PSEFNCFEEJOHMBZFS'BTU5FYUPS.0&

  16. &YUSJOTJDFWBMVBUJPO ✦ 104UBHHJOH 16 0SJHJOBMͷ݁ՌΛଛͳΘͣʹ εϖϧϛεͰͷੑೳվળ

  17. &YUSJOTJDFWBMVBUJPO ✦ 104UBHHJOH 17 USBJOͱUFTU͕ۃ୺ʹҟͳΔઃఆͰ΋༗ޮʹ࡞༻

  18. $PODMVTJPO 18 ✦ εϖϧϛε଱ੑΛඋ͑ͨ୯ޠ෼ࢄදݱ ɾεϖϧϛεͷ୯ޠͱਖ਼͍͠୯ޠͷ෼ࢄදݱΛ͚ۙͮΔֶश ✦ ࣮ࡍʹਖ਼͍͠୯ޠͷ෼ࢄදݱʹ͍ۙͮͯ ͍Δ͜ͱΛ֬ೝ ✦ εϖϧϛεΛؚΉ༷ʑͳλεΫʹ͓͍ͯ

    ੑೳΛվળ XPSETJNJMBSJUZ BOBMPHZ 104UBHHJOH