Misspelling_Oblivious_Word_Embedding.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=47 MARUYAMA
January 22, 2020
0
40

 Misspelling_Oblivious_Word_Embedding.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=128

MARUYAMA

January 22, 2020
Tweet

More Decks by MARUYAMA

See All by MARUYAMA
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
46
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
49
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
46
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
49
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
36
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
52
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
45
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
33
A3ea3bc5dde6ae2dd6eae71da9c418b0?s=48 tmaru0204
0
67

Featured

See All Featured
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
142
19k
F383c6a4dc55e331bbe2987b622cee6b?s=48 stephaniewalter
256
11k
C7393b7ba7ec9c8890dd77d209fbb3c9?s=48 maltzj
499
36k
282d599b414022eba5096510f675b6e2?s=48 chrislema
171
14k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
309
21k
06f8b41980eb4c577fa40c41d5030c19?s=48 keathley
15
520
8081b26e05bb4354f7d65ffc34cbbd67?s=48 chriscoyier
775
240k
4262b9cfacfb6b2c77f23e1d0310cd3e?s=48 myddelton
106
11k
A9704266587836f7e784235e5073b93e?s=48 jmmastey
5
370
9fa239b3154a0169d99ab7bf1422dd12?s=48 marcelosomers
220
14k
D36d2c1821af9249b69ff7f5ed60529b?s=48 tammielis
236
23k
433acaea1012b25d97ae66da9b998dad?s=48 malarkey
191
8.3k

Transcript

  1. .JTTQFMMJOH0CMJWJPVT 8PSE&NCFEEJOHT จݙ঺հ #PSB&EJ[FM "MFLTBOESB1JLUVT 1JPUS#PKBOPXTLJ  3VJ'FSSFJSB &EPVBSE(SBWF 'BCSJ[JP4JMWFTUSJ

    /""$-)-5 QQ

  2. "CTUSBDU ✦ εϖϧϛε଱ੑΛඋ͑ͨ୯ޠ෼ࢄදݱ 2 ɾεϖϧϛεͷ୯ޠͱਖ਼͍͠୯ޠͷ෼ࢄදݱΛ͚ۙͮΔֶश ✦ ಺ɾ֎తධՁͷ྆ํʹ͓͍ͯ ఏҊख๏ ͷ༗ޮੑΛࣔͨ͠ ɾ಺తධՁXPSETJNJMBSJUZ

    XPSEBOBMPHZ  OFJHICPSIPPETJNJMBSJUZ ɾ֎తධՁ104UBHHJOH

  3. *OUSPEVDUJPO ✦ 0VUPGWPDBCVMBSZ 007 ͸ඇৗʹଟ͍ 3 ɾ8FCݕࡧΫΤϦͷ͸εϖϧϛε ✦ 007ʹରॲͰ͖Δ෼ࢄදݱΛ࡞Γ͍ͨ ɾֶशίʔύεʹεϖϧϛεͷ୯ޠΛಋೖ

    εϖϧϛε୯ޠͷεύʔεੑ ɾ'BTU5FYU εϖϧϛεύλʔϯͷڭࢣ͋Γֶश

  4. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ 4LJQHSBNXJUIOFHBUJWFTBNQMJOH 4 ίʔύε पล୯ޠ ෛྫू߹ 

  5. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ 'BTU5FYU 5 ίʔύε पล୯ޠ ෛྫू߹ ୯ޠͷจࣈOHSBN ωi FH

    CBOBOB  㱡O㱡 \CBO BOB OBO CBOB BOBO  OBOB CBOBO BOBOB^ LFT sFT (ωi , ωc ) sFT (ωi , ωc )

  6. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ .0&NPEFM 6 ίʔύε εϖϧϛεϖΞ (ωm , ωe )

    ∈ M ωm εϖϧϛεͷ୯ޠ ωe ਖ਼͍͠εϖϧͷ୯ޠ 4QFMMDPSSFDUJPOMPTT ෛྫू߹

  7. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ .0&NPEFM 7 https://ai.facebook.com/blog/-a-new-model-for-word-embeddings-that-are-resilient-to-misspellings-/

  8. %BUB ✦ &OHMJTI8JLJQFEJB 8 ɾ'BTU5FYUMPTTͷ࠷దԽ ✦ .JTTQFMMJOHTEBUBTFU ɾGBDFCPPLͷݕࡧΫΤϦʹج͍ͮͯੜ੒ ɾ 

    ϖΞ ɾIUUQTCJUCVDLFUPSHCFEJ[FMNPF

  9. .JTTQFMMFEEBUBHFOFSBUJPO ✦ &SSPSNPEFM 9 ɾݕࡧΫΤϦͷཤྺ εϖϧϛεΛϢʔβ͕मਖ਼ͨ݁͠Ռ  ͔ΒҎԼͷUSJQMFUΛ࡞੒ ɾ.0&ͷֶश࣌ʹ εϖϧϛε֬཰ʹج͍ͮͯαϯϓϦϯά

    ɾ࠷௕Ұக͢ΔΛ΋ͱʹσʔληοτ಺Λݕࡧ c c pm pe c FH hello worjdˠhello world < XPS K M  PS K M  S K M  П K M > ௚લͷจࣈྻ ฤूલͷจࣈ ฤूޙͷจࣈ 5SJQMFU

  10. &YQFSJNFOUT ✦ εϖϧϛεؚΉςετσʔλΛੜ੒ 10 ɾֶशσʔλੜ੒࣌ͱಉ༷ͷํ๏ͰεϖϧϛεΛ௥Ճ ɾฤूڑ཭ͱ୯ޠ௕Λ੍ޚ͢ΔύϥϝʔλS

  11. &YQFSJNFOUT ✦ *OUSJOTJDUBTL 11 ɾ8PSETJNJMBSJUZ ୯ޠؒͷྨࣅ౓ ਓखධՁͱͷ૬ؔʹΑΓධՁ ɾ8PSEBOBMPHZ #FSMJO(FSNBO 'SBODF1BJST

    ਖ਼ղ཰ͰධՁ ɾ/FJHICPSIPPETJNJMBSJUZ εϖϧϛεͷ෼ࢄදݱ͕ਖ਼͍͠୯ޠͷ෼ࢄදݱͱ͍͔ۙ  ฏۉٯॱҐ .33 DPWFSBHFͰධՁ

  12. *OUSJOTJDFWBMVBUJPO ✦ 8PSETJNJMBSJUZ 12

  13. *OUSJOTJDFWBMVBUJPO ✦ 8PSEBOBMPHZ 13

  14. *OUSJOTJDFWBMVBUJPO ✦ /FJHICPSIPPETJNJMBSJUZ 14

  15. &YQFSJNFOUT ✦ &YUSJOTJDUBTL 15 ɾ104UBHHJOH #J-45. $3' 8PSEFNCFEEJOHMBZFS'BTU5FYUPS.0&

  16. &YUSJOTJDFWBMVBUJPO ✦ 104UBHHJOH 16 0SJHJOBMͷ݁ՌΛଛͳΘͣʹ εϖϧϛεͰͷੑೳվળ

  17. &YUSJOTJDFWBMVBUJPO ✦ 104UBHHJOH 17 USBJOͱUFTU͕ۃ୺ʹҟͳΔઃఆͰ΋༗ޮʹ࡞༻

  18. $PODMVTJPO 18 ✦ εϖϧϛε଱ੑΛඋ͑ͨ୯ޠ෼ࢄදݱ ɾεϖϧϛεͷ୯ޠͱਖ਼͍͠୯ޠͷ෼ࢄදݱΛ͚ۙͮΔֶश ✦ ࣮ࡍʹਖ਼͍͠୯ޠͷ෼ࢄදݱʹ͍ۙͮͯ ͍Δ͜ͱΛ֬ೝ ✦ εϖϧϛεΛؚΉ༷ʑͳλεΫʹ͓͍ͯ

    ੑೳΛվળ XPSETJNJMBSJUZ BOBMPHZ 104UBHHJOH