Misspelling_Oblivious_Word_Embedding.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=47 MARUYAMA
January 22, 2020
40

 Misspelling_Oblivious_Word_Embedding.pdf

A3ea3bc5dde6ae2dd6eae71da9c418b0?s=128

MARUYAMA

January 22, 2020
Tweet

Transcript

  1. .JTTQFMMJOH0CMJWJPVT 8PSE&NCFEEJOHT จݙ঺հ #PSB&EJ[FM "MFLTBOESB1JLUVT 1JPUS#PKBOPXTLJ  3VJ'FSSFJSB &EPVBSE(SBWF 'BCSJ[JP4JMWFTUSJ

    /""$-)-5 QQ
  2. "CTUSBDU ✦ εϖϧϛε଱ੑΛඋ͑ͨ୯ޠ෼ࢄදݱ 2 ɾεϖϧϛεͷ୯ޠͱਖ਼͍͠୯ޠͷ෼ࢄදݱΛ͚ۙͮΔֶश ✦ ಺ɾ֎తධՁͷ྆ํʹ͓͍ͯ ఏҊख๏ ͷ༗ޮੑΛࣔͨ͠ ɾ಺తධՁXPSETJNJMBSJUZ

    XPSEBOBMPHZ  OFJHICPSIPPETJNJMBSJUZ ɾ֎తධՁ104UBHHJOH
  3. *OUSPEVDUJPO ✦ 0VUPGWPDBCVMBSZ 007 ͸ඇৗʹଟ͍ 3 ɾ8FCݕࡧΫΤϦͷ͸εϖϧϛε ✦ 007ʹରॲͰ͖Δ෼ࢄදݱΛ࡞Γ͍ͨ ɾֶशίʔύεʹεϖϧϛεͷ୯ޠΛಋೖ

    εϖϧϛε୯ޠͷεύʔεੑ ɾ'BTU5FYU εϖϧϛεύλʔϯͷڭࢣ͋Γֶश
  4. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ 4LJQHSBNXJUIOFHBUJWFTBNQMJOH 4 ίʔύε पล୯ޠ ෛྫू߹ 

  5. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ 'BTU5FYU 5 ίʔύε पล୯ޠ ෛྫू߹ ୯ޠͷจࣈOHSBN ωi FH

    CBOBOB  㱡O㱡 \CBO BOB OBO CBOB BOBO  OBOB CBOBO BOBOB^ LFT sFT (ωi , ωc ) sFT (ωi , ωc )
  6. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ .0&NPEFM 6 ίʔύε εϖϧϛεϖΞ (ωm , ωe )

    ∈ M ωm εϖϧϛεͷ୯ޠ ωe ਖ਼͍͠εϖϧͷ୯ޠ 4QFMMDPSSFDUJPOMPTT ෛྫू߹
  7. .JTTQFMMJOH0CMJWJPVT&NCFEEJOH ✦ .0&NPEFM 7 https://ai.facebook.com/blog/-a-new-model-for-word-embeddings-that-are-resilient-to-misspellings-/

  8. %BUB ✦ &OHMJTI8JLJQFEJB 8 ɾ'BTU5FYUMPTTͷ࠷దԽ ✦ .JTTQFMMJOHTEBUBTFU ɾGBDFCPPLͷݕࡧΫΤϦʹج͍ͮͯੜ੒ ɾ 

    ϖΞ ɾIUUQTCJUCVDLFUPSHCFEJ[FMNPF
  9. .JTTQFMMFEEBUBHFOFSBUJPO ✦ &SSPSNPEFM 9 ɾݕࡧΫΤϦͷཤྺ εϖϧϛεΛϢʔβ͕मਖ਼ͨ݁͠Ռ  ͔ΒҎԼͷUSJQMFUΛ࡞੒ ɾ.0&ͷֶश࣌ʹ εϖϧϛε֬཰ʹج͍ͮͯαϯϓϦϯά

    ɾ࠷௕Ұக͢ΔΛ΋ͱʹσʔληοτ಺Λݕࡧ c c pm pe c FH hello worjdˠhello world < XPS K M  PS K M  S K M  П K M > ௚લͷจࣈྻ ฤूલͷจࣈ ฤूޙͷจࣈ 5SJQMFU
  10. &YQFSJNFOUT ✦ εϖϧϛεؚΉςετσʔλΛੜ੒ 10 ɾֶशσʔλੜ੒࣌ͱಉ༷ͷํ๏ͰεϖϧϛεΛ௥Ճ ɾฤूڑ཭ͱ୯ޠ௕Λ੍ޚ͢ΔύϥϝʔλS

  11. &YQFSJNFOUT ✦ *OUSJOTJDUBTL 11 ɾ8PSETJNJMBSJUZ ୯ޠؒͷྨࣅ౓ ਓखධՁͱͷ૬ؔʹΑΓධՁ ɾ8PSEBOBMPHZ #FSMJO(FSNBO 'SBODF1BJST

    ਖ਼ղ཰ͰධՁ ɾ/FJHICPSIPPETJNJMBSJUZ εϖϧϛεͷ෼ࢄදݱ͕ਖ਼͍͠୯ޠͷ෼ࢄදݱͱ͍͔ۙ  ฏۉٯॱҐ .33 DPWFSBHFͰධՁ
  12. *OUSJOTJDFWBMVBUJPO ✦ 8PSETJNJMBSJUZ 12

  13. *OUSJOTJDFWBMVBUJPO ✦ 8PSEBOBMPHZ 13

  14. *OUSJOTJDFWBMVBUJPO ✦ /FJHICPSIPPETJNJMBSJUZ 14

  15. &YQFSJNFOUT ✦ &YUSJOTJDUBTL 15 ɾ104UBHHJOH #J-45. $3' 8PSEFNCFEEJOHMBZFS'BTU5FYUPS.0&

  16. &YUSJOTJDFWBMVBUJPO ✦ 104UBHHJOH 16 0SJHJOBMͷ݁ՌΛଛͳΘͣʹ εϖϧϛεͰͷੑೳվળ

  17. &YUSJOTJDFWBMVBUJPO ✦ 104UBHHJOH 17 USBJOͱUFTU͕ۃ୺ʹҟͳΔઃఆͰ΋༗ޮʹ࡞༻

  18. $PODMVTJPO 18 ✦ εϖϧϛε଱ੑΛඋ͑ͨ୯ޠ෼ࢄදݱ ɾεϖϧϛεͷ୯ޠͱਖ਼͍͠୯ޠͷ෼ࢄදݱΛ͚ۙͮΔֶश ✦ ࣮ࡍʹਖ਼͍͠୯ޠͷ෼ࢄදݱʹ͍ۙͮͯ ͍Δ͜ͱΛ֬ೝ ✦ εϖϧϛεΛؚΉ༷ʑͳλεΫʹ͓͍ͯ

    ੑೳΛվળ XPSETJNJMBSJUZ BOBMPHZ 104UBHHJOH