Misspelling_Oblivious_Word_Embedding.pdf

Transcript

1. .JTTQFMMJOH
   0CMJWJPVT
   
   8PSE
   &NCFEEJOHT
   จݙ঺հ #PSB
   &EJ[FM
   "MFLTBOESB
   1JLUVT
   1JPUS
   #PKBOPXTLJ
   
   3VJ
   'FSSFJSB
   &EPVBSE
   (SBWF
   'BCSJ[JP
   4JMWFTUSJ /""$-)-5
   QQ
2. "CTUSBDU ✦ εϖϧϛε଱ੑΛඋ͑ͨ୯ޠ෼ࢄදݱ 2 ɾεϖϧϛεͷ୯ޠͱਖ਼͍͠୯ޠͷ෼ࢄදݱΛ͚ۙͮΔֶश ✦ ಺ɾ֎తධՁͷ྆ํʹ͓͍ͯ
   ఏҊख๏ ͷ༗ޮੑΛࣔͨ͠ ɾ಺తධՁ
   XPSE
   TJNJMBSJUZ
   XPSE
   BOBMPHZ
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   
   OFJHICPSIPPE
   TJNJMBSJUZ ɾ֎తධՁ
   104
   UBHHJOH
3. *OUSPEVDUJPO ✦ 0VUPGWPDBCVMBSZ 007 ͸ඇৗʹଟ͍ 3 ɾ8FCݕࡧΫΤϦͷ͸εϖϧϛε ✦ 007ʹରॲͰ͖Δ෼ࢄදݱΛ࡞Γ͍ͨ ɾֶशίʔύεʹεϖϧϛεͷ୯ޠΛಋೖ
   
   
   
   εϖϧϛε୯ޠͷεύʔεੑ ɾ'BTU5FYU
   
   εϖϧϛεύλʔϯͷڭࢣ͋Γֶश
4. .JTTQFMMJOH
   0CMJWJPVT
   &NCFEEJOH ✦ 4LJQHSBN
   XJUI
   OFHBUJWF
   TBNQMJOH 4 ίʔύε पล୯ޠ ෛྫू߹ 
5. .JTTQFMMJOH
   0CMJWJPVT
   &NCFEEJOH ✦ 'BTU5FYU 5 ίʔύε पล୯ޠ 
   ෛྫू߹ 
   ୯ޠ
   
   
   ͷจࣈOHSBN ωi FH
   CBOBOB
   㱡O㱡 \CBO
   BOB
   OBO
   CBOB
   BOBO
   OBOB
   CBOBO
   BOBOB^
   LFT sFT (ωi , ωc ) sFT (ωi , ωc )
6. .JTTQFMMJOH
   0CMJWJPVT
   &NCFEEJOH ✦ .0&
   NPEFM 6 ίʔύε εϖϧϛεϖΞ (ωm , ωe ) ∈ M ωm 
   εϖϧϛεͷ୯ޠ ωe 
   ਖ਼͍͠εϖϧͷ୯ޠ
   4QFMM
   DPSSFDUJPO
   MPTT
   
   
   ෛྫू߹
7. .JTTQFMMJOH
   0CMJWJPVT
   &NCFEEJOH ✦ .0&
   NPEFM 7 https://ai.facebook.com/blog/-a-new-model-for-word-embeddings-that-are-resilient-to-misspellings-/
8. %BUB ✦ &OHMJTI
   8JLJQFEJB 8 ɾ'BTU5FYU
   MPTTͷ࠷దԽ ✦ .JTTQFMMJOHT
   EBUBTFU ɾGBDFCPPLͷݕࡧΫΤϦʹج͍ͮͯੜ੒ ɾ  
   ϖΞ ɾIUUQT
   CJUCVDLFUPSHCFEJ[FMNPF
9. .JTTQFMMFE
   EBUB
   HFOFSBUJPO ✦ &SSPS
   NPEFM 9 ɾݕࡧΫΤϦͷཤྺ εϖϧϛεΛϢʔβ͕मਖ਼ͨ݁͠Ռ
   
   
   
   ͔ΒҎԼͷUSJQMFUΛ࡞੒ ɾ.0&ͷֶश࣌ʹ
   εϖϧϛε֬཰ʹج͍ͮͯαϯϓϦϯά ɾ࠷௕Ұக͢Δ
   
   
   Λ΋ͱʹσʔληοτ಺Λݕࡧ c c pm pe c FH
   hello worjd
   ˠ
   hello world < XPS
   K
   M
   PS
   K
   M
   S
   K
   M
   П
   K
   M >
   
   
   ௚લͷจࣈྻ
   
   
   
   
   
   ฤूલͷจࣈ
   
   
   
   
   ฤूޙͷจࣈ
   5SJQMFU
   
   
   
   
   
10. &YQFSJNFOUT ✦ εϖϧϛεؚΉςετσʔλΛੜ੒ 10 ɾֶशσʔλੜ੒࣌ͱಉ༷ͷํ๏ͰεϖϧϛεΛ௥Ճ ɾฤूڑ཭ͱ୯ޠ௕Λ੍ޚ͢ΔύϥϝʔλS
11. &YQFSJNFOUT ✦ *OUSJOTJD
    UBTL 11 ɾ8PSE
    TJNJMBSJUZ
    
    
    
    
    
    
    
    ୯ޠؒͷྨࣅ౓
    ਓखධՁͱͷ૬ؔʹΑΓධՁ ɾ8PSE
    BOBMPHZ
    
    
    
    
    
    
    
    #FSMJO
    
    (FSNBO
    
    'SBODF
    
    1BJST
    ਖ਼ղ཰ͰධՁ ɾ/FJHICPSIPPE
    TJNJMBSJUZ
    
    
    
    
    
    
    εϖϧϛεͷ෼ࢄදݱ͕ਖ਼͍͠୯ޠͷ෼ࢄදݱͱ͍͔ۙ
    
    
    
    
    
    
    
    ฏۉٯॱҐ .33
    DPWFSBHFͰධՁ
12. *OUSJOTJD
    FWBMVBUJPO ✦ 8PSE
    TJNJMBSJUZ 12
13. *OUSJOTJD
    FWBMVBUJPO ✦ 8PSE
    BOBMPHZ 13
14. *OUSJOTJD
    FWBMVBUJPO ✦ /FJHICPSIPPE
    TJNJMBSJUZ 14
15. &YQFSJNFOUT ✦ &YUSJOTJD
    UBTL 15 ɾ104
    UBHHJOH
    
    #J-45.
    
    $3' 
    8PSE
    FNCFEEJOH
    MBZFS
    'BTU5FYU
    PS
    .0&
16. &YUSJOTJD
    FWBMVBUJPO ✦ 104
    UBHHJOH 16 0SJHJOBMͷ݁ՌΛଛͳΘͣʹ
    εϖϧϛεͰͷੑೳվળ
17. &YUSJOTJD
    FWBMVBUJPO ✦ 104
    UBHHJOH 17 USBJOͱUFTU͕ۃ୺ʹҟͳΔઃఆͰ΋༗ޮʹ࡞༻
18. $PODMVTJPO 18 ✦ εϖϧϛε଱ੑΛඋ͑ͨ୯ޠ෼ࢄදݱ ɾεϖϧϛεͷ୯ޠͱਖ਼͍͠୯ޠͷ෼ࢄදݱΛ͚ۙͮΔֶश ✦ ࣮ࡍʹਖ਼͍͠୯ޠͷ෼ࢄදݱʹ͍ۙͮͯ ͍Δ͜ͱΛ֬ೝ ✦ εϖϧϛεΛؚΉ༷ʑͳλεΫʹ͓͍ͯ ੑೳΛվળ
    XPSE
    TJNJMBSJUZ
    BOBMPHZ
    104
    UBHHJOH