Upgrade to Pro — share decks privately, control downloads, hide ads and more …

身近に潜むtokenize 2016

672ee2598bea695496f11022a9a9c4c8?s=47 moznion
July 03, 2016
Technology
0
3.6k

身近に潜むtokenize 2016

YAPC Hachioji 2016 LT 資料です

672ee2598bea695496f11022a9a9c4c8?s=128

moznion

July 03, 2016
Tweet

More Decks by moznion

See All by moznion
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
2
3.4k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
2
1.7k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
0
3.6k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
11
6k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
8
11k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
21
5.8k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
0
3.5k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
1
3k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
0
4.3k

Other Decks in Technology

See All in Technology
2016ba6b977a2e6691811fa66d5f4336?s=48 cyberagentdevelopers
PRO
1
420
Ed7b8f16fbacc81910f91624f2250d3a?s=48 dolphiiiin
0
100
93aef1d166a8a3536538eff713f80307?s=48 flant
0
5.3k
0d29d155ce5c5a93ed46363626da3ea7?s=48 ocise
1
5.3k
B46a00cafe34a9437d3a5bc6afc5bee3?s=48 aditya45
1
490
9a38c60104a629648564527582d071c6?s=48 ta28masa
0
130
Cd891a89dfec6ca7bd278b5f5bd87c90?s=48 tzkoba
10
2.8k
00851927294532e0742c2c174730dff0?s=48 ido_kara_deru
2
230
65f840d22d4507284fc10332fdde00fe?s=48 lulak21
0
150
9cdd446fb259ec93e52d4388f60197f8?s=48 karamem0
0
610
204f36383109212baaedfabb8abcfc9e?s=48 konakalab
0
140
8e308462954f8c38cc60dabb8b7bc6a3?s=48 widstkyi
0
200

Featured

See All Featured
C1daf20e5c49ff910745198ef9869ac2?s=48 hatefulcrawdad
255
17k
2bb923c57a1fdc3a2eb484bb8d565fd2?s=48 ufuk
58
5.5k
A9179349dd2bdc67f377719f56d85656?s=48 garrettdimon
289
110k
B3ace07412a5178ea778e7eec161fc0a?s=48 jcasabona
8
670
0bce06bd06ee7a2c4f5500f25dcf7f18?s=48 paulrobertlloyd
71
3.7k
D47656e20ff5e42f125fc5ea0fd636c6?s=48 tmm1
63
9.9k
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
193
8.9k
812e1705ff0f8bc1bcf18587bde687d5?s=48 62gerente
587
210k
C9b18d9dff88a9dd2393364c2b3b21bd?s=48 colly
66
3.1k
C0b42577cfc2b321be3474618107e933?s=48 samanthasiow
59
6.6k
A415db3ac9e9668acbc1fb36eead84ac?s=48 mthomps
40
2.4k
D83926c323d4f9289f947b4b4e76b939?s=48 jensimmons
208
10k

Transcript

  1. ਎ۙʹજΉ tokenize 2016 @moznion

  2. @moznion

  3. ͜͜Ͱݴ͏ tokenize - ͳΜ͔௕͍೚ҙͷจࣈྻ͕͋ͬͯ - ͦΕΛίϯϐϡʔλ͕ղऍ͠΍͢ ͍୯Ґ (token) ʹͿͬͨ੾Δ

  4. Έͳ͞Μ tokenize ͯ͠·͔͢

  5. ༷ʑͳ΋ͷΛ token ʹ ෼͚͍͖ͯ·͠ΐ͏ ෼͚Δඞཁ͕͋Γ·͢

  6. ྫ͑͹ʁ

  7. ༣ศ൪߸

  8. ༣ศ൪߸ ken_all.csv

  9. ॅॴ

  10. ॅॴ ૯຿লࢿྉ (pdf)

  11. ి࿩൪߸

  12. ి࿩൪߸ ૯຿লࢿྉ (doc, pdf)

  13. ςϯγϣϯ্͕ͬͯ
 ͖·͔ͨ͠ʁ

  14. ͸͍ɼྑ͍Ͱ͢ ͘͢͝ྑ͍Ͱ͢

  15. ࢢ֎ہ൪ͷ࿩Λ͠·͠ΐ͏

  16. 03-5321-1111

  17. 03-5321-1111

  18. Φοɼ؆୯ͦ͏Ͱ͢Ͷ

  19. ࢢ֎ہ൪

  20. ࢢ֎ہ൪ ૯຿লࢿྉ (doc, pdf)

  21. ࢢ֎ہ൪ ૯຿লࢿྉ (doc, pdf)

  22. None

  23. ͱΓ͋͑ͣத਎ݟͯΈ·͠ΐ͏

  24. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 1 ๺ւಓߐผࢢɺࡳຈࢢɺ ๺޿ౡࢢɺۭ஌܊ೆຈொ 11 CDE

  25. OKOK

  26. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 3 ๺ւಓ༦ுࢢʢ෋໺Λআ ͘ɻʣ 123 DE

  27. OKOK

  28. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 32 ๺ւಓҏୡࢢɺѾా܊ ʢಎ但ބொٴͼ๛Ӝொʹ ݶΔɻʣɺ༗च܊ 142 DE

  29. OKOK

  30. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 93 ੨৿ݝे࿨ాࢢɺࡾ୔ ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށ

    ொٴͼ࿡ށொʹݶΔɻʣ 176 DE

  31. ੝Γ্͕ͬͯ·͍Γ·ͨ͠

  32. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 363 େࡕ෎஑ాࢢۭߓɺେࡕࢢʢ౦ॅ٢۠໼ాࣣஸ໨ٴͼฏ໺۠௕٢઒ล࢛ஸ໨Λআ ͘ɻʣɺ໳ਅࢢʢੴݪொɺઘொɺҰ൪ொɺେ૔ொɺ֞಺ொɺ܂࠽৽ொɺ޾෱ொɺणொɺӫ ொɺ খ࿏ொɺ৽ڮொɺ຤޿ொɺ݄ग़ொɺಊࢁொɺ఼ౡொɺதொɺ඿ொɺ଎ݟொɺ౦ాொɺਂా ொɺݹ઒ொɺຊொɺদੜொɺদ༿ொɺޚಊொɺ޲ౡொɺݩொɺ༄ాொٴͼ༄ொʹݶ

    Δɻʣɺ ਧాࢢɺઁ௡ࢢʢ๺ผ෎ொɺ৽ࡏՈɺਖ਼੃ɺਖ਼੃ຊொɺঙ԰ɺઍཬٰɺઍཬٰ৽ொɺઍཬ ٰ౦࢛ஸ໨ٴͼޒஸ໨ɺ੢Ұ௡԰ɺ඿ொɺ౦ਖ਼੃ɺ౦Ұ௡԰ɺ౦ผ෎ɺҰ௡԰ɺผ෎ɺ ࡾౡɺೆઍཬٰฒͼʹೆผ෎ொʹݶΔɻʣɺ๛தࢢɺ౦େࡕࢢʢѴொɺ஑ౡொɺ஑೭୺ ொɺग़ӢҪொɺग़ӢҪຊொɺҴ༿ɺࠓถɺؠాொʢࡾஸ໨Λআ͘ɻʣɺӝੜಊҰஸ໨ɺՃ ೲɺ্ੴ੾ொɺ্࢛৚ொɺ্࿡ສࣉொɺ઒தɺ઒ాɺՏ಺ொɺਆాொɺتཬ઒ொɺ๺ੴ੾ ொɺ๺ߵ஑ொɺ٬๥ொɺ೔Լொɺޒ৚ொɺߵ஑ொɺߵ஑ಙ҇ொɺߵ஑ຊொɺߵ஑ݩொɺݹ ຳྠɺࡩொɺ࢛৚ொɺౡ೭಺ɺԼ࿡ສࣉொɺত࿨ொɺ৽஑ౡொɺ৽ߵ஑ொɺ৽ொɺ৽ঙɺ ຤޿ொɺ֯ాɺળࠜࣉொɺୋ఼ொɺๅொɺཱՖொɺۄ۲ொ੢ɺۄ۲ொ౦ɺۄ۲ݩொɺ๛Ӝ ொɺௗډொɺதੴ੾ொɺத৽։ɺத໺ɺதߵ஑ொɺೆ૳ொɺ੢ੴ੾ொɺ੢ؠాҰஸ໨ɺ੢ ߵ஑ொɺֹాொɺ෍ࢢொɺശ఼ொɺՖԂ੢ொɺՖԂ౦ொɺՖԂຊொɺ౦ੴ੾ொɺ౦ߵ஑ ொɺ౦๛Ӝொɺ౦ࢁொɺඛߐɺඛ԰౦ɺත୻ࢁொɺຊঙதҰஸ໨ɺຊொɺদݪɺদݪೆɺ ਫ૸ɺೆߵ஑ொɺೆ࢛৚ொɺຳྠɺޚ޾ொɺݩொɺࢁखொɺ໻ੜொɺԣখ࿏ொɺԣປɺԣ ປ੢ɺԣປೆɺ٢ాɺ٢ాຊொɺ٢ాԼౡɺ٢ݪɺ࿡ສࣉொٴͼए૲ொΛআ͘ɻʣɺकޱ ࢢɺീඌࢢʢ஛ᔹɺ஛ᔹ੢ٴͼ஛ᔹ౦ʹݶΔɻʣɺฌݿݝೌ࡚ࢢ 6 BCDE

  33. େࡕ෎஑ాࢢۭߓɺେࡕࢢʢ౦ॅ٢۠໼ాࣣஸ໨ٴͼฏ໺۠௕٢઒ล࢛ஸ໨Λআ ͘ɻʣɺ໳ਅࢢʢੴݪொɺઘொɺҰ൪ொɺେ૔ொɺ֞಺ொɺ܂࠽৽ொɺ޾෱ொɺणொɺӫொɺ খ࿏ொɺ৽ڮொɺ຤޿ொɺ݄ग़ொɺಊࢁொɺ఼ౡொɺதொɺ඿ொɺ଎ݟொɺ౦ాொɺਂా ொɺݹ઒ொɺຊொɺদੜொɺদ༿ொɺޚಊொɺ޲ౡொɺݩொɺ༄ాொٴͼ༄ொʹݶΔɻʣɺ ਧాࢢɺઁ௡ࢢʢ๺ผ෎ொɺ৽ࡏՈɺਖ਼੃ɺਖ਼੃ຊொɺঙ԰ɺઍཬٰɺઍཬٰ৽ொɺઍཬ ٰ౦࢛ஸ໨ٴͼޒஸ໨ɺ੢Ұ௡԰ɺ඿ொɺ౦ਖ਼੃ɺ౦Ұ௡԰ɺ౦ผ෎ɺҰ௡԰ɺผ෎ɺ ࡾౡɺೆઍཬٰฒͼʹೆผ෎ொʹݶΔɻʣɺ๛தࢢɺ౦େࡕࢢʢѴொɺ஑ౡொɺ஑೭୺ ொɺग़ӢҪொɺग़ӢҪຊொɺҴ༿ɺࠓถɺؠాொʢࡾஸ໨Λআ͘ɻʣɺӝੜಊҰஸ໨ɺՃ ೲɺ্ੴ੾ொɺ্࢛৚ொɺ্࿡ສࣉொɺ઒தɺ઒ాɺՏ಺ொɺਆాொɺتཬ઒ொɺ๺ੴ੾ ொɺ๺ߵ஑ொɺ٬๥ொɺ೔Լொɺޒ৚ொɺߵ஑ொɺߵ஑ಙ҇ொɺߵ஑ຊொɺߵ஑ݩொɺݹ

    ຳྠɺࡩொɺ࢛৚ொɺౡ೭಺ɺԼ࿡ສࣉொɺত࿨ொɺ৽஑ౡொɺ৽ߵ஑ொɺ৽ொɺ৽ঙɺ ຤޿ொɺ֯ాɺળࠜࣉொɺୋ఼ொɺๅொɺཱՖொɺۄ۲ொ੢ɺۄ۲ொ౦ɺۄ۲ݩொɺ๛Ӝ ொɺௗډொɺதੴ੾ொɺத৽։ɺத໺ɺதߵ஑ொɺೆ૳ொɺ੢ੴ੾ொɺ੢ؠాҰஸ໨ɺ੢ ߵ஑ொɺֹాொɺ෍ࢢொɺശ఼ொɺՖԂ੢ொɺՖԂ౦ொɺՖԂຊொɺ౦ੴ੾ொɺ౦ߵ஑ ொɺ౦๛Ӝொɺ౦ࢁொɺඛߐɺඛ԰౦ɺත୻ࢁொɺຊঙதҰஸ໨ɺຊொɺদݪɺদݪೆɺ ਫ૸ɺೆߵ஑ொɺೆ࢛৚ொɺຳྠɺޚ޾ொɺݩொɺࢁखொɺ໻ੜொɺԣখ࿏ொɺԣປɺԣ ປ੢ɺԣປೆɺ٢ాɺ٢ాຊொɺ٢ాԼౡɺ٢ݪɺ࿡ສࣉொٴͼए૲ொΛআ͘ɻʣɺकޱ ࢢɺീඌࢢʢ஛ᔹɺ஛ᔹ੢ٴͼ஛ᔹ౦ʹݶΔɻʣɺฌݿݝೌ࡚ࢢ

  34. ͸͍

  35. ݟ·͢

  36. ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ๺ɺ Ѵೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣ

  37. ϋϋʔϯ

  38. શ֯ಡ఺Ͱ۟੾ΒΕͨ શׅ֯ހͷSࣜͩͳʁ

  39. ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ๺ɺ Ѵೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣ ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣʣ

  40. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣʣ ୯७ͳϦετ

  41. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶ Δɻʣʣ ͜Ε͸വ਺

  42. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶ Δɻʣʣ ߴ֊വ਺

  43. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶ Δɻʣʣ bool (cond)

  44. φϧϗσΟ΢ε

  45. ΍͍͖ͬͯ·͢

  46. ࠓ·Ͱͷઆ໌ͱ͸ؔ܎ͷͳ͍࣮૷ https://github.com/moznion/Number-Phone- JP-AreaCode

  47. ͦͷ͏ͪ SࣜΛཧղ͢Δ࣮૷ʹͳΓ·͢

  48. ࠷ޙʹ

  49. ׭ެி͸ mysqldump ఏڙͯ͘͠Ε