Pro Yearly is on sale from $80 to $50! »

身近に潜むtokenize 2016

672ee2598bea695496f11022a9a9c4c8?s=47 moznion
July 03, 2016
Technology
0
3.5k

身近に潜むtokenize 2016

YAPC Hachioji 2016 LT 資料です

672ee2598bea695496f11022a9a9c4c8?s=128

moznion

July 03, 2016
Tweet

More Decks by moznion

See All by moznion
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
2
3.3k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
2
1.7k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
0
3.5k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
11
5.9k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
8
10k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
21
5.7k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
0
3.3k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
1
2.9k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
0
4.2k

Other Decks in Technology

See All in Technology
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
120
D16bc1f94b17ddc794c2dfb48ef59456?s=48 mosky
0
510
D0f5daa7cc3a26140c06ea29e5e235cc?s=48 noriyukitakei
0
220
8065fe5a0d33908c6f71c5ae28939dcd?s=48 ayatokura
0
120
7cd783377515bdf8207062840b7b2f4e?s=48 soracom
0
190
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
120
Fe06c08a0de4da36003bfeb7b749cbf8?s=48 ryotaumebayashi
1
300
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
140
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
900
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
420
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
350
Eebedc2ee7ff95ffb9d9102c6d4a065c?s=48 line_devday2020
0
140

Featured

See All Featured
C157b16234f1e75e8eac3698c1d4414a?s=48 ddemaree
274
31k
8ec1383b240b5ba15ffb9743fceb3c0e?s=48 philnash
7
400
A415db3ac9e9668acbc1fb36eead84ac?s=48 mthomps
39
2.2k
96270e4c3e5e9806cf7245475c00b275?s=48 addyosmani
310
21k
C0b42577cfc2b321be3474618107e933?s=48 samanthasiow
56
6.2k
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
258
24k
719435d98d452de7ac367c828266cf01?s=48 erikaheidi
12
4k
F716e5f737fcfb03f2cf8d1a184f1dbe?s=48 nonsquared
81
3.3k
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
26
1.8k
5f50f94346fbcb23706f0707169317a4?s=48 aarron
256
36k
E6c6e133e74c3b83f04d2861deaa1c20?s=48 searls
203
35k
465724d73fe3a92c0879fdfb43a3a6f3?s=48 philhawksworth
192
8.7k

Transcript

  1. ਎ۙʹજΉ tokenize 2016 @moznion

  2. @moznion

  3. ͜͜Ͱݴ͏ tokenize - ͳΜ͔௕͍೚ҙͷจࣈྻ͕͋ͬͯ - ͦΕΛίϯϐϡʔλ͕ղऍ͠΍͢ ͍୯Ґ (token) ʹͿͬͨ੾Δ

  4. Έͳ͞Μ tokenize ͯ͠·͔͢

  5. ༷ʑͳ΋ͷΛ token ʹ ෼͚͍͖ͯ·͠ΐ͏ ෼͚Δඞཁ͕͋Γ·͢

  6. ྫ͑͹ʁ

  7. ༣ศ൪߸

  8. ༣ศ൪߸ ken_all.csv

  9. ॅॴ

  10. ॅॴ ૯຿লࢿྉ (pdf)

  11. ి࿩൪߸

  12. ి࿩൪߸ ૯຿লࢿྉ (doc, pdf)

  13. ςϯγϣϯ্͕ͬͯ
 ͖·͔ͨ͠ʁ

  14. ͸͍ɼྑ͍Ͱ͢ ͘͢͝ྑ͍Ͱ͢

  15. ࢢ֎ہ൪ͷ࿩Λ͠·͠ΐ͏

  16. 03-5321-1111

  17. 03-5321-1111

  18. Φοɼ؆୯ͦ͏Ͱ͢Ͷ

  19. ࢢ֎ہ൪

  20. ࢢ֎ہ൪ ૯຿লࢿྉ (doc, pdf)

  21. ࢢ֎ہ൪ ૯຿লࢿྉ (doc, pdf)

  22. None

  23. ͱΓ͋͑ͣத਎ݟͯΈ·͠ΐ͏

  24. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 1 ๺ւಓߐผࢢɺࡳຈࢢɺ ๺޿ౡࢢɺۭ஌܊ೆຈொ 11 CDE

  25. OKOK

  26. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 3 ๺ւಓ༦ுࢢʢ෋໺Λআ ͘ɻʣ 123 DE

  27. OKOK

  28. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 32 ๺ւಓҏୡࢢɺѾా܊ ʢಎ但ބொٴͼ๛Ӝொʹ ݶΔɻʣɺ༗च܊ 142 DE

  29. OKOK

  30. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 93 ੨৿ݝे࿨ాࢢɺࡾ୔ ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށ

    ொٴͼ࿡ށொʹݶΔɻʣ 176 DE

  31. ੝Γ্͕ͬͯ·͍Γ·ͨ͠

  32. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 363 େࡕ෎஑ాࢢۭߓɺେࡕࢢʢ౦ॅ٢۠໼ాࣣஸ໨ٴͼฏ໺۠௕٢઒ล࢛ஸ໨Λআ ͘ɻʣɺ໳ਅࢢʢੴݪொɺઘொɺҰ൪ொɺେ૔ொɺ֞಺ொɺ܂࠽৽ொɺ޾෱ொɺणொɺӫ ொɺ খ࿏ொɺ৽ڮொɺ຤޿ொɺ݄ग़ொɺಊࢁொɺ఼ౡொɺதொɺ඿ொɺ଎ݟொɺ౦ాொɺਂా ொɺݹ઒ொɺຊொɺদੜொɺদ༿ொɺޚಊொɺ޲ౡொɺݩொɺ༄ాொٴͼ༄ொʹݶ

    Δɻʣɺ ਧాࢢɺઁ௡ࢢʢ๺ผ෎ொɺ৽ࡏՈɺਖ਼੃ɺਖ਼੃ຊொɺঙ԰ɺઍཬٰɺઍཬٰ৽ொɺઍཬ ٰ౦࢛ஸ໨ٴͼޒஸ໨ɺ੢Ұ௡԰ɺ඿ொɺ౦ਖ਼੃ɺ౦Ұ௡԰ɺ౦ผ෎ɺҰ௡԰ɺผ෎ɺ ࡾౡɺೆઍཬٰฒͼʹೆผ෎ொʹݶΔɻʣɺ๛தࢢɺ౦େࡕࢢʢѴொɺ஑ౡொɺ஑೭୺ ொɺग़ӢҪொɺग़ӢҪຊொɺҴ༿ɺࠓถɺؠాொʢࡾஸ໨Λআ͘ɻʣɺӝੜಊҰஸ໨ɺՃ ೲɺ্ੴ੾ொɺ্࢛৚ொɺ্࿡ສࣉொɺ઒தɺ઒ాɺՏ಺ொɺਆాொɺتཬ઒ொɺ๺ੴ੾ ொɺ๺ߵ஑ொɺ٬๥ொɺ೔Լொɺޒ৚ொɺߵ஑ொɺߵ஑ಙ҇ொɺߵ஑ຊொɺߵ஑ݩொɺݹ ຳྠɺࡩொɺ࢛৚ொɺౡ೭಺ɺԼ࿡ສࣉொɺত࿨ொɺ৽஑ౡொɺ৽ߵ஑ொɺ৽ொɺ৽ঙɺ ຤޿ொɺ֯ాɺળࠜࣉொɺୋ఼ொɺๅொɺཱՖொɺۄ۲ொ੢ɺۄ۲ொ౦ɺۄ۲ݩொɺ๛Ӝ ொɺௗډொɺதੴ੾ொɺத৽։ɺத໺ɺதߵ஑ொɺೆ૳ொɺ੢ੴ੾ொɺ੢ؠాҰஸ໨ɺ੢ ߵ஑ொɺֹాொɺ෍ࢢொɺശ఼ொɺՖԂ੢ொɺՖԂ౦ொɺՖԂຊொɺ౦ੴ੾ொɺ౦ߵ஑ ொɺ౦๛Ӝொɺ౦ࢁொɺඛߐɺඛ԰౦ɺත୻ࢁொɺຊঙதҰஸ໨ɺຊொɺদݪɺদݪೆɺ ਫ૸ɺೆߵ஑ொɺೆ࢛৚ொɺຳྠɺޚ޾ொɺݩொɺࢁखொɺ໻ੜொɺԣখ࿏ொɺԣປɺԣ ປ੢ɺԣປೆɺ٢ాɺ٢ాຊொɺ٢ాԼౡɺ٢ݪɺ࿡ສࣉொٴͼए૲ொΛআ͘ɻʣɺकޱ ࢢɺീඌࢢʢ஛ᔹɺ஛ᔹ੢ٴͼ஛ᔹ౦ʹݶΔɻʣɺฌݿݝೌ࡚ࢢ 6 BCDE

  33. େࡕ෎஑ాࢢۭߓɺେࡕࢢʢ౦ॅ٢۠໼ాࣣஸ໨ٴͼฏ໺۠௕٢઒ล࢛ஸ໨Λআ ͘ɻʣɺ໳ਅࢢʢੴݪொɺઘொɺҰ൪ொɺେ૔ொɺ֞಺ொɺ܂࠽৽ொɺ޾෱ொɺणொɺӫொɺ খ࿏ொɺ৽ڮொɺ຤޿ொɺ݄ग़ொɺಊࢁொɺ఼ౡொɺதொɺ඿ொɺ଎ݟொɺ౦ాொɺਂా ொɺݹ઒ொɺຊொɺদੜொɺদ༿ொɺޚಊொɺ޲ౡொɺݩொɺ༄ాொٴͼ༄ொʹݶΔɻʣɺ ਧాࢢɺઁ௡ࢢʢ๺ผ෎ொɺ৽ࡏՈɺਖ਼੃ɺਖ਼੃ຊொɺঙ԰ɺઍཬٰɺઍཬٰ৽ொɺઍཬ ٰ౦࢛ஸ໨ٴͼޒஸ໨ɺ੢Ұ௡԰ɺ඿ொɺ౦ਖ਼੃ɺ౦Ұ௡԰ɺ౦ผ෎ɺҰ௡԰ɺผ෎ɺ ࡾౡɺೆઍཬٰฒͼʹೆผ෎ொʹݶΔɻʣɺ๛தࢢɺ౦େࡕࢢʢѴொɺ஑ౡொɺ஑೭୺ ொɺग़ӢҪொɺग़ӢҪຊொɺҴ༿ɺࠓถɺؠాொʢࡾஸ໨Λআ͘ɻʣɺӝੜಊҰஸ໨ɺՃ ೲɺ্ੴ੾ொɺ্࢛৚ொɺ্࿡ສࣉொɺ઒தɺ઒ాɺՏ಺ொɺਆాொɺتཬ઒ொɺ๺ੴ੾ ொɺ๺ߵ஑ொɺ٬๥ொɺ೔Լொɺޒ৚ொɺߵ஑ொɺߵ஑ಙ҇ொɺߵ஑ຊொɺߵ஑ݩொɺݹ

    ຳྠɺࡩொɺ࢛৚ொɺౡ೭಺ɺԼ࿡ສࣉொɺত࿨ொɺ৽஑ౡொɺ৽ߵ஑ொɺ৽ொɺ৽ঙɺ ຤޿ொɺ֯ాɺળࠜࣉொɺୋ఼ொɺๅொɺཱՖொɺۄ۲ொ੢ɺۄ۲ொ౦ɺۄ۲ݩொɺ๛Ӝ ொɺௗډொɺதੴ੾ொɺத৽։ɺத໺ɺதߵ஑ொɺೆ૳ொɺ੢ੴ੾ொɺ੢ؠాҰஸ໨ɺ੢ ߵ஑ொɺֹాொɺ෍ࢢொɺശ఼ொɺՖԂ੢ொɺՖԂ౦ொɺՖԂຊொɺ౦ੴ੾ொɺ౦ߵ஑ ொɺ౦๛Ӝொɺ౦ࢁொɺඛߐɺඛ԰౦ɺත୻ࢁொɺຊঙதҰஸ໨ɺຊொɺদݪɺদݪೆɺ ਫ૸ɺೆߵ஑ொɺೆ࢛৚ொɺຳྠɺޚ޾ொɺݩொɺࢁखொɺ໻ੜொɺԣখ࿏ொɺԣປɺԣ ປ੢ɺԣປೆɺ٢ాɺ٢ాຊொɺ٢ాԼౡɺ٢ݪɺ࿡ສࣉொٴͼए૲ொΛআ͘ɻʣɺकޱ ࢢɺീඌࢢʢ஛ᔹɺ஛ᔹ੢ٴͼ஛ᔹ౦ʹݶΔɻʣɺฌݿݝೌ࡚ࢢ

  34. ͸͍

  35. ݟ·͢

  36. ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ๺ɺ Ѵೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣ

  37. ϋϋʔϯ

  38. શ֯ಡ఺Ͱ۟੾ΒΕͨ શׅ֯ހͷSࣜͩͳʁ

  39. ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ๺ɺ Ѵೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣ ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣʣ

  40. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣʣ ୯७ͳϦετ

  41. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶ Δɻʣʣ ͜Ε͸വ਺

  42. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶ Δɻʣʣ ߴ֊വ਺

  43. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶ Δɻʣʣ bool (cond)

  44. φϧϗσΟ΢ε

  45. ΍͍͖ͬͯ·͢

  46. ࠓ·Ͱͷઆ໌ͱ͸ؔ܎ͷͳ͍࣮૷ https://github.com/moznion/Number-Phone- JP-AreaCode

  47. ͦͷ͏ͪ SࣜΛཧղ͢Δ࣮૷ʹͳΓ·͢

  48. ࠷ޙʹ

  49. ׭ެி͸ mysqldump ఏڙͯ͘͠Ε