身近に潜むtokenize 2016

672ee2598bea695496f11022a9a9c4c8?s=47 moznion
July 03, 2016
Technology
0
3.5k

身近に潜むtokenize 2016

YAPC Hachioji 2016 LT 資料です

672ee2598bea695496f11022a9a9c4c8?s=128

moznion

July 03, 2016
Tweet

More Decks by moznion

See All by moznion
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
2
3.3k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
2
1.6k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
0
3.4k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
11
5.9k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
8
10k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
21
5.7k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
0
3.2k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
1
2.9k
672ee2598bea695496f11022a9a9c4c8?s=48 moznion
0
4.2k

Other Decks in Technology

See All in Technology
2cf373725ded741824c50fd571eda6e1?s=48 udzura
13
6.3k
Ea29e2b19d11b48f867ae71d6a6de5df?s=48 opelab
18
6.7k
Ff98f59b09d38b46d177e9a12b77dad4?s=48 yksn
0
220
53e2d354b3299d64a54af680865516d5?s=48 satotakeshi
3
640
C422cc033079e005fd1aa1b845b099da?s=48 meow_noisy
0
110
3bf6da1f63cd8b7a2f802f95c269ed80?s=48 fromatom
6
730
2564c99f616f1ecfc0f617a6fe87e2a9?s=48 penguin045
0
260
C58d9fc209cfdc0b822f851911110fa6?s=48 coe
14
6.1k
9bf153d8c0ce36ba6d9d20c2914b70f4?s=48 shimastripe
11
700
F01c8fdfa64bdfc00a94896e0b1359e0?s=48 tmdoi
0
330
53850955f15249a1a9dc49df6113e400?s=48 line_developers
1
900
3623c11f38517055d9040073ed81913b?s=48 endoumari
3
670

Featured

See All Featured
B3d6434763caa0ef5dc4b792662c49f7?s=48 smashingmag
281
46k
C51b39fa3c79ccb99dcb8a076bc98287?s=48 brianwarren
83
4.6k
A16eb159db895e3b01d3dc95767ad595?s=48 jonyablonski
6
640
3ab1249be442027903e1180025340b3f?s=48 reverentgeek
23
1.6k
79acae287842acf29084005533a7fb3b?s=48 hursman
103
9.1k
56c4053438af8e8b90d6f53cbb7573be?s=48 jakevdp
769
190k
D83926c323d4f9289f947b4b4e76b939?s=48 jensimmons
205
9.9k
C1daf20e5c49ff910745198ef9869ac2?s=48 hatefulcrawdad
257
16k
6804f1775cb4babfcc3851298566fbce?s=48 tanoku
85
8.3k
C4de88ea47538e4594750e3861a341c8?s=48 brettharned
91
2.8k
1519587b1a0febb658c36c94f6272b0d?s=48 roundedbygravity
84
7.7k
78b475797a14c84799063c7cd073962f?s=48 holman
459
270k

Transcript

  1. ਎ۙʹજΉ tokenize 2016 @moznion

  2. @moznion

  3. ͜͜Ͱݴ͏ tokenize - ͳΜ͔௕͍೚ҙͷจࣈྻ͕͋ͬͯ - ͦΕΛίϯϐϡʔλ͕ղऍ͠΍͢ ͍୯Ґ (token) ʹͿͬͨ੾Δ

  4. Έͳ͞Μ tokenize ͯ͠·͔͢

  5. ༷ʑͳ΋ͷΛ token ʹ ෼͚͍͖ͯ·͠ΐ͏ ෼͚Δඞཁ͕͋Γ·͢

  6. ྫ͑͹ʁ

  7. ༣ศ൪߸

  8. ༣ศ൪߸ ken_all.csv

  9. ॅॴ

  10. ॅॴ ૯຿লࢿྉ (pdf)

  11. ి࿩൪߸

  12. ి࿩൪߸ ૯຿লࢿྉ (doc, pdf)

  13. ςϯγϣϯ্͕ͬͯ
 ͖·͔ͨ͠ʁ

  14. ͸͍ɼྑ͍Ͱ͢ ͘͢͝ྑ͍Ͱ͢

  15. ࢢ֎ہ൪ͷ࿩Λ͠·͠ΐ͏

  16. 03-5321-1111

  17. 03-5321-1111

  18. Φοɼ؆୯ͦ͏Ͱ͢Ͷ

  19. ࢢ֎ہ൪

  20. ࢢ֎ہ൪ ૯຿লࢿྉ (doc, pdf)

  21. ࢢ֎ہ൪ ૯຿লࢿྉ (doc, pdf)

  22. None

  23. ͱΓ͋͑ͣத਎ݟͯΈ·͠ΐ͏

  24. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 1 ๺ւಓߐผࢢɺࡳຈࢢɺ ๺޿ౡࢢɺۭ஌܊ೆຈொ 11 CDE

  25. OKOK

  26. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 3 ๺ւಓ༦ுࢢʢ෋໺Λআ ͘ɻʣ 123 DE

  27. OKOK

  28. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 32 ๺ւಓҏୡࢢɺѾా܊ ʢಎ但ބொٴͼ๛Ӝொʹ ݶΔɻʣɺ༗च܊ 142 DE

  29. OKOK

  30. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 93 ੨৿ݝे࿨ాࢢɺࡾ୔ ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށ

    ொٴͼ࿡ށொʹݶΔɻʣ 176 DE

  31. ੝Γ্͕ͬͯ·͍Γ·ͨ͠

  32. ൪߸۠ըίʔυ ൪߸۠ը ࢢ֎ہ൪ ࢢ಺ہ൪ 363 େࡕ෎஑ాࢢۭߓɺେࡕࢢʢ౦ॅ٢۠໼ాࣣஸ໨ٴͼฏ໺۠௕٢઒ล࢛ஸ໨Λআ ͘ɻʣɺ໳ਅࢢʢੴݪொɺઘொɺҰ൪ொɺେ૔ொɺ֞಺ொɺ܂࠽৽ொɺ޾෱ொɺणொɺӫ ொɺ খ࿏ொɺ৽ڮொɺ຤޿ொɺ݄ग़ொɺಊࢁொɺ఼ౡொɺதொɺ඿ொɺ଎ݟொɺ౦ాொɺਂా ொɺݹ઒ொɺຊொɺদੜொɺদ༿ொɺޚಊொɺ޲ౡொɺݩொɺ༄ాொٴͼ༄ொʹݶ

    Δɻʣɺ ਧాࢢɺઁ௡ࢢʢ๺ผ෎ொɺ৽ࡏՈɺਖ਼੃ɺਖ਼੃ຊொɺঙ԰ɺઍཬٰɺઍཬٰ৽ொɺઍཬ ٰ౦࢛ஸ໨ٴͼޒஸ໨ɺ੢Ұ௡԰ɺ඿ொɺ౦ਖ਼੃ɺ౦Ұ௡԰ɺ౦ผ෎ɺҰ௡԰ɺผ෎ɺ ࡾౡɺೆઍཬٰฒͼʹೆผ෎ொʹݶΔɻʣɺ๛தࢢɺ౦େࡕࢢʢѴொɺ஑ౡொɺ஑೭୺ ொɺग़ӢҪொɺग़ӢҪຊொɺҴ༿ɺࠓถɺؠాொʢࡾஸ໨Λআ͘ɻʣɺӝੜಊҰஸ໨ɺՃ ೲɺ্ੴ੾ொɺ্࢛৚ொɺ্࿡ສࣉொɺ઒தɺ઒ాɺՏ಺ொɺਆాொɺتཬ઒ொɺ๺ੴ੾ ொɺ๺ߵ஑ொɺ٬๥ொɺ೔Լொɺޒ৚ொɺߵ஑ொɺߵ஑ಙ҇ொɺߵ஑ຊொɺߵ஑ݩொɺݹ ຳྠɺࡩொɺ࢛৚ொɺౡ೭಺ɺԼ࿡ສࣉொɺত࿨ொɺ৽஑ౡொɺ৽ߵ஑ொɺ৽ொɺ৽ঙɺ ຤޿ொɺ֯ాɺળࠜࣉொɺୋ఼ொɺๅொɺཱՖொɺۄ۲ொ੢ɺۄ۲ொ౦ɺۄ۲ݩொɺ๛Ӝ ொɺௗډொɺதੴ੾ொɺத৽։ɺத໺ɺதߵ஑ொɺೆ૳ொɺ੢ੴ੾ொɺ੢ؠాҰஸ໨ɺ੢ ߵ஑ொɺֹాொɺ෍ࢢொɺശ఼ொɺՖԂ੢ொɺՖԂ౦ொɺՖԂຊொɺ౦ੴ੾ொɺ౦ߵ஑ ொɺ౦๛Ӝொɺ౦ࢁொɺඛߐɺඛ԰౦ɺත୻ࢁொɺຊঙதҰஸ໨ɺຊொɺদݪɺদݪೆɺ ਫ૸ɺೆߵ஑ொɺೆ࢛৚ொɺຳྠɺޚ޾ொɺݩொɺࢁखொɺ໻ੜொɺԣখ࿏ொɺԣປɺԣ ປ੢ɺԣປೆɺ٢ాɺ٢ాຊொɺ٢ాԼౡɺ٢ݪɺ࿡ສࣉொٴͼए૲ொΛআ͘ɻʣɺकޱ ࢢɺീඌࢢʢ஛ᔹɺ஛ᔹ੢ٴͼ஛ᔹ౦ʹݶΔɻʣɺฌݿݝೌ࡚ࢢ 6 BCDE

  33. େࡕ෎஑ాࢢۭߓɺେࡕࢢʢ౦ॅ٢۠໼ాࣣஸ໨ٴͼฏ໺۠௕٢઒ล࢛ஸ໨Λআ ͘ɻʣɺ໳ਅࢢʢੴݪொɺઘொɺҰ൪ொɺେ૔ொɺ֞಺ொɺ܂࠽৽ொɺ޾෱ொɺणொɺӫொɺ খ࿏ொɺ৽ڮொɺ຤޿ொɺ݄ग़ொɺಊࢁொɺ఼ౡொɺதொɺ඿ொɺ଎ݟொɺ౦ాொɺਂా ொɺݹ઒ொɺຊொɺদੜொɺদ༿ொɺޚಊொɺ޲ౡொɺݩொɺ༄ాொٴͼ༄ொʹݶΔɻʣɺ ਧాࢢɺઁ௡ࢢʢ๺ผ෎ொɺ৽ࡏՈɺਖ਼੃ɺਖ਼੃ຊொɺঙ԰ɺઍཬٰɺઍཬٰ৽ொɺઍཬ ٰ౦࢛ஸ໨ٴͼޒஸ໨ɺ੢Ұ௡԰ɺ඿ொɺ౦ਖ਼੃ɺ౦Ұ௡԰ɺ౦ผ෎ɺҰ௡԰ɺผ෎ɺ ࡾౡɺೆઍཬٰฒͼʹೆผ෎ொʹݶΔɻʣɺ๛தࢢɺ౦େࡕࢢʢѴொɺ஑ౡொɺ஑೭୺ ொɺग़ӢҪொɺग़ӢҪຊொɺҴ༿ɺࠓถɺؠాொʢࡾஸ໨Λআ͘ɻʣɺӝੜಊҰஸ໨ɺՃ ೲɺ্ੴ੾ொɺ্࢛৚ொɺ্࿡ສࣉொɺ઒தɺ઒ాɺՏ಺ொɺਆాொɺتཬ઒ொɺ๺ੴ੾ ொɺ๺ߵ஑ொɺ٬๥ொɺ೔Լொɺޒ৚ொɺߵ஑ொɺߵ஑ಙ҇ொɺߵ஑ຊொɺߵ஑ݩொɺݹ

    ຳྠɺࡩொɺ࢛৚ொɺౡ೭಺ɺԼ࿡ສࣉொɺত࿨ொɺ৽஑ౡொɺ৽ߵ஑ொɺ৽ொɺ৽ঙɺ ຤޿ொɺ֯ాɺળࠜࣉொɺୋ఼ொɺๅொɺཱՖொɺۄ۲ொ੢ɺۄ۲ொ౦ɺۄ۲ݩொɺ๛Ӝ ொɺௗډொɺதੴ੾ொɺத৽։ɺத໺ɺதߵ஑ொɺೆ૳ொɺ੢ੴ੾ொɺ੢ؠాҰஸ໨ɺ੢ ߵ஑ொɺֹాொɺ෍ࢢொɺശ఼ொɺՖԂ੢ொɺՖԂ౦ொɺՖԂຊொɺ౦ੴ੾ொɺ౦ߵ஑ ொɺ౦๛Ӝொɺ౦ࢁொɺඛߐɺඛ԰౦ɺත୻ࢁொɺຊঙதҰஸ໨ɺຊொɺদݪɺদݪೆɺ ਫ૸ɺೆߵ஑ொɺೆ࢛৚ொɺຳྠɺޚ޾ொɺݩொɺࢁखொɺ໻ੜொɺԣখ࿏ொɺԣປɺԣ ປ੢ɺԣປೆɺ٢ాɺ٢ాຊொɺ٢ాԼౡɺ٢ݪɺ࿡ສࣉொٴͼए૲ொΛআ͘ɻʣɺकޱ ࢢɺീඌࢢʢ஛ᔹɺ஛ᔹ੢ٴͼ஛ᔹ౦ʹݶΔɻʣɺฌݿݝೌ࡚ࢢ

  34. ͸͍

  35. ݟ·͢

  36. ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ๺ɺ Ѵೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣ

  37. ϋϋʔϯ

  38. શ֯ಡ఺Ͱ۟੾ΒΕͨ શׅ֯ހͷSࣜͩͳʁ

  39. ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ๺ɺ Ѵೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣ ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣʣ

  40. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶΔɻʣʣ ୯७ͳϦετ

  41. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶ Δɻʣʣ ͜Ε͸വ਺

  42. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶ Δɻʣʣ ߴ֊വ਺

  43. ʢ੨৿ݝे࿨ాࢢɺࡾ୔ࢢɺ্๺܊ʢ౦๺ொʢѴ ๺ɺѴೆɺ্໺ɺେӜɺ্๺๺ɺ্๺ೆٴ ͼ৽ؗʹݶΔɻʣɺࣣށொٴͼ࿡ށொʹݶ Δɻʣʣ bool (cond)

  44. φϧϗσΟ΢ε

  45. ΍͍͖ͬͯ·͢

  46. ࠓ·Ͱͷઆ໌ͱ͸ؔ܎ͷͳ͍࣮૷ https://github.com/moznion/Number-Phone- JP-AreaCode

  47. ͦͷ͏ͪ SࣜΛཧղ͢Δ࣮૷ʹͳΓ·͢

  48. ࠷ޙʹ

  49. ׭ެி͸ mysqldump ఏڙͯ͘͠Ε