the world of characters

Transcript

1. 1จࣈͷੈք @orisano
2. Έͳ͞Μ จࣈΛ਺͑ΒΕ·͢ΑͶʁ
3. a
4. a => 1
5. ͋
6. ͋ => 1
7. 佛
8. 佛 => 1
10. => 1
12. => 1
13. Z͑ͫ̓ͪ̂ͫ̽ ̴̙̤̞͉͚̯̞̠͍A̴̵̜̰͔ ͫ͗ ͢ L̠ͨͧͩ͘ G̴̻͈͍͔̹ ̑͗̎̅͛ ́ Ǫ̵̹̻̝̳ ͂̌ ̌͘! ͖̬̰̙̗ ̿̋ ͥ ͥ̂ͣ̐́́͜͞
14. Z͑ͫ̓ͪ̂ͫ̽ ̴̙̤̞͉͚̯̞̠͍A̴̵̜̰͔ ͫ͗ ͢ L̠ͨͧͩ͘ G̴̻͈͍͔̹ ̑͗̎̅͛ ́ Ǫ̵̹̻̝̳ ͂̌ ̌͘! ͖̬̰̙̗ ̿̋ ͥ ͥ̂ͣ̐́́͜͞ => 6
15. Έͳ͞Μ όΠτ਺Λ਺͑ΒΕ·͔͢ʁ (UTF-8)
16. a
17. a => 1
18. ͋
19. ͋ => 3
20. 佛
21. 佛 => 4
23. => 4
25. => 18
26. Z͑ͫ̓ͪ̂ͫ̽ ̴̙̤̞͉͚̯̞̠͍A̴̵̜̰͔ ͫ͗ ͢ L̠ͨͧͩ͘ G̴̻͈͍͔̹ ̑͗̎̅͛ ́ Ǫ̵̹̻̝̳ ͂̌ ̌͘! ͖̬̰̙̗ ̿̋ ͥ ͥ̂ͣ̐́́͜͞
27. Z͑ͫ̓ͪ̂ͫ̽ ̴̙̤̞͉͚̯̞̠͍A̴̵̜̰͔ ͫ͗ ͢ L̠ͨͧͩ͘ G̴̻͈͍͔̹ ̑͗̎̅͛ ́ Ǫ̵̹̻̝̳ ͂̌ ̌͘! ͖̬̰̙̗ ̿̋ ͥ ͥ̂ͣ̐́́͜͞ => 143
28. ͋ͳ͕ͨࢥ͏1จࣈ͸ Ͳ͏਺͑Δ΂͖͔ʁ
29. byte਺Ͱ͸਺͑ΒΕͳ͍
30. Unicode͸จࣈू߹ จࣈͱ਺஋͕ରԠ͢Δ
31. ͋ => 3042
32. => 1F914
33. ͜ͷ਺஋ͷ͜ͱΛ ίʔυϙΠϯτ ͱݺͿ
34. ͜ͷίʔυϙΠϯτΛ byteྻͰදݱ͢Δํ๏Λ ΤϯίʔσΟϯάͱ͍͏
35. UTF-8ͱ͔UTF-16ͱ͔͸ ΤϯίʔσΟϯάͷҰछ
36. ͱΓ͋͑ͣ ίʔυϙΠϯτΛ਺͑Ε͹ ղܾʁ
37. ͍͍͑
38. => 1F468 + 200D + 1F469 + 200D + 1F466
39. ࣮͸ෳ਺ͷίʔυϙΠϯτͰ ҰͭͷจࣈʹͳͬͨΓ͢Δ
40. ਓ͕ؒೝ͍ࣝͯ͠Δ̍จࣈ͸ ॻهૉ(Grapheme cluster) ͱݺ͹Ε͍ͯΔ
41. Ͳ͏΍Ε͹ ίʔυϙΠϯτͷྻ͔Β ॻهૉΛऔΓग़ͤΔ͔
42. ίʔυϙΠϯτ͕ؒ ॻهૉڥքʹͳΔ͔Ͳ͏͔ͷ ݫີͳϧʔϧ͕͋Δ
43. UAX #29 Unicode Text Segmentation
45. ͜ΕΛJSͰ࣮૷ͯ͠·ͨ͠ github.com/orisano/graphemesplit
46. ৄ͘͠͸ UAX #29 Λݟͯ http://unicode.org/reports/tr29/
47. ݟ஌Β͵ਓʹʓจࣈͱ ݴΘΕͨͱ͖ʹ͸ ͪΌΜͱ֬ೝ͠Α͏ʂ
48. 1 byte? 1 codepoint? 1 grapheme cluster?