Upgrade to Pro — share decks privately, control downloads, hide ads and more …

the world of characters

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for orisano orisano
September 13, 2018
1.5k
8

the world of characters

Avatar for orisano

orisano

September 13, 2018

More Decks by orisano

See All by orisano
OSS Performance Tuning Tips
Avatar for orisano orisano
8
6.2k
Docker-Compose & BuildKit
Avatar for orisano orisano
4
1.1k
Container Build Talk
Avatar for orisano orisano
3
2.6k
dockerignore talk
Avatar for orisano orisano
2
7.3k
Better docker image+
Avatar for orisano orisano
6
6.6k
Socket.IO Introduction
Avatar for orisano orisano
0
3.3k
Profiling Go Application
Avatar for orisano orisano
11
8.1k
Multi-stage Builds Patterns & Practice
Avatar for orisano orisano
6
5.3k
better docker image
Avatar for orisano orisano
22
31k

Featured

See All Featured
Leveraging LLMs for student feedback in introductory data science courses - posit::conf(2025)
Avatar for Mine Cetinkaya-Rundel minecr
1
300
AI: The stuff that nobody shows you
Avatar for John Nunemaker jnunemaker
PRO
8
730
Ruling the World: When Life Gets Gamed
Avatar for Sebastian Deterding codingconduct
0
260
How STYLIGHT went responsive
Avatar for nonsquared nonsquared
100
6.2k
End of SEO as We Know It (SMX Advanced Version)
Avatar for Michael King ipullrank
3
4.2k
The SEO identity crisis: Don't let AI make you average
Avatar for Varn varn
0
500
Producing Creativity
Avatar for Steve Smith orderedlist
PRO
348
40k
Effective software design: The role of men in debugging patriarchy in IT @ Voxxed Days AMS
Avatar for Kenny Baas-Schwegler baasie
0
430
The B2B funnel & how to create a winning content strategy
Avatar for Katarina Dahlin katarinadahlin
PRO
1
400
Design of three-dimensional binary manipulators for pick-and-place task avoiding obstacles (IECON2024)
Avatar for konakalab konakalab
0
470
Docker and Python
Avatar for Tania Allard trallard
47
3.9k
Organizational Design Perspectives: An Ontology of Organizational Design Elements
Avatar for Dr. Kim W Petersen kimpetersen
PRO
1
750

Transcript

  1. 1จࣈͷੈք @orisano

  2. Έͳ͞Μ จࣈΛ਺͑ΒΕ·͢ΑͶʁ

  3. a

  4. a => 1

  5. ͋

  6. ͋ => 1

  7. 佛

  8. 佛 => 1

  9. None

  10. => 1

  11. None

  12. => 1

  13. Z͑ͫ̓ͪ̂ͫ̽ ̴̙̤̞͉͚̯̞̠͍A̴̵̜̰͔ ͫ͗ ͢ L̠ͨͧͩ͘ G̴̻͈͍͔̹ ̑͗̎̅͛ ́ Ǫ̵̹̻̝̳ ͂̌

    ̌͘! ͖̬̰̙̗ ̿̋ ͥ ͥ̂ͣ̐́́͜͞

  14. Z͑ͫ̓ͪ̂ͫ̽ ̴̙̤̞͉͚̯̞̠͍A̴̵̜̰͔ ͫ͗ ͢ L̠ͨͧͩ͘ G̴̻͈͍͔̹ ̑͗̎̅͛ ́ Ǫ̵̹̻̝̳ ͂̌

    ̌͘! ͖̬̰̙̗ ̿̋ ͥ ͥ̂ͣ̐́́͜͞ => 6

  15. Έͳ͞Μ όΠτ਺Λ਺͑ΒΕ·͔͢ʁ (UTF-8)

  16. a

  17. a => 1

  18. ͋

  19. ͋ => 3

  20. 佛

  21. 佛 => 4

  22. None

  23. => 4

  24. None

  25. => 18

  26. Z͑ͫ̓ͪ̂ͫ̽ ̴̙̤̞͉͚̯̞̠͍A̴̵̜̰͔ ͫ͗ ͢ L̠ͨͧͩ͘ G̴̻͈͍͔̹ ̑͗̎̅͛ ́ Ǫ̵̹̻̝̳ ͂̌

    ̌͘! ͖̬̰̙̗ ̿̋ ͥ ͥ̂ͣ̐́́͜͞

  27. Z͑ͫ̓ͪ̂ͫ̽ ̴̙̤̞͉͚̯̞̠͍A̴̵̜̰͔ ͫ͗ ͢ L̠ͨͧͩ͘ G̴̻͈͍͔̹ ̑͗̎̅͛ ́ Ǫ̵̹̻̝̳ ͂̌

    ̌͘! ͖̬̰̙̗ ̿̋ ͥ ͥ̂ͣ̐́́͜͞ => 143

  28. ͋ͳ͕ͨࢥ͏1จࣈ͸ Ͳ͏਺͑Δ΂͖͔ʁ

  29. byte਺Ͱ͸਺͑ΒΕͳ͍

  30. Unicode͸จࣈू߹ จࣈͱ਺஋͕ରԠ͢Δ

  31. ͋ => 3042

  32. => 1F914

  33. ͜ͷ਺஋ͷ͜ͱΛ ίʔυϙΠϯτ ͱݺͿ

  34. ͜ͷίʔυϙΠϯτΛ byteྻͰදݱ͢Δํ๏Λ ΤϯίʔσΟϯάͱ͍͏

  35. UTF-8ͱ͔UTF-16ͱ͔͸ ΤϯίʔσΟϯάͷҰछ

  36. ͱΓ͋͑ͣ ίʔυϙΠϯτΛ਺͑Ε͹ ղܾʁ

  37. ͍͍͑

  38. => 1F468 + 200D + 1F469 + 200D + 1F466

  39. ࣮͸ෳ਺ͷίʔυϙΠϯτͰ ҰͭͷจࣈʹͳͬͨΓ͢Δ

  40. ਓ͕ؒೝ͍ࣝͯ͠Δ̍จࣈ͸ ॻهૉ(Grapheme cluster) ͱݺ͹Ε͍ͯΔ

  41. Ͳ͏΍Ε͹ ίʔυϙΠϯτͷྻ͔Β ॻهૉΛऔΓग़ͤΔ͔

  42. ίʔυϙΠϯτ͕ؒ ॻهૉڥքʹͳΔ͔Ͳ͏͔ͷ ݫີͳϧʔϧ͕͋Δ

  43. UAX #29 Unicode Text Segmentation

  44. None

  45. ͜ΕΛJSͰ࣮૷ͯ͠·ͨ͠ github.com/orisano/graphemesplit

  46. ৄ͘͠͸ UAX #29 Λݟͯ http://unicode.org/reports/tr29/

  47. ݟ஌Β͵ਓʹʓจࣈͱ ݴΘΕͨͱ͖ʹ͸ ͪΌΜͱ֬ೝ͠Α͏ʂ

  48. 1 byte? 1 codepoint? 1 grapheme cluster?