In the beginning was TXT

A very short overview of the history of encodings, given at Vienna.rb on 2014-10-02

Transcript

1. In the beginning was TXT
2. !
3. EBCDIC
4. Source: http://en.wikipedia.org/wiki/EBCDIC
5. ASCII
6. "#$%&
8. ä, ö, or å and Ø?
9. Latin-1 ISO/IEC 8859-1
10. Latin-*
11. Windows code pages
12. Then came the €
13. (
15. Shift-JIS
16. This sucks
17. Unicode!
18. Unicode!
19. ✈️ (planes!)
20. Basic Multilingual Plane
21. Code Points
22. U+0041 (LATIN SMALL LETTER A)
23. Source: http://codepoints.net/U+0041
24. Grapheme
25. a a a a a a a
26. Composite characters
27. U+0065 U+0301 or U+00E9
28. e+´ => é é
29. ´ != ´
30. Unicode… is not an encoding
31. UTF-32
32. UCS-2/UTF-16
33. UTF-8
34. Source: http://en.wikipedia.org/wiki/File:UnicodeGrow2b.png
35. What does it look like?
36. Codepoint Char ASCII Latin-1 ISO-8859-15 UTF-8 UTF-16 U+0041 A 0x41 0x41 0x41 0x41 0x00 0x41 U+00C4 Ä - 0xc4 0xc4 0xc3 0x84 0x00 0xc4 U+20AC € - - 0xa4 0xe3 0x82 0xac 0x20 0xac U+C218 ࣻ - - - 0xec 0x88 0x98 0xc2 0x18 Encoding comparison Source: http://perlgeek.de/en/article/encodings-and-unicode
37. Remember: Just because someone claims it’s UTF-8, doesn’t mean it is