Perl Localization with the Unicode CLDR

Unicode is much more than just characters. The Unicode Consortium defines open standards for collating, parsing, and formatting data in much of the world’s languages. The Common Locale Data Repository (CLDR) is the largest standard repository of locale data along with specifications for its use and is a powerful resource for software localization. Unicode CLDR is quickly becoming the de facto locale standard with widespread use among companies including Google, Apple, and IBM; projects ranging from Linux distributions to Wikipedia; and increasing support in many programming languages.

This talk will provide an introduction to software localization with the CLDR, highlight several CLDR-based CPAN projects, demonstrate how Shutterstock uses and contributes to them, and discuss the remaining work for the Perl community to provide first-class CLDR support.

Presented at:
◦ 2014-05-03: DC–Baltimore Perl Workshop (DCBPW) 2014, Silver Spring, MD
◦  2014-06-23: YAPC::NA 2014, Orlando, FL

Video: https://youtu.be/DcPpUnlENAs
Notes: http://opensourcebridge.org/wiki/2014/Unicode_Beyond_Just_Characters:_Localization_with_the_CLDR

Transcript

1. Unicode Beyond Just Characters Localization with the CLDR Nick Patch @nickpatch Shutterstock
2. 森
3. ⪷
4. 얜
5. ﲵ
7. ぷ Ꮨ ⇱ K ㋻
8. Ꙃ २ ௲
9. ⇱ ⤳ ⪷ ௲ २ ൪ G K ж Ꙃ ﲵ Ꮨ 얜 ぷ ㋻ 森
10. → g ﲵ ← حض ㋻ →ワ
11. Perl ♥ Unicode
12. Unicode CLDR
13. i18n vs. L10n
15. Locales
16. $locale = Locales->new('fr'); say $locale->get_language_from_code('en'); anglais
17. $locale = Locales->new('fr'); say $locale->get_territory_from_code('US'); États-Unis
22. CLDR::Number
23. $cldr = CLDR::Number->new(locale => 'es');
24. $cldr = CLDR::Number->new(locale => 'es'); $decf = $cldr->decimal_formatter;
25. $cldr = CLDR::Number->new(locale => 'es'); $decf = $cldr->decimal_formatter; say $decf->format(1234.5);
26. $cldr = CLDR::Number->new(locale => 'es'); $decf = $cldr->decimal_formatter; say $decf->format(1234.5); 1 234,5
27. $decf->locale('es-MX'); say $decf->format(1234.5); 1,234.5
28. $decf->locale('ar'); say $decf->format(1234.5); ١٬٢٣٤٫٥
29. $decf->locale('bn'); say $decf->format(123_000); ১,২৩,০০০
30. $decf->locale('bn'); say $decf->format(12_300_000); ১,২৩,০০,০০০
31. $perf = $cldr->percent_formatter( locale => 'tr' );
32. $perf = $cldr->percent_formatter( locale => 'tr' );
33. $perf = $cldr->percent_formatter( locale => 'tr' ); say $perf->format(0.05);
34. $perf = $cldr->percent_formatter( locale => 'tr' ); say $perf->format(0.05); %5
35. $perf->locale('ar'); say $perf->format(0.05); ٥٪
36. $perf->locale('fr'); say $perf->format(0.05); 5 %
37. $perf->permil(1); say $perf->format(0.05); 50 ‰
38. $curf = $cldr->currency_formatter( locale => 'en', currency_code => 'USD', );
39. $curf = $cldr->currency_formatter( locale => 'en', currency_code => 'USD', );
40. $curf = $cldr->currency_formatter( locale => 'en', currency_code => 'USD', ); say $curf->format(9.99);
41. $curf = $cldr->currency_formatter( locale => 'en', currency_code => 'USD', ); say $curf->format(9.99); $9.99
42. $curf->locale('en-CA'); say $curf->format(9.99); US$9.99
43. $curf->locale('fr-CA'); say $curf->format(9.99); 9,99 $US
44. $curf->locale('fr-CA'); $curf->currency_code('CAD') say $curf->format(9.99); 9,99 $
45. $curf->locale('bn'); $curf->currency_code('INR'); say $curf->format(123_000); ১,২৩,০০০.০০₹
46. $decf->locale('en'); translate( '[_1]–[_2] of [_3]', $decf->format(1), $decf->format(25), $decf->format(1500), );
47. $decf->locale('en'); translate( '[_1]–[_2] of [_3]', $decf->format(1), $decf->format(25), $decf->format(1500), ); 1–25 of 1,500
48. $decf->locale('en'); translate( '[_1] of [_2]', $decf->range(1, 25), $decf->format(1500), ); 1–25 of 1,500
49. $decf->locale('ja'); translate( '[_1] of [_2]', $decf->range(1, 25), $decf->format(1500), ); 1 ～ 25 の 1,500
50. $decf->locale('ja'); $decf->numbering_system('fullwide'); translate( '[_1] of [_2]', $decf->range(1, 25), $decf->format(1500), ); １～２５の１ , ５００
51. $decf->locale('ja-u-nu-fullwide'); translate( '[_1] of [_2]', $decf->range(1, 25), $decf->format(1500), ); １～２５の１ , ５００
52. Unicode::Collate::Locale
53. use Unicode::Collate::Locale;
54. use Unicode::Collate::Locale; $c = Unicode::Collate::Locale->new( locale => 'pl' );
55. use Unicode::Collate::Locale; $c = Unicode::Collate::Locale->new( locale => 'pl' ); @sorted = $c->sort(@words);
56. DateTime DateTime::Locale
57. use DateTime; $dt = DateTime->now(locale => 'ja'); say $dt->format_cldr( $dt->locale->datetime_format_full ); 2014 年 6 月 23 日水曜日 9 時 50 分 42 秒 UTC
58. Locale::CLDR
59. perl-cldr.github.io @PerlCLDR
60. TODO DateTime DateTime::Locale CLDR::Transform CLDR::Segment
61. Nick Patch @nickpatch Shutterstock