統計をとって高速化する Scala開発

Slide 1

Slide 1 text

౷ܭΛͱͬͯߴ଎Խ͢Δ  4DBMB։ൃ Ҿ༻ɿKJHPLVOPDPN

Slide 2

Slide 2 text

ࣗݾ঺հ ໊લ খּݪΈ͖ͭ!ZBNJU[LZ ձࣾ גࣜձࣾ$ZCFS; 4DBMBྺ ϲ݄ 3VCZྺ ೥ εϚϗ޿ࠂͷΞυςΫاۀͰ͢

Slide 3

Slide 3 text

ڈ೥ͷ4DBMB$POGFSFODFɺ͍֮͑ͯ·͔͢ʁ

Slide 4

Slide 4 text

+BNFT3PQFS͞ΜͷϥΠϒίʔσΟϯά ܝࣔ൘Λͦͷ৔Ͱ։ൃ Ҿ༻ɿWJNFPDPN

Slide 5

Slide 5 text

+BNFT3PQFS͞ΜͷϥΠϒίʔσΟϯά εχϖοτΛೖྗͯ͠ʜʜ TN⒎

Slide 6

Slide 6 text

+BNFT3PQFS͞ΜͷϥΠϒίʔσΟϯά ŕŦŖƃ Ҿ༻ɿKJHPLVOPDPN

Slide 7

Slide 7 text

͜Μͳ;͏ʹ։ൃͰ͖ͨΒ  ؾ͍͍࣋ͪʜʜʂ

Slide 8

Slide 8 text

*OUFMMJ+ͷ-JWF5FNQMBUF

Slide 9

Slide 9 text

*OUFMMJ+ͷ-JWF5FNQMBUF εχϖοτΛೖྗͯ͠ʜʜ

Slide 10

Slide 10 text

*OUFMMJ+ͷ-JWF5FNQMBUF ŕŦŖƃʂ

Slide 11

Slide 11 text

*OUFMMJ+ͷ-JWF5FNQMBUF ม਺΋ิ׬ʂ

Slide 12

Slide 12 text

Կͷεχϖοτ࡞Ζ͏ʜʜʁ

Slide 13

Slide 13 text

ͦ͏ͩɺσʔλΛͱΖ͏ʂ

Slide 14

Slide 14 text

ιʔείʔυͷϫʔυΧ΢ϯτ ϫʔυΧ΢ϯτ ୯ޠ ग़ݱ਺ ग़ݱ཰ 4USJOH EFG ʜ ʜ ʜ

Slide 15

Slide 15 text

ࣾ಺Ͱूܭͯ͠Έ·ͨ͠

Slide 16

Slide 16 text

$ZCFS;Ͱͷूܭ 順位単語出現率順位単語出現率 1 . 13 -> 1.22% 2 ( 14 Long 1.04% 3 ) 15 => 1.04% 4 , 6.85% 16 val 1.03% 5 : 3.82% 17 rs 0.92% 6 = 2.58% 18 id 0.81% 7 " 2.08% 19 c 0.80% 8 [ 1.90% 20 rn 0.76% 9 ] 1.90% 21 String 0.63% 10 { 1.88% 22 * 0.51% 11 } 1.88% 23 Option 0.50% 12 def 1.24% 24 get 0.46%

Slide 17

Slide 17 text

άϥϑʹͯ͠Έͨ ग़ݱॱҐ ग़ݱ཰

Slide 18

Slide 18 text

άϥϑʹͯ͠Έͨ ग़ݱॱҐ ग़ݱ཰ Ұ෦ͷ୯ޠ͚͕ͩසग़͢Δ

Slide 19

Slide 19 text

άϥϑʹͯ͠Έͨ ग़ݱॱҐ ग़ݱ཰ ্Ґ݅Ͱˋ

Slide 20

Slide 20 text

྆ର਺άϥϑʹͯ͠ΈΔͱʜʜ

Slide 21

Slide 21 text

྆ର਺άϥϑ ௚ઢʂ ͋·Γग़ͯ͜ͳ͍୯ޠ සग़୯ޠ ग़ݱॱҐ ग़ݱ཰

Slide 22

Slide 22 text

δοϓͷ๏ଇ ӳޠͰ΋੒Γཱͭ๏ଇ ग़ݱॱҐ ग़ݱ཰ 5IF "OE 2VBMJUZ 3FBMJUZ Ҿ༻ɿQIBKIVFEVdSJUUOFSGSBDUBMIUNM ͋·Γग़ͯ͜ͳ͍୯ޠ සग़୯ޠ

Slide 23

Slide 23 text

࿩Λ໭ͯ͠ʜ ग़ݱॱҐ ग़ݱ཰ ্Ґ݅Ͱˋ

Slide 24

Slide 24 text

·ͣ͸Λলུ͢ΔઓུͰ -JWF5FNQMBUFΛ࡞ͬͯΈΔ

Slide 25

Slide 25 text

$ZCFS;Ͱͷूܭ 順位単語出現率順位単語出現率 1 . 9.96% 13 -> 1.22% 2 ( 8.67% 14 Long 1.04% 3 ) 8.67% 15 => 1.04% 4 , 6.85% 16 WBM 1.03% 5 : 3.82% 17 rs 0.92% 6 = 2.58% 18 id 0.81% 7 " 2.08% 19 c 0.80% 8 [ 1.90% 20 rn 0.76% 9 ] 1.90% 21 String 0.63% 10 { 1.88% 22 * 0.51% 11 } 1.88% 23 Option 0.50% 12 EFG 1.24% 24 get 0.46% EFG WBMΛεχϖοτԽ

Slide 26

Slide 26 text

ҰจࣈʹׂΓ౰ͯΔ ಉ࣌ʹΧοί΍΋ิ׬ lEz lWz

Slide 27

Slide 27 text

ྫ

Slide 28

Slide 28 text

ྫ W͚ͩೖΕͯʜ

Slide 29

Slide 29 text

ྫ ŕŦŖƃʂ

Slide 30

Slide 30 text

ྫ

Slide 31

Slide 31 text

ྫ

Slide 32

Slide 32 text

݁Ռ WBMม਺໊஋ Wλϒ จࣈ จࣈ

Slide 33

Slide 33 text

$ZCFS;Ͱͷूܭ 順位単語出現率順位単語出現率 1 . 9.96% 13 -> 1.22% 2 ( 8.67% 14 -POH 1.04% 3 ) 8.67% 15 => 1.04% 4 , 6.85% 16 val 1.03% 5 : 3.82% 17 rs 0.92% 6 = 2.58% 18 id 0.81% 7 " 2.08% 19 c 0.80% 8 [ 1.90% 20 rn 0.76% 9 ] 1.90% 21 4USJOH 0.63% 10 { 1.88% 22 * 0.51% 11 } 1.88% 23 0QUJPO 0.50% 12 def 1.24% 24 get 0.46% ͍͔ͭ͘ͷܕ͸Α͘ೖྗ͞ΕΔ

Slide 34

Slide 34 text

Α͘࢖͏ܕͷ-JWF5FNQMBUFΛొ࿥ l4z l-z l0z l*z

Slide 35

Slide 35 text

Α͘࢖͏ܕͷ-JWF5FNQMBUFΛొ࿥ l4z l-z l0z l*z

Slide 36

Slide 36 text

͜͜·ͰͰ

Slide 37

Slide 37 text

ͳΜͱʜʜʂ

Slide 38

Slide 38 text

໿Λলུ ཧ࿦্͸࣌ؒ։ൃͨ͠Β࣌ؒ୹ॖͰ͖Δ

Slide 39

Slide 39 text

(SPPWZ4DSJQUΛ࢖͏ͱ  ͜Μͳ͜ͱ΋

Slide 40

Slide 40 text

ϝιουͷϩάग़ྗ

Slide 41

Slide 41 text

ϝιουͷϩάग़ྗ

Slide 42

Slide 42 text

ϝιουͷϩάग़ྗ ŕŦŖƃʂ

Slide 43

Slide 43 text

42-ͷੜ੒

Slide 44

Slide 44 text

42-ͷੜ੒

Slide 45

Slide 45 text

42-ͷੜ੒ ŕŦŖƃʂ

Slide 46

Slide 46 text

·ͱΊ *OUFMMJ+ͷ-JWF5FNQMBUFΛ࢖͍͜ͳͦ͏ ιʔε΋͋ΔΑʂ IUUQTHJUIVCDPNZBNJU[LZTDBMBJOUFMMJK