$30 off During Our Annual Pro Sale. View Details »

Optimizing Ruby with JIT

Optimizing Ruby with JIT

Takashi Kokubun

August 30, 2019
Tweet

More Decks by Takashi Kokubun

Other Decks in Programming

Transcript

  1. Optimizing Ruby with JIT
    Builderscon 2019 / Takashi Kokubun
    ࠷଎ͷݴޠΛ໨ࢦͯ͠

    View Slide

  2. View Slide

  3. Ruby 2.6 ͔ΒJITΛ։ൃ

    View Slide

  4. ΍Γ·ͨ͠ [Misc #16094]

    View Slide

  5. View Slide

  6. (࠷దԽࢹ఺Ͱͷ)
    Rubyͷಛ௃

    View Slide

  7. 1. ϝιου΋ఆ਺΋࠶ఆٛ͠์୊
    1 + 1 #=> 100

    View Slide

  8. 1. ϝιου΋ఆ਺΋࠶ఆٛ͠์୊
    1 + 1 #=> 100

    View Slide

  9. 1. ϝιου΋ఆ਺΋࠶ఆٛ͠์୊
    1 + 1 #=> 100

    View Slide

  10. 2. ߦ͕ਐΉͱ೚ҙͷ͜ͱ͕ى͖Δ
    a = 1 + 1

    View Slide

  11. 2. ߦ͕ਐΉͱ೚ҙͷ͜ͱ͕ى͖Δ
    a = 1 + 1
    a #=> 2

    View Slide

  12. 2. ߦ͕ਐΉͱ೚ҙͷ͜ͱ͕ى͖Δ
    a = 1 + 1
    a #=> 2
    a #=> 100
    !?

    View Slide

  13. 2. ߦ͕ਐΉͱ೚ҙͷ͜ͱ͕ى͖Δ

    View Slide

  14. 2. ߦ͕ਐΉͱ೚ҙͷ͜ͱ͕ى͖Δ
    ʮ3ߦ໨ʹୡͨ͠Β a = 100ʯ

    View Slide

  15. 3. ଞʹ΋ָ͍͠ػೳ͕͍ͬͺ͍
    • eval
    • ଋറ΍؀ڥͷΦϒδΣΫτԽ (binding, Proc)
    • ೚ҙΦϒδΣΫτͷྻڍػೳ (ObjectSpace)
    • Φʔόʔϑϩʔ͢Δͱܕ͕มΘΔ੔਺
    • ΞυϨεมΘΓ์୊ͷώʔϓྖҬ (GC.compact)

    View Slide

  16. ຊ೔ͷΰʔϧ
    ͜ͷ࠷దԽ͕ࠔ೉ͳݴޠΛ
    ݶք·Ͱߴ଎Խ͢Δ
    ָ͠͞Λମݧ͍ͯͨͩ͘͠

    View Slide

  17. RubyΠϯλϓϦλͷ͘͠Έ

    View Slide

  18. 1. RubyͷίʔυΛಡΈࠐΉ

    View Slide

  19. 2. ύʔεͯ͠ߏจ໦ʹ͢Δ

    EFGUXP

    View Slide

  20. 3. ίϯύΠϧ໋ͯ͠ྩྻʹ͢Δ

    EFGUXP

    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF

    View Slide

  21. 4. VMͰ໋ྩྻΛ࣮ߦ͢Δ

    EFGUXP

    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ

    View Slide

  22. 4. VMͰ໋ྩྻΛ࣮ߦ͢Δ

    EFGUXP

    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ

    View Slide

  23. 4. VMͰ໋ྩྻΛ࣮ߦ͢Δ

    EFGUXP

    UXP
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ


    View Slide

  24. 4. VMͰ໋ྩྻΛ࣮ߦ͢Δ

    EFGUXP

    UXP
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ



    View Slide

  25. 4. VMͰ໋ྩྻΛ࣮ߦ͢Δ

    EFGUXP

    UXP
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ

    View Slide

  26. ͜ͷϑΣʔζͷڍಈΛ଎͍ͨ͘͠

    EFGUXP

    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ

    View Slide

  27. 5. JIT ίϯύΠϥͰߴ଎Խ͢Δ
    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ
    +*5

    View Slide

  28. 5. JIT ίϯύΠϥͰߴ଎Խ͢Δ
    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ
    +*5
    ࠓͷͱ͜Ζ
    *OUFHFS
    ࠶ఆٛ͞Εͯͳ͍ͳ

    View Slide

  29. 5. JIT ίϯύΠϥͰߴ଎Խ͢Δ
    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ
    +*5

    ͳͷͰ͸

    View Slide

  30. 5. JIT ίϯύΠϥͰߴ଎Խ͢Δ
    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ
    +*5
    ͍΍ɺ͕࠶ఆٛ
    ͞ΕͨΒ͔΋

    View Slide

  31. 5. JIT ίϯύΠϥͰߴ଎Խ͢Δ
    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ
    +*5

    View Slide

  32. 5. JIT ίϯύΠϥͰߴ଎Խ͢Δ
    UXP
    QVUPCKFDU
    QVUPCKFDU
    TFOE
    MFBWF
    7JSUVBM.BDIJOF
    ελοΫ
    +*5

    View Slide

  33. JITͰͲͷ͘Β͍଎͘ͳΔͷ͔

    View Slide

  34. JITʹ͓͚Δੑೳ޲্
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.0
    0.0
    0.0
    0.0
    0.0
    0.0
    0.0
    0.0
    34.2
    Details: https://gist.github.com/k0kubun/0337e1f40b146b2cae7b7c8e6a79973a
    1.0x
    Version

    View Slide

  35. JITʹ͓͚Δੑೳ޲্
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.0
    2.1
    2.2
    2.3
    0.0
    0.0
    0.0
    0.0
    39.1
    37.9
    37.8
    34.2
    Details: https://gist.github.com/k0kubun/0337e1f40b146b2cae7b7c8e6a79973a
    1.1x
    Version

    View Slide

  36. JITʹ͓͚Δੑೳ޲্
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.0
    2.1
    2.2
    2.3
    2.4
    2.5
    0.0
    0.0
    49.0
    46.2
    39.1
    37.9
    37.8
    34.2
    Details: https://gist.github.com/k0kubun/0337e1f40b146b2cae7b7c8e6a79973a
    1.4x
    Version

    View Slide

  37. JITʹ͓͚Δੑೳ޲্
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.0
    2.1
    2.2
    2.3
    2.4
    2.5
    2.6
    0.0
    55.9
    49.0
    46.2
    39.1
    37.9
    37.8
    34.2
    Details: https://gist.github.com/k0kubun/0337e1f40b146b2cae7b7c8e6a79973a
    1.6x
    Version

    View Slide

  38. JITʹ͓͚Δੑೳ޲্
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.0
    2.1
    2.2
    2.3
    2.4
    2.5
    2.6
    2.6
    JIT
    85.8
    55.9
    49.0
    46.2
    39.1
    37.9
    37.8
    34.2
    Details: https://gist.github.com/k0kubun/0337e1f40b146b2cae7b7c8e6a79973a
    2.5x
    Version

    View Slide

  39. ͜ͷ͕ࠩग़Δཧ༝Λݟ͍͖ͯ·͢
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.6
    2.6
    JIT
    85.8
    55.9
    0.0
    0.0
    0.0
    0.0
    0.0
    0.0
    Details: https://gist.github.com/k0kubun/0337e1f40b146b2cae7b7c8e6a79973a
    Version

    View Slide

  40. JITίϯύΠϥ͸ͲͷΑ͏ʹ
    ߴ଎ԽΛ͢Δ͔?

    View Slide

  41. JITͷجૅ0
    ػցޠʹ͚ͨͩ͠Ͱ͸
    ଎͘ͳΒͳ͍

    View Slide

  42. VM࣮ߦ → ػցޠ ͰͷੑೳมԽ
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.6
    native
    2.6
    JIT
    85.8
    55.9
    ?
    (-O3 w/ VM໋ྩΠϯϥΠϯԽͳ͠)

    View Slide

  43. VM࣮ߦ → ػցޠ ͰͷੑೳมԽ
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.6
    native
    2.6
    JIT
    85.8
    56.2
    55.9
    (-O3 w/ VM໋ྩΠϯϥΠϯԽͳ͠)

    View Slide

  44. ػցޠʹ͚ͨͩ͠Ͱ͸଎͘ͳΒͳ͍
    • VMͷ࣮૷͕ͦ΋ͦ΋ػցޠͰಈ͍͍ͯΔ
    • VMͰ࣮૷͞Ε͍ͯΔෳࡶͳॲཧΛ؆ུԽͰ͖ͳ
    ͚Ε͹଎͘ͳΒͳ͍

    View Slide

  45. VMͷதͰ͸Կ͕ى͖͍ͯΔ͔
    (Ͳ͕͜଎͘Ͱ͖ͦ͏Ͱ͠ΐ͏͔?)

    View Slide

  46. View Slide

  47. View Slide

  48. View Slide

  49. View Slide

  50. View Slide

  51. View Slide

  52. View Slide

  53. View Slide

  54. View Slide

  55. View Slide

  56. View Slide

  57. View Slide

  58. View Slide

  59. View Slide

  60. View Slide

  61. View Slide

  62. View Slide

  63. RubyͷJIT͸CίϯύΠϥΛ࢖͏
    • ࣮ߦ࣌ʹCίϯύΠϥΛ࣮ߦͯ͠ಈతϥΠϒϥϦ
    Λੜ੒ɺಈతϩʔυ
    • ϝϦοτ: Ҡ২ੑͷ୲อ͕ͦΕͳΓʹָɺෳ਺
    ͷ࠷దԽόοΫΤϯυΛ࢖͑Δ
    • σϝϦοτ: JITίϯύΠϧத·͋·͋Ϧιʔε
    Λ࢖͏ɺϓϩηε΍γάφϧͷѻ͍͕൥ࡶʹͳ
    Δ

    View Slide

  64. RubyͷJIT͸CίϯύΠϥΛ࢖͏
    • CίϯύΠϥ͸ී௨ͷCͷίʔυͰ࠷దԽͰ͖Δൣ
    ғ͔͠࠷దԽͰ͖ͳ͍
    • Rubyಛ༗ͷಛผͳॲཧΛऔΓআ͘ͷ͸େମࣗ෼
    Ͱ࣮૷͢Δ͔͠ͳ͍

    View Slide

  65. ίϯύΠϥͷ࠷దԽʹΑΔߴ଎Խ
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.6
    native
    com
    piler
    2.6
    JIT
    85.8
    62.5
    56.2
    55.9
    (-O3 w/ VM໋ྩΠϯϥΠϯԽ͋Γ)

    View Slide

  66. JITͷجૅ1
    ϓϩάϥϜΧ΢ϯλͷ࠷దԽ

    View Slide

  67. View Slide

  68. ϓϩάϥϜΧ΢ϯλͷ࠷దԽ
    • VMͷϓϩάϥϜΧ΢ϯλͷҙٛͷҰͭ͸VM໋ྩ
    σΟεύον͕ͩɺ͜Ε͸ෆཁʹͳ͍ͬͯΔ
    • Ͱ͸ɺϓϩάϥϜΧ΢ϯλಈ͔͞ͳͯ͘΋͍͍͔?

    View Slide

  69. ϓϩάϥϜΧ΢ϯλͷ࠷దԽ
    • ଞͷϓϩάϥϜΧ΢ϯλͷ༻్:
    • ྫ֎ͷΩϟονςʔϒϧʹ࢖ΘΕΔ
    • ྫ֎͕ͳ͘ͱ΋ߦ൪߸ͷܭࢉʹ࢖ΘΕΔ

    View Slide

  70. View Slide

  71. View Slide

  72. ϓϩάϥϜΧ΢ϯλͷ࠷దԽ
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.6
    native
    com
    piler
    pc
    2.6
    JIT
    85.8
    62.7
    62.5
    56.2
    55.9

    View Slide

  73. JITͷجૅ2
    ελοΫϙΠϯλͷ࠷దԽ

    View Slide

  74. View Slide

  75. ελοΫϙΠϯλͷ࠷దԽ
    • VMͷελοΫϙΠϯλͷҙٛ͸VMͷελοΫͷ
    ૢ࡞ʹ͋Δ
    • ωΠςΟϒͳελοΫ΍ϨδελͰಉ͡ૢ࡞Λ࣮
    ݱͯ͠ελοΫϙΠϯλΛ΍ΊΒΕͳ͍͔?

    View Slide

  76. ελοΫϙΠϯλͷ࠷దԽ
    • ϝιουݺͼग़͢͠Δࡍʹ͸VMͷελοΫʹ໭
    ͞ͳ͍ͱݺͼग़ͨ͠ϝιου͔ΒࢀরͰ͖ͳ͍
    • େҬ୤ग़ޙʹ࢖ΘΕΔ

    View Slide

  77. View Slide

  78. View Slide

  79. View Slide

  80. View Slide

  81. ελοΫϙΠϯλͷ࠷దԽ
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.6
    native
    com
    piler
    pc sp
    2.6
    JIT
    85.8
    66.4
    62.7
    62.5
    56.2
    55.9

    View Slide

  82. ·͔ͩͳΓ͕ࠩ͋Δ
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.6
    native
    com
    piler
    pc sp
    2.6
    JIT
    85.8
    66.4
    62.7
    62.5
    56.2
    55.9

    View Slide

  83. Ͳ͏ͨ͠Βߋʹ଎͘ͳΔͷ͔?
    • PC/SPͷૢ࡞͸ผʹϘτϧωοΫͰ͸ͳ͍ͷͰ͜
    ΕͰ͸଎͘ͳΒͳ͍
    • Ή͠ΖRubyͷಈతͳಛੑͷαϙʔτͷͨΊʹ೉͠
    ͘ͳ͍ͬͯΔ࠷దԽΛ࣮ݱ͢Δํ͕ॏཁ

    View Slide

  84. JITͷڧΈΛੜ͔ͨ͠࠷దԽ

    View Slide

  85. JITͷԠ༻1
    ϝιουΠϯϥΠϯԽ

    View Slide

  86. View Slide

  87. ϝιουΠϯϥΠϯԽ
    • 1+1Λܭࢉ͢ΔΑΓ΋Rubyͷϝιουݺͼग़͠ॲ
    ཧͷํ͕ෳࡶ
    • ϝιουݺͼग़͠ͷΦʔόʔϔουΛແʹͰ͖
    ͳ͍͔? => ΠϯϥΠϯԽ

    View Slide

  88. ϝιουΠϯϥΠϯԽ
    • ΠϯϥΠϯԽ͢ΔͱɺίʔϧελοΫͷૢ࡞͕ͳ
    ͘ͳΔ͚ͩͰͳ͘ɺϝιουݺͼग़͠Λӽ͑ͯ࠷
    దԽ͕ޮ͘
    • ͔͠͠ΠϯϥΠϯԽͨ͠ޙਖ਼͍͠ڍಈʹద੾ʹ෮
    ؼͰ͖Δඞཁ͕͋Δ
    • “Deoptimization” ͱ͍͏

    View Slide

  89. Rubyͷϝιουݺͼग़͠ͷ͘͠Έ
    • άϩʔόϧϝιουΩϟογϡͱΠϯϥΠϯϝ
    ιουΩϟογϡ͕͋Δ
    • ΠϯϥΠϯϝιουΩϟογϡ͸શͯͷcall siteʹ
    ରͯ͠ଘࡏ͢Δ
    • ͜ΕΛDeoptimizationʹ࢖͏

    View Slide

  90. ϝιουΠϯϥΠϯԽ
    • ΠϯϥΠϯԽ͢Δϝιου಺Ͱߦ൪߸Λऔಘͨ͠
    Γྫ֎͕ඈΜͩΓ͠ͳ͍͜ͱΛอূ͠ͳ͍ͱ͍͚
    ͳ͍
    • VM໋ྩͷϝλσʔλΛ༻ҙ͓ͯ͘͠

    View Slide

  91. ϝιουΠϯϥΠϯԽ

    View Slide

  92. View Slide

  93. View Slide

  94. ϝιουΠϯϥΠϯԽ
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.6
    native
    com
    piler
    pc sp
    inline
    2.6
    JIT
    85.8
    72.4
    66.4
    62.7
    62.5
    56.2
    55.9

    View Slide

  95. JITͷԠ༻2
    Πϯελϯεม਺ͷ࠷దԽ

    View Slide

  96. Πϯελϯεม਺ͷ࠷దԽ
    • Πϯελϯεม਺ΛಡΉʹ͸Կ౓͔ϝϞϦͷϩʔ
    υΛ͠ͳ͍ͱ͍͚ͳ͍ => ஗͍
    • ຊདྷϩʔυ͠ͳ͍ͱ͍͚ͳ͍஋ΛJITੜ੒ίʔυ಺
    Ͱ͸ଈ஋ʹͰ͖ͳ͍͔?

    View Slide

  97. RubyͷΠϯελϯεม਺ͷ͘͠Έ
    • Ϋϥε͝ͱʹɺ͋ΔΠϯελϯεม਺͕֨ೲ͞Ε
    ͍ͯΔΠϯσοΫε͕ҟͳΔ
    • ܧঝͯ͠ಉ໋͡ྩྻ͕ڞ༗͞Ε͍ͯΔͱյΕΔ

    View Slide

  98. Πϯελϯεม਺ͷ࠷దԽ
    • ϝιουΠϯϥΠϯԽͱಉ༷ͷํ๏Ͱ
    Deoptimization͢Δ
    • Ճ͑ͯɺ༨ܭͳϒϥϯνΛ࡟Δ͜ͱͰίϯύΠϥ
    ͷ࠷దԽ͕ޮ͖΍͘͢͢Δ

    View Slide

  99. Πϯελϯεม਺ͷ࠷దԽ

    View Slide

  100. Πϯελϯεม਺ͷ࠷దԽ
    NES emulator: github.com/mame/optcarrot
    fps
    0
    23
    46
    69
    92
    2.6
    native
    com
    piler
    pc sp
    inline
    ivar
    2.6
    JIT
    85.8
    85.8
    72.4
    66.4
    62.7
    62.5
    56.2
    55.9

    View Slide

  101. Ruby͸·ͩਐԽΛ࢒͍ͯ͠Δ
    (TruffleRuby ͸ 170fps ग़Δ)

    View Slide

  102. ·ͱΊ
    • Ruby͸࠷଎ͷݴޠͱͳΓಘΔ͔ʁ
    • ଞͷݴޠͰ΋ॻ͚Δίʔυ͸ɺେ఍͸ͦΕ૬౰
    ʹ࠷దԽͰ͖Δ
    • Rubyಛ༗ͬΆ͍ݴޠػೳ͸અ౓ͷ͋Δར༻Λ

    View Slide