State of JRuby 2014

RubyConf AU
21 February, 2014, Sydney, NSW, Australia

Video: https://vimeo.com/90823948

Transcript

1. State of JRuby 2014 Hiro Asari! Travis CI! ! RubyConf Australia 2014
2. Have you heard of JRuby?
3. Have you tried JRuby?
4. Are you using JRuby?
5. JRuby is an implementation of the Ruby language
6. Ruby J
7. Ruby ust J
8. JRuby vs Ruby
9. Ruby Thread models OS Threads Green Threads Kernel GIL Ruby interpreter Ruby 1.8 Green Threads GIL Ruby interpreter Kernel Ruby 1.9, 2.0 Green Threads Kernel JVM JRuby
10. JRuby is a fast implementation of the Ruby language on the Java Virtual Machine
11. JRuby is fast • JVM improves over time
12. JRuby is fast • Faster and more mature garbage collectors
13. Time per GC versus heap usage Time per GC 0ms 75ms 150ms 225ms 300ms Heap usage (MRI/JRuby) 188KB/29MB 27MB/127MB 199MB/238MB Ruby 2.0.0 JRuby
14. 0 1.5 3 4.5 6 Interpreted AST (i.e., no compiler) Interpreted IR MRI 2.1.0 Compiled AST, no InvokeDynamic Compiled AST, with InvokeDynamic Mandelbrot
15. Web servers
16. TorqueBox • Application server with built-in support for • messaging • scheduling • caching • daemons
17. Puma • Concurrent web server
18. Trinidad • Tomcat-based lightweight server
19. Deployment options • Heroku • OpenShift • Roll your own on EC2
20. Web benchmarks • http://www.techempower.com/benchmarks/ #section=data-r8&hw=ec2&test=json&l=35s! • Ruby + Unicorn! • JRuby + TorqueBox
21. Web Benchmarks JSON Serialization 0 5500 11000 16500 22000 rack rails-stripped rails sinatra jruby 1.7.8 ruby 2.0.0
22. Web Benchmarks JSON Serialization (Log scale) 1 100 10000 rack rails-stripped rails sinatra jruby 1.7.8 ruby 2.0.0
23. 300 600 900 1200 sinatra rails-stripped rails jruby 1.7.8 ruby 2.0.0 Web Benchmarks Single Query
24. Web Benchmarks Multiple Queries 35.0 70.0 105.0 140.0 sinatra rails-stripped rails jruby 1.7.8 ruby 2.0.0
25. Brief History of JRuby • 2001 — started by Jan Arne Petersen • 2006 — Rails support • 2011 — v 1.6.0 (experimental C extension support) • 2012 — v 1.7.0 (InvokeDynamic support)
26. 2013 • Released 1.6.8 • community-based release • Released 1.7.2 through 1.7.9 • 1.7.4 introduced experimental Ruby 2.0 support
27. 2013 $ git checkout master Switched to branch 'master' Your branch is up-to-date with 'origin/master'. $ git log --format='%ai %s' | grep -v Merge | grep 2013-\\d\\d-\\d\\d -c 2459 ! ! ! ! ! ! ! !
28. 2013 $ git co jruby-1_7 Switched to branch 'jruby-1_7' Your branch is up-to-date with 'origin/jruby-1_7'. $ git log --format='%ai %s' | grep -v Merge | grep 2013-\\d\\d-\\d\\d -c 1939 ! ! ! ! ! ! ! !
29. 2013 commit 1176078fa56f4bf3409ba05345def99a0ee06cb2 Author: Thomas E. Enebo <tom.enebo@gmail.com> Date: Tue Oct 1 11:30:22 2013 -0500 ! The future is now? ! ! ! ! ! ! ! !
30. JRuby Architecture JVM FFI JDK JRuby Core Classes Ruby Core classes Other Java Libraries Compiler & Byte Code Backend Extras Ruby Application Standard Libs
31. JVM • Constantly evolving
32. JVM Over Time 0 6 12 18 24 Java 1.4 Java 5 Java 6 Java 7 JRuby 1.0.3 (bm_red_black_tree.rb)
33. vs MRI 0 6 12 18 24 Java 1.4 Java 5 Java 6 Java 7 JRuby 1.0.3 (bm_red_black_tree.rb) MRI 1.8
34. InvokeDynamic • New language feature in Java 7 • Optimized any kind of calls like Java calls • Ruby as fast as Java — in theory
35. InvokeDynamic • Improving throughout the 7u# releases
36. Java 8 • Due out 18 March, 2014
37. Mandelbrot Java 7u51 vs Java 8 b128 0 0.2 0.4 0.6 0.8 1 7u51 8 b128
38. JRuby Architecture JVM FFI JDK JRuby Core Classes Ruby Core classes Other Java Libraries JRuby runtime Extras Ruby Application Standard Libs
39. FFI require&'ffi'& ! module&Hello& &&extend&FFI::Library& &&ffi_lib&FFI::Library::LIBC& &&attach_function&:puts,&[&:string&],&:int& end& ! Hello.puts("Hello,&World")
40. FFI in Java 9* FFI in Java 9* Still JEP stage In 2016?
41. Startup Times • Still the biggest pain point for JRuby programmers
42. Startup Times -e 1 gem --help rake -T 0 2.5 5 7.5 10 Ruby 2.0.0 JRuby
43. Startup Times • Some optimizations are possible via JVM tuning
44. Nailgun • Keep a single JVM running in background • Toss commands over to it • It stays hot, so code starts faster • Hard to clean up all state (e.g. threads) • Can’t get access to user’s terminal
45. Drip • Start a new JVM after each command • Pre-boot JVM plus optional code • Analyze command line for differences • Age out unused instances • https://github.com/flatland/drip
46. Rails startup time Seconds (lower is better) 0 4 8 12 16 7u51 7u51 + optimizations 8 b128 8 b128 + optimizations 7u51 + Drip 7u51 + optimizations + Drip 8 b128 + Drip 8 b128 + optimizations + Drip
47. export JRUBY_OPTS=" -J-XX:+TieredCompilation -J-XX:TieredStopAtLevel=1 -J-noverify"
48. Further optimization with Drip
49. public class DripMain {! public static RubyInstanceConfig DRIP_CONFIG;! public static Ruby DRIP_RUNTIME;! ! public static final String JRUBY_DRIP_WARMUP_ENV = "JRUBY_DRIP_WARMUP";! public static final String JRUBY_DRIP_WARMUP_DEFAULT = "1 + 1";! public static final String JRUBY_DRIP_PREBOOT_FILE = "./dripmain.rb";! ! public static void main(String[] args) throws IOException {! // warmup JVM first! Ruby ruby = Ruby.newInstance();! ! String envWarmup = System.getenv(JRUBY_DRIP_WARMUP_ENV);! if (envWarmup != null && envWarmup.length() > 0) {! ruby.evalScriptlet(envWarmup);! } else {! ruby.evalScriptlet(JRUBY_DRIP_WARMUP_DEFAULT);! }! ! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);! ! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);! ! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePath(), false);! } finally {! fis.close();! }! }! ! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }! }!
50. public static final String JRUBY_DRIP_WARMUP_ENV = "JRUBY_DRI public static final String JRUBY_DRIP_WARMUP_DEFAULT = "1 + 1 public static final String JRUBY_DRIP_PREBOOT_FILE = "./dripm public static void main(String[] args) throws IOException {! // warmup JVM first! Ruby ruby = Ruby.newInstance();! String envWarmup = System.getenv(JRUBY_DRIP_WARMUP_ENV);! if (envWarmup != null && envWarmup.length() > 0) {! ruby.evalScriptlet(envWarmup);! } else {! ruby.evalScriptlet(JRUBY_DRIP_WARMUP_DEFAULT);! }! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!
51. public static final String JRUBY_DRIP_WARMUP_ENV = "JRUBY_DRI public static final String JRUBY_DRIP_WARMUP_DEFAULT = "1 + 1 public static final String JRUBY_DRIP_PREBOOT_FILE = "./dripm public static void main(String[] args) throws IOException {! // warmup JVM first! Ruby ruby = Ruby.newInstance();! String envWarmup = System.getenv(JRUBY_DRIP_WARMUP_ENV);! if (envWarmup != null && envWarmup.length() > 0) {! ruby.evalScriptlet(envWarmup);! } else {! ruby.evalScriptlet(JRUBY_DRIP_WARMUP_DEFAULT);! }! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!
52. public static final String JRUBY_DRIP_WARMUP_ENV = "JRUBY_DRI public static final String JRUBY_DRIP_WARMUP_DEFAULT = "1 + 1 public static final String JRUBY_DRIP_PREBOOT_FILE = "./dripm public static void main(String[] args) throws IOException {! // warmup JVM first! Ruby ruby = Ruby.newInstance();! String envWarmup = System.getenv(JRUBY_DRIP_WARMUP_ENV);! if (envWarmup != null && envWarmup.length() > 0) {! ruby.evalScriptlet(envWarmup);! } else {! ruby.evalScriptlet(JRUBY_DRIP_WARMUP_DEFAULT);! }! // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);!
53. // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePa } finally {! fis.close();! }! }! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!
54. // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePa } finally {! fis.close();! }! }! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!
55. // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePa } finally {! fis.close();! }! }! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!
56. // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePa } finally {! fis.close();! }! }! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!
57. // preboot actual runtime! Ruby.clearGlobalRuntime();! File dripMain = new File(JRUBY_DRIP_PREBOOT_FILE);! RubyInstanceConfig config = new RubyInstanceConfig();! ruby = Ruby.newInstance(config);! if (dripMain.exists()) {! FileInputStream fis = new FileInputStream(dripMain);! try {! ruby.getLoadService().load(dripMain.getAbsolutePa } finally {! fis.close();! }! }! // use config and runtime from preboot process! DRIP_CONFIG = config;! DRIP_RUNTIME = ruby;! }!
58. JRuby Startup rake -T 0 2.5 5 7.5 10 C Ruby JRuby JRuby (best) JRuby (drip) JRuby (drip init) JRuby (dripmain)
59. Next generation JRuby
60. Brief History of JRuby • 2001 — started by Jan Arne Petersen • 2006 — Rails support • 2011 — v 1.6.0 (experimental C extension support) • 2012 — v 1.7.0 (InvokeDynamic support) • 2014 — v 9000
61. JRuby 9000 Version 0 20 40 60 80 100 Years 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 Illustrator (Mac OS), since 1987 MRI (since 1993) JRuby (since 2001)
62. Why 9000?
64. Because it is over 8000.
65. JRuby Architecture JVM FFI JDK JRuby Core Classes Ruby Core classes Other Java Libraries Intermediate Representation Extras Ruby Application Standard Libs
66. Intermediate Representation Lexical! Analysis Parsing Bytecode Generation Interpret AST IR Instructions CFG DFG … Existing New! Dalvik Generation … Semantic! Analysis Optimization
67. 1 check_arity(2, 0, -1)! 2 a(0:0) = recv_pre_reqd_arg(0)! 3 thread_poll! 4 line_num(2)! 5 %v_2 = call(+, a(0:0), [1:Fixnum])! 6 return(%v_2) -Xir.passes=LocalOptimizationPass,DeadCodeElimination def foo(a, b)! c = 1! d = a + c! end 0 check_arity(2, 0, -1)! 1 a(0:0) = recv_pre_reqd_arg(0)! 2 b(0:1) = recv_pre_reqd_arg(1)! 3 %block(0:2) = recv_closure! 4 thread_poll! 5 line_num(1)! 6 c(0:3) = 1:fixnum! 7 line_num(2)! 8 %v_0 = call(+, a(0:0), [c(0:3)])! 9 d(0:4) = copy(%v_0)! 10 return(%v_0) propagation def foo(a)! ! a + 1! end
68. Truffle http://www.flickr.com/photos/qwrrty/2838741714/
69. JRuby Architecture JVM FFI JDK JRuby Core Classes Ruby Core classes Other Java Libraries Truffle Extras Ruby Application Standard Libs
70. Truffle • AST interpreting framework from Oracle Labs • Potential alternative to: • AST interpreter • bytecode backend • IR
71. 0 1.5 3 4.5 6 Interpreted AST (i.e., no compiler) Interpreted IR MRI 2.1.0 Compiled AST, no InvokeDynamic Compiled AST, with InvokeDynamic Truffle Mandelbrot
72. JRuby Architecture Graal FFI JDK JRuby Core Classes Ruby Core classes Other Java Libraries Extras Ruby Application Standard Libs Truffle
73. Mandelbrot 0 1.5 3 4.5 6 Interpreted AST (i.e., no compiler) Interpreted IR Compiled AST, no InvokeDynamic Compiled AST, with InvokeDynamic MRI 2.1.0 Truffle Truffle + Graal
75. JRuby Architecture JVM FFI JDK JRuby Core Classes Ruby Core classes Other Java Libraries JRuby runtime Extras Ruby Application Standard Libs
76. 2.1 Compatibility • No 2.0 mode will be provided (1.7.x has limited support) • Some work to do on 2.1 specs
77. C extensions No more
78. Google rejected JRuby team’s application for GSoC 2014.
79. Contact! ! @hiro_asari! GitHub: BanzaiMan! @jruby! @travisci