Matthias Grimmer on "One Vm to rule them all"

Copyright © 2015 Oracle and/or its aﬃliates. All rights reserved.
One VM To Rule Them All! And With Interoperability Bind Them Matthias Grimmer, @grimmer_m, JKU Linz Thomas Wuerthinger, @thomaswue, Oracle Labs

2 Let’s ask a search engine… One Language to Rule Them All?

3 One Language to Rule Them All? Let’s ask Stack Overﬂow…

4 C

5 3 Goal: One VM for all languages means interoperability and being able to choose the best language for the task! Lower is better

6 You can execute any language on the JVM / CLR - as long as it looks like Java / C#.

Everything is a dynamic map Everything is a map and every operation a function call Everything is a map and every operation a function call and everything is a vector C Everything is an address

8 Parser and language work to build syntax tree (AST), AST Interpreter Write a “real” VM In C/C++, still using AST interpreter, spend a lot of time implementing runtime system, GC, … Deﬁne a bytecode format and write bytecode interpreter People complain about performance Write a JIT compiler Improve the garbage collector Performance is still bad Prototype a new language

9 Parser and language work to build syntax tree (AST), AST Interpreter Write a “real” VM In C/C++, still using AST interpreter, spend a lot of time implementing runtime system, GC, … People start using it Deﬁne a bytecode format and write bytecode interpreter People complain about performance Write a JIT compiler Improve the garbage collector Performance is still bad Prototype a new language

10 Guest Language Application Guest Language Implementation Host Services OS Written by: Application Developer VM Expert OS Expert Language Developer Guest Language Managed Host Language or Unmanaged Language Unmanaged Language (typically C or C++) Managed Host Language Written in:

11 Guest Language Application Guest Language Implementation Host Services OS Written by: Application Developer VM Expert OS Expert Language Developer Guest Language Java Java / C++ Unmanaged Language (typically C or C++) Java Written in: Graal VM Truﬄe

12 Guest Language Application Guest Language Implementation Host Services OS Written by: Application Developer VM Expert OS Expert Language Developer Guest Language Java Java / C++ Unmanaged Language (typically C or C++) Java Written in: Graal VM Truﬄe int main() { struct complex *a = …; struct complex *b = …; add(a, b); }

13 Guest Language Application Guest Language Implementation Host Services OS Written by: Application Developer VM Expert OS Expert Language Developer Guest Language Java Java / C++ Unmanaged Language (typically C or C++) Java Written in: Graal VM Truﬄe int main() { struct complex *a = …; struct complex *b = …; add(a, b); }

14 Guest Language Application Guest Language Implementation Host Services OS Written by: Application Developer VM Expert OS Expert Language Developer Guest Language Java Java / C++ Unmanaged Language (typically C or C++) Java Written in: Graal VM Truﬄe C

15 a + b Object int String

16 Object add(Object a, Object b) { if(a instanceof Integer && b instanceof Integer) { return (int)a + (int)b; } else if (a instanceof String && b instanceof String) { return (String)a + (String)b; } else { return genericAdd(a, b); } }

17 Object add(Object a, Object b) { if(a instanceof Integer && b instanceof Integer) { return (int)a + (int)b; } else if (a instanceof String && b instanceof String) { return (String)a + (String)b; } else { return genericAdd(a, b); } } int add(int a, int b) { return a + b; }

18 Object add(Object a, Object b) { if(a instanceof Integer && b instanceof Integer) { return (int)a + (int)b; } else if (a instanceof String && b instanceof String) { return (String)a + (String)b; } else { return genericAdd(a, b); } } int add(int a, int b) { return a + b; } String add(String a, String b) { return a + b; }

19 Object add(Object a, Object b) { if(a instanceof Integer && b instanceof Integer) { return (int)a + (int)b; } else if (a instanceof String && b instanceof String) { return (String)a + (String)b; } else { return genericAdd(a, b); } } Object add(Object a, Object b) { return genericAdd(a, b); } int add(int a, int b) { return a + b; } String add(String a, String b) { return a + b; }

20 U U U U U I I I G G I I I G G Node Rewriting for Profiling Feedback AST Interpreter Rewritten Nodes AST Interpreter Uninitialized Nodes Compilation using Partial Evaluation Compiled Code Node Transitions S U I D G Uninitialized Integer Generic Double String

21 I I I G G I I I G G Deoptimization to AST Interpreter D I D G G D I D G G Node Rewriting to Update Profiling Feedback Recompilation using Partial Evaluation

22

23

Graal VM § A new JIT compiler for Java written in Java. § Designed for multi-language performance. § Downloadable from the Oracle Technology Network (OTN) with Java and JavaScript support. C

25 Graal Truﬄe R Ruby Java Scala Smalltalk C J Python JavaScript Parallel Graph AnalyLcs C

26 Performance – Java and Scala 0 0.5 1 1.5 2 2.5 Java Scala server graal DaCapo benchmarks - Normalized versus client compiler Higher is better

27 0 1 2 3 4 5 6 7 V8 Graal/JS Performance – JavaScript Higher is better

28 Performance – C 0 50 100 150 200 250 300 350 400 450 500 Composite NB FA SN FK MB FFT SOR MC SM LU GCC O0 GCC best TruﬄeC Higher is better

29 C

30

31

32 CRuby FFI

33 CRuby FFI NOT SUPPORTED

34 1 typedef VALUE void*; 2 typedef ID void*; 3 4 // Define a C function as a Ruby method 5 void rb_define_method 6 (VALUE class, const char* name, 7 VALUE(*func)(), int argc); 8 9 // Store an array element into a Ruby array 10 void rb_ary_store 11 (VALUE ary, long idx, VALUE val); 12 13 // Get the Ruby internal representation of an 14 // identifier 15 ID rb_intern(const char* name); 16 17 // Get instance variables of a Ruby object 18 VALUE rb_iv_get(VALUE object, 19 const char* iv_name) 20 21 // Invoke a Ruby method from C 22 VALUE rb_funcall(VALUE receiver ID method_id, 23 int argc, ...); 24 25 // Convert a Ruby Fixnum to C long 26 long FIX2INT(VALUE value); Well designed API? è Internal functions of CRuby

35 CRuby MRI API *.rb *.c executes extension

36 VALUE rb_ary_write(VALUE ary, long idx, VALUE value); rubyArray = Array.new 42 #include “ruby.h” // … rb_ary_write(rubyArray, 0, DBL2NUM(42)); // … TrufﬂeRuby Java *.rb executes Graal/Ruby *.c TrufﬂeC Java executes Graal/C

37 VALUE rb_ary_write(VALUE ary, long idx, VALUE value); *.c TrufﬂeC Java executes TrufﬂeRuby Java *.rb executes rubyArray = Array.new 42 #include “ruby.h” // … rb_ary_write(rubyArray, 0, DBL2NUM(42)); // … rubyArray.[] = 0, 42 Graal/Ruby Graal/C

38 1x 8x 11x 0 5 10 15 20 25 30 35 CRuby Graal/Ruby CRuby+C Graal/Ruby+C Image Processing Composite Speedup Pure Ruby Higher is better

39 1x 8x 11x 0 5 10 15 20 25 30 35 CRuby Graal/Ruby CRuby+C Graal/Ruby+C Image Processing Composite Speedup Pure Ruby Ruby + C Higher is better

40 1x 8x 11x 32x 0 5 10 15 20 25 30 35 CRuby Graal/Ruby CRuby+C Graal/Ruby+C Image Processing Composite Speedup Pure Ruby Ruby + C Higher is better

41

42 Let’s write a small part of a program in a different language! Ø There is no interface to the language I would need Ø I don’t want to write a lot of wrapper code Ø Performance will be bad #include<stdio.h> struct complex { double r; double i; } int main() { struct complex *a = …; struct complex *b = …; add(a, b); } function add(a, b) { var result = {r:0, i:0}; result.r = a.r + b.r; result.i = a.i + b.i; return result; } struct complex *a struct complex *b

43 def function(v1, v2) sum = [] for i in 0..n do sum[i] = v1[i] + v2[i] end end function(v1, v2) { v1 + v2 } v1 v2 Let’s write a small part of a program in a different language! Ø There is no interface to the language I would need Ø I don’t want to write a lot of wrapper code Ø Performance will be bad

44 Programmers want to write programs in multiple languages Use the most suitable language for a given problem §  Existing approaches are often pairwise efforts Gradually migrate existing projects §  Programmers need to write wrapper code Reusing existing source code §  Language borders introduce a performance bottleneck

45 #include<stdio.h> struct complex { double r; double i; } int main() { struct complex *a = …; struct complex *b = …; add(a, b); } function add(a, b) { var result = {r:0, i:0}; result.r = a.r + b.r; result.i = a.i + b.i; return result; } add(a, b) a->r b->r a->i b->i main.c complex.js mx graalML main.c complex.js

46 Programmers want to write programs in multiple languages Use the most suitable language for a given problem §  Existing approaches are often pairwise efforts Gradually migrate existing projects §  Programmers need to write wrapper code Reusing existing source code §  Language borders introduce a performance bottleneck

47 Programmers want to write programs in multiple languages Use the most suitable language for a given problem §  Existing approaches are often pairwise efforts è The Graal VM allows composing arbitrary languages Gradually migrate existing projects §  Programmers need to write wrapper code Reusing existing source code §  Language borders introduce a performance bottleneck

48 Programmers want to write programs in multiple languages Use the most suitable language for a given problem §  Existing approaches are often pairwise efforts è The Graal VM allows composing arbitrary languages Gradually migrate existing projects §  Programmers need to write wrapper code è Without writing boilerplate code Reusing existing source code §  Language borders introduce a performance bottleneck

49 Programmers want to write programs in multiple languages Use the most suitable language for a given problem §  Existing approaches are often pairwise efforts è The Graal VM allows composing arbitrary languages Gradually migrate existing projects §  Programmers need to write wrapper code è Without writing boilerplate code Reusing existing source code §  Language borders introduce a performance bottleneck è Cross-language inlining

High-Performance Language Interoperability 0 200 400 600 800 1000 1200 Ruby data JS data C data Ruby program JS program C program C Scores for mixing Ruby/JS/C executing the scimark benchmarks. Higher is better

§  51 §  Graal VM Binaries for Java and JavaScript! http://www.oracle.com/technetwork/oracle-labs/program-languages §  Graal and Trufﬂe API! http://openjdk.java.net/projects/graal/ §  R! https://bitbucket.org/allr/fastr §  Ruby! https://github.com/jruby/jruby/wiki/Trufﬂe §  Python! https://bitbucket.org/ssllab/zippy §  Other projects for Smalltalk, Clojure, Lua, …

52 Your Language? http://openjdk.java.net/projects/graal/ [email protected] $ hg clone hZp://hg.openjdk.java.net/graal/graal $ cd graal $ ./mx.sh -‐-‐vm server build $ ./mx.sh ideinit $ ./mx.sh -‐-‐vm server uniZest SumTest

53 Safe Harbor Statement The preceding is intended to provide some insight into a line of research in Oracle Labs. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described in connection with any Oracle product or service remains at the sole discretion of Oracle. Any views expressed in this presentation are my own and do not necessarily reﬂect the views of Oracle.

Q/A

Matthias Grimmer on "One Vm to rule them all"

Matthias Grimmer on "One Vm to rule them all"

More Decks by Enterprise Java User Group Austria

Other Decks in Technology

Featured

Transcript