● Rubex is a much more robust and stable language. ● Lots of refactoring of internal codebase. ● Little shift in Rubex’s goals - from simply speed to portability/readability of C extensions.
class BlanketWrapper attach blanket def initialize(warmth_factor, owner, len, breadth) data$.blanket.warmth_factor = warmth_factor data$.blanket.owner = owner data$.blanket.len = len data$.blanket.breadth = breadth end def warmth_factor return data$.blanket.warmth_factor end # ... more code for blanket interface. end
class BlanketWrapper attach blanket def initialize(warmth_factor, owner, len, breadth) data$.blanket.warmth_factor = warmth_factor data$.blanket.owner = owner data$.blanket.len = len data$.blanket.breadth = breadth end def warmth_factor return data$.blanket.warmth_factor end # ... more code for blanket interface. end
class BlanketWrapper attach blanket def initialize(warmth_factor, owner, len, breadth) data$.blanket.warmth_factor = warmth_factor data$.blanket.owner = owner data$.blanket.len = len data$.blanket.breadth = breadth end def warmth_factor return data$.blanket.warmth_factor end # ... more code for blanket interface. end
class BlanketWrapper attach blanket def initialize(warmth_factor, owner, len, breadth) data$.blanket.warmth_factor = warmth_factor data$.blanket.owner = owner data$.blanket.len = len data$.blanket.breadth = breadth end def warmth_factor return data$.blanket.warmth_factor end # ... more code for blanket interface. end
class BlanketWrapper attach blanket def initialize(warmth_factor, owner, len, breadth) data$.blanket.warmth_factor = warmth_factor data$.blanket.owner = owner data$.blanket.len = len data$.blanket.breadth = breadth end def warmth_factor return data$.blanket.warmth_factor end # ... more code for blanket interface. end
class BlanketWrapper attach blanket def initialize(warmth_factor, owner, len, breadth) data$.blanket.warmth_factor = warmth_factor data$.blanket.owner = owner data$.blanket.len = len data$.blanket.breadth = breadth end def warmth_factor return data$.blanket.warmth_factor end # ... more code for blanket interface. end
class BlanketWrapper attach blanket def initialize(warmth_factor, owner, len, breadth) data$.blanket.warmth_factor = warmth_factor data$.blanket.owner = owner data$.blanket.len = len data$.blanket.breadth = breadth end def warmth_factor return data$.blanket.warmth_factor end # ... more code for blanket interface. end
class BlanketWrapper attach blanket def initialize(warmth_factor, owner, len, breadth) data$.blanket.warmth_factor = warmth_factor data$.blanket.owner = owner data$.blanket.len = len data$.blanket.breadth = breadth end def warmth_factor return data$.blanket.warmth_factor end # ... more code for blanket interface. end
class Klass cfunc void foo(int a, int b) def bar def baz(int a, b, float c) end class OtherKlass cfunc void foo(int a, int b) def bar def baz(int a, b, float c) end
Advantages ● Easily import C extension APIs through a ‘require_rubex’ compiler declaration. ● Supply only the compiled binary and API files to like most C libraries. ● Portal implementations across Operating Systems. ● Auto-generated packaging and compiling scripts.
Read a file of 5_00_000 lines with a value at each line into memory Read line 0 – 1_25_000 Read line 1_25_000 – 2_50_00 Read line 2_50_000 – 3_75_000 Read line 3_75_000 – 5_00_00 Compute sum of values at each line Compute sum of values at each line Compute sum of values at each line Compute sum of values at each line Get all values and compute the average
Read a file of 5_00_000 lines with a value at each line into memory Read line 0 – 1_25_000 Read line 1_25_000 – 2_50_00 Read line 2_50_000 – 3_75_000 Read line 3_75_000 – 5_00_00 Compute sum of values at each line Compute sum of values at each line Compute sum of values at each line Compute sum of values at each line CPU 1 CPU 2 CPU 3 CPU 4
Read a file of 5_00_000 lines with a value at each line into memory Read line 0 – 1_25_000 Read line 1_25_000 – 2_50_00 Read line 2_50_000 – 3_75_000 Read line 3_75_000 – 5_00_00 Compute sum of values at each line Compute sum of values at each line Compute sum of values at each line Compute sum of values at each line Global Interpreter Lock CPU 1 CPU 2 CPU 3 CPU 4
Actual implementation ● Made a simple implementation of the aforementioned example of reading and computing values from a file. ● Benchmarks indicate huge difference in performance.
Warming up -------------------------------------- without GIL in C 3.000 i/100ms with GIL in Ruby 1.000 i/100ms with GIL in C 1.000 i/100ms Calculating ------------------------------------- without GIL in C 36.210 (± 2.8%) i/s - 183.000 in 5.059510s with GIL in Ruby 0.102 (± 0.0%) i/s - 1.000 in 9.830386s with GIL in C 18.591 (± 0.0%) i/s - 93.000 in 5.005381s Comparison: without GIL in C: 36.2 i/s with GIL in C: 18.6 i/s - 1.95x slower with GIL in Ruby: 0.1 i/s - 355.96x slower
Limitations of GIL release ● Can only use C data structures inside the no_gil block. ● Overhead associated with releasing and regaining GIL. ● Might break code that depends on the GIL.
Many C functions need to be used ● rb_raise() for raising error. ● rb_rescue(), rb_rescue2(), rb_protect(), rb_ensure() for rescue and ensure blocks. ● rb_errinfo() for getting the last error raised. ● rb_set_errinfo(Qnil) for resetting error information.
Workflow becomes complex ● Almost zero compliance with begin-ensure block workflow. ● Create C function callbacks. ● Manually catch and rescue exceptions. ● Inflexibility in sending data to callbacks.
int i = accept_number() begin raise(ArgumentError) if i == 3 raise(FooBarError) if i == 5 rescue ArgumentError i += 1 rescue FooBarError i += 2 ensure i += 10 end
Differences from Ruby ● Must specify brackets for function calls. ● No support for blocks/closures (yet). ● Must specify return keyword to return from functions. ● No support for ‘value of’ operator *. ● No support for -> operator for struct pointers. Differences from C
Detailed Docs and Tutorial ● REFERENCE.md. – Complete specification of the entire language. ● TUTORIAL.md. – Quick, easy to use explanation with code samples.
Conclusion ● Rubex is a fast and productive way of writing Ruby C extensions. ● Provides users with the elegance of Ruby and the power of C while following the principle of least surprise. ● Provides abstractions in C extensions at no performance cost.
Rubex ideas ● Typed memory views. – Get a ‘memory view’ of contiguous Ruby types. – Will work with NMatrix and NArray gems. ● Direct interfacing with GPUs through native kernels. – Zero-abstraction interfacing with GPUs for accelerating computation. – Possible use in cumo. ● Integration with GDB.
Rubyplot – advanced ruby plotting library ● Ruby does not have a single native plotting solution that even comes close to the likes of matplotlib/bokeh/something else. ● Rubyists don’t have a single go-to solution for their visualization needs that can scale. ● I think this situation is ridiculous for such a mature language ecosystem.
Various partial solutions exist ● Matplotlib.rb – interfaces python matplotlib via pycall. ● Nyaplot – Bokeh like web visualization but abandoned by author. ● Google charts/high charts/etc. – too much dependence on 3rd party web tools, some of which are paid/non-free. ● Various GNU plot frontends.
Rubyplot can change that! ● A native plotting solution written in C++ with a Ruby wrapper. ● Will directly interface with image-magick, GTK and GR to create a powerful plotting tool. ● Unlike matplotlib, will be eventually a language neutral C++ library to leverage contributions from other language communities.
View the progress of rubyplot ● Development started a few weeks ago. ● Follow on discourse: – https://discourse.ruby-data.org/ ● Follow on GitHub: – https://github.com/sciruby/rubyplot ● Contributions/opinions are welcome!
Common array library ● Nmatrix and numo/narray are two major array libraries. ● Important to bridge this divide and build on a library that is robust and well supported. ● Potential answer is plures – a language independent C backend to numpy.
More about plures ● Plures is supported by Quansight by the creators of numpy (Python). ● Common C API across languages/frameworks. ● Need more discussion on Ruby frontend.
Acknowledgements ● Ruby Association Grant 2016. ● Kenta Murata, Koichi Sasada and Naotoshi Seo for their support and mentorship. ● Fukuoka Ruby Award 2016. ● Ruby Science Foundation.
v0dro
bells17
subomi
_tanako
kazue
cocoeyes02
teamlab
zachklipp
tkhs0604
kin29
yuhta28
mkeeda
ogiwarat
shlominoach
jcasabona
jakevdp
geeforr
roundedbygravity
thekraken
phodgson
keathley
lauravandoore
holman
moore
dougneiner