Compiling Ruby

Kevin Deisz @kddeisz

# example.rb a = 5 puts a + 5

# example.rb a = 5 puts a + 5 ~/compiling-ruby $

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby example.rb 10 ~/compiling-ruby $

Ruby execution process

#require

Read source #require

Tokenize Read source #require

Tokenize Build AST Read source #require

Tokenize Build AST Read source #require Interpret AST

Tokenize Build AST Read source Interpret AST #require

Tokenize Build AST Build ISeq Read source Interpret AST #require

Execute ISeq Tokenize Build AST Build ISeq Read source Interpret AST #require

Tokenizing the input Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

# example.rb a = 5 puts a + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] a = 5 puts a + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] a = 5 puts a + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] = 5 puts a + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] 5 puts a + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5] puts a + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5][nl] puts a + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5][nl] [ident=puts] a + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5][nl] [ident=puts] [ident=a] + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5][nl] [ident=puts] [ident=a] [op+] 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5][nl] [ident=puts] [ident=a] [op+] [int=5] Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5][nl] [ident=puts] [ident=a] [op+] [int=5][nl] Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5] [nl] [ident=puts] [ident=a] [op+] [int=5] [nl] Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

Building the AST Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5] [nl] [ident=puts] [ident=a] [op+] [int=5] [nl] Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5] [nl] [ident=puts] [ident=a] [op+] [int=5] [nl] begin Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5] [nl] [ident=puts] [ident=a] [op+] [int=5] [nl] begin Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5] [nl] [ident=puts] [ident=a] [op+] [int=5] [nl] begin lvasgn :a int 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5] [nl] [ident=puts] [ident=a] [op+] [int=5] [nl] begin lvasgn :a int 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5] [nl] [ident=puts] [ident=a] [op+] [int=5] [nl] begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

[comment="# example.rb\n"] [ignored_nl] [ident=a] [op=] [int=5] [nl] [ident=puts] [ident=a] [op+] [int=5] [nl] begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

Interpreting the AST (≤ Ruby 1.8) Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts local = {} instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts local = {} instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts local = {} instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts local = {} instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts local = {} instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 5 local = {} instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts set :a
 5 local = {} instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 5 local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts get :a 5 local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 5 5 local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts send :+ 5 5 local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 10 local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts self
 10 local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts send :puts
 self
 10 local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb 10

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts local = { a: 5 } instance = {} global = {} Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq ~/compiling-ruby $ ruby example.rb 10 ~/compiling-ruby $

Building YARV instruction sequences Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

0000 trace 1 0002 putobject 5 begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block ,

begin lvasgn :a int 5 lvar :a int 5 send :+ send :puts 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Executing YARV instruction sequences Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq local = {} instance = {} global = {} ~/compiling-ruby $ 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq local = {} instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq local = {} instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 5 local = {} instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 
 5 local = {} instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq self local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq self local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 5
 self local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 5 self local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 5 5 self local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 5 5 self local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 10 self local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq 10 self local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 10 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq local = { 3: 5 } instance = {} global = {} ~/compiling-ruby $ ruby example.rb 10 ~/compiling-ruby $ 0000 trace 1 0002 putobject 5 0004 setlocal 3 0006 trace 1 0008 putself 0009 getlocal 3 0011 putobject 5 0013 opt_plus !mid:+, argc:1, ARGS_SIMPLE>, 0016 opt_send_without_block , 0019 leave

Reading/writing YARV instruction sequences (≥ Ruby 2.3) Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ ls -l total 16 -rw-r--r-- 1 kddeisz staff 32 Aug 28 15:11 example.rb -rw-r--r-- 1 kddeisz staff 777 Aug 29 11:17 example.yarb ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ ls -l total 16 -rw-r--r-- 1 kddeisz staff 32 Aug 28 15:11 example.rb -rw-r--r-- 1 kddeisz staff 777 Aug 29 11:17 example.yarb ~/compiling-ruby $ ruby -e "content = File.read('example.yarb'); RubyVM::InstructionSequence.load_from_binary(content).eval" 10 ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ ls -l total 16 -rw-r--r-- 1 kddeisz staff 32 Aug 28 15:11 example.rb -rw-r--r-- 1 kddeisz staff 777 Aug 29 11:17 example.yarb ~/compiling-ruby $ ruby -e "content = File.read('example.yarb'); RubyVM::InstructionSequence.load_from_binary(content).eval" 10 ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ ls -l total 16 -rw-r--r-- 1 kddeisz staff 32 Aug 28 15:11 example.rb -rw-r--r-- 1 kddeisz staff 777 Aug 29 11:17 example.yarb ~/compiling-ruby $ ruby -e "content = File.read('example.yarb'); RubyVM::InstructionSequence.load_from_binary(content).eval" 10 ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ ls -l total 16 -rw-r--r-- 1 kddeisz staff 32 Aug 28 15:11 example.rb -rw-r--r-- 1 kddeisz staff 777 Aug 29 11:17 example.yarb ~/compiling-ruby $ ruby -e "content = File.read('example.yarb'); RubyVM::InstructionSequence.load_from_binary(content).eval" 10 ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

# example.rb a = 5 puts a + 5 ~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ ls -l total 16 -rw-r--r-- 1 kddeisz staff 32 Aug 28 15:11 example.rb -rw-r--r-- 1 kddeisz staff 777 Aug 29 11:17 example.yarb ~/compiling-ruby $ ruby -e "content = File.read('example.yarb'); RubyVM::InstructionSequence.load_from_binary(content).eval" 10 ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

Programmatically loading YARV instruction sequences (≥ Ruby 2.3) Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

Execute ISeq Tokenize Build AST Build ISeq Read source Interpret AST #require Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

Tokenize Build AST Build ISeq Read source Interpret AST #require Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq Execute ISeq Write ISeq Read ISeq

/* ruby/load.c */ static int rb_load_internal0(rb_thread_t *th, VALUE fname, int wrap) { ... if ((iseq = rb_iseq_load_iseq(fname)) != NULL) { /* OK */ } else { VALUE parser = rb_parser_new(); rb_parser_set_context(parser, NULL, FALSE); node = (NODE *)rb_parser_load_file(parser, fname); iseq = rb_iseq_new_top(node, rb_fstring_cstr(""), fname, rb_realpath_internal(Qnil, fname, 1), NULL); } rb_iseq_eval(iseq); ... } Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

/* ruby/load.c */ static int rb_load_internal0(rb_thread_t *th, VALUE fname, int wrap) { ... if ((iseq = rb_iseq_load_iseq(fname)) != NULL) { /* OK */ } else { VALUE parser = rb_parser_new(); rb_parser_set_context(parser, NULL, FALSE); node = (NODE *)rb_parser_load_file(parser, fname); iseq = rb_iseq_new_top(node, rb_fstring_cstr(""), fname, rb_realpath_internal(Qnil, fname, 1), NULL); } rb_iseq_eval(iseq); ... } Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

/* ruby/iseq.c */ const rb_iseq_t * rb_iseq_load_iseq(VALUE fname) { VALUE iseqv = rb_check_funcall(rb_cISeq, rb_intern("load_iseq"), 1, &fname); if (!SPECIAL_CONST_P(iseqv) && RBASIC_CLASS(iseqv) == rb_cISeq) { return iseqw_check(iseqv); } return NULL; } Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

/* ruby/iseq.c */ const rb_iseq_t * rb_iseq_load_iseq(VALUE fname) { VALUE iseqv = rb_check_funcall(rb_cISeq, rb_intern("load_iseq"), 1, &fname); if (!SPECIAL_CONST_P(iseqv) && RBASIC_CLASS(iseqv) == rb_cISeq) { return iseqw_check(iseqv); } return NULL; } Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

/* ruby/iseq.c */ const rb_iseq_t * rb_iseq_load_iseq(VALUE fname) { VALUE iseqv = rb_check_funcall(rb_cISeq, rb_intern("load_iseq"), 1, &fname); if (!SPECIAL_CONST_P(iseqv) && RBASIC_CLASS(iseqv) == rb_cISeq) { return iseqw_check(iseqv); } return NULL; } Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

/* ruby/iseq.c */ const rb_iseq_t * rb_iseq_load_iseq(VALUE fname) { VALUE iseqv = rb_check_funcall(rb_cISeq, rb_intern("load_iseq"), 1, &fname); if (!SPECIAL_CONST_P(iseqv) && RBASIC_CLASS(iseqv) == rb_cISeq) { return iseqw_check(iseqv); } return NULL; } Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

class RubyVM::InstructionSequence def self.load_iseq(source_path) iseq_path = File.join( File.expand_path(__dir__, '.iseq'), source_path.gsub(/[^A-Za-z0-9\._-]/) { |c| '%02x' % c.ord }.gsub('.rb', '.yarb')) if File.exist?(iseq_path) && (File.mtime(source_path) <= File.mtime(iseq_path)) return RubyVM::InstructionSequence .load_from_binary(File.binread(iseq_path)) end begin iseq = RubyVM::InstructionSequence .compile(File.read(source_path)) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

class RubyVM::InstructionSequence def self.load_iseq(source_path) iseq_path = File.join( File.expand_path(__dir__, '.iseq'), source_path.gsub(/[^A-Za-z0-9\._-]/) { |c| '%02x' % c.ord }.gsub('.rb', '.yarb')) if File.exist?(iseq_path) && (File.mtime(source_path) <= File.mtime(iseq_path)) return RubyVM::InstructionSequence .load_from_binary(File.binread(iseq_path)) end begin iseq = RubyVM::InstructionSequence .compile(File.read(source_path)) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

class RubyVM::InstructionSequence def self.load_iseq(source_path) iseq_path = File.join( File.expand_path(__dir__, '.iseq'), source_path.gsub(/[^A-Za-z0-9\._-]/) { |c| '%02x' % c.ord }.gsub('.rb', '.yarb')) if File.exist?(iseq_path) && (File.mtime(source_path) <= File.mtime(iseq_path)) return RubyVM::InstructionSequence .load_from_binary(File.binread(iseq_path)) end begin iseq = RubyVM::InstructionSequence .compile(File.read(source_path)) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

class RubyVM::InstructionSequence def self.load_iseq(source_path) iseq_path = File.join( File.expand_path(__dir__, '.iseq'), source_path.gsub(/[^A-Za-z0-9\._-]/) { |c| '%02x' % c.ord }.gsub('.rb', '.yarb')) if File.exist?(iseq_path) && (File.mtime(source_path) <= File.mtime(iseq_path)) return RubyVM::InstructionSequence .load_from_binary(File.binread(iseq_path)) end begin iseq = RubyVM::InstructionSequence .compile(File.read(source_path)) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

class RubyVM::InstructionSequence def self.load_iseq(source_path) iseq_path = File.join( File.expand_path(__dir__, '.iseq'), source_path.gsub(/[^A-Za-z0-9\._-]/) { |c| '%02x' % c.ord }.gsub('.rb', '.yarb')) if File.exist?(iseq_path) && (File.mtime(source_path) <= File.mtime(iseq_path)) return RubyVM::InstructionSequence .load_from_binary(File.binread(iseq_path)) end begin iseq = RubyVM::InstructionSequence .compile(File.read(source_path)) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

class RubyVM::InstructionSequence def self.load_iseq(source_path) iseq_path = File.join( File.expand_path(__dir__, '.iseq'), source_path.gsub(/[^A-Za-z0-9\._-]/) { |c| '%02x' % c.ord }.gsub('.rb', '.yarb')) if File.exist?(iseq_path) && (File.mtime(source_path) <= File.mtime(iseq_path)) return RubyVM::InstructionSequence .load_from_binary(File.binread(iseq_path)) end begin iseq = RubyVM::InstructionSequence .compile(File.read(source_path)) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

Examples Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq /* bootsnap/lib/bootsnap/compile_cache/iseq.rb */ module InstructionSequenceMixin def load_iseq(path) # Having coverage enabled prevents iseq dumping/loading. return nil if defined?(Coverage) && Bootsnap::CompileCache::Native.coverage_running? Bootsnap::CompileCache::Native.fetch( Bootsnap::CompileCache::ISeq.cache_dir, path.to_s, Bootsnap::CompileCache::ISeq ) rescue RuntimeError => e if e.message =~ /unmatched platform/ puts "unmatched platform for file #{path}" end raise end ... end

/* yomikomu/lib/yomikomu.rb */ class RubyVM::InstructionSequence if ENV['YOMIKOMU_YOMIKOMANAI'] != 'true' def self.load_iseq fname ::Yomikomu::STORAGE.load_iseq(fname) end end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

Now for the fun part Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq

class RubyVM::InstructionSequence def self.load_iseq(source_path) iseq_path = File.join( File.expand_path(__dir__, '.iseq'), source_path.gsub(/[^A-Za-z0-9\._-]/) { |c| '%02x' % c.ord }.gsub('.rb', '.yarb')) if File.exist?(iseq_path) && (File.mtime(source_path) <= File.mtime(iseq_path)) return RubyVM::InstructionSequence .load_from_binary(File.binread(iseq_path)) end begin iseq = RubyVM::InstructionSequence .compile(File.read(source_path)) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

class RubyVM::InstructionSequence def self.load_iseq(source_path) iseq_path = File.join( File.expand_path(__dir__, '.iseq'), source_path.gsub(/[^A-Za-z0-9\._-]/) { |c| '%02x' % c.ord }.gsub('.rb', '.yarb')) if File.exist?(iseq_path) && (File.mtime(source_path) <= File.mtime(iseq_path)) return RubyVM::InstructionSequence .load_from_binary(File.binread(iseq_path)) end begin content = File.read(source_path) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq THIS IS THE FUN PART Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) content.gsub!(/~n\(([\d\s+-\/*\(\)]+?)\)/) do |match| eval(match[3..-2]) end iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) content.gsub!(/~n\(([\d\s+-\/*\(\)]+?)\)/) do |match| eval(match[3..-2]) end iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq module Utils def self.days_to_seconds(days) days * 24 * 60 * 60 end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) content.gsub!(/~n\(([\d\s+-\/*\(\)]+?)\)/) do |match| eval(match[3..-2]) end iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq module Utils def self.days_to_seconds(days) days * ~n(24 * 60 * 60) end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) content.gsub!(/~n\(([\d\s+-\/*\(\)]+?)\)/) do |match| eval(match[3..-2]) end iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part module Utils def self.days_to_seconds(days) days * ~n(24 * 60 * 60) end end

content = File.read(source_path) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) serial_format = '%FT%T%:z' content.gsub!(/~d\((.+?)\)/) do |match| date = Date.parse(match[3..-2]) "Date.strptime('#{date.strftime(serial_format)}', " \ "'#{serial_format}')" end iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) serial_format = '%FT%T%:z' content.gsub!(/~d\((.+?)\)/) do |match| date = Date.parse(match[3..-2]) "Date.strptime('#{date.strftime(serial_format)}', " \ "'#{serial_format}')" end iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part module Utils def self.days_since_start(date) date - Date.parse('January 1st, 2017') end end

content = File.read(source_path) serial_format = '%FT%T%:z' content.gsub!(/~d\((.+?)\)/) do |match| date = Date.parse(match[3..-2]) "Date.strptime('#{date.strftime(serial_format)}', " \ "'#{serial_format}')" end iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq module Utils def self.days_since_start(date) date - ~d(January 1st, 2017) end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) serial_format = '%FT%T%:z' content.gsub!(/~d\((.+?)\)/) do |match| date = Date.parse(match[3..-2]) "Date.strptime('#{date.strftime(serial_format)}', " \ "'#{serial_format}')" end iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part module Utils def self.days_since_start(date) date - ~d(January 1st, 2017) end end

It works! Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

It works! https://github.com/kddeisz/vernacular/blob/ master/lib/vernacular/regex_modifier.rb Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Tokenize Build AST Build ISeq Read source Interpret AST #require Execute ISeq Write ISeq Read ISeq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Tokenize Build AST Build ISeq Read source Interpret AST #require Execute ISeq Write ISeq Read ISeq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part Modify source

Let’s go further Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq THIS IS THE FUN PART Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) require 'parser/current' # class CustomBuilder < Parser::Builders::Default builder = CustomBuilder.new # class CustomParser < Parser::CurrentRuby parser = CustomParser.new(builder) # class CustomRewriter < Parser::Rewriter rewriter = CustomRewriter.new rewriter.instance_variable_set(:@parser, parser) buffer = Parser::Base.send(:setup_source_buffer, '(string)', 1, content, parser.default_encoding) ast = parser.parse(content) content = rewriter.rewrite(buffer, ast) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) require 'parser/current' # class CustomBuilder < Parser::Builders::Default builder = CustomBuilder.new # class CustomParser < Parser::CurrentRuby parser = CustomParser.new(builder) # class CustomRewriter < Parser::Rewriter rewriter = CustomRewriter.new rewriter.instance_variable_set(:@parser, parser) buffer = Parser::Base.send(:setup_source_buffer, '(string)', 1, content, parser.default_encoding) ast = parser.parse(content) content = rewriter.rewrite(buffer, ast) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq module Utils def self.add(left, right) left + right end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) require 'parser/current' # class CustomBuilder < Parser::Builders::Default builder = CustomBuilder.new # class CustomParser < Parser::CurrentRuby parser = CustomParser.new(builder) # class CustomRewriter < Parser::Rewriter rewriter = CustomRewriter.new rewriter.instance_variable_set(:@parser, parser) buffer = Parser::Base.send(:setup_source_buffer, '(string)', 1, content, parser.default_encoding) ast = parser.parse(content) content = rewriter.rewrite(buffer, ast) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq module Utils def self.add(left : Integer, right : Integer) left + right end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) require 'parser/current' # class CustomBuilder < Parser::Builders::Default builder = CustomBuilder.new # class CustomParser < Parser::CurrentRuby parser = CustomParser.new(builder) # class CustomRewriter < Parser::Rewriter rewriter = CustomRewriter.new rewriter.instance_variable_set(:@parser, parser) buffer = Parser::Base.send(:setup_source_buffer, '(string)', 1, content, parser.default_encoding) ast = parser.parse(content) content = rewriter.rewrite(buffer, ast) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part module Utils def self.add(left, right) unless left.is_a?(Integer) raise ArgumentError, "Invalid type, " \ "expected Integer, got #{left.class.name}" end unless right.is_a?(Integer) raise ArgumentError, "Invalid type, " \ "expected Integer, got #{right.class.name}" end left + right end end

content = File.read(source_path) require 'parser/current' # class CustomBuilder < Parser::Builders::Default builder = CustomBuilder.new # class CustomParser < Parser::CurrentRuby parser = CustomParser.new(builder) # class CustomRewriter < Parser::Rewriter rewriter = CustomRewriter.new rewriter.instance_variable_set(:@parser, parser) buffer = Parser::Base.send(:setup_source_buffer, '(string)', 1, content, parser.default_encoding) ast = parser.parse(content) content = rewriter.rewrite(buffer, ast) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq module Utils def self.add(left : Integer, right : Integer) left + right end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) require 'parser/current' # class CustomBuilder < Parser::Builders::Default builder = CustomBuilder.new # class CustomParser < Parser::CurrentRuby parser = CustomParser.new(builder) # class CustomRewriter < Parser::Rewriter rewriter = CustomRewriter.new rewriter.instance_variable_set(:@parser, parser) buffer = Parser::Base.send(:setup_source_buffer, '(string)', 1, content, parser.default_encoding) ast = parser.parse(content) content = rewriter.rewrite(buffer, ast) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq module Utils def self.add(left, right) left + right end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) require 'parser/current' # class CustomBuilder < Parser::Builders::Default builder = CustomBuilder.new # class CustomParser < Parser::CurrentRuby parser = CustomParser.new(builder) # class CustomRewriter < Parser::Rewriter rewriter = CustomRewriter.new rewriter.instance_variable_set(:@parser, parser) buffer = Parser::Base.send(:setup_source_buffer, '(string)', 1, content, parser.default_encoding) ast = parser.parse(content) content = rewriter.rewrite(buffer, ast) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq module Utils def self.add(left, right) = Integer left + right end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

module Utils def self.add(left, right) result = begin left + right end unless result.is_a?(Integer) raise "Invalid return value, expected " \ "Integer got #{result.class.name}" end result end end content = File.read(source_path) require 'parser/current' # class CustomBuilder < Parser::Builders::Default builder = CustomBuilder.new # class CustomParser < Parser::CurrentRuby parser = CustomParser.new(builder) # class CustomRewriter < Parser::Rewriter rewriter = CustomRewriter.new rewriter.instance_variable_set(:@parser, parser) buffer = Parser::Base.send(:setup_source_buffer, '(string)', 1, content, parser.default_encoding) ast = parser.parse(content) content = rewriter.rewrite(buffer, ast) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

content = File.read(source_path) require 'parser/current' # class CustomBuilder < Parser::Builders::Default builder = CustomBuilder.new # class CustomParser < Parser::CurrentRuby parser = CustomParser.new(builder) # class CustomRewriter < Parser::Rewriter rewriter = CustomRewriter.new rewriter.instance_variable_set(:@parser, parser) buffer = Parser::Base.send(:setup_source_buffer, '(string)', 1, content, parser.default_encoding) ast = parser.parse(content) content = rewriter.rewrite(buffer, ast) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq module Utils def self.add(left, right) = Integer left + right end end Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

It works! Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

It works! https://github.com/kddeisz/vernacular/blob/ master/lib/vernacular/ast_modifier.rb Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Tokenize Build AST Build ISeq Read source Interpret AST #require Execute ISeq Write ISeq Read ISeq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part Modify source

Tokenize Build AST Build ISeq Read source Interpret AST #require Execute ISeq Write ISeq Read ISeq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part Modify source Modify AST

Let’s go even further Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

~/compiling-ruby $ ruby -e "File.write('example.yarb', RubyVM::InstructionSequence.compile_file('example.rb').to_binary)" ~/compiling-ruby $ hexdump example.yarb ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 struct ibf_header { char magic[4]; /* YARB */ unsigned int major_version; unsigned int minor_version; unsigned int size; unsigned int extra_size; unsigned int iseq_list_size; unsigned int id_list_size; unsigned int object_list_size; ibf_offset_t iseq_list_offset; ibf_offset_t id_list_offset; ibf_offset_t object_list_offset; }; Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 %w[59 41 52 42].map do |ord| ord.to_i(16).chr end.join # YARB Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 %w[59 41 52 42].map do |ord| ord.to_i(16).chr end.join # YARB %w{78 38 36 5f 36 34 2d 64 61 72 77 69 6e 31 35}.map do |ord| ord.to_i(16).chr end.join # x86_64-darwin15 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 header Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 header RUBY_VERSION Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 header RUBY_VERSION iseq offset list Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 header RUBY_VERSION iseq offset list id offset list Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

0000000 59 41 52 42 02 00 00 00 03 00 00 00 09 03 00 00 0000010 00 00 00 00 01 00 00 00 04 00 00 00 08 00 00 00 0000020 dc 01 00 00 e0 01 00 00 e9 02 00 00 78 38 36 5f 0000030 36 34 2d 64 61 72 77 69 6e 31 35 00 2a 00 00 00 0000040 00 00 00 00 01 00 00 00 00 00 00 00 0f 00 00 00 0000050 00 00 00 00 04 00 00 00 00 00 00 00 59 00 00 00 0000060 00 00 00 00 03 00 00 00 00 00 00 00 2a 00 00 00 0000070 00 00 00 00 01 00 00 00 00 00 00 00 0e 00 00 00 0000080 00 00 00 00 57 00 00 00 00 00 00 00 03 00 00 00 0000090 00 00 00 00 0f 00 00 00 00 00 00 00 04 00 00 00 00000a0 00 00 00 00 3d 00 00 00 00 00 00 00 00 00 00 00 00000b0 00 00 00 00 00 00 00 00 00 00 00 00 30 00 00 00 00000c0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00000d0 00 00 00 00 33 00 00 00 00 00 00 00 00 00 00 00 00000e0 03 00 00 00 06 00 00 00 04 00 00 00 01 00 00 00 00000f0 00 00 00 00 02 00 00 00 00 00 00 00 10 00 00 00 0000100 01 00 00 00 03 00 00 00 00 00 00 00 14 00 00 00 0000110 01 00 00 00 00 00 00 00 14 00 00 00 3c 00 00 00 0000120 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 * 0000150 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 0000160 00 00 00 00 03 00 00 00 00 00 00 00 03 00 00 00 0000170 00 00 00 00 03 00 00 00 00 00 00 00 dc 00 00 00 0000180 00 00 00 00 ec 00 00 00 00 00 00 00 00 00 00 00 0000190 00 00 00 00 ff ff ff ff ff ff ff ff 00 00 00 00 00001a0 00 00 00 00 00 00 00 00 00 00 00 00 f4 00 00 00 00001b0 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00001c0 00 00 00 00 01 00 00 00 00 00 00 00 02 00 00 00 00001d0 00 00 00 00 02 00 00 00 03 00 00 00 14 01 00 00 00001e0 00 00 00 00 00 00 00 00 05 00 00 00 00 00 00 00 00001f0 06 00 00 00 00 00 00 00 07 00 00 00 00 00 00 00 0000200 f1 00 00 00 08 00 00 00 00 00 00 00 45 00 00 00 0000210 01 00 00 00 00 00 00 00 0a 00 00 00 00 00 00 00 0000220 65 78 61 6d 70 6c 65 2e 72 62 45 00 00 00 01 00 0000230 00 00 00 00 00 00 43 00 00 00 00 00 00 00 2f 55 0000240 73 65 72 73 2f 6b 64 64 65 69 73 7a 2f 44 6f 63 0000250 75 6d 65 6e 74 73 2f 70 72 6f 6a 65 63 74 73 2f 0000260 73 61 6e 64 62 6f 78 2f 63 6f 6d 70 69 6c 69 6e 0000270 67 2d 72 75 62 79 2f 65 78 61 6d 70 6c 65 2e 72 0000280 62 45 00 00 00 02 00 00 00 00 00 00 00 06 00 00 0000290 00 00 00 00 00 3c 6d 61 69 6e 3e f5 00 00 00 0b 00002a0 00 00 00 00 00 00 00 45 00 00 00 02 00 00 00 00 00002b0 00 00 00 01 00 00 00 00 00 00 00 61 45 00 00 00 00002c0 02 00 00 00 00 00 00 00 01 00 00 00 00 00 00 00 00002d0 2b 45 00 00 00 02 00 00 00 00 00 00 00 04 00 00 00002e0 00 00 00 00 00 70 75 74 73 00 02 00 00 0c 02 00 00002f0 00 2a 02 00 00 81 02 00 00 9b 02 00 00 a7 02 00 0000300 00 bc 02 00 00 d1 02 00 00 0000309 header RUBY_VERSION iseq offset list id offset list object offset list Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

~/compiling-ruby $ ruby -e "RubyVM::InstructionSequence.compile_file('example.rb').to_binary" [ 0 - 3] magic = YARB [ 4 - 7] major_version = 2 [ 8 - 11] minor_version = 3 [12 - 15] size = 801 [16 - 19] extra_size = 0 [20 - 23] iseq_list_size = 1 [24 - 27] id_list_size = 4 [28 - 31] object_list_size = 9 [32 - 35] iseq_list_offset = 468 [36 - 39] id_list_offset = 472 [40 - 43] object_list_offset = 765 [44 - 60] RUBY_PLATFORM = x86_64-darwin15 [468 - 471] iseq 0 = 276 [472 - 479] id 0 = a [480 - 487] id 1 = + [488 - 495] id 2 = puts iseqs = [{ location.pathobj = ["example.rb", true] location.base_label = "" location.label = "" iseq_encoded = param.opt_table = NULL param.keyword = NULL line_info_table = [{ position: 0, line_no: 3 }, { position: 6, line_no: 4 }] local_table = [36945] catch_table = NULL parent_iseq = -1 local_iseq = is_entries = NULL ci_entries = [{ mid: 43, flag: 16, orig_argc: 1 }, { mid: 15617, flag: 20, orig_argc: 1 }] cc_entries = NULL mark_ary = 0 body size = 20 }] ~/compiling-ruby $ Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

#load_iseq allows us to provide our own bytecode. Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

#load_iseq allows us to provide our own bytecode. We can inject debugging code into Ruby to learn the binary structure of a YARV bytecode dump. Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

#load_iseq allows us to provide our own bytecode. We can inject debugging code into Ruby to learn the binary structure of a YARV bytecode dump. So, we can write our own code that compiles down to YARV bytecode. Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

class RubyVM::InstructionSequence def self.load_iseq(source_path) Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part begin iseq = RubyVM::InstructionSequence .compile(File.read(source_path)) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end iseq_path = File.join( File.expand_path(__dir__, '.iseq'), source_path.gsub(/[^A-Za-z0-9\._-]/) { |c| '%02x' % c.ord }.gsub('.rb', '.yarb')) if File.exist?(iseq_path) && (File.mtime(source_path) <= File.mtime(iseq_path)) return RubyVM::InstructionSequence .load_from_binary(File.binread(iseq_path)) end

class RubyVM::InstructionSequence def self.load_iseq(source_path) Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part begin iseq = RubyVM::InstructionSequence .compile(File.read(source_path)) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end ...

class RubyVM::InstructionSequence def self.load_iseq(source_path) Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part begin content = File.read(source_path) iseq = RubyVM::InstructionSequence.compile(content) File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end ...

class RubyVM::InstructionSequence def self.load_iseq(source_path) Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part begin content = File.read(source_path) iseq = if File.basename(source_path).end_with?('.tb.rb') Tuby.compile(content) else RubyVM::InstructionSequence.compile(content) end File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end ...

class RubyVM::InstructionSequence def self.load_iseq(source_path) Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part begin content = File.read(source_path) iseq = if File.basename(source_path).end_with?('.tb.rb') Tuby.compile(content) else RubyVM::InstructionSequence.compile(content) end File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end ...

class RubyVM::InstructionSequence def self.load_iseq(source_path) Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part begin content = File.read(source_path) iseq = if File.basename(source_path).end_with?('.tb.rb') Tuby.compile(content) else RubyVM::InstructionSequence.compile(content) end File.binwrite(iseq_path, iseq.to_binary) iseq rescue SyntaxError, RuntimeError nil end end end ... Contract = String → #to_binary Tuby::compile RubyVM::InstructionSequence::compile

Tokenize Build AST Build ISeq Read source Interpret AST #require Execute ISeq Write ISeq Read ISeq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part Modify source Modify AST

Tokenize Build AST Build ISeq Read source Interpret AST #require Execute ISeq Write ISeq Read ISeq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part Modify source Modify AST Build Tuby

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part Because we’re writing YARV bytecode, we maintain interoperability with Ruby.

Because we’re writing YARV bytecode, we maintain interoperability with Ruby. We can get the benefits of a compiler and instruction elimination without having to write a native extension. Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part /* formulae.tb.rb */ impl Formulae::sphere_volume(radius) { (4 / 3) * 3.14159 * (radius ** 3) }

Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part /* formulae.tb.rb */ impl Formulae::sphere_volume(radius) { (4 / 3) * 3.14159 * (radius ** 3) } /* formulae.rb */ Formulae.sphere_volume(5) # 392.68987500000003

Does it work? Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Does it work? Kind of… Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Does it work? Kind of… https://github.com/kddeisz/tuby Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Tokenize Build AST Build ISeq Read source Interpret AST #require Execute ISeq Write ISeq Read ISeq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part Modify source Modify AST Build Tuby

#require Execute ISeq Read ISeq Tokenize • Build AST • (Interpret AST) • Build ISeq • Execute ISeq • Read/write ISeq • The fun part

Why would you ever do this?

Programming is using human language to represent computer lexicon.

Programming is using human language to represent computer lexicon. Code gets read many more times than it gets written.

Programming is using human language to represent computer lexicon. Code gets read many more times than it gets written. Optimize for reading code.

What’s next?

#require Execute ISeq Read ISeq

#require Execute ISeq Read ISeq JIT Compile ISeq

No content

#require Execute ISeq Read ISeq

#require Execute ISeq Read ISeq Queue ISeq

#require Execute ISeq Read ISeq Queue ISeq Start worker

#require Execute ISeq Read ISeq Queue ISeq Start worker Dequeue ISeq

#require Execute ISeq Read ISeq Queue ISeq Start worker Generate C Dequeue ISeq

#require Execute ISeq Read ISeq Queue ISeq Start worker Generate C Dequeue ISeq Compile native

#require Execute ISeq Read ISeq Queue ISeq Start worker Generate C Dequeue ISeq Compile native Call native

No content

https://github.com/ruby/ruby/pull/1782

What’s next?

Compiling Ruby github.com/kddeisz/compiling-ruby Kevin Deisz @kddeisz