Grow Your Unix Beard Using Ruby

This talk will be a safari tour through some unique features and internals of Unicorn. The Unicorn codebase is the best, most comprehensive example of Unix systems programming in Ruby that I've come across.

Transcript

1. Grow Your Unix Beard With Ruby Jesse Storimer
2. @jstorimer
5. Grow Your Unix Beard With Ruby
6. Unix Ruby
8. http://tomayko.com/writings/unicorn-is-unix
10. :o http://www.flickr.com/photos/69er/463302758/
11. http://whiteboardunicorns.com
12. Rack HTTP server for fast clients and Unix
13. Rack HTTP server for fast clients and Unix
14. Pre-forking
15. forking
17. fork() creates a new process
20. fork() returns twice
29. fork() returns twice
30. fork() returns twice once, but in two processes
37. fork() creates an exact copy of the calling process
38. @hits = Array(1..5) pid = Process.fork do @hits.delete_at(1) puts "Child hits: #@hits" end Process.wait(pid) puts "Parent hits: #@hits"
39. $hits = Array(1..5) pid = Process.fork do $hits.delete_at(1) puts "Child hits: #$hits" end Process.wait(pid) puts "Parent hits: #$hits"
40. Pre-forking
41. Pre-forking
44. http://whiteboardunicorns.com
45. def start open_listener_socket load_rack_app 2.times do fork { worker_loop } end end def worker_loop loop do connection = listener_socket.accept process_client(connection) end end
48. copy on write: share memory until it’s modified
49. CoW Friendly Rubies •MRI 2.0 •Ruby Enterprise Edition •MRI 1.9.3-p194-perf
53. replace an instance of itself without losing any connections
55. http://whiteboardunicorns.com
56. def reexec fork do cmd = [$0] cmd << ARGV.dup ENV['LISTENERS'] = sockets.map(&:fileno) exec(*cmd) # exec("unicorn", "-c", "unicorn_config.rb") end end
57. exec() transforms the calling process into a new process
62. def reexec fork do cmd = [$0] cmd << ARGV.dup ENV['LISTENERS'] = sockets.map(&:fileno) exec(*cmd) # exec("unicorn", "-c", "unicorn_config.rb") end end
65. http://unicorn.bogomips.org/
66. fork + exec
67. fork + exec Process.spawn('time cat') system('time cat') `time cat` IO.popen('time cat') Open3.popen3('time cat')
68. module Process def self.spawn(*args) # .. IO.pipe do |read, write| pid = Process.fork do read.close write.close_on_exec = true begin Rubinius::Spawn.exec(env, prog, argv, redirects, options) rescue => e write.write Marshal.dump(e) exit! 1 end end # .. end end end fork + exec
69. module Process def self.spawn(*args) # .. IO.pipe do |read, write| pid = Process.fork do read.close write.close_on_exec = true begin Rubinius::Spawn.exec(env, prog, argv, redirects, options) rescue => e write.write Marshal.dump(e) exit! 1 end end # .. end end end fork + exec
70. fork + exec $ curl google.com > google.html pid = fork do $stdout.reopen('google.html') exec('curl', 'google.com') end Process.wait(pid)
71. fork + exec $ curl google.com > google.html pid = fork do $stdout.reopen('google.html') exec('curl', 'google.com') end Process.wait(pid)
73. The original Unix beards
74. “[..] the Unix beard is really an extension of the philosopher's beard, and the academic's beard.”
77. Thanks! Tweet @jstorimer Email jesse@jstorimer.com Books http://workingwithcode.com Use RUBYCONF to save $10
78. “Thirty years from now, there will still be a fork(2) and a pipe(2) and a exec(2) and smart people will still be using them to solve hard problems reliably and predictably, just like they were thirty years ago.” ~ Ryan Tomayko
79. Refs •http://www.colourlovers.com/palette/1938182/coconut_lips_RC •http://www.colourlovers.com/palette/1111659/Ninja_Rainbow •http://www.colourlovers.com/palette/1936237/Keynote_2 •http://whiteboardunicorns.com/ •http://www.flickr.com/photos/amyvdh/6003141750/sizes/o/in/photostream/ •http://www.twoideas.org/2009/07/unix-beards/ •http://www.flickr.com/photos/69er/463302758/