Goliath & async Ruby

Transcript

1. Goliath Jacques Fuentes @jpfuentes2 github/jpfuentes2 EventMachine ruby 1.9 Fibers asynchronous

   pure awesomesness by PostRank

2. WHY? but your pants aren’t tight enough for node.js you

   want to be an async hipster

3. Draw Something by OMGPOP downloads on release day downloads w/in

   50 days drawings per second 30K 50M 3K OMGSCALE

4. I don’t need roflscale... should I use this?

5. why the hell not? Goliath is... robust easy scalable performant

   ruby <3

6. 3 EventMachine Ruby 1.9 Fibers em-synchrony Pillars

7. -Driven EventMachine Callbacks Fast Reactor Pattern

8. class Handler < EM::Connection include EM::HttpServer def initialize(mysql) @mysql =

   mysql end def process_http_request http = EM::HttpRequest.new('http://some-awesome-api').get http.callback do query = @mysql.query "insert awesome data" query.callback do |result| send_response "saved data!" end end end def send_response(content) r = EM::DelegatedHttpResponse.new(self) r.status = 200 r.content = content r.send_response end end EM.run do client = Mysql2::EM::Client.new EM::start_server("0.0.0.0", 8085, Handler, client) end

9. http://cdn.memegenerator.net/instances/400x/13756444.jpg

10. lightweight “green” threads Fibers co-operative lightweight “green” threads

11. http://www.igvita.com/2009/05/13/fibers-cooperative-scheduling-in-ruby/

12. combine Ruby 1.9 Fibers w/ EventMachine make async code look

    synchronous =>

13. require 'eventmachine' require 'em-http' require 'fiber' def async_fetch(url) f =

    Fiber.current http = EventMachine::HttpRequest.new(url).get :timeout => 10 http.callback { f.resume(http) } http.errback { f.resume(http) } return Fiber.yield end EventMachine.run do Fiber.new { puts "Setting up HTTP request #1" data = async_fetch('http://www.google.com/') puts "Fetched page #1: #{data.response_header.status}" EventMachine.stop }.resume end

14. em-synchrony by Ilya Grigorik Fiber “aware” library & wrappers makes

    async look sync Redis/Memcache ActiveRecord MySQL

15. 3 EventMachine Ruby 1.9 Fibers em-synchrony Pillars

16. require 'goliath' class Hello < Goliath::API # default to JSON

    output, allow Yaml as secondary use Goliath::Rack::Render, ['json', 'yaml'] def response(env) [200, {}, "Hello World"] end end # > ruby hello.rb -sv # > [97570:INFO] 2011-02-15 00:33:51 :: Starting server on 0.0.0.0:9000 in development mode. Watch out for stones.

17. require 'config/setup' Configuration::Server.setup! class Server < Goliath::API use Goliath::Rack::Render, 'json'

    use Goliath::Rack::Heartbeat use Goliath::Rack::Params map "/sticky-notes" do run StickyNotesAPI.new end map "/todos" do run TodosAPI.new end map "/research-items" do run ResearchItemsAPI.new end map "/at-a-glance" do run AtAGlanceAPI.new end map "/tickets-graphs" do run TicketGraphsAPI.new end end

18. class TodosAPI < Goliath::API include Helper def get Todo.for_user(current_user).chronological.active end

    def put (@todo = Todo.find(params['id'])).update_attributes put_params publish @todo end def post @todo = Todo.create! post_params publish @todo end private def put_params params.slice('complete_date', 'text', 'due_date', 'assignee_id') end def post_params params.merge("creator_id" => current_user[:id]) end end

19. module Helper include Dashboard::RedisHelper def response(env) http_method = env['REQUEST_METHOD'].downcase return

    cors_options if http_method == 'options' invoke_api_using http_method end def publish(resource) event = { app_name: resource.class.app_name, ignore: current_user[:id], payload: resource } redis.publish 'dashboard', event.to_json end private def invoke_api_using(http_method) response = send(http_method) [200, cors_headers, response] end def cors_headers { 'Access-Control-Allow-Origin' => env['HTTP_ORIGIN'], 'Access-Control-Allow-Methods' => 'GET, PUT, POST, DELETE, OPTIONS', 'Access-Control-Allow-Headers' => 'Content-Type, Depth, User-Agent, X- Requested-With, Cache-Control', 'Access-Control-Allow-Credentials' => 'true' } end end

20. module Pusher def self.config YAML.load(File.read('config/pusher.yml'))[ENV['PUSHER_ENV']] end def self.start EM.run do

    @subscriber = EM::Hiredis.connect @subscriber.subscribe('dashboard') @sockets = Pusher::Sockets.new EventMachine::WebSocket.start(config) do |ws| ws.onopen { @sockets << ws } ws.onclose { @sockets.delete(ws) } end @subscriber.on(:message) do |channel, msg| event = Pusher::Event.new msg @sockets.send event end end end end

21. class Dashboard.Websocket constructor: (@options) -> _.extend @, Backbone.Events @start() start:

    -> @socket = new WebSocket @options.url @socket.onmessage = @onmessage @socket.onclose = @onclose @trigger "start", @ onmessage: (e) => data = JSON.parse e.data @trigger "message", data onclose: (e) => @reconnect() @trigger "closed", data reconnect: -> clearTimeout @_reconnect @_reconnect = setTimeout => @start() , 2000 class Dashboard.Application load: -> @socket() socket: -> @websocket = new Dashboard.Websocket url: "ws://0.0.0.0:2092" @websocket.start() @websocket.bind "message", @_receive, @ _receive: (event) -> app = @getApp event.app_name app.update event.payload

22. require 'goliath' require 'em-synchrony/activerecord' require 'yajl' require 'grape' class User

    < ActiveRecord::Base; end; class MyAPI < Grape::API version 'v1', :using => :path format :json resource 'users' do get "/" do User.all end get "/:id" do User.find(params['id']) end post "/create" do User.create(params['user']) end end end class APIServer < Goliath::API def response(env) MyAPI.call(env) end end

23. Questions? Jacques Fuentes @jpfuentes2 github/jpfuentes2