Concorrência, paralelismo e o Ruby

Concorrência, paralelismo e o Ruby Ricardo Valeriano github.com/ricardovaleriano @sr_valeriano backslashes.net
Sunday, December 9, 12

http://www.webforce.com.br/pt/imprensa.php “Forbes Brasil, out 2000” Sunday, December 9, 12

Conceitos básicos ferramentas para implementação Sunday, December 9, 12

O que e como posso fazer em Ruby? Sunday, December
9, 12

Threads and Process Non Blocking IO, GIL fork... Sunday, December
9, 12

Ecossistema EventMachine, Unicorn, Thin, Celluloid Sunday, December 9, 12

? Sunday, December 9, 12

Ruby Threads Sunday, December 9, 12

Ruby Threads (on MRI) Sunday, December 9, 12

? Sunday, December 9, 12

? ? Sunday, December 9, 12

? ? OMG! AWESOME! Sunday, December 9, 12

IO? Sunday, December 9, 12

IO? IO? Sunday, December 9, 12

IO? IO? CPU? Sunday, December 9, 12

? IO? IO? CPU? Sunday, December 9, 12

Fibur = Thread bur / lib / bur.rb Sunday, December
9, 12

Rota, params, controler#action... Sunday, December 9, 12

CPU? Rota, params, controler#action... Sunday, December 9, 12

CPU? Rota, params, controler#action... render... Sunday, December 9, 12

Ruby Threads um pequeno benchmark Sunday, December 9, 12

require 'benchmark' require 'net/http' require 'uri' uri = URI("http://example.org") Benchmark.bm
do |b| b.report('get normal') do 10.times { Net::HTTP.get_response uri } end end Sunday, December 9, 12

require 'benchmark' require 'net/http' require 'uri' uri = URI("http://example.org") Benchmark.bm
do |b| b.report('get normal') do 10.times { Net::HTTP.get_response uri } end end b.report('get maroto') do 10.times.map do Thread.new{ Net::HTTP.get_response uri } end.map(&:join) end Sunday, December 9, 12

require 'benchmark' require 'mysql2' sql_fuleiro = "SELECT * FROM user"
Benchmark.bm do |x| x.report "select fuleiro" do 15.times do end end end Sunday, December 9, 12

Benchmark.bm do |x| x.report "select fuleiro" do 15.times do end end end mysql2 = Mysql2::Client.new host: "localhost", username: "root" Sunday, December 9, 12

Benchmark.bm do |x| x.report "select fuleiro" do 15.times do end end end mysql2 = Mysql2::Client.new host: "localhost", username: "root" mysql2.query "use mysql" Sunday, December 9, 12

Benchmark.bm do |x| x.report "select fuleiro" do 15.times do end end end mysql2 = Mysql2::Client.new host: "localhost", username: "root" mysql2.query "use mysql" mysql2.query sql_fuleiro Sunday, December 9, 12

x.report "select threaded" do 15.times.map do Thread.new{ mysql2 = Mysql2::Client.new
host: "localhost", username: "root" mysql2.query "use mysql" mysql2.query sql_fuleiro } end.map(&:join) end Sunday, December 9, 12

x.report "select event machine" do 15.times do mysql2 = Mysql2::EM::Client.new
host: "localhost", username: "root" mysql2.query "use mysql" mysql2.query sql_fuleiro end end Sunday, December 9, 12

Race conditions Sunday, December 9, 12

class SomatorOMG attr_accessor :counter def initialize @counter = 0 end
def pluzz(how_much) @counter = @counter + how_much end end Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new (1..100).map do Thread.new{ } end Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new (1..100).map do Thread.new{ } end 100.times { omg.pluzz(1) } Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new (1..100).map do Thread.new{ } end 100.times { omg.pluzz(1) } .map(&:join) Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new omg.pluzz 1 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter omg.pluzz 1 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 omg.pluzz 1 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 omg.pluzz 1 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= omg.pluzz 1 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 omg.pluzz 1 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter 2 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter 2 @counter Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter 2 @counter 2 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter 2 @counter 2 2 + 1 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter 2 @counter 2 2 + 1 @counter= Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter 2 @counter 2 2 + 1 @counter= 3 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter 2 2 + 1 @counter 2 2 + 1 @counter= 3 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter 2 2 + 1 @counter= @counter 2 2 + 1 @counter= 3 Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end omg = SomatorOMG.new @counter 0 0 + 1 @counter= 1 @counter 1 1 + 1 @counter= 2 @counter 2 2 + 1 @counter= 3 @counter 2 2 + 1 @counter= 3 Sunday, December 9, 12

Locks Sunday, December 9, 12

Locks #FTW? Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end require 'monitor' Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end require 'monitor' include MonitorMixin Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end require 'monitor' include MonitorMixin super Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end require 'monitor' include MonitorMixin super # WAT? Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end require 'monitor' include MonitorMixin super # WAT? .. extend(MonitorMixin) Sunday, December 9, 12

def pluzz(how_much) @counter = @counter + how_much end end require 'monitor' include MonitorMixin synchronize do end super # WAT? .. extend(MonitorMixin) Sunday, December 9, 12

omg = SomatorOMG.new omg.pluzz(1) Sunday, December 9, 12

Dead Lock Sunday, December 9, 12

DIFÍCIL! Sunday, December 9, 12

http://rubyconf2008.confreaks.com/what-all-rubyist-should- know-about-threads.html Sunday, December 9, 12

GIL? (ou GVL) Sunday, December 9, 12

GIL? (ou GVL) NO! Sunday, December 9, 12

GIL? (ou GVL) Sunday, December 9, 12

Mas e os 428372 cores? Sunday, December 9, 12

Mas e os 428372 cores? vários Sunday, December 9, 12

PARALELISMO FAZER VÁRIAS TAREFAS... PARALELAMENTE XD Sunday, December 9, 12

I’m not a threading guy! I’m not a threading guy!

Yukihiro Matsumoto, RubyConf 2012 Yukihiro Matsumoto, RubyConf 2012 “i’m not
a threading guy” “i’m not a threading guy” Sunday, December 9, 12

MRI’s Land Sunday, December 9, 12

(unix) Process Sunday, December 9, 12

pid = Process.fork Sunday, December 9, 12

pid = Process.fork puts "#{pid}, eu (#{Process.pid}) sou seu pai!
XD" Sunday, December 9, 12

do puts "OMG! Nasci!" end pid = Process.fork puts "#{pid},
eu (#{Process.pid}) sou seu pai! XD" Sunday, December 9, 12

do puts "OMG! Nasci!" end pid = Process.fork while true
sleep(1) end puts "#{pid}, eu (#{Process.pid}) sou seu pai! XD" Sunday, December 9, 12

do puts "OMG! Nasci!" end pid = Process.fork while true
sleep(1) end while true sleep(1) end puts "#{pid}, eu (#{Process.pid}) sou seu pai! XD" Sunday, December 9, 12

Sem shared memory, sem lock’s Sunday, December 9, 12

rupy = "Rupy BR" Process.fork do end Sunday, December 9,
12

rupy = "Rupy BR" Process.fork do end rupy << "
2012" puts "no filho: #{rupy}" Sunday, December 9, 12

rupy = "Rupy BR" Process.fork do end rupy << "
2012" puts "no filho: #{rupy}" puts "no pai: #{rupy}" Sunday, December 9, 12

Sem shared memory? Sunday, December 9, 12

E a comunicação? Sunday, December 9, 12

pid = Process.fork do end Sunday, December 9, 12

pid = Process.fork do end reader, writer = IO.pipe Sunday,
December 9, 12

pid = Process.fork do end reader, writer = IO.pipe while(
(msg = gets.chomp) != "fui") writer.puts "Papa: #{msg}" end Sunday, December 9, 12

(msg = gets.chomp) != "fui") writer.puts "Papa: #{msg}" end puts "fui papa!" Sunday, December 9, 12

(msg = gets.chomp) != "fui") writer.puts "Papa: #{msg}" end puts "fui papa!" while(msg = reader.gets) puts msg end Sunday, December 9, 12

(msg = gets.chomp) != "fui") writer.puts "Papa: #{msg}" end puts "fui papa!" while(msg = reader.gets) puts msg end writer.close Sunday, December 9, 12

(msg = gets.chomp) != "fui") writer.puts "Papa: #{msg}" end reader.close puts "fui papa!" while(msg = reader.gets) puts msg end writer.close Sunday, December 9, 12

Tá de sacanagem! Ficar trocando string? Sunday, December 9, 12

class Armenga attr_accessor :lol def sera? "oh yeah baby!" end
end Sunday, December 9, 12

reader, writer = IO.pipe Sunday, December 9, 12

reader, writer = IO.pipe armenga = Armenga.new armenga.lol = "LoLoLoLing"
writer.puts Marshal::dump armenga Sunday, December 9, 12

reader, writer = IO.pipe pid = Process.fork do end armenga
= Armenga.new armenga.lol = "LoLoLoLing" writer.puts Marshal::dump armenga Sunday, December 9, 12

reader, writer = IO.pipe pid = Process.fork do end armenga
= Armenga.new armenga.lol = "LoLoLoLing" writer.puts Marshal::dump armenga reader.close Sunday, December 9, 12

reader, writer = IO.pipe writer.close data = reader.gets omg =
Marshal::load data pid = Process.fork do end armenga = Armenga.new armenga.lol = "LoLoLoLing" writer.puts Marshal::dump armenga reader.close Sunday, December 9, 12

reader, writer = IO.pipe writer.close data = reader.gets omg =
Marshal::load data pid = Process.fork do end armenga = Armenga.new armenga.lol = "LoLoLoLing" writer.puts Marshal::dump armenga reader.close puts omg.lol puts omg.sera? Sunday, December 9, 12

Tudo lindo! SO cuida de tudo! Sunday, December 9, 12

Não cuida? Sunday, December 9, 12

E se tiver 8 cores? 16? 128? Sunday, December 9,
12

Tem que cuidar dos processos... Sunday, December 9, 12

RAM? Desperdício? Sunday, December 9, 12

http://tomayko.com/writings/unicorn-is-unix Sunday, December 9, 12

http://www.confreaks.com/videos/1289-rubyconf2012-grow- your-unix-beard-using-ruby Jesse Storimer Sunday, December 9, 12

Reactor Pattern Sunday, December 9, 12

Event Machine Sunday, December 9, 12

Sintaxe horrível? Sunday, December 9, 12

Sintaxe horrível? Diferente? Sunday, December 9, 12

#!/usr/bin/env ruby # # server_1 require 'rubygems' require 'eventmachine' module
EchoServer def post_init puts "-- someone connected to the echo server!" end def receive_data data send_data ">>> you sent: #{data}" end end EventMachine::run { EventMachine::start_server "127.0.0.1", 8081, EchoServer puts 'running echo server on 8081' } Sunday, December 9, 12

#!/usr/bin/env ruby # # client_1 require 'rubygems' require 'eventmachine' class
Echo < EventMachine::Connection def post_init send_data 'Hello' end def receive_data(data) p data end end EventMachine.run { EventMachine.connect '127.0.0.1', 8081, Echo } Sunday, December 9, 12

ACTOR MODEL ROBUSTES MALANDRA INSPIRADA NO ERLANG (OU NO SMALLTALK?)

Futures Sunday, December 9, 12

class Charlie def report # some sloooooow process here. end
end Sunday, December 9, 12

>> future = charlie.future.report class Charlie def report # some
sloooooow process here. end end Sunday, December 9, 12

>> future = charlie.future.report => #<Celluloid::Future:0x000001009759b8> class Charlie def report
# some sloooooow process here. end end Sunday, December 9, 12

>> future = charlie.future.report => #<Celluloid::Future:0x000001009759b8> >> future.value class Charlie
def report # some sloooooow process here. end end Sunday, December 9, 12

>> future = charlie.future.report => #<Celluloid::Future:0x000001009759b8> >> future.value => "Charlie
Sheen is winning!" class Charlie def report # some sloooooow process here. end end Sunday, December 9, 12

>> future = charlie.future.report => #<Celluloid::Future:0x000001009759b8> >> future.value => "Charlie
Sheen is winning!" class Charlie def report # some sloooooow process here. end end include Celluloid Sunday, December 9, 12

Concorrência é uma forma de organizar o pensamento Sunday, December
9, 12

Concorrência pode ser executada paralelamente Sunday, December 9, 12

MRI threads não bloqueantes ou processos unix Sunday, December 9,
12

JRuby e Rubinius threads nativas, sem GIL Sunday, December 9,
12

Evented IO muitas conexões grande inatividade de cpu Sunday, December
9, 12

Actor Model Abstração sobre modelos de concorrência Sunday, December 9,
12

http://merbist.com/2011/10/03/about-concurrency-and-the-gil http://www.confreaks.com/videos/1302-rubyconf2012-the-celluloid-ecosystem http://vimeo.com/groups/waza2012/videos/49718712 http://www.confreaks.com/videos/1281-rubyconf2012-why-jruby-works http://yehudakatz.com/2010/08/14/threads-in-ruby-enough-already http://www.confreaks.com/videos/1289-rubyconf2012-grow-your-unix-beard- using-ruby http://www.engineyard.com/blog/2011/ruby-concurrency-and-you http://jsconf.eu/2009/video_nodejs_by_ryan_dahl.html http://rubyconf2008.confreaks.com/what-all-rubyist-should-know-about-
threads.html http://jstorimer.com/2012/11/08/matz-is-not-a-threading-guy.html http://tomayko.com/writings/unicorn-is-unix Referências Sunday, December 9, 12

MUITO Obrigado! Ricardo Valeriano github.com/ ricardovaleriano @sr_valeriano backslashes.net Sunday, December
9, 12

Concorrência, paralelismo e o Ruby

Concorrência, paralelismo e o Ruby

More Decks by Ricardo Valeriano

Other Decks in Programming

Featured

Transcript