Sidekiq como alternativa para background jobs

Transcript

1. Sidekiq como alternativa para background jobs @gurgelrenan
2. @gurgelrenan
3. Background Jobs? Pq?
4. Requisições devem ser rápidas
5. • Relatórios • Envio de email em massa • Gerar métricas • Push notification
6. Se algo acontece fora do fluxo do programa principal, chamados de async
7. class HandoutsController < ApplicationController def create @handout = Handout.create(handout_params) # this may take a while Notification.notify_parents(@handout) head :ok end end
8. class Notification def self.notify_parents(handout) device_ids = Responsible.pluck(:device_id) device_ids.each_slice(1000) do |thousand_devices| send_push(handout, thousand_devices) end end end
10. Redis - Storage
11. Sidekiq Web
12. Flow Browser Rails Redis Sidekiq
13. Começando…
14. https://redis.io/download Instalar Redis
15. Windows?
16. gem install 'sidekiq' Gemfile
17. # will create app/workers/handout_worker.rb rails g sidekiq:worker Handout app/workers
18. class HandoutWorker include Sidekiq::Worker def perform(handout_id) # do something end end HandoutWorker
19. HandoutWorker.perform_async(5) Executando
20. Pré-requisitos Redis rodando ($ redis-server) Sidekiq rodando ($ bundle exec sidekiq)
21. class HandoutWorker include Sidekiq::Worker def perform(handout_id) Notification.notify_parents(handout_id) end end Worker
22. Web # dentro de config/routes.rb require 'sidekiq/web' mount Sidekiq::Web => '/sidekiq'
23. Autenticação? • Devise • Clearance • Authlogic • Custom….
24. Ex: Devise # config/routes.rb authenticate :user do mount Sidekiq::Web => '/sidekiq' end
25. Boas Práticas
26. Sempre use IDs
27. Os argumentos do job vão ser serializados - JSON # Bad HandoutWorker.perform_async(@handout) # Good HandoutWorker.perform_async(@handout.id)
28. Idempotente O job pode ser executado várias vezes sem criar feitos colaterais
29. Transacional Se o job falhar, desfaça as alterações que foram feitas
30. def perform(...) # ... ActiveRecord::Base.transaction do david.withdrawal(100) mary.deposit(100) end # ... end
31. Live coding lol
32. Delayed Job Delayed Job uses your SQL database for storage and processes jobs in a single-threaded process. It's simple to set up but the performance and scalability aren't great. I would not use delayed_job for systems processing 100,000s of jobs/day.
33. Sidekiq uses redis for storage and processes jobs in a multi- threaded process. It's just as easy to set up as resque but more efficient in terms of raw processing speed. Your worker code does need to be thread-safe.
34. Sidekiq uses redis for storage and processes jobs in a multi- threaded process. It's just as easy to set up as resque but more efficient in terms of raw processing speed. Your worker code does need to be thread-safe.
35. Active Job
37. Fila default
38. Clockwork
39. Obrigado!