Do it Later with Resque & Delayed Job

A talk I gave at Lone Star Ruby 2012 in Austin, Texas.

Ruby isn't the fastest language on the block, so many systems are built where potentially lengthy operations are done in the background, keeping your application fast and responsive. We take a look at two frameworks for managing background queues and how they can be used effectively in Rails applications.

Transcript

1. %P
   JU
   -BUFS
   XJUI
   3FTRVF
   
   %FMBZFE
   +PC #FO
   4DIFJSNBO !TVCEJHJUBM IUUQCFOTDIFJSNBODPN Saturday, August 11, 12
2. %P
   JU
   -BUFS
   XJUI
   3FTRVF
   
   %FMBZFE
   +PC #FO
   4DIFJSNBO !TVCEJHJUBM IUUQCFOTDIFJSNBODPN ...and Sidekiq? Saturday, August 11, 12
3. 8F
   BSF
   IJSJOH 3BJMT
   
   J04 Saturday, August 11, 12
4. OTTDSFFODBTUDPN Saturday, August 11, 12
5. &YQSFTTJWF 'MFYJCMF .BMMFBCMF 'VO 3VCZ
   
   8FC
   
   ❤ Saturday, August 11, 12
6. 3BX
   4QFFE .VMUJ5ISFBEJOH 3VCZ
   JT
   OPU
   LOPXO
   GPS Saturday, August 11, 12
7. 1MFOUZ
   PG
   FYBNQMFT #VU
   3VCZ
   BQQT
   DBO
   TDBMF Saturday, August 11, 12
8. 1MFOUZ
   PG
   FYBNQMFT #VU
   3VCZ
   BQQT
   DBO
   TDBMF Saturday, August 11, 12
9. $BDIJOH .VMUJQMF
   XFC
   QSPDFTTFT .POHSFMT 6OJDPSO
   XPSLFST )FSPLV
   EZOPT &UD %JTUSJCVUJOH
   UIF
   -PBE )PX
   EP
   3BJMT
   BQQT
   TDBMF Saturday, August 11, 12
10. )FSPLV`T
    %ZOP
    .PEFM Saturday, August 11, 12
11. )FSPLV`T
    %ZOP
    .PEFM Saturday, August 11, 12
12. ,FFQ
    3FRVFTUT
    -JHIUXFJHIU Saturday, August 11, 12
13. 1FSGPSN
    DPNQMFY
    XPSL
    JO
    UIF
    CBDLHSPVOE Saturday, August 11, 12
14. 8IBU
    XPSL
    TIPVME
    XF
    QFSGPSN
    JO
    UIF
    CBDLHSPVOE Saturday, August 11, 12
15. 8IBU
    XPSL
    TIPVME
    XF
    QFSGPSN
    JO
    UIF
    CBDLHSPVOE 4FOEJOH
    FNBJMT $PNNVOJDBUJOH
    XJUI
    SE
    QBSUZ
    "1*T $BMDVMBUJOH
    TUBUT 3FCVJMEJOH
    JOEFYFT 3FTJ[JOHQSPDFTTJOH
    QIPUPT 1PTU
    QSPDFTTJOH
    PG
    NPEFMT &ODPEJOH
    BVEJPWJEFP &YUSBDU
    JOGP
    PVU
    PG
    NFEJB
    pMFT 8BSN
    DBDIFT Saturday, August 11, 12
16. .BOZ
    TPMVUJPOT
    GPS
    UIJT %FMBZFE
    +PC 3FTRVF 4JEF,JR Saturday, August 11, 12
17. %FMBZFE
    +PC IUUQTHJUIVCDPNDPMMFDUJWFJEFBEFMBZFE@KPC +VTU
    B
    HFN 6TFT
    ZPVS
    EBUBCBTF 3BLF
    UBTL
    UP
    SVO
    XPSLFST Saturday, August 11, 12
18. # Gemfile gem 'rails' gem 'sqlite' gem 'delayed_job_active_record' Saturday, August 11, 12
19. $ rails generate delayed_job $ rake db:migrate Saturday, August 11, 12
20. class Foo def bar puts "baz" end end (irb) > Foo.new.delay.bar $BMMFS
    EFDJEFT
    BTZOD Saturday, August 11, 12
21. class Foo def bar puts "baz" end handle_asynchronously :bar end (irb) > Foo.new.bar $BMMFS
    EPFTO`U
    DBSF Saturday, August 11, 12
22. class MyJob def perform puts "I'm doing background work!" sleep 10 end end (irb)> Delayed::Job.enqueue MyJob.new Saturday, August 11, 12
23. %FNP
    'FUDIJOH
    -JOL
    5JUMFT VTJOH
    %FMBZFE
    +PC Saturday, August 11, 12
24. )BOEMJOH
    'BJMVSFT
    
    'BJMVSF
    DPVOU
    
    TMJEJOH
    EFMBZ
    
    $POUJOVF
    VOUJM
    KPC
    JT
    
    EBZT
    
    
    
    
    
    
    
    
    PME Saturday, August 11, 12
25. 1SPT
    PG
    %+ &BTZ 8PSLT
    XJUI
    "3
    
    .POHPJE +VTU
    B
    HFN 'BJMVSF
    IBOEMJOH Saturday, August 11, 12
26. %PXOTJEFT
    PG
    %+ Saturday, August 11, 12
27. %PXOTJEFT
    PG
    %+ 4PNFXIBU
    TUBMF
    EFWFMPQNFOU 6TFT
    ZPVS
    BQQ`T
    EBUBCBTF 5BCMF
    MPDLJOH 8PSLFS
    RVFSJFT
    FYQFOTJWF
    
    
    XJUI
    B
    MBSHF
    RVFVF /P
    CVJMUJO
    EBTICPBSE Saturday, August 11, 12
28. 4PNF
    UIJOHT
    UP
    MPPL
    BU %FMBZFE
    +PC
    "ENJO %FMBZFE
    +PC
    .POHPJE
    BEBUFS Saturday, August 11, 12
29. 3FTRVF #BTFE
    PO
    3FEJT .VMUJQMF
    RVFVFT 2VFVF
    1SJPSJUZ #VJMUJO
    %BTICPBSE Saturday, August 11, 12
30. 8IZ
    2VFVF
    1SJPSJUZ DBMDVMBUF@TUBUT
    RVFVF EFMJWFS@QVSDIBTF
    RVFVF Saturday, August 11, 12
31. +PCT
    JO
    3FTRVF 1MBJO
    DMBTTFT .VTU
    TFU
    DMBTT
    WBSJBCMF
    queue
    .VTU
    JNQMFNFOU
    DMBTT
    NFUIPE
    perform Saturday, August 11, 12
32. %FpOJOH
    +PCT
    JO
    3FTRVF class SendNewsletterJob @queue = :mailer def self.perform(newsletter_id) newsletter = Newsletter.find(newsletter_id) User.subscribed.find_each do |user| UserMailer.newsletter( user, newsletter).deliver end end end Saturday, August 11, 12
33. &ORVFVJOH
    +PCT
    JO
    3FTRVF Resque.enqueue(SendNewsletterJob, 256) Saturday, August 11, 12
34. 3FEJT IUUQSFEJTJP ,FZ
    WBMVF
    TUPSF 'BTU "UPNJD 0 
    QVTI
    
    QPQ .BTUFSTMBWF
    DPOpHVSBUJPO Saturday, August 11, 12
35. 3FEJT
    $POpHVSBUJPO 4UPSF
    FOUJSF
    TFU
    JO
    NFNPSZ $POpHVSF
    TZOD
    UP
    EJTL
    &WFSZ
    XSJUF
    4-08
    %PO`U
    'MVTI
    '"45
    &WFSZ
    TFDPOE
    $0.130.*4&
    
    
    
    Saturday, August 11, 12
36. *OTUBMMJOH
    3FEJT 0O
    B
    .BD brew install redis 0O
    UIF
    TFSWFS
    6CVOUV wget http://redis.googlecode.com/files/redis-2.4.13.tar.gz tar xzvf redis-2.4.13 cd redis-2.4.13 make sudo make install )PTUFE
    XJUI
    3FEJT
    5P
    (P IUUQSFEJTUPHPDPN Saturday, August 11, 12
37. *OTUBMMJOH
    3FTRVF
    JO
    B
    3BJMT
    BQQ (FNpMF gem 'resque' MJCUBTLTSFTRVFSBLF require 'resque/tasks’ Saturday, August 11, 12
38. 3VOOJOH
    UIF
    XFC
    DPOTPMF 4FQBSBUF
    TJOBUSB
    BQQ resque-web .PVOUFE
    JO
    ZPVS
    SBJMT
    BQQ # routes.rb Saturday, August 11, 12
39. .PVOUJOH
    UIF
    XFC
    DPOTPMF require 'resque/server' YourApp::Application.routes.draw do mount Resque::Server.new, :at => "resque" ... end Saturday, August 11, 12
40. 3VOOJOH
    UIF
    XPSLFS T $ QUEUE=* rake resque:work Saturday, August 11, 12
41. 4FMFDUJOH
    2VFVFT
    
    1SJPSJUJFT $ QUEUE=urgent,* rake resque:work Saturday, August 11, 12
42. .BLF
    TVSF
    3BJMT
    FOWJSPONFOU
    JT
    MPBEFE $ QUEUE=* rake environment resque:work Saturday, August 11, 12
43. .BLF
    TVSF
    3BJMT
    FOWJSPONFOU
    JT
    MPBEFE # lib/tasks/resque.rake task "resque:setup" => :environment do # any other setup end Saturday, August 11, 12
44. %FNP
    'FUDIJOH
    6TFS
    "WBUBST VTJOH
    3FTRVF Saturday, August 11, 12
45. 1SPT
    PG
    3FTRVF Saturday, August 11, 12
46. 1SPT
    PG
    3FTRVF &BTZ 'BTU /P
    JNQBDU
    PO
    BQQ
    EC
    QFSG "ENJO
    EBTICPBSE 'MFYJCMF Saturday, August 11, 12
47. %SBXCBDLT
    PG
    3FTRVF .PSF
    DPNQMFY .PSF
    UIJOHT
    UP
    TFUVQ
    NPOJUPS 8POLZ
    SFQPSUJOH
    PO
    )FSPLV Saturday, August 11, 12
48. 5IJOHT
    UP
    MPPL
    BU 3FTRVF
    .BJMFS IUUQTHJUIVCDPN[BQOBQSFTRVF@NBJMFS 3FTRVF
    4DIFEVMFS IUUQTHJUIVCDPNCWBOEFOCPTSFTRVFTDIFEVMFS 3FTRVF
    3FUSZ
    4VQQPSU IUUQTHJUIVCDPNMBOUJOTSFTRVFSFUSZ Saturday, August 11, 12
49. Saturday, August 11, 12
50. l8IBU
    JG
    XF
    DPVME
    SFQMBDF
    
    3FTRVF
    
    %+
    XPSLFST
    XJUI
    
    4JEFLJR
    XPSLFS z 4JEFLJR Saturday, August 11, 12
51. l5IBU`T
    B
    CPME
    TUBUFNFOUz Saturday, August 11, 12
52. 4JEFLJR .BTUFS
    1SPDFTT 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS 8PSLFS Saturday, August 11, 12
53. #Z
    UIF
    QPXFS
    PG
    $FMMVMPJE Saturday, August 11, 12
54. 5BLFBXBZT Saturday, August 11, 12
55. 5BLFBXBZT -PUT
    PG
    XPSL
    DBO
    CF
    EPOF
    JO
    UIF
    CBDLHSPVOE ,FFQ
    SFRVFTUT
    MJHIUXFJHIU
    EFGFS
    BT
    NVDI
    BT
    QPTTJCMF $IPPTF
    ZPVS
    PXO
    BEWFOUVSF 8SJUF
    KPC
    DMBTTFT
    JO
    SVCZ .POJUPS
    ZPVS
    KPCT Saturday, August 11, 12
56. 2VFTUJPOT #FO
    4DIFJSNBO !TVCEJHJUBM IUUQCFOTDIFJSNBODPN IUUQOTTDSFFODBTUDPN Saturday, August 11, 12