ngx_mruby v2における ノンブロッキングなmruby実行の実装詳細

Transcript

1. ʙ͋Εͬʁ࡞ऀɾɾɾ͋Εͬʁʁʁฤʙ !QZBNB
   
   (.0
   1FQBCP
   *OD
   
   3VCZ8PVME
   $POGFSFODF
    OHY@NSVCZ
   Wʹ͓͚Δ
   ϊϯϒϩοΩϯάͳNSVCZ࣮ߦͷ ࣮૷ৄࡉ

2. γχΞɾϓϦϯγύϧ
   ΤϯδχΞ ࢁԼ
   ࿨඙
   
   !QZBNB ϗεςΟϯάࣄۀ෦νʔϑςΫχΧϧϦʔυ IUUQTUFOTOBQPODPN

3. ϗεςΟϯάࣄۀ &$ࢧԉࣄۀ ϋϯυϝΠυɾͦͷଞࣄۀ

4. ೥ ϩϦϙοϓʂϨϯλϧαʔό
   αʔϏεఏڙ։࢝ ೥ ೥ ೥ ϔςϜϧ
   αʔϏεఏڙ։࢝ 1ࢁ͕ϖύϘʹೖࣾʂʂ̍ ೥݄೔
   ࣛࣇౡݝग़ਫࢢʹ͓͍ͯ1ࢁര஀ʂʂ̍ ೥

   ݱࡏɾ૑ۀ೥໨ ϜʔϜʔυϝΠϯ
   αʔϏεఏڙ։࢝

5. 45/4
   -JOVY
   /44
   4FSWFS
   TUOTKQ

6. 45/4

7. ࠓ೔࿩͢͜ͱ wOHY@NSVCZ
   wOHJOYͷجຊ
   wOHY@NSVCZ
   Wͷ՝୊
   wOHY@NSVCZ
   Wʹ͓͚ΔϊϯϒϩοΩϯάॲཧ

8. લఏ wOHJOYͷΠϕϯτϞδϡʔϧ͸FQPMMલఏͰ࿩͠·͢
   w3VCZͷ࿩Λ͠·͕͢ɺ3VCZߏจͷ࿩͸͋·Γग़͖ͯ ·ͤΜ

9. OHY@NSVCZ
   "
   'BTU
   BOE
   .FNPSZ&⒏DJFOU
   8FC
   4FSWFS
   &YUFOTJPO
   .FDIBOJTN
   
   6TJOH
   4DSJQUJOH
   -BOHVBHF
   NSVCZ
   GPS
   OHJOY
   IUUQOHYNSVCZPSH

10. OHY@NSVCZ
    WʹίϯτϦϏϡʔτ

11. None

12. 

13. OHY@NSVCZ NSVCZ@TTM@IBOETIBLF@IBOEMFS@DPEF
    
    
    
    TTM
    
    OHJOY44-OFX
    
    
    DFSUJpDBUF@EBUB
    
    'JMFSFBE QBUIUP\TTMTFSWFSOBNF^DSU
    
    
    LFZ@EBUB
    
    'JMFSFBE QBUIUP\TTMTFSWFSOBNF^LFZ
    
    
    TTMDFSUJpDBUF@EBUB
    
    DFSUJpDBUF@EBUB
    

    
    
    TTMDFSUJpDBUF@LFZ@EBUB
    
    LFZ@EBUB
     OHJOYͷ͋ΒΏΔΠϕϯτʹϑοΫͯ͠ɺNSVCZͷίʔυΛ࣮ߦ͠ɺ
    ϓϥΨϒϧʹτϥϑΟοΫίϯτϩʔϧग़དྷΔ

14. ϖύϘͷࣄྫ ಈతূ໌ॻ؅ཧ ਺ඦສυϝΠϯͷূ໌ॻΛ.Z42-Ͱ؅ཧ ίϯςϯπΩϟογϡ ΩϟογϡϙϦγʔΛ)551
    "1*ܦ༝Ͱऔಘ͠ɺOHJOYͷ
    Ωϟογϡͷ0/ɾ0''Λίϯτϩʔϧ

15. OHJOY
    
    NSVCZ

16. Πϕϯτۦಈ
    ඇಉظ*0 OHJOY

17. Πϕϯτۦಈ OHJOY FQPMM FWFOU FWFOU FWFOU DMJFOU DMJFOU DMJFOU BDDFQU

    BDDFQU BDDFQU FQPMM@XBJU  ઀ଓ΍ϨεϙϯεΛ*0Πϕϯτͱͯ͠ॲཧ͢Δ IUUQTMJOVYKNPTEOKQIUNM-%1@NBOQBHFTNBOFQPMM@XBJUIUNM

18. ඇಉظ*0
    
    શͯ͸ϑΝΠϧͰ͋Δ OHJOY FQPMM FWFOU FWFOU FWFOU DMJFOU DMJFOU DMJFOU BDDFQU

    BDDFQU BDDFQU FQPMM@XBJU  ϑΝΠϧσΟεΫϦϓλͦΕͧΕΛϒϩοΫͤͣ
    FQPMMͰඇಉظʹ*0ॲཧΛߦ͏ GE GE GE

19. OHJOY
    XPSLFS OHJOY FQPMM FWFOU FWFOU FWFOU DMJFOU DMJFOU DMJFOU BDDFQU

    BDDFQU BDDFQU FQPMM@XBJU  ΫϥΠΞϯτ͔ΒͷϦΫΤετ͸XPSLFS͕ॲཧ XPSLFS XPSLFS NBTUFS FQPMM@XBJU 

20. OHY@NSVCZ OHJOY FQPMM FWFOU FWFOU FWFOU DMJFOU DMJFOU DMJFOU BDDFQU

    BDDFQU BDDFQU FQPMM@XBJU  )551ϦΫΤετ࣌ͷNSVCZ࣮ߦ΋XPSLFSͰߦΘΕΔ XPSLFS XPSLFS NBTUFS MPDBUJPO
    IFBEFST
    \
    
    
    
    
    NSVCZ@DPOUFOU@IBOEMFS@DPEF
    
    
    
    
    
    
    
    
    
    S
    
    OHJOY3FRVFTUOFX
    
    
    
    
    
    
    
    
    SDPOUFOU@UZQF
    
    UFYUIUNM
    
    
    
    
    
    
    
    
    OHJOYSQVUT
    IFBEFST
    \SIFBEFST@JOBMM^CSCS
    
    
    
    
    
    ^

21. OHY@NSVCZͷ՝୊ SFRVFTU SFRVFTU SFRVFTU NSVCZ NSVCZ NSVCZ SFTQPOTF SFTQPOTF SFTQPOTF

    XPSLFS XPSLFS͋ͨΓͷNSVCZ࣮ߦͰඇಉظ*0͕ϒϩοΫ͞ΕΔ

22. ࠓ೔ͷओ୊ SFRVFTU SFRVFTU SFRVFTU NSVCZ NSVCZ NSVCZ SFTQPOTF SFTQPOTF SFTQPOTF

    XPSLFS ͜͏ͳͬͨʂʂ͍̍ͯ͏࿩Λ͠·͢

23. Ϧιʔε͕͏·͘׆༻Ͱ͖ͳ͍έʔε container.boot! loop do break if container.boot? sleep 1000 end

    OHY@NSVCZ͔ΒίϯςφϓϩηεΛىಈ͠ɺ
    ىಈ׬ྃΛTMFFQͰ଴ͭΑ͋͘Δॲཧ

24. ՝୊Λղܾ͢ΔϊϯϒϩοΩϯάΠϯλʔϑΣʔε /HJOY"TZODTMFFQ
    /HJOY"TZOD)551TVC@SFRVFTU

25. /HJOY"TZODTMFFQ

26. /HJOY"TZODTMFFQ SFRVFTU SFRVFTU NSVCZ SFTQPOTF SFTQPOTF MPPQ
    EP
    
    CSFBL
    JG
    DPOUBJOFSCPPU
    

    
    /HJOY"TZODTMFFQ
    
    FOE NSVCZ TMFFQ TMFFQ࣌ʹNSVCZͷϒϩοΫΛ։์͢Δ

27. /HJOY"TZODTMFFQ wOHY
    FWFOU
    MPPQ
    wOHY@BEE@UJNFS
    w'JCFS

28. OHJOY
    FWFOU
    MPPQ pOE
    UJNFS FQPMM@XBJU FYFD
    FWFOU
    IBOEMFS FYFD
    UJNFS
    
    IBOEMFS 
    ௚ۙͰൃՐ͢ΔλΠϚʔΛ୳͢
    
    *0ΠϕϯτΛ଴ͭ
    
    *0ΠϕϯτͷϋϯυϥΛ࣮ߦ͢Δ
    

    
    λΠϚʔͷϋϯυϥΛ࣮ߦ͢Δ

29. OHJOY
    FWFOU
    IBOEMFS wOHJOYͰ͸FWFOUʹIBOEMFSΛఆٛग़དྷΔ
    wUJNFSͷIBOEMFS͸ίʔϧόοΫͷΑ͏ͳΠϝʔδ
    wϢʔβʔͷ೚ҙͷΦϒδΣΫτΛ֨ೲɺऔΓग़͢͜ͱ ͕Մೳ

30. OHY@BEE@UJNFS ev = (ngx_event_t *)p; ev->handler = ngx_mrb_timer_handler; ev->data =

    re; ngx_add_timer(ev, (ngx_msec_t)timer); FWEBUBʹNSC@TUBUFͳͲ3VCZͷ৘ใΛอ࣋͠ɺ
    IBOEMFS࣮ߦ࣌ʹऔΓग़͠ɺ3VCZΛ࣮ߦ͢Δ

31. 3VCZͷίϯςΩετ͸Ͳ͏ͳΔ͔ʁ puts "1" Nginx::Async.sleep 1000 puts "2" /HJOY"TZODTMFFQ͕࣮ߦ͞Εɺ
    QVUT
    
    ͕࣮ߦ͞Εͯ͠·͏
    ˠ
    3VCZͷॲཧΛఀࢭ͢Δඞཁ͕͋Δ

32. 'JCFS

33. 'JCFS fiber = Fiber.new { puts 'Ruby is' Fiber.yield puts

    'Good' } fiber.resume fiber.resume ͍ΘΏΔίϧʔνϯͰɺ'JCFSZJFMEͷ࣌఺Ͱ
    ॲཧΛఀࢭͤ͞Δ͜ͱ͕ग़དྷΔɻ
    'JCFSSFTVNFʹΑͬͯॲཧΛ࠶։

34. 3VCZ
    JT
    (PPE

35. OHY@NSVCZ
    
    'JCFS *NBHF MPDBUJPO
    IFBEFST
    \
    
    
    
    
    NSVCZ@DPOUFOU@IBOEMFS@DPEF
    
    
    
    
    
    
    
    QVUT
    
    
    
    
    
    
    
    /HJOY"TZODTMFFQ
    
    
    
    
    
    
    
    QVUT
    
    
    
    
    
    
    ^ MPDBUJPO
    IFBEFST
    \
    

    
    
    
    
    NSVCZ@DPOUFOU@IBOEMFS@DPEF
    
    
    
    
    
    
    
    'JCFSOFX
    EP
    
    
    
    
    
    
    
    
    QVUT
    
    
    
    
    
    
    
    
    
    /HJOY"TZODTMFFQ
    
    
    
    
    
    
    
    
    
    QVUT
    
    
    
    
    
    
    
    FOE
    
    
    
    
    
    3VCZͷίʔυΛ'JCFSͰ҉໧తʹแΉ

36. OHY@NSVCZ
    
    'JCFS *NBHF
    
    EFG
    @OHY@NSC@QSFQBSF@pCFS OHJOY@IBOEMFS
    
    
    
    
    pCFS@IBOEMFS
    
    'JCFSOFX
    \
    OHJOY@IBOEMFSDBMM
    ^
    
    
    
    
    MBNCEB
    EP
    
    
    
    
    
    
    SFTVMU
    
    pCFS@IBOEMFSSFTVNF
    
    
    
    
    
    
    <pCFS@IBOEMFSBMJWF
    SFTVMU>
    

    
    
    
    
    FOE
    
    
    FOE
    'JCFSΛ͞Βʹ1SPDͰแΉ

37. /HJOY"TZODTMFFQ class Async class << self def sleep(*args) __sleep(*args) Fiber.yield

    end end end @@TMFFQ UJNFS࡞Δϝιου ಺Ͱ
    'JCMFSΠϯελϯεΛ$ͷίϯςΩετʹ
    อଘ͠ɺOHJOYͷλΠϚʔϋϯυϥʔʹઃఆޙɺ 'JCFSZJFMEͰ3VCZΛఀࢭ

38. OHY@BEE@UJNFS OHY@NSVCZ@UJNFS @IBOEFS 'JCFSZJFME 'JCFSSFTVNF 'JCFSΦϒδΣΫτΛίʔϧόοΫؔ਺ͷϙΠϯλͱڞʹ
    λΠϚʔʹηοτ λΠϚʔηοτ࣌఺Ͱ3VCZͷίϯςΩετΛఀࢭ͠ɺOHJOYͷ
    ΠϕϯτϧʔϓΛ࠶։ λΠϚʔΠϕϯτൃՐ࣌ʹ࣮ߦ͞ΕɺλΠϚʔΠϕϯτ͔Β
    

    3VCZͷίϯςΩετΛऔΓग़͢ 3VCZͷ࣮ߦΛ࠶։͢Δ /HJOY"TZOD4MFFQ

39. /HJOY"TZOD)551TVC@SFRVFTU

40. OHY@IUUQ@TVCSFRVFTU location / { # subrequest } location /subreqest {

    puts "hello" } # http://localhost/ => hello ͋ΔϩέʔγϣϯʹདྷͨϦΫΤετΛ
    ଞͷϩέʔγϣϯʹϦΫΤετͨ݁͠ՌͰ
    Ԡ౴͢ΔΑ͏ͳ࢖͍ํ

41. SFRVFTU SFRVFTU NSVCZ SFTQPOTF SFTQPOTF NSVCZ ϦΫΤετΛ౤͛ΔͱϒϩοΫΛ։์͠ɺ
    Ϩεϙϯε࣌ʹίʔϧόοΫΛड͚औΓ࠶։ TVCSFRFTU 3FRVFTU

    3FTQPOTF /HJOY"TZOD)551TVC@SFRVFTU

42. /HJOY"TZOD)551TVC@SFRVFTU
    
    3FEJT location / { # subrequest /redis } location /redis

    { puts redis get key } 3FEJTͷϦΫΤετ଴ͪ࣌ؒ΍
    ֎෦"1*ΛOHY@NSVCZͰ࣮ߦ͢Δ Α͋͘Δέʔε

43. /HJOY"TZOD)551TVC@SFRVFTU def sub_request(location, query_param = nil) if query_param.is_a?(Hash) __sub_request(location, ::nginx::Utils....)

    elsif query_param.is_a?(String) __sub_request(location, query_param) elsea __sub_request(location) end Fiber.yield end TMFFQͱಉ͘͡ɺ@@TVC@SFRVFTUͰ
    ίʔϧόοΫΛઃఆ͠ɺ'JCFSZJFME

44. /HJOY"TZOD)551TVC@SFRVFTU ps->handler = ngx_mrb_async_http_sub_request_done; ps->data = actx; if (ngx_http_subrequest(r, actx->uri,

    args, &sr, ps, NGX_HTTP_SUBREQUEST_IN_MEMORY) != NGX_OK) { mrb_raise(mrb, E_RUNTIME_ERROR, "ngx_http_subrequest failed for http_sub_rquest method"); } ίʔϧόοΫΛઃఆ͠ɺαϒϦΫΤετΛ࣮ߦ͢Δ

45. /HJOY"TZOD)551TVC@SFRVFTU static ngx_int_t ngx_mrb_async_http_sub_request_done(ngx_http_request_t *sr, void *data, ngx_int_t rc) {

    ngx_mrb_async_http_ctx_t *actx = data; ngx_mrb_reentrant_t *re = actx->re; ngx_http_mruby_ctx_t *ctx; re->r = sr->parent; ... ίʔϧόοΫͰฦ٫͞ΕΔOHY@IUUQ@SFRVFTU@Uߏ଄ମ˞͔Β͸
    αϒϦΫΤετͷϨεϙϯεϘσΟ΍ϔομ͕औಘͰ͖ͳ͍ ˞֤ΠϕϯτͰ࣋ͪճΒΕΔɺϦΫΤετͷ৘ใ

46. XBJUJOH
    TVCSFRVFTU pOBMJ[F
    CPEZ
    pMUFS /HJOY"TZOD)551TVC@SFRVFTU NBJO
    SFRVFTU
    OHY@IUUQ@SFRVFTU@U TVC
    SFRVFTU
    OHY@IUUQ@SFRVFTU@U PUIFS
    FWFOU OHY@IUUQ@SFRVFTU@UNBJO pOJTI
    SFRVFTU

    NSVCZ αϒϦΫΤετͷϨεϙϯε͸ɺϝΠϯϦΫΤετͷ
    ώʔϓʹॻ͍ͯ͋͛Δඞཁ͕͋Δ

47. /HJOY"TZOD)551TVC@SFRVFTU location /async_http_sub_request { mruby_rewrite_handler_code ' Nginx::Async::HTTP.sub_request "/sub_req_dst" res =

    Nginx::Async::HTTP.last_response nginx.rputs res.body '; } Ϩεϙϯεͷड͚औΓ͸ϝΠϯϦΫΤετͷ(FUUFSΛ௨ͯ͠ɺ αϒϦΫΤετ͕ॻ͍ͨώʔϓͷ஋Λऔಘ

48. ੑೳධՁ

49. IUUQTICNBUTVNPUPSKQFOUSZ

50. ଌఆ؀ڥ w.BD#PPL1SP
    .JE
    w$16
    ()[
    *OUFM
    $PSF
    J
    w.FNPSZ
    (#
    w7JSUVBM#PY
    w$16
    $PSF
    w.FNPSZ
    (#
    w04
    6CVOUV
    9FOJBM

51. TMFFQ
    NTFD
    SFUVSO
     MPDBUJPO
    "
    CMPDLJOH
    IUUQ
    SFRVFTU MPDBUJPO
    #
    OPOCMPDLJOH
    
    IUUQ
    SFRVFTU BC $

    ab -n 10000 -c 100 http://127.0.0.1:58080/ PSJHJOʹ)551ϦΫΤετ͢Δ؀ڥ IUUQ
    SFRVFTU IUUQ
    SFRVFTU

52. OPOCMPDLJOH͕ഒఔ౓ߴ଎Ͱ͋Δ CMPDLJOH
    IUUQ
    SFRVFTU OPOCMPDLJOH
    IUUQ
    SFRVFTU 3FRVFTUT
    QFS
    TFDPOE
    
    
    
    
    <TFD>
    NFBO
    5JNF
    QFS
    SFRVFTU
    
    
    
    
    
    
    
    <NT>
    5JNF
    QFS
    SFRVFTU
    
    
    
    
    
    
    
    <NT>
    5SBOTGFS
    SBUF
    
    
    
    
    
    
    
    
    
    
    <,CZUFTTFD>
    SFDFJWFE
    3FRVFTUT
    QFS
    TFDPOE
    
    
    
    
    <TFD>
    

    NFBO
    5JNF
    QFS
    SFRVFTU
    
    
    
    
    
    
    
    <NT>
    
    5JNF
    QFS
    SFRVFTU
    
    
    
    
    
    
    
    <NT>
    
    5SBOTGFS
    SBUF
    
    
    
    
    
    
    
    
    
    
    <,CZUFTTFD>
    SFDFJWFE

53. ࠷ޙʹ

54. NSVCZ࠷ߴʂʂ̍ NSVCZʹΑͬͯΤϯδχΞͱͯ͠ɺ
    Ұஈਂ͘જΕΔΑ͏ʹͳͬͨ

55. 5IBOLZPV ࠷৽ͷ࠾༻৘ใΛνΣοΫˠ !QC@SFDSVJU