dRuby2016

RubyKaigi2016

Transcript

1. ͠͹Β͓͘଴͍ͪͩ͘͞ ✓ ͝ཡͷεϙϯαʔͷఏڙ ʹΑΓ͓ૹΓ͠·͢
2. slide sponsors 044
   (BUFח⿫⸇׃״ֲ
   ׅ
   ջأذ؍٦ـؤռ䋆涪㡰⚥
   !NB
   ؔزشה3VCZדֶ䖉׍׃גְתׅկ
   !NJXB
   ؔزشה3VCZדֶ䖉׍׃גְתׅկ
   !NBNF
   歍׃鴥׫כUPSVCZEPPSLFFQFSKQ
   ַ׵
   !
   WFTUJHF@
   ؔزشה3VCZծ➙䎃כְְ괏ス  ך傈
   !1613-
   虠加歕ջ梾楤㼔Ꟍ
   枾䒍莔ռ׀勻䏄ֶ䖉׍׃גֶ׶תׅ
   !PHJKVO
3. more slide sponsors Ⰻ鿇׌׏ה䙼׏ג׋??
   ![[BL@KQ
   E3VCZח״׷ⴓ侔٥8FCفؚٗٓىؚٝ
   ؔ٦ي爡
   F#PPL
   4UPSF
   IUUQFTUPSFPINTIBDPKQUJUMFT1
   
   !IJTBTIJN
   
   ׫זׁתծTFLJ眍׾ֶ嚂׃׫ֻ׌ְׁկ䊛䃵歲꥔ך倯כծLBXBTBLJSCծ ZPLPIBNBSC׾ֶ鑐׃ֻ׌ְׁկ,ذٖؽך飑ⰅכծTFLJׁ׿穗歋ד׀湱锑ְ׋ ׌ֽ׷ה׀⼿⸂׃תׅկ
   !UTVCPJ
   &NCFS4BQQPSP
   ׾״׹׃ֶֻיְָ׃תׅ
   խխխխխխխ IUUQTXXXGBDFCPPLDPNHSPVQTFNCFSTBQQPSP
   !USJDLOPUFT
   ְִ٦ְ✌✌؟ٝٓ؎ؤ⳿ꨡד
   3VCZ8PSME
   $POGFSFODF
   遤ֲֿ ׈٦
   !ZBODZB
4. dRuby in the last century seki@ruby-lang.org
5. @m_seki Rubyίϛολ ERB, dRuby, Rindaͷஶऀ લ࠲͕Matz - Ruby committer - Author of ERB, dRuby, Rinda
6. Agenda dRubyͷੜཱ͍ͪ dRubyͷ঺հ ͜Ε͔Β - The birth of dRuby - Introduction of dRuby - Future
7. 1999 [ruby-list:15406] 1st dRuby
8. 1st dRuby on T-shirts TV[VSJKQN@TFLJ
9. 2005 - ·ͩॳ࡮Γങ͑·͢ dRuby ʹΑΔ
   ؔ
   কढ़
   ஶ
   ෼ࢄ ɾ Web ϓϩάϥϛϯά
   First printing from 2005 (Still available)
10. ΋ͬͱΘ͔Γ΍͘͢΄Ίͯʂ Praise it more directly, please!
11. 2012 (-2014 ઈ൛) Publication from 2012 (Become out of print in 2014)
12. 2000 Perl/Ruby Conference (Kyoto) 2000೥ ࠷ॳͷߨԋ͸͜ͷձ৔ ײܹ͍ͯ͠Δ - Perl/Ruby Conference (Kyoto) - The first talk I gave was in year 2000 at this place. - I am impressed.
13. 2000-2016 ࠓ೔͸ಉ͡ձ৔Ͱ·ͨdRubyͷ࿩Λ͍ͨ͠ I would like to give a talk about dRuby again in the same place today.
14. ͠͹Β͓͘଴͍ͪͩ͘͞ ✓ 
    ✓ 4MJEF
    TQPOTPST
    ✓ "HFOEB please wait for a moment
15. OOPARTS I was just reminded of dRuby's OOPARTS-ness
16. OOPARTS
17. dRuby͸Ͳ͔͜Β͖ͨͷ dRubyҎલ (Before dRuby: BD) Where did dRuby come from? - Before dRuby (BD)
18. BD8͘Β͍ͷ͜ͱ ੲͬΆ͍UNIXΛ࢖ͬͨ૊ΈࠐΈγεςϜ খ͞ͳσʔϞϯͷ૊Έ߹Θͤ fork, pipe, signal, SystemV IPC select()ͳ͔ͬͨ From the old days (BD8) - Embedded system using old-fashioned UNIX - Combination of tiny daemons - fork, pipe, signal, SystemV IPC - select() did not exist
19. BD8͘Β͍ͷ͜ͱ ܭଌ૷ஔ܈Λ੍ޚ ૷ஔ͔ΒσʔλΛऔΔ/੍ޚ͢Δͨ͘͞Μ ͷσʔϞϯͱͦΕΛ·ͱΊΔσʔϞϯ ৘ใΛՄࢹԽ͢ΔΞϓϦέʔγϣϯ ϓϩηεΛ෼͚Δඞવੑ͕͋ͬͨ From the old days (BD8) - Controlling a group of measurement devices - Many daemons that extract and control data from devices, and a daemon that controls them in turn - Need to divide between processes
20. CGIͷ୯७ͳੈք (BD5) ԶϚΠΫϩαʔϏε࣌୅ request/response, stateless ͍ΖΜͳγεςϜΛCGIͰॻ͖௚ͨ͠ Perl, AppleScript A simple world of CGI - My Microservices era - request/response, stateless - Rewrote various systems using CGI
21. Ruby & shttpsrv (BD1) 1998-9 Ruby & shttpsrvʹग़ձ͏ 1998-9, Met Ruby & shttpsrv
22. shttpsrv RubyͰॻ͔ΕͨHTTPαʔό WEBrickΑΓͣͬͱલ খ͍͞ - Web server written in Ruby - Before WEBrick - Small and extensible
23. HTTPΛϓϩηεʹຒΊࠐΉ খ͞ͳΞϓϦʹWebαʔόΛຒΊࠐΉ ΞϓϦؒΛHTTPͰͭͳ͍Ͱָ͠ΜͰͨ Embedding HTTP into processes - Embedding web server into small apps - Had fun Application communication via HTTP
24. ͳΜ͔ؾʹೖΒͳ͍ ͍ͭ΋RubyͱWebͷੈքͷ຋༁࡞ۀͯͨ͠ HTTPʹ͓͚ΔΦϒδΣΫτͷަ׵ͷ੍໿ Server - Clientͷݻఆతͳؔ܎ ϝιουͱ͍͏ΑΓؔ਺ίʔϧ Not so cool because... - Routine work translating between Ruby and the Web world - HTTP's restriction on how to exchange objects - Fixed relation between Server and Client - More like a functional call rather than a method
25. RubyͰ࿩͍ͨ͠ Ruby ObjectͳΜ͔ͩΒɺRubyΆ͘࿩͍ͨ͠ Want to speak in Ruby - Given that they are Ruby objects, it is tempting to speak in Ruby-ish way
26. RubyʹؼΖ RubyͷΑ͏ʹৼΔ෣͏෼ࢄΦϒδΣΫτ RPCͰͳ͘RMI Rubyͷϝιουݺͼग़͠ΛsocketͰ֦ு Return to Ruby - Distributed objects acting like Ruby - No RPC, but RMI - Extending Ruby's method invocation with sockets
27. ϩϚϯ RMIΛࢥ͍͍͔ͭͯΒͷࢥߟ࣮ݧ ෼ࢄΦϒδΣΫτ͕͋Δ͔ͷΑ͏ͳԋग़ͱ͸ OOPLͱΦϒδΣΫτΈ͍ͨͳ... Romance - Thought-experiment since the idea of RMI - How to make it look like there are distributed objects - Something like OOP-language and objects
28. ͭ·Γ ؆୯௨৴ϥΠϒϥϦͰ͸ͳ͍ ௨৴Λ؆୯ʹ͢Δ͜ͱ͸ૂ͍ͬͯͳ͍ طଘͷRPCϓϩτίϧͷϥούʔͰ͸ͳ͍ ΋ͬͱ৘ॹతͳ΋ͷ In other words, Not a library that makes communication simple - It doesn't aim to make communication simple - It is not a wrapper of an already-existing RPC protocol - Something more poetic
29. ͠͹Β͓͘଴͍ͪͩ͘͞ ✓ 
    ✓ E3VCZલ࢙Λઆ໌ͨ͠
    ✓ ͔ͭ͗ΒE3VCZΛ঺հ please wait for a moment - Done: Pre-history of dRuby - Now, we are on to demonstration
30. dRubyͯͳʹʁ ෼ࢄΦϒδΣΫτγεςϜ ϓϩηεӽ͠ʹϝιου͕ݺ΂Δ ϓϩηεؒͰΦϒδΣΫτ͕ૹΕΔ What is dRuby? - Distributed Object System - Can Invoke methods in different process - Can send objects between process
31. ਐΊํ irbͷσϞͰجຊతͳಈ࡞Λઆ໌ ΈΜͳTerminalΛ2ͭ༻ҙͯ͠ʂ unixͷਓ΋windowsͷਓ΋! Outline - Basis using irb demo - Please prepare two teminals!
32. dRubyͷ͓͔͛ͰWindowsͰ ΋࣮ݧͰ͖ΔΑʂ Thanks to the dRuby book, gets on Windows no longer blocks other threads.
33. Demo1 Starting up dRubyΛ࢖͏ͨΊͷ४උ ؆୯ͳRMI Key Value Store Demo1 Starting Up - Preparing to use dRuby - A simple RMI - Key-Value Store
34. Hashαʔό Hash server (oso-matz) client (jushi-matz) Hash server kvs['greeting'] = 'Hello, World.'
35. start_service start_serviceͰ͸͡Ί·͢ URIͱΦϒδΣΫτΛࢦఆͯ͠ެ։ ໌ࣔతͳެ։ DRb.start_service('druby://localhost:54321', {}) DRb.uri #=> 'druby://localhost:54321' DRb.front #=> {} start_service - Begin with start_service - Publicize URI and an object - Explicit publicizing
36. Proxy URI͔ΒProxyΛੜ੒ kvs = DRbObject.new_with_uri('druby://localhost:54321') Generates a proxy from a URI
37. ͨͩݺͿ͚ͩ ผϓϩηεͷϝιουݺͼग़͠ Hash#[]=(k, v) kvs['greeting'] = "Hello, World." Just call the method - Calling method in a different process
38. Hashαʔό DRb.start_service('druby://localhost:54321', {}) DRb.front #=> {} DRb.start_service kvs = DRbObject.new_with_uri('druby://localhost:54321') kvs['greeting'] = "Hello, World." DRb.front #=> {"greeting"=>"Hello, World."}
39. Demo1 DRb.start_service('druby://localhost:54321', {}) DRb.front DRb.start_service kvs = DRbObject.new_with_uri('druby://localhost:54321') kvs['greeting'] = "Hello, World."
40. ΍ͬͨ͜ͱ DRb.start_serviceͰ͸͡Ίͨ URIͰproxyΛͭͬͨ͘ ͋ͱ͸ݺͿ͚ͩ What we did - Started with DRb.start_service - Created a proxy with a URI - Then, we just called it
41. ͼͬ͘Γͯ͠ʂ dRubyͷ४උ͸start_service͚ͩ ΠϯλʔϑΣΠεఆٛෆཁ ੲ͸IDLఆٛ͢ΔγεςϜ͕ଟ͔ͬͨ Surprised, aren't you? - Only need to do start_service to prepare for dRuby - No need to declare interfaces - In the old days, many systems defined IDL
42. Demo2 Ͳ͕ͬͪαʔόʁ ҉໧తʹObjectΛެ։͠·͢ jushi-matzͷ $stdout Λoso-matz͕ݺͼ·͢ server / clientͷཱ৔͕ೖΕସΘΓ·͢ Demo 2 Which one is the server? - Implicitly publicize an object - oso-matz will call $stdout on jushi-matz - Server/client roles will switch
43. ΦϒδΣΫτΛૹΔ ϝιουͷҾ਺Ͱ$stdoutΛૹΔ ҉໧తʹެ։ kvs['outlet'] = $stdout Sending objects - Send $stdout as method arguments - Publicized implicitly
44. ٯస ϦϞʔτͷ$stdoutͷϝιουΛݺͿ ϗϯϞϊΛ͍࣋ͬͯΔํ͕αʔόʔ ϝιουΛݺͿํ͕ΫϥΠΞϯτ DRb.front['outlet'].class #=> DRb::DRbObject DRb.front['outlet'].puts('Hello, Again.') Reversal - Call $stdout methods on the remote - The one that has the read one is the server - The one that calls the method is the client
45. Demo2 Ͳ͕ͬͪαʔόʁ DRb.front['outlet'].class #=> DRb::DRbObject DRb.front['outlet'].puts('Hello, Again.') kvs['outlet'] = $stdout kvs['outlet'] #=> $stdout Demo2 Which one is the server?
46. Demo2 Ͳ͕ͬͪαʔόʁ kvs['outlet'] = $stdout kvs['outlet'] #=> $stdout DRb.front['outlet'].class #=> DRb::DRbObject DRb.front['outlet'].puts('Hello, Again.')
47. ΍ͬͨ͜ͱ jushi-matzͷ$stdoutΛoso-matzʹڭ͑ͨ oso-matz͸ͦΕʹputsͨ͠ jushi-matzͷ୺຤ʹҹࣈ͞Εͨ What we did - Taught oso-matz about $stdout on jushi-matz - oso-matz did puts on it - Printed on a terminal on jushi-matz
48. ͳʹ͕͓͖ͨʁ ҉໧తͳެ։ $stdoutΛࣗಈతʹproxyʹऔΓସ͑ͨ Marshal.dumpͷՄ൱͕৚݅ dumpՄೳ ➡ ෳ੡ dumpෆՄೳ ➡ proxy What happened? - Implicit publicization - Replaced $stdout with proxy automatically - Depends on the availability of Marshal.dump - dumpable => duplication - not dumpable => proxy
49. Marshal.dump 'outlet'͸dumpͰ͖Δ ෳ੡ $stdout͸dumpͰ͖ͳ͍ proxy Marshal.dump - 'outlet' is dumpable - duplicating - $stdout cannot be dumped - proxy kvs['outlet'] = $stdout # kvs.[]=('outlet', $stdout)
50. ͜͜Ͱͷԋग़ RubyͳΒҾ਺΍໭Γ஋͕ෳ੡͞Εͳ͍ dRubyͰ΋͢΂ͯproxyʹ͢Δ΂͖ʁ ౰વͦ͏ࢥ͏ true, false, nil, ਺... ͜Ε΋proxyʹ͢Δ΂͖ʁ ͏ʔΜ Some thinking - In Ruby, arguments and return values are not duplicated - Should dRuby proxy everything? - Yes, of course - true, false, nil, numbers, ... should it also proxy them? - Mmm
51. ࣗવʹݟ͑Δଥڠ΋ඞཁͩ ӬԕʹProxyͰ͸஋͕खʹೖΒͳ͍ Ͳ͔͜ʹڥք͕ඞཁͩ Marshal.dumpʹͨ͠ ͳΜ͔͍͍ײ͡ʹಈ͘ Natural compromise - Using proxy, we will never get the value - We need a border somewhere - Made it using Marshal.dump - Works good
52. OOPͬΆ͞ ΦϒδΣΫτ͕૬ޓʹݺͼ߹͑Δ͜ͱ How to make it look OOP-ish - Let objects call each other
53. ruby-list:15406 1st sampleɹ require 'drb.rb' class DRbEx def initialize @hello = 'hello' end def hello @hello end def sample(a, b, c) a.to_i + b.to_i + c.to_i end end if __FILE__ == $0 DRb.start_service('druby://localhost:7640', DRbEx.new) DRb.thread.join end require 'drb.rb' class DRbEx2 def initialize(n) @n = n end def _dump raise TypeError, 'can\'t dump' end def to_i @n.to_i end end if __FILE__ == $0 DRb.start_service('druby://localhost:7950') ro = DRbObject.new(nil, 'druby://localhost: 7640') p ro.hello p ro.sample(DRbEx2.new(1), 2, 3) p ro.sample(1, ro.sample(DRbEx2.new(1), 2, 3), DRbEx2.new(3)) end
54. OOPͬΆ͞ ΠςϨʔλ΋ಉ͡࢓૊ΈͰಈ͘Α block ro.each do |it| foo(it) end How to make it look OOP-ish - Iterators also work the same way - block
55. Demo3 ෼ࢄQueue QueueΛ࢖ͬͯ଴ͪ߹Θͤ͠·͢ ϓϩηεؒͰpush/pop Demo 3 Distributed Queue - Wait using queue - push/pop between processes
56. ଴ͪ߹Θͤ QueueΛ࢖ͬͯ଴ͪ߹Θͤ jushi-matz͔Βͷσʔλͷ౸ணΛ଴ͪ·͢ Waiting - Waiting using queue - Wait for the data from jushi-matz to arrive
57. ४උ QueueΛ࡞ͬͯHashʹೖΕ·͢ popͯ͠଴ͪ·͢ queue = Queue.new DRb.front['queue'] = queue queue.pop Preparation - Create a queue, and put it in a Hash - Pop, and wait
58. σʔλΛૹΔ Hashαʔό͔ΒQueueΛखʹೖΕΔ pushͰσʔλΛૹΓ·͢ queue = kvs['queue'] queue.push(1.0) Sending data - Obtain a queue from a hash server - send a data
59. Demo3 ෼ࢄQueue queue = Queue.new DRb.front['queue'] = queue queue = kvs['queue'] queue.push(1.0) queue.pop #=> 1.0 queue.pop #(blocked) queue.push(2.0) queue.pop #=> 2.0 (cont.) Demo 3 Distributed Queue
60. Demo3 ෼ࢄQueue queue = Queue.new DRb.front['queue'] = queue queue.pop queue.pop queue = kvs['queue'] queue.push(1.0) queue.push(2.0)
61. ͳʹ͕͓͖ͨʁ HashαʔόΛհͯ͠QueueΛखʹೖΕͨ Name Serivce QueueΛ࢖ͬͯೋਓ͕଴ͪ߹Θͤͯͨ͠ What happened? - A queue was obtained via a hash server - Two people were waiting for each other using a queue
62. ͜͜Ͱͷԋग़ Queue, Mutex, Monitor ... ThreadಉظϝΧχζϜ΋ͦͷ··࢖͑Δ Some thoughts here - Queue, Mutex, Monitor, ... - We can use the Thread-synchronization mechanism as is
63. dRuby͕޲͘ঢ়گ ण໋ͷҧ͏৘ใΛѻ͏ ଴ͪ߹ΘͤΛσβΠϯ͢Δ͜ͱ͕ଟ͍ Scenarios suited for dRuby - Handling information of different life span - A system of waiting
64. BD8͘Β͍ͷ͜ͱ ܭଌ૷ஔ܈Λ੍ޚ ૷ஔ͔ΒσʔλΛऔΔ/੍ޚ͢Δͨ͘͞Μ ͷσʔϞϯͱͦΕΛ·ͱΊΔσʔϞϯ ৘ใΛՄࢹԽ͢ΔΞϓϦέʔγϣϯ ϓϩηεΛ෼͚Δඞવੑ͕͋ͬͨ From the old days (BD8) - Controlling a group of measurement devices - Many daemons that extract and control data from devices, and a daemon that controls them in turn - Need to divide between processes
65. Twitterͷ৔߹ In case of Twitter
66. Prototyping Twitter ॳظ͸dRuby/RindaͩͬͨΒ͍͠ ͍·͸࢖ͬͯͳ͍ ࣗ෼ͷαʔϏε΋dRubyͰ͸͡Ίͯ࠷ޙʹ͸ ࢖Θͳ͘ͳΔ͜ͱ͕͋Δ ར༻͞Εͯޮ཰͋͛Δඞཁ͕Ͱ͔ͯΒ - It looks like they had used dRuby/Rinda in the beginning. - But not now. - Even I sometimes start some services using dRuby, ending up not using it. - It happened since my services gained popularity, and I needed to make them more efficient.
67. ঺հͷ·ͱΊ جຊతͳdRubyͷ࢖͍ํΛ঺հͨ͠ ४උ RMI Queue ෼ࢄΦϒδΣΫτΆ͔ͬͨʁ Interim summary - Introduced basic uses of dRuby - Preparation - RMI - Queue - Looked like distributed objects?
68. ͠͹Β͓͘଴͍ͪͩ͘͞ ✓ 
    ✓ E3VCZͷσϞΛͨ͠
    ✓ ෼ࢄΦϒδΣΫτΆ͍ʁ
    ✓ ଓ͖͸ॻ੶Ͱʂ
    ✓ ࣍͸ݴ͍༁ please wait for a moment - Did demo on dRuby - Looks like distributed objects? - Please buy the book for more information! - Next: the excuses
69. ͜Ε͔Β ௚͍ͨ͠ͱ͜Ζ ॳظͷ࣮૷ʹ໭͍ͨ͠ͱ͜Ζ͕͍͔ͭ͘ ςετ ܒ໤͢Δ From now on - Want to fix: - Several points to revert to the initial implementation - Tests - Enlighten people
70. ηΩϡϦςΟͬΆ͍ͷফ͍ͨ͠ ACL, insecure_method ... dRuby͸RMIͰϝιουݺͼग़͠ͷ֦ு ϝιουݺͼग़͠ͳͷͰ݀ͩΒ͚Ͱྑ͍ ةͳ͍΋ͷ͸ةͳ͘ݟ͑Δ΂͖ Want to hide security-ish things - ACL, insecure_method, ... - dRuby extends methods with RMI - It is okay to have loop holes since it is a method call - Dangerous things should look dangerous
71. UnitTest ڈ೥akr͞Μʹݴ͍༁ͨ͠ צҧ͍ͯͨ͠ Ұൠతʹ͸APIͷϝιου୯Ґʹॻ͘΋ͷ ͩͬͨΒ͍͠ ςετέʔεΛετʔϦʔϨϕϧͰॻ͘΂ ͖ͩͱࢥͬͯͨ - I made an excuse to akr last year. - I mistook it. - Turned out that in general, they should be written per API method. - I had thought they should be written at story levels.
72. ܒ໤͢Δ ·͓ͣ΋͠Ζ͕ͬͯ΋Β͏ ฒߦॲཧͷצॴ(ʁ)ʹؾ͍ͮͯ΋Β͏ Enlightening people - Have people enjoy it. - Let them realize the tips of parallel processing
73. ͠͹Β͓͘଴͍ͪͩ͘͞ ✓ 
    ✓ ඪ४ఴ෇Λଓ͚ͯ΋Β͏ Α͏ʹΞϐʔϧ͢Δ
    ✓ ΋͏ऴΘΓ
    ✓ εϥΠυӳ༁νʔϜʹ͓ ྱΛ͍͏ please wait for a moment - Appeal to have them continuously attached by default - Almost the end
74. History of dRuby (and me) 1999-3 ERB 1999-9 DRb 2003 committer 2010 pokemon-master 2000 Rinda 1998 started ruby 2006 - 2016 Ruby Kaigi
75. ·ͱΊ 2000೥ͱಉ͡৔ॴͰdRubyͷ࿩Λͨ͠ dRubyͷੜཱ͍ͪ dRubyͷ঺հ ͜Ε͔Β 21ੈل΋͓΋͠Ζ͕ͬͯ΋Β͑ΔͰ͠ΐ͏͔ Conclusion - I gave a talk on dRuby at the same place I did in year 2000. - Birth of dRuby - Introduction of dRuby - Future - Will people still have fun with dRuby in the 21st century?