OSCON 2012: ql.io and Node.js

OSCON 2012 (July - Portland, OR) presentation by Subbu Allamaraju and myself on ql.io and Node.js

Transcript

1. node.js and ql.io Build Your Own HTTP APIs for Agility and Scale OSCON July 20, 2012 1  
2. Subbu Allamaraju @sallamar github.com/s3u 2  
3. Jon LeBlanc @jcleblanc github.com/jcleblanc 3  
4. How to consume HTTP APIs cheaply and efficiently 4  
5. 5   curl  -­‐X  <HTTP  method>  <URI>    
6. Real code (randomized)
15. Find things from A For each thing, find details from B For each thing, find more details from C Merge results Use case: 15  
16. Find products Find dominant categories of products Look up category info Merge categories with products Use case: 16  
17. Get stuff from A If A is down, try from B Annotate stuff with other stuff from C Ignore some things from the stuff Join all Use case: 17  
18. Producers   Client [Really important client] Why don't you give me an API optimized for my use cases? Server [Really important producer] Thanks. Get a number and stand in the line! 18  
19. Producers   Client Server [Really important producer] Thanks. Get a number and stand in the line! Who gets to decide the right thing? 19   [Really important client] Why don't you give me an API optimized for my use cases?
20. Build Your Own Optimized APIs 20  
21. 21   https://github.com/ql-io/ql.io Platform Engineering
22. A domain specific language for HTTP client programming 22  
23. cut down lines of code reduce no of requests save bandwidth 23  
25. http://ql.io/console 25  
26. 26   Server Web Node.js ql.io Installation Modes
27. 27   curl  http://<host>/q?s=query  
28. As a Standalone Server Node Host ql.io Data (internal ) Data (externa l)
29. #  As  a  node.js  module   npm  install  ql.io-­‐engine      
30.   //  Use  ql.io  from  node.js   var  Engine  =  require('ql.io-­‐engine');   var  engine  =  new  Engine({    //OPTIONS   });     var  script  =  '…';   engine.execute(script,  function(emitter){          emitter.on("end",  function(err,  res){                  …          });   });      
31. Language:  Defining  a  Data  Source   Include  in  .ql  file   Include  in  Request  
32. Example:  Mustache  Templates  
33. Example:  jQuery  for  Cross  Domain  Reqs  
34. Let’s Do It!
35. 1.  Interop via HTTP 2.  SQL inspired 3.  Implicit orchestration 4.  Failure modes 5.  Consumer oriented 35  
36. 36   code https://github.com/ql-io/ql.io docs/demos http://ql.io https://github.com/jcleblanc/api-masher blog http://ql-io.github.com