OSCON 2012: ql.io and Node.js

Transcript

1. node.js and ql.io Build Your Own HTTP APIs for Agility

   and Scale OSCON July 20, 2012 1  

2. Subbu Allamaraju @sallamar github.com/s3u 2  

3. Jon LeBlanc @jcleblanc github.com/jcleblanc 3  

4. How to consume HTTP APIs cheaply and efficiently 4  

5. 5   curl  -­‐X  <HTTP  method>  <URI>    

6. Real code (randomized)

7. 7  

8. 8  

9. 9  

10. 10  

11. 11  

12. 12  

13. 13  

14. 14  

15. Find things from A For each thing, find details from

    B For each thing, find more details from C Merge results Use case: 15  

16. Find products Find dominant categories of products Look up category

    info Merge categories with products Use case: 16  

17. Get stuff from A If A is down, try from

    B Annotate stuff with other stuff from C Ignore some things from the stuff Join all Use case: 17  

18. Producers   Client [Really important client] Why don't you give

    me an API optimized for my use cases? Server [Really important producer] Thanks. Get a number and stand in the line! 18  

19. Producers   Client Server [Really important producer] Thanks. Get a

    number and stand in the line! Who gets to decide the right thing? 19   [Really important client] Why don't you give me an API optimized for my use cases?

20. Build Your Own Optimized APIs 20  

21. 21   https://github.com/ql-io/ql.io Platform Engineering

22. A domain specific language for HTTP client programming 22  

23. cut down lines of code reduce no of requests save

    bandwidth 23  

24. 24  

25. http://ql.io/console 25  

26. 26   Server Web Node.js ql.io Installation Modes

27. 27   curl  http://<host>/q?s=query  

28. As a Standalone Server Node Host ql.io Data (internal )

    Data (externa l)

29. #  As  a  node.js  module   npm  install  ql.io-­‐engine  

       

30.   //  Use  ql.io  from  node.js   var  Engine  =

     require('ql.io-­‐engine');   var  engine  =  new  Engine({    //OPTIONS   });     var  script  =  '…';   engine.execute(script,  function(emitter){          emitter.on("end",  function(err,  res){                  …          });   });      

31. Language:  Defining  a  Data  Source   Include  in  .ql  file

      Include  in  Request  

32. Example:  Mustache  Templates  

33. Example:  jQuery  for  Cross  Domain  Reqs  

34. Let’s Do It!

35. 1.  Interop via HTTP 2.  SQL inspired 3.  Implicit orchestration

    4.  Failure modes 5.  Consumer oriented 35  

36. 36   code https://github.com/ql-io/ql.io docs/demos http://ql.io https://github.com/jcleblanc/api-masher blog http://ql-io.github.com