Boatyard @ EmpireJS 2012

https://github.com/exfm/node-boatyard

Transcript

1. BOATYARD @__lucas CTO EX.FM Monday, October 22, 12
2. MUSIC ex.fm = ENVIRONMENT Monday, October 22, 12
3. HOW DO I PLAY THIS SONG? WHAT ARE MY FRIENDS LISTENING TO? HAVE YOU HEARD THE NEW DR. DOG ALBUM YET? Monday, October 22, 12
4. platforms iOS Android Web App Mobile Web Chrome Extension Firefox Extension Safari Add-on 3rd Party Apps Televisions Monday, October 22, 12
5. Monday, October 22, 12
6. PROB LEMS Monday, October 22, 12
7. MONGO TO S3 50M+ DOCS 90GB+ RAW DATA Monday, October 22, 12
8. cred: http://karmasphere.com/amazon-emr ELASTIC MAPREDUCE Monday, October 22, 12
9. HADOOP + MONGODB Monday, October 22, 12
10. SCRIPT IT OURSELVES Monday, October 22, 12
11. Monday, October 22, 12
12. Monday, October 22, 12
13. write a function and execute it on a bunch of instances. Monday, October 22, 12
14. swell if it was JS. Monday, October 22, 12
15. BOATYARD BOATYARD alert(“toot.”) Monday, October 22, 12
16. 2 functions + metadata = 1 BOAT Monday, October 22, 12
17. PARTITIONER.JS create chunks Monday, October 22, 12
18. TASK.JS process chunks Monday, October 22, 12
19. METADATA hosts stowaways dependencies no pom.xml Monday, October 22, 12
20. CAPTAIN MATES HANDS Monday, October 22, 12
21. CAPTAIN Create partitions Hand them out to mates Keep track of what’s what Monday, October 22, 12
22. MATE Talk to captain for hands Cluster messages with hands Monday, October 22, 12
23. HAND Talks only to mate Killed when everything’s done Does the actual work acquire → progress → release Monday, October 22, 12
24. $> cd myboat $> yard launch you clouds Monday, October 22, 12
25. $> cd myboat $> yard launch you clouds Monday, October 22, 12
26. $> cd myboat $> yard launch you clouds Monday, October 22, 12
27. WHY Monday, October 22, 12
28. GET THINGS DONE Monday, October 22, 12
29. WTF DEPLOY? Monday, October 22, 12
30. JIFASNIF Monday, October 22, 12
31. Monday, October 22, 12
32. STRESS TEST Monday, October 22, 12
33. MOVE DATA Monday, October 22, 12
34. WEB CRAWLER Monday, October 22, 12
35. ANALYSIS Monday, October 22, 12
36. ? Monday, October 22, 12
37. @__lucas THANKS github/exfm/ node-boatyard Monday, October 22, 12