Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Boatyard @ EmpireJS 2012
Search
Lucas Hrabovsky
October 22, 2012
Programming
110
0
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Boatyard @ EmpireJS 2012
https://github.com/exfm/node-boatyard
Lucas Hrabovsky
October 22, 2012
Transcript
37 slides
BOATYARD @__lucas CTO EX.FM Monday, October 22, 12
MUSIC ex.fm = ENVIRONMENT Monday, October 22, 12
HOW DO I PLAY THIS SONG? WHAT ARE MY FRIENDS
LISTENING TO? HAVE YOU HEARD THE NEW DR. DOG ALBUM YET? Monday, October 22, 12
platforms iOS Android Web App Mobile Web Chrome Extension Firefox
Extension Safari Add-on 3rd Party Apps Televisions Monday, October 22, 12
Monday, October 22, 12
PROB LEMS Monday, October 22, 12
MONGO TO S3 50M+ DOCS 90GB+ RAW DATA Monday, October
22, 12
cred: http://karmasphere.com/amazon-emr ELASTIC MAPREDUCE Monday, October 22, 12
HADOOP + MONGODB Monday, October 22, 12
SCRIPT IT OURSELVES Monday, October 22, 12
Monday, October 22, 12
Monday, October 22, 12
write a function and execute it on a bunch of
instances. Monday, October 22, 12
swell if it was JS. Monday, October 22, 12
BOATYARD BOATYARD alert(“toot.”) Monday, October 22, 12
2 functions + metadata = 1 BOAT Monday, October 22,
12
PARTITIONER.JS create chunks Monday, October 22, 12
TASK.JS process chunks Monday, October 22, 12
METADATA hosts stowaways dependencies no pom.xml Monday, October 22, 12
CAPTAIN MATES HANDS Monday, October 22, 12
CAPTAIN Create partitions Hand them out to mates Keep track
of what’s what Monday, October 22, 12
MATE Talk to captain for hands Cluster messages with hands
Monday, October 22, 12
HAND Talks only to mate Killed when everything’s done Does
the actual work acquire → progress → release Monday, October 22, 12
$> cd myboat $> yard launch you clouds Monday, October
22, 12
$> cd myboat $> yard launch you clouds Monday, October
22, 12
$> cd myboat $> yard launch you clouds Monday, October
22, 12
WHY Monday, October 22, 12
GET THINGS DONE Monday, October 22, 12
WTF DEPLOY? Monday, October 22, 12
JIFASNIF Monday, October 22, 12
Monday, October 22, 12
STRESS TEST Monday, October 22, 12
MOVE DATA Monday, October 22, 12
WEB CRAWLER Monday, October 22, 12
ANALYSIS Monday, October 22, 12
? Monday, October 22, 12
@__lucas THANKS github/exfm/ node-boatyard Monday, October 22, 12
More Decks by Lucas Hrabovsky
See All by Lucas Hrabovsky
Compass Plugins - Philly MUG, May 24th 2018
__lucas
0
59
Electron at MongoDB: LibertyJS 2016
__lucas
0
290
standalone executables for node.js apps
__lucas
1
70
Cloudsearch @ ex.fm
__lucas
0
110
100% JS @ LXJS 2012
__lucas
2
220
mongodb + ex.fm @ MongoPGH 2012
__lucas
2
1.1k
AWS Customer Presentation: exfm - How exfm uses AWS and Amazon CloudSearch- AWS Summit 2012 - NYC
__lucas
2
280
Other Decks in Programming
See All in Programming
まずはコードより業務と向き合う:テーブル解体のためにPdMを呼んだ話
sakawe_ee
0
270
imagewebp()の向こう側: WebPはなぜ JPEG・PNGより軽いのか
yuzneri
0
150
AIが実装を担う時代の「技術設計」と「チームマネジメント」
kamina_zzz
2
440
はじめてのKubernetesコントリビューション
nasa9084
0
320
エージェントの管理もエージェントに – herdr-core と自作バックログで作る司令塔 –
nearme_tech
PRO
1
110
AIが生成したコードは読むべきか?抽象化設計とコードの品質保証 / abstraction-design-and-quality
minodriven
17
9.5k
正解の無い問題を 「できるだけ上手く」解く ヒューリスティックで感性を磨こう。〜現実課題をプログラミングで解きあうコミュニティについて〜
allegrogiken
0
110
はじめてのPLATEAU
nokonoko1203
1
670
なぜ私たちは「現時点では」KMPの導入を見送ったのか
chigichan24
1
630
Crash Auto Pipelines
veronikapj
1
450
Skills Are the New npm [AAIF Bengaluru]
shivamsaraswat
0
120
例外からRich Errorsまで Kotlinエラーハンドリングの進化を読み解く
shiita0903
0
240
Featured
See All Featured
Documentation Writing (for coders)
carmenintech
77
5.6k
Bootstrapping a Software Product
garrettdimon
PRO
306
120k
Lightning talk: Run Django tests with GitHub Actions
sabderemane
0
330
How to build an LLM SEO readiness audit: a practical framework
nmsamuel
2
990
Reflections from 52 weeks, 52 projects
jeffersonlam
356
22k
Darren the Foodie - Storyboard
khoart
PRO
5
4.1k
The Straight Up "How To Draw Better" Workshop
denniskardys
239
140k
Discover your Explorer Soul
emna__ayadi
2
1.3k
How to Ace a Technical Interview
jacobian
280
24k
Performance Is Good for Brains [We Love Speed 2024]
tammyeverts
12
2k
Typedesign – Prime Four
hannesfritz
42
3.2k
No one is an island. Learnings from fostering a developers community.
thoeni
21
3.9k