Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up
for free
Scaling CANDDi
coldclimate
July 29, 2013
Technology
0
79
Scaling CANDDi
for
http://www.supermondays.org/
coldclimate
July 29, 2013
Tweet
Share
More Decks by coldclimate
See All by coldclimate
coldclimate
0
66
coldclimate
3
3.4k
coldclimate
0
43
coldclimate
0
83
coldclimate
1
120
Other Decks in Technology
See All in Technology
clustervr
0
190
110y
3
730
pinboro
1
1.5k
shimacos
2
320
ocise
0
130
kappa4
4
2.2k
fujiihda
8
1k
pinboro
0
2.1k
natsusan
0
160
clustervr
0
200
suzukiry
0
210
cygames
1
360
Featured
See All Featured
samlambert
237
9.9k
denniskardys
220
120k
brianwarren
83
4.7k
jmmastey
8
530
keithpitt
401
20k
zenorocha
297
39k
addyosmani
494
110k
rocio
155
11k
addyosmani
310
21k
andyhume
62
3.4k
roundedbygravity
241
21k
brad_frost
156
6.4k
Transcript
Scaling CANDDi oli wood @coldclimate
history
measure things that matter
back of a fag packet if good enough
have somewhere to test which is not live
use realistic data
ab/siege + ec2 instances
there are no silver bullets
aim for a silver shotgun cartridge
define the scenarios
build a pipeline view
identify symptoms but solve problems
symptoms are what you can see
problems are what you can solve
bad new: the problem is your code
good news: thus you can fix it
do less big things less often
do frequent things much faster
avoid waiting
pull less data
cache the painful things
cache: in memory
cache: redis/memcache
cache: url/browser cache
hunt collisions
use the tools
iostat
sar -P
strace -p
iftop
xdebug + webgrind
statsd
mongotop
mongosniff
tail -100000 mongodb. log | awk -F' ' '{print $NF}'
| grep ms$ | sed 's/ms//g' |sort -n | tail -20 | xargs -I {} grep {} ms$ mongodb.log
and the big gestures
nginx
nodejs
redis
aim: loosely coupled components which are horizontally scalable both on
box and by box
BULLSHIT
aim: fast enough for medium term business needs
aim: not to waste time in a geek circle jerk
result: 10x the throughput
result: 2000 non- trivial inbound events a second
good luck