Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Scaling CANDDi
coldclimate
July 29, 2013
Technology
0
150
Scaling CANDDi
for
http://www.supermondays.org/
coldclimate
July 29, 2013
Tweet
Share
More Decks by coldclimate
See All by coldclimate
You don't scale like servers scale
coldclimate
0
82
Quick and dirty load testing with Vegeta
coldclimate
3
3.8k
Continuously deploying https served statically compiled sites to S3 with canonical domains
coldclimate
0
54
Scripting creating AWS based servers
coldclimate
0
150
refactoring
coldclimate
1
120
Other Decks in Technology
See All in Technology
ユーザーテストガイドライン VERSION 2.0
kouzoukaikaku
0
1.5k
ECテックカンファレンス2023 EC事業部のモバイル開発2023
tatsumi0000
0
340
DNS権威サーバのクラウドサービス向けに行われた攻撃および対策 / DNS Pseudo-Random Subdomain Attack and mitigations
kazeburo
5
1.3k
AWS re:Invent 2022で発表された新機能を試してみた ~Cloud OperationとSecurity~ / New Cloud Operation and Security Features Announced at AWS reInvent 2022
yuj1osm
1
220
Bill One 開発エンジニア 紹介資料
sansantech
PRO
0
120
Oktaの管理者権限を適切に移譲してみた
shimosyan
2
270
OCI技術資料 : ロード・バランサー 詳細 / Load Balancer 200
ocise
2
7.2k
SPA・SSGでSSRのようなOGP対応!
simo123
2
160
CSS Variable をもっと活用する / Kyoto.js 18
spring_raining
2
1k
01_ユーザーリサーチ実施の進め方
kouzoukaikaku
0
660
Logbii(ログビー) 会社紹介
logbii
0
160
MLOps Workshopでの学びと弥生の研究開発基盤 / takeaways from MLOps workshop and YAYOI's research and development infrastructure
yayoi_dd
0
150
Featured
See All Featured
Documentation Writing (for coders)
carmenintech
51
2.9k
ParisWeb 2013: Learning to Love: Crash Course in Emotional UX Design
dotmariusz
101
6.2k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
32
6.7k
Bash Introduction
62gerente
601
210k
Creatively Recalculating Your Daily Design Routine
revolveconf
207
11k
Into the Great Unknown - MozCon
thekraken
2
300
StorybookのUI Testing Handbookを読んだ
zakiyama
8
3.2k
It's Worth the Effort
3n
177
26k
Easily Structure & Communicate Ideas using Wireframe
afnizarnur
182
15k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
15
1.2k
No one is an island. Learnings from fostering a developers community.
thoeni
12
1.5k
YesSQL, Process and Tooling at Scale
rocio
159
12k
Transcript
Scaling CANDDi oli wood @coldclimate
history
measure things that matter
back of a fag packet if good enough
have somewhere to test which is not live
use realistic data
ab/siege + ec2 instances
there are no silver bullets
aim for a silver shotgun cartridge
define the scenarios
build a pipeline view
identify symptoms but solve problems
symptoms are what you can see
problems are what you can solve
bad new: the problem is your code
good news: thus you can fix it
do less big things less often
do frequent things much faster
avoid waiting
pull less data
cache the painful things
cache: in memory
cache: redis/memcache
cache: url/browser cache
hunt collisions
use the tools
iostat
sar -P
strace -p
iftop
xdebug + webgrind
statsd
mongotop
mongosniff
tail -100000 mongodb. log | awk -F' ' '{print $NF}'
| grep ms$ | sed 's/ms//g' |sort -n | tail -20 | xargs -I {} grep {} ms$ mongodb.log
and the big gestures
nginx
nodejs
redis
aim: loosely coupled components which are horizontally scalable both on
box and by box
BULLSHIT
aim: fast enough for medium term business needs
aim: not to waste time in a geek circle jerk
result: 10x the throughput
result: 2000 non- trivial inbound events a second
good luck