Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Sign up for free
Menu
Search
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Features
All features
Private URLs
Password Protection
Custom URLS
Scheduled publishing
Remove Branding
Restrict embedding
Deck Collections
Notes
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Explore
Featured decks
Featured speakers
Programming
Technology
Storyboards
Pricing
Search
Sign in
Sign up for free
Scalability Issues ... cure first, prevent later
Search
Thijs Feryn
PRO
June 09, 2012
Technology
1k
2
Share
Embed
Copy iframe code
Copy JS code
Copy link
Start on current slide
Scalability Issues ... cure first, prevent later
Slides for the DPC12 edition of my scalability talk.
Thijs Feryn
PRO
June 09, 2012
Transcript
85 slides
None
Evangelist
None
None
None
@ThijsFeryn
Please3 rate3my3talk3on3 Joind.in https://joind.in/6247
It3works3on3my3computer
None
It’s3the3internet’s3fault
Suits & hipsters
“Isn't'hos*ng' supposed'to'be'a' bulk'product?”
“The'Cloud'will' make'sure'my'app' scales”
“Large'campaigns' on'shared'hos*ng,' why'is'that'a' problem?”
“What's'a' database'index?”
“We'll'solve'that' with'an'Ajax'call”
“We'll'probably'have' 10.000'visitors'on' the'next'campaign”
GeBng3the3numbers3right
Let’s3do3a3complete3rewrite3!
Have3you3got3the3Gme?
Or3the3money?
What3do3you3do?
Nothing
Throw3 servers3at3 the3 problem
Do3some3 tricks3!
Throw3servers3at3the3problem
Scale3verGcally
Fast Cheap vs Limited Expensive Long% term Short% term
Scale3horizontally
Efficient Unlimited vs ConsideraGons IniGal3effort Long% term Short% term
What3kind3of3infrastructure3do3you3need?
What3kind3of3infrastructure3do3you3need? One3big3 box?
What3kind3of3infrastructure3do3you3need? Scale3across3 1003nodes?
What3kind3of3infrastructure3do3you3need? That3big3F53 loadbalancer?
What3kind3of3infrastructure3do3you3need? Only3the3DB3 gets3 hammered
What3kind3of3infrastructure3do3you3need? Lots3of3staGc3 traffic
What3kind3of3infrastructure3do3you3need? Shared3hosGng3 will3do3...3 except3during3the3 month3of3the3event
About3a3mulGYserver3setup
Goal:3(almost)3no3code3changes
Cache
Frontend Backend Data% cache Opcode% cache Page% cache APC Memcached
SQLite File Redis +more +more
What? When3not? How3long? CompaGbility Limited3size
Tricks
RewriteEngine*On RewriteCond*%{REQUEST_FILENAME}*=s*[OR] RewriteCond*%{REQUEST_FILENAME}*=l*[OR] RewriteCond*%{REQUEST_FILENAME}*=d RewriteRule*^.*$*=*[NC,L] RewriteRule*^.*$*index.php*[NC,L] Use3mod_rewrite Hit3frontcontroller3if3resource3doesn’t3exist
Use3mod_rewrite Write3output3to3file3and3print3to3screen <?php require('db.php'); $data = db_get_content_from_uri( $_SERVER['REQUEST_URI']); $fp =
fopen(dirname(__FILE__). $_SERVER['REQUEST_URI'], 'w'); fwrite($fp, $data); fclose($fp); echo $data;
APC
Auto3prepend3&3auto3append AutomaGcally3executed3before3every3request [PHP] auto_prepend_file*“/path/to/prepend.php” auto_append_file*“/path/to/append.php”
Auto3prepend Read3from3cache3or3start3output3buffer <?php if($_SERVER['REQUEST_METHOD'] == 'GET'){ $key = md5('http://'.$_SERVER['HTTP_HOST']. $_SERVER['REQUEST_URI']);
if(($output = apc_fetch($key)) !== false){ echo $output; exit(); } ob_start(); }
Auto3append Close3output3buffer,3store3data3in3cache3&3 print3output <?php if($_SERVER['REQUEST_METHOD'] == 'GET'){ $output = ob_get_contents();
ob_end_clean(); $key = md5('http://'.$_SERVER['HTTP_HOST']. $_SERVER['REQUEST_URI']); apc_store($key,$output,20); echo $output; }
Data3cache Caching3layer3 before3on3top3 of3the3 database
<?php class Data { private $_mysqlDependency; public function __construct($mysqlDependency) {
$this->_mysqlDependency = $mysqlDependency; } public function fetchQueryFromDatabase($key) { return $this->_mysqlDependency- >fetchQueryEscaped("SELECT * FROM `myTable` WHERE `myKey` = '%s'",$key); } } No% cache
<?php class Data { private $_namespace = 'myNamespace_'; private $_ttl
= 3600; private $_mysqlDependency; public function __construct($mysqlDependency) { $this->_mysqlDependency = $mysqlDependency; } public function fetchQueryFromDatabase($key) { if(($value = apc_fetch(md5( $this->_namespace.$key))) === false){ $value = $this->_fetchDataFromDatabase($key); $this->_storeDataInCache($key,$value); } return $value; } ... Override% &%use%cache Read% from%DB%&% store%in%cache
... private function _storeDataInCache($key,$value) { apc_store(md5($this->_namespace.$key),$value, $this->_ttl); return $this; }
private function _fetchQueryFromDatabase($key) { return $this->_mysqlDependency- >fetchQueryEscaped("SELECT * FROM `myTable` WHERE `myKey` = '%s'",$key); } } Fetch% from%DB Store% in%cache
You3can3also3use3Memcached
You3can3also3use3Memcached memcached.sess_prefix = "memc.sess.key." session.save_path="127.0.0.1:11211" session.save_handler = memcached Also% for%session%
handling
Reverse3 (caching)3 proxies
Put3‘em3in3 front3of3your3 webserver
They3honor3 your3caching3 headers
None
Request vcl_recv In cache? vcl_hash Cacheable? vcl_hit() vcl_miss() vcl_deliver() vcl_fetch()
No Yes No Yes Response
backend default { .host = "127.0.0.1"; .port = "8080"; }
acl purge { "localhost"; "127.0.0.1"; "some.host.name.com"; "1.2.3.4"; }
sub vcl_recv { if (req.request == "PURGE") { if (!client.ip
~ purge) { error 405 "Not allowed: " + client.ip; } return(lookup); } if (req.request != "GET" && req.request != "HEAD" && req.request != "PUT" && req.request != "POST" && req.request != "TRACE" && req.request != "OPTIONS" && req.request != "DELETE") { return (pipe); }
if (req.request != "GET" && req.request != "HEAD") { return
(pass); } if (req.http.Accept-Encoding) { if (req.url ~ "\.(gif|jpg|jpeg|swf|flv|mp3|mp4| pdf|ico|png|gz|tgz|bz2)(\?.*|)$") { remove req.http.Accept-Encoding; } else if (req.http.Accept-Encoding ~ "gzip") { set req.http.Accept-Encoding = "gzip"; } else if (req.http.Accept-Encoding ~ "deflate"){ set req.http.Accept-Encoding = "deflate"; } else { remove req.http.Accept-Encoding; } }
if (req.url ~ "\.(gif|jpg|jpeg|swf|css|js|flv|mp3| mp4|pdf|ico|png)(\?.*|)$") { unset req.http.cookie; set req.url
= regsub(req.url, "\?.*$", ""); return (lookup); } if (req.url ~ "\?(utm_(campaign|medium|source|term)| adParams|client|cx|eid|fbid|feed|ref(id|src)?|v(er| iew))=") { set req.url = regsub(req.url, "\?.*$", ""); } if (req.http.cookie ~ "^ *$") { unset req.http.cookie; }
sub vcl_fetch { if (req.url ~ "wp-(login|admin)" || req.url ~
"preview=true" || req.url ~ "xmlrpc.php") { return (hit_for_pass); } if ( (!(req.url ~ "(wp-(login|admin)|login)"))) { unset beresp.http.set-cookie; set beresp.ttl = 1h; } if (req.url ~ "\.(gif|jpg|jpeg|swf|css|js|flv|mp3| mp4|pdf|ico|png)(\?.*|)$") { set beresp.ttl = 365d; } }
sub vcl_deliver { if (obj.hits > 0) { set resp.http.X-Cache
= "HIT"; } else { set resp.http.X-Cache = "MISS"; } } sub vcl_hit { if (req.request == "PURGE") { purge; set obj.ttl = 0s; error 200 "OK"; } } sub vcl_miss { if (req.request == "PURGE") { purge; error 200 "OK"; } }
FPM hfp://www.php.net/manual/en/install.fpm.configuraGon.php
[www] listen = 9000 user = www-data group = www-data
pm = dynamic pm.max_children = 10 pm.start_servers = 4 pm.max_spare_servers = 6 pm.max_requests = 500 php_admin_value[sendmail_path] = /usr/sbin/sendmail -t -i -f
[email protected]
php_flag[display_errors] = off php_admin_value[error_log] = /var/log/fpm-php.www.log php_admin_flag[log_errors] = on php_admin_value[memory_limit] = 32M
None
upstream fpm { server php1.server.com:9000; server php2.server.com:9000; } upstream memcached
{ server memcached1.server.com:11211; server memcached2.server.com:11211; } server { root /var/www; index index.php index.html index.htm; server_name nginx.server.com; location / { try_files $uri $uri/ /index.php; } location @php { fastcgi_pass fpm; fastcgi_index index.php; include fastcgi_params; }
location ~ \.php$ { set $memcached_key $request_uri; memcached_pass memcached; memcached_next_upstream
not_found; default_type text/html; error_page 404 405 502 = @php; } location ~* \.(?:ico|css|js|gif|jpe?g|png)$ { expires max; add_header Pragma public; add_header Cache-Control "public, must- revalidate, proxy-revalidate"; } }
location ~ \.php$ { set $memcached_key $request_uri; memcached_pass memcached; memcached_next_upstream
not_found; default_type text/html; error_page 404 405 502 = @php; } location ~* \.(?:ico|css|js|gif|jpe?g|png)$ { expires max; add_header Pragma public; add_header Cache-Control "public, must- revalidate, proxy-revalidate"; } }
None
Content Delivery Network
+3 W33Total3 Cache
None
✓Enable3caching ✓Enable3cron.php ✓Configure3log3retenGon ✓Flat3catalog ✓Enable3compilaGon ✓Install3Varnish3Cache3plugin ✓Split3frontend3&3backend3servers ✓Perform3indexing3on3separate3 server
None
Boost Varnish Memcached
Don’t3be3clueless
Ask3for3help
Apply3the3tricks
And3don’t3forget3to3refactor3akerwards
And3then3relax3...3and3be3happy
None
More Decks by Thijs Feryn
See All by Thijs Feryn
What's new in Varnish? New features in the high-performance caching proxy - SREday Amsterdam 2026
thijsferyn
PRO
0
36
Accelerate Docker Image delivery with Varnish caching
thijsferyn
PRO
0
43
Speed up your CI/CD pipelines by caching build & runtime artifacts
thijsferyn
PRO
0
47
Speed up your CI/CD pipelines by caching build & runtime artifacts
thijsferyn
PRO
0
37
Caching Kubernetes? Introducing the Varnish Gateway Controller for Kubernetes
thijsferyn
PRO
0
59
Caching the uncacheable with Varnish - PHP London 2020
thijsferyn
PRO
0
600
Accelerating OTT video platforms with Varnish - London Video Tech meetup 2020
thijsferyn
PRO
0
520
't Oncachebare cachen
thijsferyn
PRO
0
520
Caching the uncacheable with Varnish - PHP UG FFM 19
thijsferyn
PRO
1
980
Other Decks in Technology
See All in Technology
目を覚ませ!僕らの認証情報が何者かに侵略されてるぞ
tkito
2
440
変更差分を読むために環境を整備しよう
pipepasta
1
430
「個社」ではなく「業界」の課題を解く AI 対話開発 ー 価値を広げる設計と、価値を守るエンジニアリング ー
ivry_presentationmaterials
3
250
OpenTelemetryで変わった 新時代のCloudWatchメトリクス監視
tsukuboshi
0
390
MCPでネットワーク障害調査を自動化する前に直すべき3つのこと
yama3133
0
510
プロダクションコードにおける encoding/json から encoding/json/v2 へのスムーズな移行
sansantech
PRO
1
440
BALLAS Technology Deck
ballas_inc
0
810
Oracle Base Database Service 技術詳細
oracle4engineer
PRO
17
120k
エンタープライズ事業未経験のデータ屋、 AI時代にN回撃沈する.pdf
ryoskdara_
0
140
「AIチャットからもできないの?」と言われたら ~業務アプリをMCP対応するときの認証・認可の勘所
oidfj
0
360
AI時代における医療情報システムのセキュリティ / Security of Healthcare IT Systems in the AI Era
henryofficial
0
190
AIで実装が加速したのに、 なぜ私は仕事の大半で人と話し続けていたのか?
say_no_w
0
180
Featured
See All Featured
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
marktimemedia
31
3k
From Legacy to Launchpad: Building Startup-Ready Communities
dugsong
0
380
Highjacked: Video Game Concept Design
rkendrick25
PRO
2
580
Visual Storytelling: How to be a Superhuman Communicator
reverentgeek
2
750
Impact Scores and Hybrid Strategies: The future of link building
tamaranovitovic
0
490
Paper Plane
katiecoart
PRO
6
55k
The Cost Of JavaScript in 2023
addyosmani
56
10k
Hiding What from Whom? A Critical Review of the History of Programming languages for Music
tomoyanonymous
3
1.4k
SEO in 2025: How to Prepare for the Future of Search
ipullrank
3
3.9k
Un-Boring Meetings
codingconduct
0
500
How to Ace a Technical Interview
jacobian
280
24k
Jess Joyce - The Pitfalls of Following Frameworks
techseoconnect
PRO
1
480