Slide 1
Slide 1 text
No content
Slide 2
Slide 2 text
Hi
my
name
is
Thijs
Slide 3
Slide 3 text
I’m
an
evangelist
at
Slide 4
Slide 4 text
I’m
a
board
member
at
Slide 5
Slide 5 text
No content
Slide 6
Slide 6 text
h"p://joind.in/7048
Please
give
me
feedback
Slide 7
Slide 7 text
No content
Slide 8
Slide 8 text
Varnish ?
Slide 9
Slide 9 text
Cache?
Slide 10
Slide 10 text
Reverse proxy?
Slide 11
Slide 11 text
Loadbalancer?
Slide 12
Slide 12 text
Loadbalancer?
HTTP accelerator
Slide 13
Slide 13 text
In
front
of
the
webserver
Slide 14
Slide 14 text
Primary
purpose
Caching
Slide 15
Slide 15 text
Reverse
caching
proxy
Slide 16
Slide 16 text
No content
Slide 17
Slide 17 text
No content
Slide 18
Slide 18 text
GET
/
HTTP/1.1
Host:
www.drupal.be
Connection:
close]
User-‐Agent:
Mozilla/5.0
(Macintosh;
U;
Intel
Mac
OS
X
10_6_4;
de-‐de)
AppleWebKit/533.16
(KHTML,
like
Gecko)
Version/5.0
Safari/533.16
Accept-‐Encoding:
gzip
Accept-‐Charset:
ISO-‐8859-‐1,UTF-‐8;q=0.7,*;q=0.7
Cache-‐Control:
no-‐cache
Accept-‐Language:
de,en;q=0.7,en-‐us;q=0.3
HTTP request
Slide 19
Slide 19 text
Status:
HTTP/1.1
200
OK
Date:
Mon,
03
Sep
2012
12:56:26
GMT
Server:
Apache/2.2.9
(Debian)
X-‐Powered-‐By:PHP/5.2.6-‐1+lenny16
X-‐Drupal-‐Cache:
HIT
Etag:"1346675891-‐1"
X-‐Generator:
Drupal
7
(http://drupal.org)
Cache-‐Control:
public,
max-‐age=0
Vary:
Cookie,Accept-‐Encoding
Content-‐Encoding:
gzip
Last-‐Modified:
Mon,
03
Sep
2012
12:38:11
GMT
Connection:
close
Transfer-‐Encoding:
chunked
Content-‐Type:
text/html;
charset=utf-‐8
HTTP response
Slide 20
Slide 20 text
What can we cache?
Slide 21
Slide 21 text
✓Static files
✓Dynamic pages
✓Webservices
Slide 22
Slide 22 text
No content
Slide 23
Slide 23 text
No content
Slide 24
Slide 24 text
Expires:
Sun,
25
Jun
2006
14:57:12
Cache-‐Control:
max-‐age=86400,
must-‐revalidate
Expira6on
Slide 25
Slide 25 text
Last-‐Modified:
Sun,
25
Jun
2006
14:57:12
GMT
ETag:
“686897696a7c876b7e”
Invalida6on
Slide 26
Slide 26 text
Last-‐Modified:
Sun,
25
Jun
2006
14:57:12
GMT
ETag:
“686897696a7c876b7e”
Compared
with
the
“If-‐None-‐
Match”
header.
Throws
“HTTP/1.0
304
Not
Modified”
accordingly
Invalida6on
Slide 27
Slide 27 text
Browser cache is your friend
Slide 28
Slide 28 text
Confusion?!
Slide 29
Slide 29 text
Multiple
standards
Slide 30
Slide 30 text
Can be
ignored by the
browser
Slide 31
Slide 31 text
Force
refresh
Slide 32
Slide 32 text
Cache per
client
Slide 33
Slide 33 text
Choose Varnish
http://
www.varnish-‐
cache.org
Slide 34
Slide 34 text
Install &
configure
Slide 35
Slide 35 text
curl
http://repo.varnish-‐cache.org/debian/GPG-‐
key.txt
|
apt-‐key
add
-‐
apt-‐get
update
echo
"deb
http://repo.varnish-‐cache.org/
debian/
squeeze
varnish-‐3.0"
>>
/etc/apt/
sources.list
apt-‐get
install
varnish
Slide 36
Slide 36 text
DAEMON_OPTS="-‐a
:80
\
-‐T
localhost:6082
\
-‐f
/etc/varnish/default.vcl
\
-‐S
/etc/varnish/secret
\
-‐s
malloc,256m"
In
“/etc/default/varnish”
Install &
configure
Slide 37
Slide 37 text
Backend
Slide 38
Slide 38 text
Listen
8080
In
“/etc/apache2/ports.conf”
Backend
Slide 39
Slide 39 text
backend
default
{
.host
=
"127.0.0.1";
.port
=
"8080";
}
In
“/etc/varnish/default.vcl”
Backend
Slide 40
Slide 40 text
Out of the box
Slide 41
Slide 41 text
No content
Slide 42
Slide 42 text
Only get & HEAD
No cookie & auth headers
No set-cookie headers
cache ttl > 0
No vary “*”
When will varnish cache?
Slide 43
Slide 43 text
About cookies
Slide 44
Slide 44 text
About cookies
HTTP cookie
request header
via browser
HTTP set-cookie
response header
via webserver
Slide 45
Slide 45 text
based on host/ip + urL hash
By default in Memory
Optionally on disk
how will varnish cache?
Slide 46
Slide 46 text
Request vcl_recv
In cache?
vcl_hash Cacheable?
vcl_hit() vcl_miss()
vcl_deliver()
vcl_fetch()
No
Yes
No
Yes
Response
Slide 47
Slide 47 text
No content
Slide 48
Slide 48 text
Monitoring
&
Logging
Slide 49
Slide 49 text
Varnishstat
✓General stats
✓Realtime
Slide 50
Slide 50 text
4+05:26:25
Hitrate
ratio:
10
100
254
Hitrate
avg:
0.8486
0.7619
0.7285
1760818
6.99
4.82
client_conn
-‐
Client
connections
accepted
11088687
25.96
30.36
client_req
-‐
Client
requests
received
8042715
11.98
22.02
cache_hit
-‐
Cache
hits
2609561
11.98
7.15
cache_miss
-‐
Cache
misses
47104
1.00
0.13
backend_conn
-‐
Backend
conn.
success
610
0.00
0.00
backend_fail
-‐
Backend
conn.
failures
2998265
12.98
8.21
backend_reuse
-‐
Backend
conn.
reuses
12081
0.00
0.03
backend_toolate
-‐
Backend
conn.
was
closed
3010356
13.98
8.24
backend_recycle
-‐
Backend
conn.
recycles
13
0.00
0.00
backend_retry
-‐
Backend
conn.
retry
520
0.00
0.00
fetch_head
-‐
Fetch
head
2857965
11.98
7.83
fetch_length
-‐
Fetch
with
Length
151309
2.00
0.41
fetch_chunked
-‐
Fetch
chunked
4404
0.00
0.01
fetch_close
-‐
Fetch
wanted
close
676
0.00
0.00
fetch_failed
-‐
Fetch
failed
31164
0.00
0.09
fetch_304
-‐
Fetch
no
body
(304)
220
.
.
n_sess_mem
-‐
N
struct
sess_mem
53
.
.
n_sess
-‐
N
struct
sess
29540
.
.
n_object
-‐
N
struct
object
29561
.
.
n_objectcore
-‐
N
struct
objectcore
5058
.
.
n_objecthead
-‐
N
struct
objecthead
2613
.
.
n_waitinglist
-‐
N
struct
waitinglist
3
.
.
n_vbc
-‐
N
struct
vbc
22
.
.
n_wrk
-‐
N
worker
threads
1789
0.00
0.00
n_wrk_create
-‐
N
worker
threads
created
Slide 51
Slide 51 text
Varnishlog
✓In-memory logs of
Varnish activity
✓Tag based
Slide 52
Slide 52 text
✓RxHeader
✓RxLostHeader
✓RxProtocol
✓RxRequest
✓RxResponse
✓RxStatus
✓RxURL
✓TxHeader
✓TxLostHeader
✓TxProtocol
✓TxRequest
✓TxResponse
✓TxStatus
✓TxURL
✓ReqEnd
✓ReqStart
✓Hit
✓Error
✓VCL_call
✓VCL_return
✓VCL_acl
Notable tags
Slide 53
Slide 53 text
Examples
varnishlog
-‐c
-‐m"VCL_call:hit"
|
grep
RxURL
varnishlog
-‐c
-‐m"VCL_call:miss"
|
grep
RxURL
varnishlog
-‐a
-‐w
/tmp/varnish.log
varnishlog
-‐r
/tmp/varnish.log
varnishlog
-‐i
RxHeader
-‐I
Cookie
Slide 54
Slide 54 text
12
SessionOpen
c
172.16.26.1
50396
:8080
12
ReqStart
c
172.16.26.1
50396
668213522
12
RxRequest
c
GET
12
RxURL
c
/test.php
12
RxProtocol
c
HTTP/1.1
12
RxHeader
c
Host:
varnish.dev:8080
12
RxHeader
c
User-‐Agent:
Mozilla/5.0
(Macintosh;
U;
Intel
Mac
OS
X
10.6;
nl;
rv:1.9.2.10)
Gecko/20100914
Firefox/3.6.10
12
RxHeader
c
Accept:
text/html,application/xhtml+xml,application/xml;q=0.9,*/
*;q=0.8
12
RxHeader
c
Accept-‐Language:
nl,en-‐us;q=0.7,en;q=0.3
12
RxHeader
c
Accept-‐Encoding:
gzip,deflate
12
RxHeader
c
Accept-‐Charset:
ISO-‐8859-‐1,utf-‐8;q=0.7,*;q=0.7
12
RxHeader
c
Keep-‐Alive:
115
12
RxHeader
c
Connection:
keep-‐alive
12
RxHeader
c
Cookie:
PHPSESSID=2n2pkit81qdgk6k4trf1crft16
12
VCL_call
c
recv
12
VCL_return
c
pass
12
VCL_call
c
hash
12
VCL_return
c
hash
12
VCL_call
c
pass
12
VCL_return
c
pass
14
BackendClose
-‐
default
14
BackendOpen
b
default
127.0.0.1
34267
127.0.0.1
80
12
Backend
c
14
default
default
Slide 55
Slide 55 text
Varnishtop
✓Incremental
✓Continuously updated
✓In-memory
✓Tag based
Slide 56
Slide 56 text
Examples
varnishtop
-‐i
RxHeader
-‐I
\^User-‐Agent
varnishtop
-‐i
RxRequest
varnishtop
-‐i
RxHeader
-‐I
\^Host
varnishtop
-‐i
RxHeader
-‐I
Cookie
Slide 57
Slide 57 text
list
length
20
107.57
RxHeader
User-‐Agent:
Mozilla/5.0
(Windows
NT
6.1;
W
101.96
RxHeader
User-‐Agent:
Mozilla/5.0
(Windows
NT
6.1;
W
82.49
RxHeader
User-‐Agent:
Mozilla/4.0
(compatible;
MSIE
69.90
RxHeader
User-‐Agent:
Mozilla/5.0
(compatible;
MSIE
64.04
RxHeader
User-‐Agent:
Mozilla/5.0
(Windows
NT
6.1;
W
43.74
RxHeader
User-‐Agent:
Mozilla/4.0
(compatible;
MSIE
22.01
RxHeader
User-‐Agent:
Mozilla/5.0
(iPod;
U;
CPU
iPho
21.43
RxHeader
User-‐Agent:
Mozilla/4.0
(compatible;
MSIE
19.86
RxHeader
User-‐Agent:
Mozilla/5.0
(X11;
Linux
x86_64
15.47
RxHeader
User-‐Agent:
Mozilla/5.0
(Windows
NT
6.1;
W
12.96
RxHeader
User-‐Agent:
Mozilla/5.0
(Windows
NT
6.1;
W
4.87
RxHeader
User-‐Agent:
Mozilla/4.0
(compatible;
MSIE
2.97
RxHeader
User-‐Agent:
Mozilla/5.0
(compatible;
MSIE
2.75
RxHeader
User-‐Agent:
Mozilla/5.0
(Windows
NT
6.1;
W
2.56
RxHeader
User-‐Agent:
Mozilla/5.0
(Windows
NT
6.1;
r
0.97
RxHeader
User-‐Agent:
Mozilla/5.0
(Windows;
U;
Windo
0.86
RxHeader
User-‐Agent:
Mozilla/5.0
(iPhone;
CPU
iPhon
0.83
RxHeader
User-‐Agent:
Mozilla/5.0
(Windows;
U;
Windo
0.53
RxHeader
User-‐Agent:
Mozilla/5.0
(compatible;
Googl
0.44
RxHeader
User-‐Agent:
Mozilla/4.0
(compatible;)
Slide 58
Slide 58 text
Varnishncsa
✓Access logs
✓Apache format
✓For analytics
Slide 59
Slide 59 text
Example
varnishncsa
-‐D
-‐a
-‐w
/var/log/some.log
172.16.26.1
-‐
-‐
[19/Oct/2010:16:08:02
+0200]
"GET
http://varnish.dev:8080/
HTTP/1.1"
200
97
"-‐"
"Mozilla/5.0
(Macintosh;
U;
Intel
Mac
OS
X
10.6;
nl;
rv:1.9.2.10)
Gecko/20100914
Firefox/
3.6.10"
Slide 60
Slide 60 text
Telnet
management
root@dev:/#
telnet
localhost
6082
Trying
::1...
Connected
to
localhost.
Escape
character
is
'^]'.
200
154
-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐
Varnish
HTTP
accelerator
CLI.
-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐
Type
'help'
for
command
list.
Type
'quit'
to
close
CLI
session.
Slide 61
Slide 61 text
Telnet
management
vcl.load
vcl.use
vcl.discard
vcl.list
vcl.show
Slide 62
Slide 62 text
READY FOR
ACTION?
Slide 63
Slide 63 text
Request vcl_recv
In cache?
vcl_hash Cacheable?
vcl_hit() vcl_miss()
vcl_deliver()
vcl_fetch()
No
Yes
No
Yes
Response
Slide 64
Slide 64 text
Out of the box
Slide 65
Slide 65 text
#
sub
vcl_recv
{
#
if
(req.restarts
==
0)
{
#
if
(req.http.x-‐forwarded-‐for)
{
#
set
req.http.X-‐Forwarded-‐For
=
#
req.http.X-‐Forwarded-‐For
+
",
"
+
client.ip;
#
}
else
{
#
set
req.http.X-‐Forwarded-‐For
=
client.ip;
#
}
#
}
#
if
(req.request
!=
"GET"
&&
#
req.request
!=
"HEAD"
&&
#
req.request
!=
"PUT"
&&
#
req.request
!=
"POST"
&&
#
req.request
!=
"TRACE"
&&
#
req.request
!=
"OPTIONS"
&&
#
req.request
!=
"DELETE")
{
#
/*
Non-‐RFC2616
or
CONNECT
which
is
weird.
*/
#
return
(pipe);
#
}
#
if
(req.request
!=
"GET"
&&
req.request
!=
"HEAD")
{
#
/*
We
only
deal
with
GET
and
HEAD
by
default
*/
#
return
(pass);
#
}
#
if
(req.http.Authorization
||
req.http.Cookie)
{
#
/*
Not
cacheable
by
default
*/
#
return
(pass);
#
}
#
return
(lookup);
#
}
Slide 66
Slide 66 text
#
sub
vcl_hash
{
#
hash_data(req.url);
#
if
(req.http.host)
{
#
hash_data(req.http.host);
#
}
else
{
#
hash_data(server.ip);
#
}
#
return
(hash);
#
}
#
sub
vcl_fetch
{
#
if
(beresp.ttl
<=
0s
||
#
beresp.http.Set-‐Cookie
||
#
beresp.http.Vary
==
"*")
{
#
/*
#
*
Mark
as
"Hit-‐For-‐Pass"
for
the
next
2
minutes
#
*/
#
set
beresp.ttl
=
120
s;
#
return
(hit_for_pass);
#
}
#
return
(deliver);
#
}
Slide 67
Slide 67 text
Construct your own vcl
Slide 68
Slide 68 text
Cache
sta6c
files
sub
vcl_recv{
if((req.request
==
"GET"
||
req.request
==
"HEAD")
&&
req.url
~
"\.
(png|gif|jpe?g|swf|css|js|html?|sstm)
$"
){
return(lookup);
}
else
{
return(pass);
}
}
Slide 69
Slide 69 text
Custom
hit/miss
marker
sub
vcl_deliver
{
if
(obj.hits
>
0)
{
set
resp.http.X-‐Varnish-‐Cache
=
"HIT";
}
else
{
set
resp.http.X-‐Varnish-‐Cache
=
"MISS";
}
}
Slide 70
Slide 70 text
Set
TTL
sub
vcl_fetch
{
if(req.url
~
"^/bla")
{
set
beresp.ttl
=
10s;
}
else
{
set
beresp.ttl
=
3600s;
}
}
Slide 71
Slide 71 text
Expiration
1.Vcl (beresp.ttl)
2.Cache-control s-maxage
3.Cache-control max-age
4.Expires
Slide 72
Slide 72 text
Remove
client
cookies
sub
vcl_recv
{
unset
req.http.cookie;
}
Remove
server
cookies
sub
vcl_fetch
{
unset
beresp.http.set-‐cookie;
}
Slide 73
Slide 73 text
Remove
GA
cookies
sub
vcl_recv
{
if
(req.http.Cookie)
{
set
req.http.Cookie
=
regsuball(req.http.Cookie,"(^|;
)
*__utm.=[^;]+;?
*","\1");
if
(req.http.Cookie
==
"")
{
remove
req.http.Cookie;
}
}
Slide 74
Slide 74 text
Ignore
cookies
sub
vcl_recv
{
if
(req.request
==
"GET"
||
req.request
==
"HEAD")
{
return
(lookup);
}
}
Ignores
default
behaviour
Slide 75
Slide 75 text
Add
cookies
to
hash
sub
vcl_recv
{
if
(req.request
==
"GET"
||
req.request
==
"HEAD")
{
return
(lookup);
}
}
sub
vcl_hash
{
hash_data(req.http.cookie);
}
All
cookies
Slide 76
Slide 76 text
Add
a
specific
cookie
to
hash
sub
vcl_recv
{
if
(!req.http.Cookie
~
"country")
{
return(pass);
}
}
sub
vcl_hash
{
if(req.http.Cookie
~
"country"){
hash_data(regsuball(req.http.Cookie,
"^.+;?
?
country=([a-‐zA-‐Z0-‐9]+)(
|;|
;).*$","\1"));
}
}
Slide 77
Slide 77 text
Choose
a
backend
backend
default
{
.host
=
"default.server.com";
.port
=
"80";
}
backend
other
{
.host
=
"other.server.com";
.port
=
"80";
}
sub
vcl_recv
{
if(req.http.host
~
"^www\."){
set
req.backend=
default;
}
else
{
set
req.backend
=
other;
}
}
Slide 78
Slide 78 text
Load
balancing
backend
default
{
.host
=
"default.server.com";
.port
=
"80";
.probe
=
{
.url
=
"/";
.timeout
=
50
ms;
.interval
=
1s;
.window
=
2;
.threshold
=
2;
}
}
backend
other
{
.host
=
"other.server.com";
.port
=
"80";
.probe
=
{
.url
=
"/";
.timeout
=
50
ms;
.interval
=
1s;
.window
=
2;
.threshold
=
2;
}
}
Slide 79
Slide 79 text
Director
for
load
balancing
director
back
random
{
{.backend
=
default;
.weight=1;}
{.backend
=
other;
.weight=2;}
}
sub
vcl_recv
{
set
req.backend
=
back;
return(pass);
}
Slide 80
Slide 80 text
Directors
✓Round-robin
✓Random
✓Hash
✓Dns
✓Client
✓Fallback
Slide 81
Slide 81 text
Grace
mode
sub
vcl_recv
{
if
(req.backend.healthy)
{
set
req.grace
=
1s;
}
else
{
set
req.grace
=
10s;
}
}
Keep
reading
from
cache,
even
when
expired
Slide 82
Slide 82 text
ACL
&
purge
acl
purge
{
"localhost";
"192.0.2.1"/24;
}
sub
vcl_recv
{
if
(req.request
==
"PURGE")
{
if
(!client.ip
~
purge)
{
error
405
"Not
allowed.";
}
return(lookup);
}
}
sub
vcl_hit
{
if
(req.request
==
"PURGE")
{
purge;
error
200
"Purged.";
}
}
sub
vcl_miss
{
if
(req.request
==
"PURGE")
{
purge;
error
200
"Purged.";
}
}
Or
404
curl
-‐X
PURGE
hcp://yoursite.com/yourpage
Slide 83
Slide 83 text
More action?
Slide 84
Slide 84 text
Edge Side Includes
Slide 85
Slide 85 text
header.php
menu.php main.php
footer.php
Slide 86
Slide 86 text
Slide 87
Slide 87 text
header.php
menu.php main.php
footer.php
TTL
5s
No
caching
TTL
10s
TTL
2s
Slide 88
Slide 88 text
Slide 89
Slide 89 text
Slide 90
Slide 90 text
".PHP_EOL;
} else {
include($file);
}
}
ESI
PHP
helper
funcdon
Slide 91
Slide 91 text
Slide 92
Slide 92 text
ESI
VCL
sub
vcl_recv
{
set
req.http.Surrogate-‐Capability="key=ESI/1.0";
}
sub
vcl_fetch
{
if(beresp.http.Surrogate-‐Control~"ESI/1.0")
{
unset
beresp.http.Surrogate-‐Control;
set
beresp.do_esi=true;
}
}
Slide 93
Slide 93 text
In Drupal
✓Varnish module
➡Supports purging
✓Esi module
Slide 94
Slide 94 text
No content
Slide 95
Slide 95 text
h"p://joind.in/7048
Please
give
me
feedback
Slide 96
Slide 96 text
Thanks
Slide 97
Slide 97 text
No content