Video streaming acceleration with Varnish

VIDEO IS BIG !

ONLINE VIDEO IS DOMINATING

OVERTTHETOP

PACKAGING

HTTP VIDEO PACKAGING FORMATS ✓ HLS ✓ MPEG-DASH ✓ CMAF

HTTP LIVE STREAMING (HLS)

VIDEO.MP4 STREAM.M3U8 STREAM_01.TS STREAM_02.TS STREAM_03.TS ENCODING & PACKAGING VIDEO: H264
AUDIO: AAC

#EXTM3U #EXT-X-VERSION:3 #EXT-X-TARGETDURATION:6 #EXT-X-MEDIA-SEQUENCE:0 #EXT-X-PLAYLIST-TYPE:VOD #EXTINF:6.000000, stream_00.ts #EXTINF:6.000000, stream_01.ts #EXTINF:6.000000,
stream_02.ts #EXTINF:6.000000, stream_03.ts #EXTINF:6.000000, stream_04.ts #EXTINF:6.000000, stream_05.ts #EXTINF:6.000000, stream_06.ts #EXTINF:6.000000, stream_07.ts #EXTINF:6.000000, stream_08.ts #EXTINF:6.000000, stream_09.ts #EXTINF:5.280000, stream_010.ts #EXT-X-ENDLIST STREAM.M3U8

PLAYER NEEDS TO SUPPORT HLS

WHAT TOOL DO WE USE TO ENCODE & PACKAGE?

ffmpeg -i video.mp4 \ -c:v libx264 -crf 21 \ -preset
veryfast -g 25 -sc_threshold 0 \ -c:a aac -b:a 128k -ac 2 \ -f hls -hls_time 4 -hls_playlist_type vod stream.m3u8

HI, I'M THIJS

I'M AN EVANGELIST AT

+-5,000,000 WEBSITES 20% OF THE TOP 10K WEBSITES

I'M @THIJSFERYN

CONTENT DELIVERY CHALLENGES

HEAVY COMPUTING

NETWORK CAPACITY

SERVER CAPACITY

THROWING SERVERS AT THE PROBLEM

MO' MONEY MO' SERVERS MO' PROBLEMS

DON’T RECOMPUTE IF THE DATA HASN’T CHANGED

REVERSE CACHING PROXY

NORMALLY USER SERVER

WITH REVERSE CACHING PROXY USER PROXY SERVER

WHY NOT USE A CDN?

VARNISH IS CDN SOFTWARE!

CDNS WITH MANY POINTS OF PRESENCE WILL DDOS YOUR ORIGIN

VARNISH VARNISH VARNISH ORIGIN

CDN CDN CDN ORIGIN VARNISH

WHY IS VARNISH SO POWERFUL?

WHY IS VARNISH SO POWERFUL? ✓ EXTREMELY LOW RESOURCE ✓
EXTREMELY STABLE ✓ 100 GBIT PER SERVER ✓ NO DISK ACCESS AT RUNTIME ✓ REQUEST COALESCING ✓ VARNISH CONFIGURATION LANGUAGE ✓ VMODS ✓ COMPLIES TO HTTP BEST PRACTICES ✓ ENTERPRISE FEATURES*

ORIGIN VARNISH REQUEST COALESCING

LIVE STREAMING VS VIDEO ON DEMAND

LIVE ✓ LOW LATENCY ✓ CONSTANT PLAYLIST UPDATES ✓ LOW
TTL ON PLAYLISTS ✓ ONLY THE LAST X SEGMENTS ARE REQUIRED ✓ SEGMENT SIZE TRADEOFF

VOD ✓ NO PLAYLIST UPDATES ✓ HIGH TTL ON PLAYLISTS
✓ ALL SEGMENTS ARE REQUIRED ✓ STORAGE REQUIREMENTS ✓ PRE-FETCHING POSSIBLE

HEAD VS LONG TAIL HEAD LONG TAIL

STORAGE

WHERE VARNISH STORES ITS OBJECTS ✓ MEMORY ✓ DISK ✓
MASSIVE STORAGE ENGINE (ENTERPRISE ONLY)

MEMORY MEMORY ORIGIN ORIGIN MEMORY MEMORY MEMORY MEMORY MEMORY

MEMORY MEMORY ORIGIN ORIGIN DISK DISK DISK

ADAPTIVE BITRATE STREAMS

STREAM_0.M3U8 STREAM_01.TS STREAM_02.TS STREAM_03.TS STREAM_1.M3U8 STREAM_11.TS STREAM_12.TS STREAM_13.TS MASTER.M3U8 LOW
BITRATE HIGH BITRATE ADAPTIVE BITRATE STREAMS

#EXTM3U #EXT-X-VERSION:3 #EXT-X-STREAM- INF:BANDWIDTH=1020800,RESOLUTION=1080x1920,CODECS="avc1.640028,mp4a.40.2" stream_0.m3u8 #EXT-X-STREAM- INF:BANDWIDTH=2890800,RESOLUTION=1080x1920,CODECS="avc1.640028,mp4a.40.2" stream_1.m3u8 MASTER.M3U8

ffmpeg -i video.mp4 -g 25 -sc_threshold 0 \ -map v:0
-c:v:0 libx264 -b:v:0 800k \ -map v:0 -c:v:1 libx264-b:v:1 2500k \ -map a:0 -c:a aac -b:a 128k -ac 2 \ -f hls -hls_time 6 hls_playlist_type vod \ -master_pl_name master.m3u8 \ -var_stream_map "v:0,a:0 v:1,a:0" stream_%v.m3u8

LIVE STREAMING

ffmpeg -listen 1 -i rtmp://0.0.0.0/live/stream \ -threads 0 -preset veryfast
-g 25 -sc_threshold 0 \ -map v:0 -c:v:0 libx264 -b:v:0 800k \ -map v:0 -c:v:1 libx264 -b:v:1 2500k \ -map a:0 -c:a aac -b:a 128k -ac 2 \ -f hls -hls_time 6 -hls_flags delete_segments \ -hls_list_size 5 -hls_delete_threshold 1 \ -master_pl_name master.m3u8 \ -var_stream_map "v:0,a:0 v:1,a:1" /storage/hls/live/ stream_%v.m3u8

FFMPEG WEBSERVER VARNISH RTMP STREAM HLS FILES HTTP HTTP GOPRO

DIGITAL RIGHTS MANAGEMENT

$ openssl rand 16 > enc.key $ openssl rand -hex
16 230f26620bfafa3cd420cb68c0647415 ENC.KEYINFO /live/enc.key /storage/hls/live/enc.key 230f26620bfafa3cd420cb68c0647415

ffmpeg -listen 1 -i rtmp://0.0.0.0/live/stream \ -threads 0 -preset veryfast
-g 25 -sc_threshold 0 \ -map v:0 -c:v:0 libx264 -b:v:0 800k \ -map v:0 -c:v:1 libx264 -b:v:1 2500k \ -map a:0 -c:a aac -b:a 128k -ac 2 \ -f hls -hls_time 6 -hls_flags delete_segments \ -hls_list_size 5 -hls_delete_threshold 1 \ -master_pl_name master.m3u8 \ -hls_key_info_file /storage/hls/live/enc.keyinfo \ -var_stream_map "v:0,a:0 v:1,a:1" /storage/hls/live/ stream_%v.m3u8

#EXTM3U #EXT-X-VERSION:3 #EXT-X-TARGETDURATION:5 #EXT-X-MEDIA-SEQUENCE:15 #EXT-X-KEY:METHOD=AES-128,URI="/live/ enc.key",IV=0x230f26620bfafa3cd420cb68c0647415 #EXTINF:3.200000, stream_015.ts #EXTINF:4.800000, stream_016.ts
#EXTINF:3.200000, stream_017.ts #EXTINF:4.800000, stream_018.ts #EXTINF:1.088000, stream_019.ts #EXT-X-ENDLIST STREAM_0.M3U8 PLAYER SUPPORTS DRM

.TS FILES ARE ENCODED AND CAN ONLY BE DECODED BY
THE PLAYER

ENC.KEY SHOULD BE PROTECTED

vcl 4.1; import http; backend default { .host = "1.2.3.4";
.port = "80"; } sub vcl_recv { if(req.url ~ "^/live") { if (req.http.Authorization != "Basic YWRtaW46YWRtaW4=") { return (synth(401, "Restricted")); } } unset req.http.Authorization; } sub vcl_backend_response { if(bereq.url ~ "^/live/stream_[0-9]+\.m3u8$" || bereq.url == "/live/master.m3u8") { set beresp.grace = 0s; set beresp.ttl = 1s; } } sub vcl_synth { if (resp.status == 401) { set resp.http.WWW-Authenticate = {"Basic realm="Restricted area""}; } }

VARNISH ENTERPRISE ✓ CLIENT SSL TERMINATION ✓ BACKEND SSL CONNECTIONS
✓ PARALLEL ESI ✓ MASSIVE STORAGE ENGINE ✓ ENCRYPTION ✓ THROTTLING ✓ RATE LIMITING ✓ PREFETCHING ✓ GEOLOCATION ✓ AUTHENTICATION ✓ EDGESTASH ✓ CUSTOM STATISTICS ✓ ADMIN MODULE ✓ SUPPORT ✓ HIGH AVAILABILITY

HTTPS://AWS.AMAZON.COM/QUICKSTART/ARCHITECTURE/VARNISH/

MASSIVE STORAGE ENGINE

MSE ✓ MIX OF MEMORY AND DISK ✓ SMARTER LRU
✓ LESS DISK FRAGMENTATION ✓ INTELLIGENT STORAGE ROUTING ✓ MODULAR

MEMORY MEMORY ORIGIN ORIGIN DISK DISK DISK

env: { id = "myenv"; memcache_size = "100G"; }; ENVIRONMENT
CONFIGURATION

env: { id = "myenv"; memcache_size = "100G"; books =
( { id = "book1"; directory = "/var/lib/mse/book1"; database_size = "1G"; stores = ( { id = "store-1-1"; filename = "/var/lib/mse/stores/disk1/store-1-1.dat"; size = "1T"; }, { id = "store-1-2"; filename = "/var/lib/mse/stores/disk2/store-1-2.dat"; size = "1T"; } ); } };

HIGH PERFORMANCE HTTP LOGIC BOX

NO MORE ORIGIN

vcl 4.1; import file; backend default { .host = "origin";
.port = "80"; } sub vcl_init { new root = file.init("/var/www/html/"); } sub vcl_backend_fetch { set bereq.backend = root.backend(); } sub vcl_backend_response { if(bereq.url ~ "^/live/stream_[0-9]+\.m3u8$" || bereq.url == "/live/master.m3u8") { set beresp.grace = 0s; set beresp.ttl = 1s; } }

DEVICE DETECTION & BITRATE LIMITATION

vcl 4.1; import xbody; include "devicedetect.vcl"; backend default { .host
= "origin"; .port = "80"; } sub vcl_recv { call devicedetect; set req.http.X-UA-Device-Prefix = regsub(req.http.X-UA-Device,"(\w+)\-.*","\1"); } sub vcl_backend_response { if(bereq.url == "/live/master.m3u8" ){ set beresp.http.vary = "X-UA-Device-Prefix"; if(bereq.http.X-UA-Device-Prefix == "mobile") { xbody.regsub("\#EXT-X-STREAM-INF:BANDWIDTH=2890800.*\nstream_.*", ""); } } }

VIDEO SEGMENT PREFETCHING

vcl 4.1; import http; import std; backend default { .host
= "origin"; .port = "80"; } sub vcl_recv { if (req.url ~ "^/(live|vod)/.+\.ts$") { http.init(0); http.req_set_max_loops(0,1); http.req_copy_headers(0); http.req_set_method(0, "HEAD"); set req.http.x-next-url = http.prefetch_next_url(); std.log("Prefetching " + req.http.x-next-url); http.req_set_url(0, req.http.x-next-url); http.req_send_and_finish(0); } }

THE VMOD ECOSYSTEM HTTPS://VARNISH-CACHE.ORG/VMODS/ HTTPS://DOCS.VARNISH-SOFTWARE.COM/VARNISH-CACHE-PLUS/VMODS/

DEMO TIME?

HTTPS://FERYN.EU HTTPS://TWITTER.COM/THIJSFERYN HTTPS://INSTAGRAM.COM/THIJSFERYN

Video streaming acceleration with Varnish

Video streaming acceleration with Varnish

More Decks by Thijs Feryn

Other Decks in Technology

Featured

Transcript