Tap into the Secrets of Tapad's Success

How Tapad's ad-tech platform scales to hundreds of thousands of requests per second using Aerospike key-value database.

Transcript

1. Magic Scaling Sprinkles Experience operating a high-volume, low- latency ad buying platform at Tapad! ! ! ! @tobym! @TapadEng
2. Who am I? Toby Matejovsky! First engineer hired at Tapad 3+ years ago! Scala developer! ! @tobym
3. What are we talking about? ! One of the key components that allows Tapad’s realtime ad-buying platform to hit 350,000 TPS.
4. Outline • What Tapad does! • Why Aerospike is a good fit! • Operational experience! • What’s next
5. What Tapad Does (Real-time bidding) The Tapad Difference. A Unified View.
6. Ad exchange Want to show an ad to device 123? Tapad Sure, show this ad for $2 CPM No thanks Great, you won. Ad was displayed! How about to device XYZ? 95% response time: ~30 ms
8. Why Aerospike? Fast! Safe! Scale out! Expiration/eviction
9. Super fast key-value store 350,000 reads per second! on 7 nodes! ! 99% of reads are under 1 millisecond
11. Safe Replication factor! XDR (cross datacenter replication)! SSD-backed!
12. Scale out Linear scalability, just add a node*! ! ! ! *will revisit this during the next section
13. Expiration and eviction Old data expires automatically! Oldest data is evicted if the database is running out of space! ! This is desired behavior in ad-tech world
14. Operational experience with Aerospike at Tapad Configuration! Migrations! Eviction! Usage
16. Tapad’s Aerospike Configuration 100% keys in memory! 100% data in SSD storage! Replication factor 2! 512-byte block size! Need lots of free space in memory and storage for defrag (high-water mark)
18. Migrations and partitions New node requires data migration, means degraded performance! Network partition may trigger some data migration
19. Eviction Awesome feature, not intuitive if objects’ TTLs are not nicely distributed
21. Usage Blocking and non-blocking clients available! LZ4-compressed protobuf! Hot key error
22. What’s next? Smaller minimum block size! Replace Redis (UDFs)! Multiple keys to reference the same record
23. Thank You @tobym! @TapadEng Toby Matejovsky, Director of Engineering! toby@tapad.com! @tobym