Fast GeoIp Lookup using Redis

Transcript

1. Fast GeoIp Lookup using Redis Navigate : Space / Arrow Keys | - Menu | - Fullscreen | - Overview | - Blackout | - Speaker | - Help M F O B S ?  1 / 15
2. NoSQL database categories [ GitPitch @ github/mkoertgen/hello.redis ]  2 / 15
3. The V's of Big Data Originally, Volume (amount or size of data) Velocity (speed of data processing) Variety (number of types of data) More recently, Veracity (trustworthiness of the data) Value (generates the data value) [ GitPitch @ github/mkoertgen/hello.redis ]  3 / 15
4. Volume Java Says, Your Data's Not That Big [ GitPitch @ github/mkoertgen/hello.redis ]  4 / 15
5. Garbage In... Image [ GitPitch @ github/mkoertgen/hello.redis ]  5 / 15
6. Data Science is mostly about how to make sense of and interpret ( lter) your data... [ GitPitch @ github/mkoertgen/hello.redis ]  6 / 15
7. Velocity Importing 100,000,000/day ~ 1,200/sec HTTP/REST: ~50/sec => 25 container (scale out) Redis: ~500,000/sec (1 redis instance, on a laptop) [ GitPitch @ github/mkoertgen/hello.redis ]  7 / 15
8. Redis is fast! [ GitPitch @ github/mkoertgen/hello.redis ]  8 / 15
9. Why Redis? Some references: (redislabs.com) (redis.io) (codeburst.io) Why Redis Introduction to Redis Redis: What and Why? Redis and its data types [ GitPitch @ github/mkoertgen/hello.redis ]  9 / 15
10. Fundamental Theorem of Software Engineering (FTSE) We can solve any problem by adding another level of indirection (David Wheeler) ...except for the problem of too many layers (Kevlin Henney) [ GitPitch @ github/mkoertgen/hello.redis ]  10 / 15
11. GeoIp Lookup Indirect lookup using a sorted zet of ip ranges Find closest ip range: Retreive bucket: Question: What about missing or overlapping ip ranges? zrange by score hgetall [ GitPitch @ github/mkoertgen/hello.redis ]  11 / 15
12. Implementations Examples given in .NET, Node, Ruby, Python, Go, Dart, Java [ GitPitch @ github/mkoertgen/hello.redis ]  12 / 15
13. Redis Modules List of (redislabs.com), (redis.io) Some modules we nd interesting Redis Modules Redis Modules [ GitPitch @ github/mkoertgen/hello.redis ]  13 / 15
14. Some References (RedisGreen) Redis Pub/Sub: Howto Guide socketio/socket.io-redis [ GitPitch @ github/mkoertgen/hello.redis ]  14 / 15
15. Questions? Reach out  @mkoertg  mkoertgen  @marcel.koertgen [ GitPitch @ github/mkoertgen/hello.redis ]  15 / 15