The Redis way of Data Analytics

Transcript

1. the redis way of analytics ANOOP THOMAS MATHEW Profoundis Labs Pvt. Ltd.
2. Agenda • Learn basics of Redis • Learn basics of Python • Develop a web app with Django, and get visitor analytics done – yourself!
3. Getting Cozy • How many are you on UNIX machines? • How many heard about redis? • How many know python? • Installed python, redis server, redis-py and django
4. What is redis? • A Key-Value store • An In-Memory Database • Really Fast - ~1,00,000 reads/sec • Pub/Sub message passing • Supported by VMWare • Developed by Salvatore Sanfilippo and others • Opensource
5. Getting Started sudo apt-get install redis-server pip install redis ________________________________ import redis redis_client = redis.Redis(“localhost”)
6. Basic Datastructures String Integer List Set Ordered Set Hashes
7. Basic Operations String redis_client.set(“key”, “value”) redis_client.get(“key”) >>> 'value'
8. Basic Operations Integer redis_client.set(“number”, 1) redis_client.get(“number”) >>> '1' redis_client.incr(“number”) redis_client.get(“number”) >>> '2' redis_client.get(“number”) redis_client.decr(“number”) >>> '1'
9. Basic Operations List redis_client.rpush(“member”, “ATM”) redis_client.rpush(“member”, “HasGeek”) redis_client.lrange("members", 0, -1) ['ATM', 'HasGeek'] redis_client.llen("members") 2 redis_client.lindex("members", 1) 'HasGeek'
10. Basic Operations Set redis.client.sadd("members", "Adam") >>>True redis_client.sadd("members", "Bob") >>>True redis_client.sadd("members", "Carol") >>>True redis_client.sadd("members", "Adam") >>>False redis_client.smembers("members") >>>set(['Bob', 'Adam', 'Carol'])
11. Basic Operations Ordered Set redis.client.zadd("members", "Adam") >>>True redis_client.sadd("members", "Bob") >>>True redis_client.sadd("members", "Carol") >>>True redis_client.sadd("members", "Adam") >>>False redis_client.smembers("members") >>>set(['Bob', 'Adam', 'Carol'])
12. Basic Operations Hashes redis.client.hset("user:tom", "fullname", "Tom Sawyer") 1 redis_client.hset("user:tom", "password", "blah") 1 redis_client.hkeys("user:tom") ['fullname', 'password'] redis_client.hvals("user:tom") ['Tom Sawyer', 'blah'] redis_client.hgetall("user:tom") {'fullname': 'Tom Sawyer', 'password': 'blah'}
13. Publish - Subscribe pubsub = redis_client.pubsub() pubsub.subscribe('red') pubsub.publish('red', 'qube') for item in pubsub.listen(): print item
14. Why use redis? Sharing keys in-between realms Faster read-write Bit level storage access(setbit function) Cheaper logging In-memory caching Master-Slave replication
15. Let's go Hands On!
16. Final Product! https://bitbucket.org/atmb4u/hitcounter.git
17. Profoundis Labs What we do? & We are hiring! (atm@profoundis.com)
18. Get in Touch atm@profoundis.com #atmb4u 999 53 44 675