Streetlife Analytics

Streetlife Analytics

Snowplow London meetup talk about how we do analytics at streetlife using snowplow and how realtime is helping us to deliver value to our users.

2e19e78ec961cd9c60642ce7fe9f8c68?s=128

Jorge Bastida

June 15, 2016
Tweet

Transcript

  1. 2.

    • Local social network • Web, iOS and Android •

    1.3M users in uk. • 1.5B events
  2. 3.
  3. 4.
  4. 5.
  5. 6.
  6. 7.
  7. 10.
  8. 11.
  9. 12.
  10. 13.
  11. 17.
  12. 18.
  13. 19.
  14. 23.

    day impressions 2016/01/15 engagments id 1 u_impressions u_engagments 345 122

    299 99 2016/01/15 2 123 99 94 84 2016/01/15 3 934 845 843 789 2016/01/14 1 899 777 744 645 2016/01/14 2 754 543 634 433 2016/01/14 3 103 99 91 77 2016/01/13 1 499 301 382 235 2016/01/13 2 1893 1400 991 1099
  15. 24.
  16. 26.

    It works great, but the data has several hours of

    lag event ingest Load SQL View S3 Load
  17. 27.
  18. 30.

    The latency from events happening to us acting on them

    would be nearly zero event ingest Kinesis Lambda DynamoDB Load
  19. 32.

    λ • Zero-administration compute platform • Connect Lambdas with AWS

    services • Kinesis, DynamoDB, APIGateway, S3, CloudWatch, Cron… • Pricing based on usage: • ~$0.0000002 per/run • ~$0.000000208 per/100ms λ λ AWS Lambdas: 20,000 feet view
  20. 34.
  21. 35.

    • Tool to create, wire and deploy AWS Lambdas using

    CloudFormation • Python/Javascript/Java/Golang/Scala runtimes… • Supported integrations • APIGateway, CloudWatch, Dynamodb, Kinesis, S3
  22. 37.

    We are hiring! Thank you! Software Engineer (data team) Software

    Engineer (core team) Infrastructure Engineer Data Scientist