Log analysis for your Heroku app

Slides from my Heroku JP meetup talk on April 20th, 2012.

Transcript

1. Log analysis for your Heroku app
2. Eric Lindvall @lindvall github.com/eric
3. Papertrail
4. Watch your application from a browser
5. Search for problems
6. Jump to when something happened
7. See all of your apps in one place
8. Create alerts to act on your searches Have them run every minute, hour or day
9. Send important messages to Campfire
10. Send nightly reports in email
11. Notify PagerDuty when something is wrong
12. Graph message counts in Librato Metrics
13. Papertrail alert webhooks are open source https://github.com/papertrail/papertrail-services
14. Run your own webhook on Heroku
15. Automatically scale dynos based on queue time IDEA
16. Alert your iPhone when too many errors occur IDEA
17. Use a webhook to collect app metrics from Metriks EXAM PLE https://github.com/eric/metriks https://github.com/eric/metriks_log_webhook
18. Metriks.timer('fib.time').time do fib(15) end Turn Measurements into logs Apr 17 06:09:01 app app/web.1: metriks: time=1334668140 name=fib.time type=timer count=23348919 one_minute_rate=76.0977078982827 five_minute_rate=68.1730503588775 fifteen_minute_rate=62.5690560606605 mean_rate=39.3749046450413 min=0.0100461 max=121.660915185 mean=0.0643679864834903 stddev=0.051298728482402 median=0.018409955 95th_percentile=0.1440550285 Apr 17 06:09:01 app app/web.2: metriks: time=1334668140 name=fib.time type=timer count=13894859 one_minute_rate=23.9993183538984 five_minute_rate=31.6901486523292 fifteen_minute_rate=35.0794473490055 mean_rate=23.4224094363587 min=0.00994003 max=123.195304423 mean=0.0397875258344949 stddev=0.0213955001420874 median=0.015471635 95th_percentile=0.0905222869999997
19. Turn Logs into graphs Apr 17 06:09:01 app app/web.1: metriks: time=1334668140 name=fib.time type=timer count=23348919 one_minute_rate=76.0977078982827 five_minute_rate=68.1730503588775 fifteen_minute_rate=62.5690560606605 mean_rate=39.3749046450413 min=0.0100461 max=121.660915185 mean=0.0643679864834903 stddev=0.051298728482402 median=0.018409955 95th_percentile=0.1440550285 Apr 17 06:09:01 app app/web.2: metriks: time=1334668140 name=fib.time type=timer count=13894859 one_minute_rate=23.9993183538984 five_minute_rate=31.6901486523292 fifteen_minute_rate=35.0794473490055 mean_rate=23.4224094363587 min=0.00994003 max=123.195304423 mean=0.0397875258344949 stddev=0.0213955001420874 median=0.015471635 95th_percentile=0.0905222869999997
20. Heroku metriks_log_webhook (sinatra app) Rails app (with metriks gem) Papertrail Librato Metrics Papertrail webhook logs to Papertrail How it all fits together
21. Questions?
22. All of the links Get a free account: https://papertrailapp.com/ Talk to us: https://papertrailapp.com/chat Send logs from your heroku app: https://papertrailapp.com/help/heroku Ask us questions: https://help.papertrailapp.com/ Webhook documentation: http://help.papertrailapp.com/kb/how-it-works/web-hooks Read the papertrail-services source: https://github.com/papertrail/papertrail-services/ See an example custom webhook: https://github.com/eric/metriks_log_webhook/ Download this presentation: http://speakerdeck.com/u/lindvall/p/log-analysis-for-your-heroku-app
23. Thanks!