Solve your problems with monitoring

Uygulamanızın kalbini dinleyin, WTK Izmir 2014

Transcript

1. Uygulamanızın kalbini dinleyin Solve your problems with monitoring
2. Why?
3. Monitoring, a real necessary
4. How is going on?
5. What is your application doing right now? ! Do you know when it fails?
6. How about fixing things?
7. Fixing problems is difficult without logs and monitoring ! Sleep better by automating monitoring for your app
8. How about customers?
9. Don't tolerate software errors ! Don't like slow websites
10. Means
11. Loss of • Productivity • Money • Reputation
12. Loss of • Time • Visitor • Trust
13. Problems?
15. Problems • Can the users hit my pages? • What is the page load time? • Problems with browsers, client side errors? • Third party integrations runs smoothly?
16. Problems • How is my audience? Increased? • How is my revenue? • Is user orders shipping? • Functionality of application work at all?
17. Problems • I didn't change the code, something wonky? • Which part of system is not working? • Is my server over capacity? • Do i need to scale up / down my servers?
18. Problems • Is my (RDBMS|Caching|MQ) is running healthy? • How about (Memory|Disk|CPU) usage of servers? • Is (Application Server|Web server|LoadBalancer) up? • What is (Bandwidth|Network) usage? Comparing with last weeks?
19. If something fails
20. You need to get it up and running ASAP
21. Ain't Nobody Got Time For That
22. Our objective
23. Reducing ! Time to detect Time to repair
24. Solutions
25. Application availability
26. Pingdom ! http://pingdom.com ! Uptime and performance monitoring
28. Monitoring every single point
29. nagios ! http://nagios.org ! Monitor your entire IT infrastructure, a legend
31. sensu ! http://sensuapp.org ! Basically acts like “monitoring router”, highly scalable
33. monit ! http://mmonit.com/monit/ ! Proactive monitoring for processes, hosts, filesystems
34. IF <TEST> THEN ACTION [ELSE IF SUCCEEDED THEN ACTION]
35. if failed port 80 for 3 times within 5 cycles then alert if cpu is greater than 50% for 5 cycles then restart check file mydb with path /data/mydatabase.db if size > 1 GB then alert check filesystem rootfs with path / if space usage > 90% then alert check process nginx with pidfile /var/run/nginx.pid start program = "/etc/init.d/nginx start" stop program = "/etc/init.d/nginx stop" ! check host xyz with address xyz.org if failed icmp type echo count 5 with timeout 15 seconds then alert
36. runit ! http://smarden.org/runit/ ! Unix init scheme with service supervision, a replacement for sysvinit
37. collectd ! http://collectd.org ! collectd is a daemon which collects system performance statistics periodically and provides mechanisms to store
39. riemann ! http://riemann.io ! Riemann aggregates events from your servers and applications with a powerful stream processing
41. munin ! http://munin-monitoring.org ! Easily monitor the performance of your computers, networks, applications, comes with dashboard
43. ganglia ! http://ganglia.info ! Scalable distributed monitoring system for high- performance computing systems such as clusters and
45. graphite ! http://graphite.wikidot.com/start ! Highly scalable real-time graphing system. Comes with whisper datastore and carbon dashboard
47. Counting everything
48. statsd ! https://github.com/etsy/statsd/ ! A network daemon that runs on the Node.js platform and listens for statistics, like counters and timers, sent over
50. metrics ! http://metrics.codahale.com ! Metrics provides a powerful toolkit of ways to measure the behavior of critical components in your production
52. What about millions of notifications?
53. pagerduty ! http://pagerduty.com ! Centrally manages incidents from your monitoring systems
55. Exception logging
56. syslog-ng ! http://www.balabit.com/network-security/syslog-ng ! syslog-ng is an open source implementation of the Syslog protocol for Unix and Unix-like systems
57. logstash ! http://logstash.net ! Tool for managing events and logs. You can use it to collect logs, parse them, and store, comes with
59. graylog ! http://www.graylog2.org ! Search your logs, create charts, send reports and be alerted when something happens
61. sentry ! https://github.com/getsentry/sentry ! Realtime event logging and aggregation platform
63. Tracking Javascript errors
64. trackjs ! http://trackjs.com ! commercial
66. Errorception ! http://errorception.com ! commercial
68. Commercial solutions
69. newrelic ! http://newrelic.com
71. Scout ! http://scoutapp.com
73. Server density ! http://serverdensity.com
75. Ignorance Is Bliss
76. What we learned • Availability is too important • Monitoring is a must • It helps to troubleshooting easy • There is too much solutions available
77. Thanks! ! http://github.com/o