Real-Time Monitoring with Grafana, StatsD and InfluxDB

We can take a glimpse at our applications or we can truly see them. We have a choice.

Our path is laden with problems and, when they arise, the first place to run is the log. The log is straightforward when the systems are small, but when we start to scale… the more users we get, the more data we will have to go through, and finding what we need is like staring at a well-stocked library, looking at the book titles, wondering which one could possibly have the information we need.

I’d like to suggest an alternative: the combination of StatsD, a platform that collects data to build statistics, and Grafana. It allows us to create beautiful, interactive dashboards that support pluggable panels.

This talk is not only focused on the theory behind these tools but also in the experience we had with them at Youse. I will present the tools (and the alternative tools too), explain how to use them and show the code we need to measure the events we want to track. A chart will be build from scratch, starting with an event on the system and ending in a beautiful dashboard.

All the code is in Ruby. We use Ruby on Rails on our applications and we found good open source libraries to build and maintain the monitoring system.

Transcript

1. http://arturprado.com/
   

   View Slide

2. View Slide

3. View Slide

4. View Slide

5. Artur Caliendo Prado
   http://arturprado.com/
   artur.prado@youse.com.br
   @artur.prado @artur_caliendo
   @arturcp
   

   View Slide

6. Monitoração
   em tempo real
   com Grafana,
   StatsD e
   InfluxDB
   

   View Slide

7. View Slide

8. Abril, 2016
   O despertar
   

   View Slide

9. View Slide

10. Compre de pessoas criativas em todos os lugares
    "Se algo se move, a gente mede"
    

    View Slide

11. Etsy StatsD: https://github.com/etsy/statsd
    StatsD Instrument:
    https://github.com/Shopify/statsd-instrument
    

    View Slide

12. View Slide

13. View Slide

14. View Slide

15. View Slide

16. View Slide

17. Mostre o Grafana!
    

    View Slide

18. View Slide

19. View Slide

20. View Slide

21. View Slide

22. View Slide

23. View Slide

24. View Slide

25. View Slide

26. View Slide

27. View Slide

28. View Slide

29. View Slide

30. View Slide

31. View Slide

32. View Slide

33. View Slide

34. View Slide

35. View Slide

36. View Slide

37. View Slide

38. View Slide

39. View Slide

40. View Slide

41. View Slide

42. View Slide

43. View Slide

44. View Slide

45. View Slide

46. View Slide

47. View Slide

48. Isso é útil?
    

    View Slide

49. View Slide

50. View Slide

51. View Slide

52. View Slide

53. View Slide

54. View Slide

55. View Slide

56. View Slide

57. View Slide

58. View Slide

59. StatsD ou Telegraf?
    

    View Slide

60. Count x Sum
    

    View Slide

61. Recursos
    https://www.influxdata.com/
    https://github.com/etsy/statsd
    https://github.com/Shopify/statsd-instrument
    https://codeascraft.com
    http://grafana.org/
    http://labs.youse.com.br
    

    View Slide

62. View Slide

63. View Slide

64. http://arturprado.com/
    artur.prado@youse.com.br
    @artur.prado
    

    View Slide