Docker Usage Patterns - Docker Meetup Palo Alto - Nov 2015

Transcript

1. Docker Usage Patterns No Hype, Just Data Docker Meetup Palo Alto
 Nov 3, 2015 Ilan Rabinovitch Director, Community
 Datadog
2. About Me • Long time Datadog user. • Prior to Datadog built automation and monitoring tooling at Ooyala and Edmunds.com
 • Love Community Events
 SCALE and Texas Linux Fest DevOpsDay LA DevOpsDay Silicon Valley Ilan Rabinovitch
 Datadog
3. DevOpsDays Silicon Valley • Nov 6-7, 2015 • Computer History Museum • Presentations, Open Spaces • Promo Code DOCKR for 20% off! • More info on devopsdays.org
4. Quick Overview of Datadog Datadog gathers performance data from all your application and infrastructure components. • Monitoring for modern applications 1. Dynamic Infrastructure 2. Containers (Docker, ECS, Mesos, k8s, and more…) 3. Microservices • Time series storage of metrics and events • Trending, alerting and anomaly detection. • We’re hiring! (Remote, NY, Boston, Paris)
5. Monitor Everything Datadog gathers performance data from all your application components.
6. Monitor Everything Culture Automation Metrics Sharing Damon Edwards and John Willis DevOpsDay LA
8. Why so much Docker?
9. Avoid Dependency Hell
10. Who is running Docker today? Docker Adoption
11. What about in production? Docker Adoption
12. Wheres the data? Docker Adoption
13. Adopter: the average number of containers running during the month was at least 50% the number of distinct hosts run, or there were at least as many distinct containers as distinct hosts run during the month. Dabbler: used Docker during the month, but did not reach the “adopter” threshold. Abandoner: a currently active company that used Docker in the past, but hasn't used it at all in the last month. Docker Adoption
14. Turns out you aren’t alone! Docker Adoption
15. Docker Adoption Growth We’ve see 5x increase of Docker adoption over the last year.
16. Fact 1: Docker Adoption Up 5x in 1 Year
18. Fact 2: Docker now runs on 6% of hosts we monitor
19. So who is adopting Docker?
21. Fact 3: Larger Companies Are the Early Adopters!
23. Fact 4: 2/3 of Companies That Try Docker Adopt It
25. Fact 5: Users 3x the Number of Containers They Use in 5 Months
26. So what are folks running?
28. Fact 6: Most Widely Used Images Are Registry, NGINX, and Redis
29. How densely are we packing our containers?
32. Fact 7: Docker Hosts Often Run Four Containers at a Time
34. Fact 8: VMs Live 4x Longer Than Containers
36. Operational Complexity • Average containers per host: N (N=4, 10/2015) • Instances live about 4x the length of their containers • N-times as many “hosts” to manage • Affects • provisioning: prep’ing & building containers • configuration: passing config to containers • orchestration: deciding where/when containers run • monitoring: making sure containers run properly
37. Operational Complexity: Scale 100 instances 400 containers
38. Operational Complexity: Scale 160 metrics per host 640 metrics per host Assuming 4 containers per host
39. Operational Complexity: Scale 100 instances 64,000 metrics Assuming 4 containers per host
40. Operational Complexity: Velocity
41. So what does that mean for monitoring and management?
46. Monitoring Needs and Pains • Avoid Static config files tracking dynamic infrastructure.
47. Monitoring Needs and Pains: Static vs Dynamic • Avoid Static config files tracking dynamic infrastructure. 
 Configuration management is awesome, but….
48. Monitoring Needs and Pains • Avoid Static config files tracking dynamic infrastructure. • Avoid a host centric view. Focus on service level.
49. Monitoring Needs and Pains: Host Centric vs Service Centric
50. Monitoring Needs and Pains • Avoid Static config files tracking dynamic infrastructure. • Avoid a host centric view. Focus on service level. • Use tags, labels, etc on your hosts and metrics to form queries.
51. Monitoring Needs and Pains: Query Based Monitoring “Show me rate of HTTP 500 responses from nginx” “… in region us-east-1 across all availability zones” “… running my app version 2….” • Use tags, labels, etc on your hosts and metrics to form queries. • Pull in labels from your infrastructure whether EC2, Docker or your scheduler. • Ask questions that will ring true regardless of your scale that day.
52. Monitoring Needs and Pains • Avoid Static config files tracking dynamic infrastructure. • Avoid a host centric view. Focus on service level. • Use tags, labels, etc on your hosts and metrics to form queries. • Know your underlying tech. In this case Docker and how to pull metrics from it.
53. Collecting Docker Metrics
54. Collecting Docker Metrics: Pseudo Files • Access via sysfs in /sys/fs/cgroup or /cgroup • By default do not require root access. • Fast and light weight • Limited I/O and Network metrics.
55. Collecting Docker Metrics: stats • Continuous live stream of basic CPU, memory, & network metrics. • Available via API in JSON (see unix:///var/run/docker.sock) • At least version 1.5.0 of Docker (released Feb 2015)
56. Collecting Docker Metrics: stats api • Similar to stats command provides a stream of metrics • More details. • Data is returned in JSON (see unix:///var/run/docker.sock)
58. Collecting Docker Metrics: Summary CPU METRICS MEMORY METRICS I/O METRICS NETWORK METRICS pseudo-files Yes Yes Some Yes, in 1.6.1+ stats command Basic Basic No Basic API Yes Yes Some Yes
59. Appendix A: Monitoring 101 Crash Course More at: http://goo.gl/t1Rgcg
60. Monitoring 101: Categorize Your Metrics More at: http://goo.gl/t1Rgcg
61. Monitoring 101: Focus on symptoms More at: http://goo.gl/t1Rgcg
62. Recurse until you find root cause. More at: http://goo.gl/t1Rgcg
63. Cloud-Scale Monitoring Monitoring that tracks your dynamic infrastructure.
64. DASHBOARDS Build Real-Time Interactive Dashboards CORRELATION Search And Correlate Metrics And Events See It All In One Place Your Servers, Your Clouds, Your Metrics, Your Apps, Your team. Together.
65. COLLABORATION Share What You Saw, Write What You Did METRIC ALERTS Get Alerted On Critical Issues DEVELOPER API Instrument Your Apps, Write New Integrations See It All In One Place Your Servers, Your Clouds, Your Metrics, Your Apps, Your team. Together.
66. Integrations Datadog gathers performance data from all your application components.