Short slide deck originally developed for the Berlin DigitalOcean Meetup on Aug 16, 2016
Using Elastic to monitor anything@ChristophWurmAugust 2016
View Slide
Unstructured Data Structured DataSearch Logging Security MetricsAnalyticsSocial SensorLogsDocuments User Activity Location
Elastic CloudSecurityX-PackKibanaUser InterfaceElasticsearchStore, Index,& AnalyzeIngestLogstash Beats+Elastic StackAlertingMonitoringReportingGraph
”Long” pipeline
Ingest node
FilebeatTail filesPacketbeatCapture network packetsMetricbeatSystem (ex Topbeat)ApacheMySQLNginxPostgreSQLRedisZookeeperWinlogbeatWindows event logs
apachebeathttpd server-statusburrowbeatkafka consumer lagcassandrabeatnodetool cfstatscloudtrailbeataws eventsdockerbeatcontainer statselasticbeatelasticsearch statusexecbeatshell cmd outputflowbeatsflowfactbeatpuppet facterhttpbeatpoll http(s) endpointsjmxproxybeattomcat jmx metricslmsensorsbeattemp, voltage, fansmysqlbeatany query -> elasticsearchpackagebeatdpkg, rpmpingbeaticmp ping w/ rttredisbeatredis infotwitterbeattweets by screen namewmibeatwindows monitoringhttps://www.elastic.co/guide/en/beats/libbeat/master/community-beats.html
DemoBeats & Kibana 5Script at https://github.com/cwurm/elastic-monitoring-meetup
Q&A@ChristophWurm