Using Elastic to monitor anything @ChristophWurm August 2016

Unstructured Data Structured Data Search Logging Security Metrics Analytics Social Sensor Logs Documents User Activity Location

Elastic Cloud Security X-Pack Kibana User Interface Elasticsearch Store, Index, & Analyze Ingest Logstash Beats + Elastic Stack Alerting Monitoring Reporting Graph

”Long” pipeline

Ingest node

Filebeat Tail files Packetbeat Capture network packets Metricbeat System (ex Topbeat) Apache MySQL Nginx PostgreSQL Redis Zookeeper Winlogbeat Windows event logs

apachebeat httpd server-status burrowbeat kafka consumer lag cassandrabeat nodetool cfstats cloudtrailbeat aws events dockerbeat container stats elasticbeat elasticsearch status execbeat shell cmd output flowbeat sflow factbeat puppet facter httpbeat poll http(s) endpoints jmxproxybeat tomcat jmx metrics lmsensorsbeat temp, voltage, fans mysqlbeat any query -> elasticsearch packagebeat dpkg, rpm pingbeat icmp ping w/ rtt redisbeat redis info twitterbeat tweets by screen name wmibeat windows monitoring https://www.elastic.co/guide/en/beats/libbeat/master/community-beats.html

Demo Beats & Kibana 5 Script at https://github.com/cwurm/elastic-monitoring-meetup

Q&A @ChristophWurm