Introduction into the Elastic Stack

Slide 1

Slide 1 text

‹#› Introduction into the Elastic Stack Alexander Reelsen @spinscale

Slide 2

Slide 2 text

‹#› Ask questions! All the time!

Slide 3

Slide 3 text

Kibana Elasticsearch Beats Logstash X-Pack Elastic Cloud Security Alerting Monitoring Reporting Graph

Slide 4

Slide 4 text

Elasticsearch Heart of the Elastic Stack Distributed, Scalable High-availability Multi-tenancy Developer Friendly Real-time, Full-text Search Aggregations

Slide 5

Slide 5 text

Kibana Window into the Elastic Stack Visualize and analyze Geospatial Customize and Share Reports Graph Exploration UX to secure and manage the Elastic Stack Build Custom Apps

Slide 6

Slide 6 text

No content

Slide 7

Slide 7 text

No content

Slide 8

Slide 8 text

No content

Slide 9

Slide 9 text

Beats Lightweight data shippers Ship data from the source Ship and centralize in Elasticsearch Ship to Logstash for transformation and parsing Ship to Elastic Cloud Libbeat: API framework to build custom beats 30+ community Beats

Slide 10

Slide 10 text

Beats 10 Packetbeat Network data Filebeat Log files Winlogbeat Windows Event Logs Heartbeat Uptime monitoring +40 community Beats Metricbeat Metrics

Slide 11

Slide 11 text

Logstash Data processing pipeline Ingest data of all shapes, sizes, and sources Parse and dynamically transform data Transport data to any output Secure and encrypt data inputs Build your own pipeline More than 200+ plugins

Slide 12

Slide 12 text

ES-Hadoop Elasticsearch for Hadoop Two-way connector Index Hadoop data in Elasticsearch Enable real-time search capabilities Visualize HDFS data in Kibana Read/Write directly to/from Kafka Support for Spark, Storm MapReduce, and more

Slide 13

Slide 13 text

X-Pack Extensions for the Elastic Stack Security Alerting Monitoring Reporting Graph Analytics Machine Learning

Slide 14

Slide 14 text

Elastic Cloud Hosted Elasticsearch & Kibana Includes X-Pack features Starts at $45/mo Available in AWS today

Slide 15

Slide 15 text

Elastic Cloud Enterprise Provision and manage multiple Elastic Stack environments; Expose logging as a service to your entire organization

Slide 16

Slide 16 text

‹#› DEMO

Slide 17

Slide 17 text

X-pack X-pack Nodes (X) Logstash Messaging Queue Kafka Redis RabbitMQ Elasticsearch Master Nodes (3) Data Nodes - Warm (X) Instances (X) Kibana Custom UI Datastore Web APIs Social Sensors Log Files Beats Metrics Wire Data your{beat} Hadoop Ecosystem ES-Hadoop Ingest Nodes (X) Data Nodes - Hot (X) Authentication Notiﬁcation LDAP AD SSO

Slide 18

Slide 18 text

https://www.elastic.co/guide/en/elasticsearch/guide/current/index.html

Slide 19

Slide 19 text

‹#› Thank you for listening! We’re hiring https://www.elastic.co/about/careers We’re helping https://www.elastic.co/subscriptions Alexander Reelsen alex@elastic.co @spinscale