Slide 1

Slide 1 text

Elasticsearch @ Wayfair February 6, 2014

Slide 2

Slide 2 text

Name: Dan Rowe Company: Wayfair Team: Infrastructure Tools

Slide 3

Slide 3 text

Progression of integrating Elasticsearch @ Wayfair

Slide 4

Slide 4 text

4 Elasticsearch integration Syslog

Slide 5

Slide 5 text

5 Elasticsearch integration Syslog App Logs (gelf)

Slide 6

Slide 6 text

6 Elasticsearch integration Syslog App Logs (gelf) Kibana 3

Slide 7

Slide 7 text

7 Elasticsearch integration Syslog App Logs (gelf) HUD Dashboards Zabbix Graphite Others Elasticsearch

Slide 8

Slide 8 text

8 Elasticsearch integration Syslog App Logs (gelf) Zabbix Graphite Others Elasticsearc h Zabbix

Slide 9

Slide 9 text

9 Elasticsearch integration Syslog App Logs (gelf) Zabbix Graphite Others Elasticsearc h Commits

Slide 10

Slide 10 text

10 Elasticsearch integration Syslog App Logs (gelf) Zabbix Graphite Others Elasticsearc h Commits Ad Hoc Query Reports

Slide 11

Slide 11 text

11 Elasticsearch integration Syslog App Logs (gelf) Commits Network Traffic Zabbix Graphite Others Elasticsearc h Ad Hoc Query Reports

Slide 12

Slide 12 text

Usage of data in Elasticsearch @ Wayfair

Slide 13

Slide 13 text

13 Usages : Deployments Who’s Code is going out? HUD Dashboard after Deploy

Slide 14

Slide 14 text

14 Usages : Deployments Deploy Alert Email

Slide 15

Slide 15 text

15 Usages: Ad Hoc Query Alerts /** Set up adhoc alerting based off what you use to locate messages in kibana. * * item_name - a short name. Examples: elastic_search.syslog.sum.5min.int and elastic_search.syslog.sum.5min.string * query - the search terms you are using * threshold - number of hits in the last frequency of minutes * type - the type of message either 'gelf' or 'syslog'. php messages are gelf and logstash messages are syslog */ /** Set up adhoc facet query alerting based off what you use to locate messages in kibana. * * item_name - a short name. Examples: elastic_search.syslog.sum.5min.int and elastic_search.syslog.sum.5min.string * query - the search terms you are using * short_name - added to the item name to distinguish multiple items from multiple queries that you want in the same email * threshold - number of hits in the last frequency of minutes * type - the type of message either 'gelf' or 'syslog'. php messages are gelf and logstash messages are syslog * facet - the field you want to facet on * recipients - the email(s) * template - the name of the zabbix template you'd like these items in * additional_fields - if you need to see detial on fields other than the facet field in the email you can add them here. * additional_facet_fields - if you need to see all of another field that this error contians for example all the hosts an error is on * latest_timestamp_within - will check that the latest timestamp is within this window before includeing any hits in the email * window - defaults to frequency. This is the number of minutes to search. * email_subject - the subject to appear in the email * es_host_array - an array of es_hosts to query */

Slide 16

Slide 16 text

16 Usages: Issue/Error Investigation Syslog Commits Network Traffic App Logs (gelf) Unique Request ID Customer ID Files Involved Traffic Involved

Slide 17

Slide 17 text

No content