Introduction to ElasticSearch - Aviv Berko

Presented in Sela Developer Meetup:
https://www.meetup.com/Sela-Developer-Meetup/events/251009018/

Transcript

1. © Copyright SELA software & Education Labs Ltd. | 14-18 Baruch Hirsch St Bnei Brak, 51202 Israel | www.selagroup.com Elasticsearch in the Real World Aviv Berko
2. About Me – Aviv Berko Senior Database and Big Data Consultant at Sela 12+ years experience as Database Administrator Oracle 12c Certified Professional  DATA: Oracle, SQL Server, PostgreSQL, Elasticsearch, Hadoop, Hive, Impala, Spark, Vertica, BigQuery, Kafka, Nifi…
3. What is Elasticsearch? ELK and elastic products Lucene Kibana Agenda
4. What is Elasticsearch? • Elasticsearch is an open source, distributed search engine based on Lucene. • Elasticsearch provides full-text search capabilities with a HTTP web interface and schema-free JSON documents. Elasticsearch
5. Resilient - designed for scale-out High availability Structured & unstructured data Schemaless Native JSON Near Real-time Full-text search Aggregations Geospatial Elasticsearch Features
6. Elasticsearch use cases Website/App Search • Application Search • Website Search Business Development and Marketing Insights • Operational Analytics • Metric Analytics IT Operations • Hardware and Software Monitoring • Log Analytics • Security Analytics
7. Elasticsearch History Version Original release date Latest version 0.4 08/02/2010 0.4.0 1 12/02/2014 1.0.3 1.7 16/07/2015 1.7.6 2 28/10/2015 2.0.2 2.1 24/11/2015 2.1.2 2.2 02/02/2016 2.2.2 2.3 30/03/2016 2.3.5 2.4 31/08/2016 2.4.6 5 26/10/2016 5.0.2 5.1 08/12/2016 5.1.2 5.2 31/01/2017 5.2.2 5.3 28/03/2017 5.3.3 5.4 04/05/2017 5.4.3 5.5 06/07/2017 5.5.3 5.6 11/09/2017 5.6.9 6 14/11/2017 6.0.1 6.1 12/12/2017 6.1.3 6.2 06/02/2018 6.2.4
8. Elasticsearch Ranking
9. ELK
10. Source: https://www.elastic.co/blog/2017-year-in-review
11. Elastic Products Logstash Kibana Beats Elasticsearch Hadoop Connectors APM
12. Beats Elastic Products Elasticsearch Kibana Logstash Security Monitoring Alerting Hadoop Connectors Elastic Cloud Reporting Graph Machine Learning APM
13. Full-text search engine library Written entirely in Java (Cross-Platform Solution) high-performance open source project Apache Lucene
14. Inverted Index Doc1: Kill two birds with one stone Doc2: Little bird told me TOKEN Documents bird Doc1, Doc2 kill Doc1 little Doc2 me Doc2 one Doc1 stone Doc1 tell Doc2 two Doc1 with Doc1 Tokenizer Stemmer
15. Kibana is an open source analytics and visualization platform designed to work with Elasticsearch. Use Kibana to search, view data stored in Elasticsearch indices. What is Kibana?
16. Demo Kibana
17. Questions