Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017

Elasticsearch is a distributed, RESTful search and analytics engine built on top of Apache Lucene. After the initial release in 2010 it has become the most widely used full-text search engine, but it is not stopping there. The revolution happened and now it is time for evolution. We dive into current improvements and new features — how to make a great product even better.

https://www.bigdataspain.org/2017/talk/elasticsearch-revolution-you-know-for-search

Big Data Spain 2017
16th - 17th November Kinépolis Madrid

Transcript

2. (R)Evolution Philipp Krenn̴̴̴̴̴̴̴̴̴@xeraa
3. Revolution
4. https://db-engines.com/en/ranking/ search+engine
7. Who uses Elasticsearch?
8. Infrastructure | Developer Advocate
9. http://thedudeabides.com/articles/ the_birth_of_compass
11. $ curl http://localhost:9200 { "name" : "elasticsearch1", "cluster_name" : "docker-cluster", "cluster_uuid" : "MrmBv92dTQqh-z7pX2OkWw", "version" : { "number" : "5.6.1", "build_hash" : "667b497", "build_date" : "2017-09-14T19:22:05.189Z", "build_snapshot" : false, "lucene_version" : "6.6.1" }, "tagline" : "You Know, for Search" }
12. $ curl -u elastic:changeme http://localhost:9200 { "name" : "elasticsearch1", "cluster_name" : "docker-cluster", "cluster_uuid" : "MrmBv92dTQqh-z7pX2OkWw", "version" : { "number" : "5.6.1", "build_hash" : "667b497", "build_date" : "2017-09-14T19:22:05.189Z", "build_snapshot" : false, "lucene_version" : "6.6.1" }, "tagline" : "You Know, for Search" }
15. ELK Stack
19. Elastic Stack
21. Evolution
22. Strictness* 5.0 * Demo
23. Parameters & configs
24. Bootstrap checks
25. Shard Allocation API* 5.2 * Demo
26. Cross Cluster Search 5.3
27. Tribe node https://github.com/elastic/elasticsearch/ issues/4708
29. Cross cluster search
31. Rolling Upgrades* 6.0 * Demo
32. Floodstage Watermark* 6.0 * Demo
33. Low 85% High 90% Floodstage 95%
34. Sequence Numbers* 6.0 * Demo
36. Cross datacenter replication 6.x
37. Types* 5.6 to 8.0 * Demo
39. Why Data types Sparsity Scoring
40. How 5.6 opt-in single type 6.x single type 7.x type optional in API 8.x no more types https://www.elastic.co/guide/en/elasticsearch/reference/5.6/ removal-of-types.html#_schedule_for_removal_of_mapping_types
41. Adaptive Replica Selection 6.1
43. Pick best shard Exponentially Weighted Moving Average (EWMA) Piggyback on requests
45. Off by default cluster.routing.use_adaptive_replica_selection
46. Benchmarks ∞
49. Rally https://elasticsearch-benchmarks.elastic.co
50. Conclusion
51. Strictness Shard Allocation API Cross Cluster Search Rolling Upgrades
52. Floodstage Watermark Sequence Numbers Types Adaptive Replica Selection
53. Questions? Now & Elastic booth Philipp Krenn̴̴̴̴̴̴@xeraa