Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017

Elasticsearch (R)Evolution — You Know, for Search… by Philipp Krenn at Big Data Spain 2017

Elasticsearch is a distributed, RESTful search and analytics engine built on top of Apache Lucene. After the initial release in 2010 it has become the most widely used full-text search engine, but it is not stopping there. The revolution happened and now it is time for evolution. We dive into current improvements and new features — how to make a great product even better.

https://www.bigdataspain.org/2017/talk/elasticsearch-revolution-you-know-for-search

Big Data Spain 2017
16th - 17th November Kinépolis Madrid

Cb6e6da05b5b943d2691ceefa3381cad?s=128

Big Data Spain

November 23, 2017
Tweet

Transcript

  1. None
  2. (R)Evolution Philipp Krenn̴̴̴̴̴̴̴̴̴@xeraa

  3. Revolution

  4. https://db-engines.com/en/ranking/ search+engine

  5. None
  6. None
  7. Who uses Elasticsearch?

  8. Infrastructure | Developer Advocate

  9. http://thedudeabides.com/articles/ the_birth_of_compass

  10. None
  11. $ curl http://localhost:9200 { "name" : "elasticsearch1", "cluster_name" : "docker-cluster",

    "cluster_uuid" : "MrmBv92dTQqh-z7pX2OkWw", "version" : { "number" : "5.6.1", "build_hash" : "667b497", "build_date" : "2017-09-14T19:22:05.189Z", "build_snapshot" : false, "lucene_version" : "6.6.1" }, "tagline" : "You Know, for Search" }
  12. $ curl -u elastic:changeme http://localhost:9200 { "name" : "elasticsearch1", "cluster_name"

    : "docker-cluster", "cluster_uuid" : "MrmBv92dTQqh-z7pX2OkWw", "version" : { "number" : "5.6.1", "build_hash" : "667b497", "build_date" : "2017-09-14T19:22:05.189Z", "build_snapshot" : false, "lucene_version" : "6.6.1" }, "tagline" : "You Know, for Search" }
  13. None
  14. None
  15. ELK Stack

  16. None
  17. None
  18. None
  19. Elastic Stack

  20. None
  21. Evolution

  22. Strictness* 5.0 * Demo

  23. Parameters & configs

  24. Bootstrap checks

  25. Shard Allocation API* 5.2 * Demo

  26. Cross Cluster Search 5.3

  27. Tribe node https://github.com/elastic/elasticsearch/ issues/4708

  28. None
  29. Cross cluster search

  30. None
  31. Rolling Upgrades* 6.0 * Demo

  32. Floodstage Watermark* 6.0 * Demo

  33. Low 85% High 90% Floodstage 95%

  34. Sequence Numbers* 6.0 * Demo

  35. None
  36. Cross datacenter replication 6.x

  37. Types* 5.6 to 8.0 * Demo

  38. None
  39. Why Data types Sparsity Scoring

  40. How 5.6 opt-in single type 6.x single type 7.x type

    optional in API 8.x no more types https://www.elastic.co/guide/en/elasticsearch/reference/5.6/ removal-of-types.html#_schedule_for_removal_of_mapping_types
  41. Adaptive Replica Selection 6.1

  42. None
  43. Pick best shard Exponentially Weighted Moving Average (EWMA) Piggyback on

    requests
  44. None
  45. Off by default cluster.routing.use_adaptive_replica_selection

  46. Benchmarks ∞

  47. None
  48. None
  49. Rally https://elasticsearch-benchmarks.elastic.co

  50. Conclusion

  51. Strictness Shard Allocation API Cross Cluster Search Rolling Upgrades

  52. Floodstage Watermark Sequence Numbers Types Adaptive Replica Selection

  53. Questions? Now & Elastic booth Philipp Krenn̴̴̴̴̴̴@xeraa