Elastic_Stack_-_What_s_new_-_Helsinki_Meetup_June_2019.pdf

A quick overview of some of the new features in versions 6.6-7.1 of the Elastic Stack

Transcript

1. Elastic Stack A tour of the new features Melvyn Peignon Abdon Pijpelink
2. Security is now Free Basic license Versions 6.8 and 7.1 Native and file realm user management TLS (SSL) Role-based access control Kibana Spaces https://www.elastic.co/blog/security- for-elasticsearch-is-now-free
3. Elastic Cloud on Kubernetes (ECK) Alpha | Basic (free) Secured by default Based on Kubernetes Operator pattern Support for GKE and vanilla 1.11 https://www.elastic.co/blog/introduc ing-elastic-cloud-on-kubernetes-the- elasticsearch-operator-and-beyond
4. 4 Elasticsearch
5. New Era of Cluster Coordination Rebuilds the cluster coordination layer, solid foundation for the future Based on strong theoretical foundations, and extensive testing Validated with formal models github.com/elastic/elasticsearch-formal-models Benefits No more minimum_master_nodes setting Sub-second master election times Fast removal of lagging/zombie nodes Node A Node B Node C
6. Bundling the JVM Elasticsearch distribution now bundles the JDK (uses OpenJDK) Simplifies the install experience by removing extra Java installation step Unbundled (no JVM) version is available for edge cases that need it
7. Index Lifecycle Management Frozen Indices (6.6) Beta in 6.6. GA in 6.7 New in 6.7: index freeze action Basic (free) feature Part of larger story around data management Index Lifecycle Mgmt (6.6) Data Rollups (6.3) Hot / Warm Snapshots Minimal Snapshot (6.4)
8. Index Lifecycle Mgmt GA | Basic (free) Simplifies defining, automating, and managing lifecycle of your data Lifecycle phases (supported actions) Phase Supported Actions Hot Rollover, Set recovery priority Warm Minimum age, Forcemerge, Shrink, Allocate, Set replicas,Set recovery priority Cold Allocate, Freeze Index, Set replicas, Set recovery priority Delete Delete, Set recovery priority
9. Production DC Disaster Recovery DC Cross-Cluster Replication GA | Platinum Replicate indices from one Elasticsearch cluster to another Other workarounds have operational overhead, multiple vendors, and/or system complexity Leader Follower
10. Production DC Disaster Recovery DC Cross-Cluster Replication GA | Platinum Use Cases High Availability / Disaster Recovery Data Locality (geo-proximity) Central Reporting Leader Follower Built-in cluster-to-cluster replication keeps data available even in the event of a total cluster failure
11. Central DC Leader Follower Singapore DC Ireland DC Canada DC Cross-Cluster Replication GA | Platinum Use Cases High Availability / Disaster Recovery Data Locality (geo-proximity) Central Reporting Keeping a copy of the data closer to the users can reduce query times for those users
12. Central Reporting Leader Follower Singapore DC Ireland DC Canada DC Cross-Cluster Replication GA | Platinum Use Cases High Availability / Disaster Recovery Data Locality (geo-proximity) Central Reporting Cluster Pulling data into a central cluster means a headquarters can query data even if the remote clusters are offline
13. Elasticsearch SQL GA | Basic + Platinum Launched as Beta in 6.3. Now GA. REST API & CLI Client (Basic License) • Interact with Elasticsearch data using SQL syntax • Get results in a tabular format Translate API (Basic License) • Convert SQL commands to Elasticsearch Query DSL • Great way to ramp up on full Elasticsearch Query DSL syntax JDBC & ODBC Client (Platinum)
14. Elasticsearch SQL GA | Basic + Platinum New in 6.7 • Sorting of groups by aggregates • DATE datatype • CURRENT_DATE • FIRST (and FIRST_VALUE) and LAST (and LAST_VALUE) aggregate functions
15. 15 Kibana
16. New Look & Feel Dark mode everywhere Responsive dashboards Kibana query language on by default
17. New Look & Feel Dark mode everywhere Responsive dashboards Kibana query language on by default
18. New Look & Feel Dark mode everywhere Responsive dashboards Kibana query language on by default
19. Maps: A new way to explore & visualize geospatial data in Kibana Beta | Basic (free)
20. Maps Beta | Basic (free) Multiple sources & layers in one map Map raw documents, with support for both geo_points and geo_shapes Dynamic client side styling Global search for quick analysis Full screen mode for your ops center Out of the box vector shape files from Elastic Maps Service Customize as needed
21. Canvas: Showcase Your Data, Live & Pixel-Perfect GA | Basic (free)
22. Canvas: Showcase Your Data, Live & Pixel-Perfect GA | Basic (free)
23. Canvas GA | Basic (free) Showcase your data, live & pixel-perfect Tell the story of your data, your way Showcase your work on the big screen Support Elasticsearch SQL Automate reporting (adios copy/paste) Built for the community, extend Canvas with plugins
24. 24 Beats
25. Functionbeat GA | Basic (free) New Beat type that deploys as a function in serverless platforms Easily collect and stream cloud data to Elasticsearch Runs as a function in AWS Lambda Supports: Cloudwatch Logs, SQS, and Kinesis (added in 6.7). More soon. Automate via single AWS CLI command
26. Auditbeat System Module Experimental - Basic (free) This release updates the Auditbeat System module, introduced in 6.6. New in 6.7: - Packages datasets (Debian, RPM, Homebrew) - Logins dataset for Linux - OOTB dashboards for all 6 datasets in the module
27. 27 Logstash
28. Native Java Plugin Support Beta - OSS Logstash native Java plugin support provides: First-class support for developers who wish to write pure Java plugins for Logstash Seamless operation with Ruby plugins Plugins run with high performance in the Java execution engine For example Java input, filter, and output plugins see the logstash-plugins repo in GitHub.
29. 29 APM
30. .NET Agent Preview Highly anticipated APM agent released as a preview feedback welcome via github or discuss There is also a survey available: https://go.es.io/apm-dot-net
31. Thank You