Elastic Stack 5.0 alpha1 - alpha5

第17回Elasticsearch勉強会での発表資料

Transcript

1. ‹#› 2016/09 Jun Ohtani @johtani Elastic Stack 5.0 alpha1 - 5
3. ElasticελοΫ 3 Elastic Cloud  
   
   
    X-Pack Kibana    
   Elasticsearch !  "
   
   Logstash Beats +
4. Versions
5. Jun 9, 2015 1.6 Jul 16, 2015 1.7 Feb 19, 2015 4.0 Jun 10, 2015 4.1 May 14th, 2015 1.5 May 27th, 2015 1.0 Beta 1 July 13th, 2015 1.0 Beta 2 Sept 4 th, 2015 1.0 Beta 3 May 23, 2015 1.5 Nov 5, 2014 1.4 It’s complicated es kibana ls beats
6. es kibana ls beats Oct 28th Nov 21st Feb 2nd 2.0 4.2 2.0 2.1 4.3 2.1 1.0 2.2 4.4 2.2 1.1 Release Bonanza
7. v 5. 0
8. THIS IS ALPHA RELEASE! DO NOT USE IN PRODUCTION
9. elasticsearch
10. elasticsearch I N G E S T Ingest Node
11. elasticsearch Painless Scripting Dynamic/ Static
12. elasticsearch Kuromoji • N-best cost / example • Not only A best token stream • Number filter
13. elasticsearch Other changes - Alpha 1 • Plugin command • bin/elasticsearch-plugin • Text/Keyword field type instead of string field • text or keyword field types / deprecated string field type
14. elasticsearch Alpha 2 / Alpha 3 • Lucene 6 • Dimensional Points / Multi-dimensional points / IPv6 • Percolate Query • Improve Indexing performance • dots in Field name
15. elasticsearch • Low-level API • Can use Java 7 • Minimal dependencies • Only accept JSON-in and JSON-out Java REST Client
16. elasticsearch Alpha 4 • Rollover / Shrink API • Wait for refresh • Search profiler support aggs • half_float field data type, only uses 16 bits • _timestamp and _ttl can not create
17. elasticsearch Alpha 5 • Netty 4 • Aggregation improvements • Easy to try custom tokenizers/filters in the _analyze API
18. elasticsearch Custom analyzer in _analyze API Try custom analyzer without creating index
19. elasticsearch ES-Hadoop Alpha 5 • Support Spark 2.0!
20. kibana
21. kibana Brings a new focus on your data New design
22. kibana Appear in the main navigation Applicaton Framework
23. kibana • Plugin command • bin/kibana-plugin • "Sense" will be "Console" (not yet available) • Sense plugin will be built into Kibana Other changes - Alpha1
24. kibana Console - Alpha2 Sense is now 'Console'
25. kibana Import from CSV - Alpha4 Import data from CSV
26. kibana Monitoring Kibana instance - Alpha4 With X-Pack
27. kibana • Disable visualization buckets and drag to sort • Fixed small bugs • Tile map uses Elastic Tile Service Other changes - Alpha4 - Alpha5
28. logstash
29. logstash Monitor all the things Monitoring API
30. logstash Monitor all the things hot threads API
31. logstash Other changes - Alpha1 • Plugin command • bin/logstash-plugin • Kafka 0.9 support • support SSL encryption and client auth
32. logstash Alpha2 / Alpha3 • Support GeoIP2 • Support IPv6 and more information • Introduce logstash.yml • Allow to set common settings • Improve Release Packages • Support systemd • Plugin Generator
33. logstash Moar Metrics, Moar Visibility per-plugin metrics - Alpha 4
34. logstash • Improve Elasticsearch Output • Kafka 0.10 Support • Allow to set common settings • Created a new LS_HOME/data directory to store plugin states • Added hostname, http_address, version for all Monitoring APIs • Improve Beats input • Per column encoding support for JDBC input Alpha 4 & Alpha 5
35. beats
36. decode JSON from log lines JSON support in Filebeat
37. Filtering the exported data Custom Fields and generic filtering
38. Other changes - Alpha1 • Kafka output • output to Kafka directly • Integration with Ingest Node • set "pipeline parameter" in the Elasticsearch output config • Support IP/TCP flows • report statistics like packet/byte counts
39. Alpha2 / Alpha3 • Kibana dashboards per beat • New directory layout • https://www.elastic.co/guide/en/beats/filebeat/master/directory-layout.html • Metricbeat • Collect many type of metrics include Topbeat • Add conditions to filtering • And introduce 'drop_event'
40. • Monitor MongoDB with Metricbeat • Support for gzip compression in Elasticsearch output • Ignore Symlinks log files • Kibana Dashboards for Apache Metricbeat Module • Filtering flexibility based on conditions Alpha 4 & Alpha 5
41. Bundled set of features: Security, Alerting, Monitoring, Graph, and more … x-pack
42. We love extensions
43. Packs
44. X-Pack users and roles management
45. Reporting PDF
46. X-Pack reports, now with history
47. PRIVATE BETA cloud Elastic Cloud Deploy Elastic Cloud Enterprise Download
48. elastic{on} TOUR ౦ژ 2016 https://www.elastic.co/elasticon/tour/2016/tokyo 48