Elastic Stack 5.0 alpha 1-4

Elasticsearch勉強会京都での発表資料。

Transcript

1. ‹#› 2016/07 Jun Ohtani @johtani Elastic Stack 5.0 alpha1 - 4
3. ElasticελοΫ 3 Elastic Cloud  
   
   
    X-Pack Kibana    
   Elasticsearch !  "
   
   Logstash Beats +
4. 4 Product Logo
5. ELK Stack
6. ELK Stack
7. Along Came Beats ELKB
9. The Elastic Stack
10. Versions
11. Jun 9, 2015 1.6 Jul 16, 2015 1.7 Feb 19, 2015 4.0 Jun 10, 2015 4.1 May 14th, 2015 1.5 May 27th, 2015 1.0 Beta 1 July 13th, 2015 1.0 Beta 2 Sept 4 th, 2015 1.0 Beta 3 May 23, 2015 1.5 Nov 5, 2014 1.4 It’s complicated es kibana ls beats
12. es kibana ls beats Oct 28th Nov 21st Feb 2nd 2.0 4.2 2.0 2.1 4.3 2.1 1.0 2.2 4.4 2.2 1.1 Release Bonanza
13. v 5. 0
14. THIS IS ALPHA RELEASE! DO NOT USE IN PRODUCTION
15. elasticsearch
16. elasticsearch I N G E S T Ingest Node
17. elasticsearch Painless Scripting Dynamic/ Static
18. elasticsearch Kuromoji • N-best cost / example • Not only A best token stream • Number filter
19. elasticsearch Other changes - Alpha 1 • Plugin command • bin/elasticsearch-plugin • Text/Keyword field type instead of string field • text or keyword field types / deprecated string field type
20. elasticsearch Alpha 2 / Alpha 3 • Lucene 6 • Dimensional Points / Multi-dimensional points / IPv6 • Percolate Query • Improve Indexing performance • dots in Field name
21. elasticsearch • Low-level API • Can use Java 7 • Minimal dependencies • Only accept JSON-in and JSON-out Java REST Client
22. elasticsearch Alpha 4 • Rollover / Shrink API • Wait for refresh • Search profiler support aggs • half_float field data type, only uses 16 bits • _timestamp and _ttl can not create
23. kibana
24. kibana Brings a new focus on your data New design
25. kibana Appear in the main navigation Applicaton Framework
26. kibana • Plugin command • bin/kibana-plugin • "Sense" will be "Console" (not yet available) • Sense plugin will be built into Kibana Other changes - Alpha1
27. kibana Console - Alpha2 Sense is now 'Console'
28. kibana Import from CSV - Alpha4 Import data from CSV
29. kibana Monitoring Kibana instance - Alpha4 With X-Pack
30. kibana • Disable visualization buckets and drag to sort • Fixed small bugs Other changes - Alpha4
31. logstash
32. logstash Monitor all the things Monitoring API
33. logstash Monitor all the things hot threads API
34. logstash Other changes - Alpha1 • Plugin command • bin/logstash-plugin • Kafka 0.9 support • support SSL encryption and client auth
35. logstash Alpha2 / Alpha3 • Support GeoIP2 • Support IPv6 and more information • Introduce logstash.yml • Allow to set common settings • Improve Release Packages • Support systemd • Plugin Generator
36. logstash Moar Metrics, Moar Visibility per-plugin metrics - Alpha 4
37. logstash • Improve Elasticsearch Output • Kafka 0.10 Support • Allow to set common settings • Created a new LS_HOME/data directory to store plugin states • Added hostname, http_address, version for all Monitoring APIs Alpha 4
38. beats
39. decode JSON from log lines JSON support in Filebeat
40. Filtering the exported data Custom Fields and generic filtering
41. Other changes - Alpha1 • Kafka output • output to Kafka directly • Integration with Ingest Node • set "pipeline parameter" in the Elasticsearch output config • Support IP/TCP flows • report statistics like packet/byte counts
42. Alpha2 / Alpha3 • Kibana dashboards per beat • New directory layout • https://www.elastic.co/guide/en/beats/filebeat/master/directory-layout.html • Metricbeat • Collect many type of metrics include Topbeat • Add conditions to filtering • And introduce 'drop_event'
43. • Monitor MongoDB with Metricbeat • Support for gzip compression in Elasticsearch output • Ignore Symlinks log files • Kibana Dashboards for Apache Metricbeat Module Alpha4
44. Bundled set of features: Security, Alerting, Monitoring, Graph, and more … x-pack
45. We love extensions
46. Packs
47. X-Pack users and roles management
48. Reporting PDF
49. X-Pack reports, now with history
50. PRIVATE BETA cloud Elastic Cloud Deploy Elastic Cloud Enterprise Download
51. elastic{on}ͷίϯςϯπαΠτ https://www.elastic.co/elasticon/conf/2016/sf 51