Elastic Stack 5.0 alpha1 - alpha5

657aeeff3fc467567dacebf8a1ea0b23?s=47 Jun Ohtani
September 16, 2016

Elastic Stack 5.0 alpha1 - alpha5

第17回Elasticsearch勉強会での発表資料

657aeeff3fc467567dacebf8a1ea0b23?s=128

Jun Ohtani

September 16, 2016
Tweet

Transcript

  1. ‹#› 2016/09 Jun Ohtani @johtani Elastic Stack 5.0 alpha1 -

    5
  2. 2

  3. ElasticελοΫ 3 Elastic Cloud      

    X-Pack Kibana     Elasticsearch !  "  Logstash Beats +
  4. Versions

  5. Jun 9, 2015 1.6 Jul 16, 2015 1.7 Feb 19,

    2015 4.0 Jun 10, 2015 4.1 May 14th, 2015 1.5 May 27th, 2015 1.0 Beta 1 July 13th, 2015 1.0 Beta 2 Sept 4 th, 2015 1.0 Beta 3 May 23, 2015 1.5 Nov 5, 2014 1.4 It’s complicated es kibana ls beats
  6. es kibana ls beats Oct 28th Nov 21st Feb 2nd

    2.0 4.2 2.0 2.1 4.3 2.1 1.0 2.2 4.4 2.2 1.1 Release Bonanza
  7. v 5. 0

  8. THIS IS ALPHA RELEASE! DO NOT USE IN PRODUCTION

  9. elasticsearch

  10. elasticsearch I N G E S T Ingest Node

  11. elasticsearch Painless Scripting Dynamic/ Static

  12. elasticsearch Kuromoji • N-best cost / example • Not only

    A best token stream • Number filter
  13. elasticsearch Other changes - Alpha 1 • Plugin command •

    bin/elasticsearch-plugin • Text/Keyword field type instead of string field • text or keyword field types / deprecated string field type
  14. elasticsearch Alpha 2 / Alpha 3 • Lucene 6 •

    Dimensional Points / Multi-dimensional points / IPv6 • Percolate Query • Improve Indexing performance • dots in Field name
  15. elasticsearch • Low-level API • Can use Java 7 •

    Minimal dependencies • Only accept JSON-in and JSON-out Java REST Client
  16. elasticsearch Alpha 4 • Rollover / Shrink API • Wait

    for refresh • Search profiler support aggs • half_float field data type, only uses 16 bits • _timestamp and _ttl can not create
  17. elasticsearch Alpha 5 • Netty 4 • Aggregation improvements •

    Easy to try custom tokenizers/filters in the _analyze API
  18. elasticsearch Custom analyzer in _analyze API Try custom analyzer without

    creating index
  19. elasticsearch ES-Hadoop Alpha 5 • Support Spark 2.0!

  20. kibana

  21. kibana Brings a new focus on your data New design

  22. kibana Appear in the main navigation Applicaton Framework

  23. kibana • Plugin command • bin/kibana-plugin • "Sense" will be

    "Console" (not yet available) • Sense plugin will be built into Kibana Other changes - Alpha1
  24. kibana Console - Alpha2 Sense is now 'Console'

  25. kibana Import from CSV - Alpha4 Import data from CSV

  26. kibana Monitoring Kibana instance - Alpha4 With X-Pack

  27. kibana • Disable visualization buckets and drag to sort •

    Fixed small bugs • Tile map uses Elastic Tile Service Other changes - Alpha4 - Alpha5
  28. logstash

  29. logstash Monitor all the things Monitoring API

  30. logstash Monitor all the things hot threads API

  31. logstash Other changes - Alpha1 • Plugin command • bin/logstash-plugin

    • Kafka 0.9 support • support SSL encryption and client auth
  32. logstash Alpha2 / Alpha3 • Support GeoIP2 • Support IPv6

    and more information • Introduce logstash.yml • Allow to set common settings • Improve Release Packages • Support systemd • Plugin Generator
  33. logstash Moar Metrics, Moar Visibility per-plugin metrics - Alpha 4

  34. logstash • Improve Elasticsearch Output • Kafka 0.10 Support •

    Allow to set common settings • Created a new LS_HOME/data directory to store plugin states • Added hostname, http_address, version for all Monitoring APIs • Improve Beats input • Per column encoding support for JDBC input Alpha 4 & Alpha 5
  35. beats

  36. decode JSON from log lines JSON support in Filebeat

  37. Filtering the exported data Custom Fields and generic filtering

  38. Other changes - Alpha1 • Kafka output • output to

    Kafka directly • Integration with Ingest Node • set "pipeline parameter" in the Elasticsearch output config • Support IP/TCP flows • report statistics like packet/byte counts
  39. Alpha2 / Alpha3 • Kibana dashboards per beat • New

    directory layout • https://www.elastic.co/guide/en/beats/filebeat/master/directory-layout.html • Metricbeat • Collect many type of metrics include Topbeat • Add conditions to filtering • And introduce 'drop_event'
  40. • Monitor MongoDB with Metricbeat • Support for gzip compression

    in Elasticsearch output • Ignore Symlinks log files • Kibana Dashboards for Apache Metricbeat Module • Filtering flexibility based on conditions Alpha 4 & Alpha 5
  41. Bundled set of features: Security, Alerting, Monitoring, Graph, and more

    … x-pack
  42. We love extensions

  43. Packs

  44. X-Pack users and roles management

  45. Reporting PDF

  46. X-Pack reports, now with history

  47. PRIVATE BETA cloud Elastic Cloud Deploy Elastic Cloud Enterprise Download

  48. elastic{on} TOUR ౦ژ 2016 https://www.elastic.co/elasticon/tour/2016/tokyo 48