Neu im Elastic Stack

Überblick der Neuerungen im Elastic Stack: Reindex-API, Shrink-API, Ingest-Nodes, Monitoring in Logstash, neues Kibana-Interface, Timelion,...

Transcript

1. ! und " Elastic Stack Philipp Krenn̴̴̴̴̴̴@xeraa
3. Infrastructure | Developer Advocate
4. Wer verwendet: - Elasticsearch - Logstash & Kibana - Beats
5. You Know, for Search
6. ELK Stack
11. Elastic Stack
14. Query Profiler 2.2
15. Query Profiler GET /my-index/_search { "profile": true, "query": { "match_all": {} }
16. Reindex API 2.3
17. Reindex API POST /_reindex { "source": { "index": "old_index", "query": { "match":{ "user": "my_user" } } }, "dest": { "index": "new_index" } }
18. Task Managment API 2.3
19. Task Managment API GET /_tasks GET /_tasks?nodes=nodeId1,nodeId2 GET /_tasks?nodes=nodeId1,nodeId2&actions=cluster:* GET /_tasks/taskId1 GET /_tasks?parent_task_id=parentTaskId1 GET /_tasks/taskId1?wait_for_completion=true&timeout=10s POST /_tasks/taskId1/_cancel
20. Punkte in Feldnamen Zurück in 2.4
21. Punkte in Feldnamen Standardmäßig deaktiviert $ export ES_JAVA_OPTS="-Dmapper.allow_dots_in_name=true" $ ./bin/elasticsearch
22. Reporting 2.4
25. Ingest Node PUT /_ingest/pipeline/pipeline-name GET /_ingest/pipeline/pipeline-name GET /_ingest/pipeline/* DELETE /_ingest/pipeline/pipeline-name
26. Ingest Node { "description": "mysql pipeline", "processors": [ { "grok" : { "field" : "message", "pattern" : "..." } }, { "remove" : { "field" : "message" } } ] }
27. Painless Scripting {"name":"Philipp","goals":[9,27,15],"assists":[0,0,0]} GET /hockey-stats/_search { "query": { "function_score": { "script_score": { "script": { "lang": "painless", "inline": "int total = 0; for (int i = 0; i < input.doc.goals.size(); ++i) { total += input.doc.goals[i]; } return total;" } } } } }
28. Java HTTP Client
29. String Mappings string text analyzed keyword not-analyzed
30. Shrink API POST my_source_index/_shrink/my_target_index { "settings": { "index.number_of_replicas": 1, "index.number_of_shards": 1, "index.codec": "best_compression" }, "aliases": { "my_search_indices": {} } }
31. Node Names Persistent und langweilig
32. Striktes URL Parsing
33. $ curl -XGET 'localhost:9200/_analyze?tokenzier=keyword&filter=lowercase&text=this+is+a+test&pretty=true' { "error" : { "root_cause" : [ { "type" : "illegal_argument_exception", "reason" : "request [/_analyze] contains unrecognized parameter: [tokenzier] -> did you mean [tokenizer]?" } ], "type" : "illegal_argument_exception", "reason" : "request [/_analyze] contains unrecognized parameter: [tokenzier] -> did you mean [tokenizer]?" }, "status" : 400 }
35. UI
36. Console
37. Timelion
38. CSV Import
40. Monitoring http://localhost:9600/_node/hot_threads http://localhost:9600/_node/stats/ http://localhost:9600/_node/stats/events http://localhost:9600/_stats/jvm http://localhost:9600/_plugins/
41. Event Persistency Bald
43. Metricbeat
44. Community Beats
45. Prelert
47. Ausprobieren https://github.com/xeraa/vagrant-elastic-stack/
48. Pioneer Programm https://www.elastic.co/blog/elastic-pioneer-program
49. Fazit
50. Elastic Elastic Stack Elasticsearch
52. Termine
53. elastic{on}tour Frankfurt: 24.11.2016 https://www.elastic.co/elasticon/tour/2016/frankfurt
54. Training Berlin: 7.-10.11.2016 https://www.elastic.co/training
55. Danke! Fragen? Philipp Krenn̴̴̴̴̴@xeraa PS: Stickers