Elasticsearch Distributed Search and Analytics

Transcript

1. Ferhat Sobay www.sebula.com @sebula ElasticSearch www.elasticsearch.org www.searchly.com @searchlyapp www.rcmmndr.com @rcmmndr www.istanbulcoders.org www.clojureist.com
2. • Schema less • JSON/Rest • NoSQL – Full Text Search Engine • Distributed • Apache 2 • Run with zero configuration
3. Site Search
4. Site Search
5. Site Search
6. Startup • wget http:// • tar -xzf elasticsearch.1.0.1..... • bin/elasticsearch
7. Indexing and Search • Curl -XPOST http://localhost:9200/test-index/test-type -d '{“name”:”ferhat”}' • Curl -XGET http://localhost:9200/test-index/test-type? q=ferhat
8. Distributed Architecture • Replication • Scales reading • SPOF • Sharding • Lucene fragments • Scales writing • General data distribution and scalability
9. Distributed Architecture • curl -XPUT http://localhost:9200/test -d '{ “settings.index_number_of_shards”: 5, “settings.index_number_of_replicas” : 1 }'
10. Distributed Architecture
11. Distributed Architecture
12. Elasticsearch • Plugins • Clients • Hadoop Integration • Kibana & Logstash
13. Data Analysis
14. Data Analysis Facets – Aggregation Framework • 1.0 Aggregation Framework • Facets still exits
15. Kibana
16. Log Analysis
17. Notification • Distributed Percolator • Java Metrics Library ES integration
18. Misc • Index restore & Backup 1.0 • Federated client 1.0
19. Q/A