Elasticsearch - Why big system need you

Elasticsearch is a awesome, flexible and powerful open source, distributed real-time search and analytics engine for the cloud

Transcript

1. Elasticsearch Why big system need you by Trần Kim Hiếu a Mobile & Web Developer @ Silicon Straits Saigon
2. Searching is hard and important Functional requirements Find the right things (effectivity) Non-functional requirements Find the things right (efficiency) 4QFFE
   JT
   VTFMFTT
   XJUIPVU
   SFMFWBODF
   #JHHFTU
   QSPCMFN
   4FBSDI
   JT
   IJHIMZ
   TVCKFDUJWF • •
3. Search by term
4. Search by ID
5. Suggestion
6. Suggestion
7. Instant suggestion
8. Highlight
9. What is elasticsearch? distributed restful search and analytics real time data real time analytics distributed • • • • document oriented conflict management schema free restful api per-operation • • • • •
10. Installing After downloading the latest release and extracting it, elasticsearch can be started using: $ bin/elasticsearch To run foreground $ bin/elasticsearch -f It need set $JAVA_HOME variable • •
11. Using # curl -X PUT http://localhost:9200/products/product/1 -d '{ "name" : “high quality search engine" }' # curl -X POST 'http://localhost:9200/products/product/_search' -d '{ "query" : { "match" : { "name" : " search"} } }' Insert Searching
12. Configuration config/elasticsearch.yml or config/ elasticsearch.json http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/setup-configuration.html Some keyword in here YAML - http://www.yaml.org JSON - http://www.json.org • • • •
13. Logging Use famous Java logging library Log4j Seperate logging configuration (simplified log4j): config/logging.yml Keywords Log4j - http://logging.apache.org/log4j • • • •
14. Sharding & Replication Sharding is index partitioning Split logical data into physically smaller parts Control data flows Replication is share same data over several machines Increasing throughput due to concurrency Allow outage of nodes without dataloss • • • •
15. Sharding & Replication One row is a replication One column is a sharding
16. Indexing Import data to elasticsearch
17. Mapping Each JSON field can be mapped to a specific core type. JSON itself already provides us with some typing, with its support string integer/long float/double boolean null • • • • • •
18. Mapping core types array type object type root object type nested type • • • • • multi field type ip type geo point type geo shape type attachment type • • • • • http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/mapping-types.html Other types that elasticsearch supported
19. Analyzers
20. Analyzers how A simple way to understand about analyzers
21. Index how A simple way to understand about indexing
22. Searching Different ways of searching Search queries match, term, prefix, id, fuzzy Counting only, Geo-based queries More like this, Highlighting Faceting, Percolation, Scripting Suggestions • • • • •
23. Faceting Faceting allows aggregation of search results Term: Group results by a term Range: Group by price or date ranges Histogram: Group results in equally sized buckets, also as date histogram Statistical: Include statistical data like min, max, sum, avg & some more • • • • •
24. Faceting @ Vật Giá Laptop attributes faceting
25. Pluggable architecture Modularized architecture Plugins are simple zip files with a predefined layout Different plugin use-cases Lucene features Monitoring Scripting languages Rivers • • • • • • •
26. Clients & integrations Tons of languages supported already Perl, Python, Ruby, PHP, JavaScript, .NET, Scala, Clojure, Erlang Lots integrations available Grails, Play Framework (1,2), spring & spring-data Django, Haystack, Catalyst, Node, Mongoose Wordpress, Drupal, Symfony2, CakePHP, Nagios, Munin, collectd, MCollective, chef • •
27. Resources Elasticsearch official site - elasticsearch.org Introduction: Getting down and dirty with elasticsearch (Clinton Gormley) - http://www.slideshare.net/clintongormley/down-and- dirty-with-elasticsearch Explore your data with elasticsearch by Elasticsearch Inc - https://speakerdeck.com/elasticsearch/explore-your- data-with-elasticsearch Extending Elasticsearch by Alexander Reelsen - https://speakerdeck.com/spinscale/extending- elasticsearch • • • •
28. Thanks you Q & A