Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited Igor Motov New Features in Elasticsearch 1.0
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited about • Developer at Elasticsearch Inc joined Elasticsearch Inc.: Oct 2012 Elasticsearch contributor since Apr 2011 ! • Elasticsearch Inc founded: July 2012 headquarters: Amsterdam and Los Altos, CA provides: training (public & onsite), development support, production support subscription
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited v1.0 • rolling upgrades because not everyone can afford having “scheduled maintenance” • ability to backup data because “rm -rf" happens !
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited rolling upgrades Photo by Kamyar Adl
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited snapshot and restore Photo by John http://www.flickr.com/people/60026579@N00
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited restore in 0.90 1. close the index (shutdown the cluster) 2. find all existing index shards 3. replace all index shards with data from backup 4. open the index (start the cluster)
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited https://github.com/elasticsearch/ elasticsearch/issues/3826
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited how does it work in 0.90? • all queries are stored in special _percolate index • _percolate index has 1 primary shard which is replicated to every node • each percolated document is indexed in memory • all queries are executed against this document sequentially • execution time is linear to number of queries!
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited how does it work in 0.90? • all queries are stored in special _percolate index • _percolate index has 1 primary shard which is replicated to every node • each percolated document is indexed in memory • all queries are executed against this document sequentially • execution time is linear to number of queries!
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited other features • percolation of existing document • percolate count api • filter support (in addition to queries in 0.90) • highlighting • scoring • multi percolate (bulk percolation)
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited https://github.com/elasticsearch/ elasticsearch/issues/3173
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited _cat/* api Image Source: Wikipedia,
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited _cat/* api no, it will not help you organize your massive collection of cat pictures
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited _cat/* api It’s because humans suck at reading JSON
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited Which one is the master? (v1.0) $ curl localhost:9200/_cat/master GNf0hEXlTfaBvQXKBF300A 10.0.1.13 Lang, Steven
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited What’s wrong with facets in 0.90?
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited terms facet • Divides documents into buckets based on a value of a selected term • Calculates statistics on some other field of these document for each bucket
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited MOAR!!! But what if I want an average density by population histogram for each state?
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited aggs = buckets + calcs CA TX MA CO AZ
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited calc aggregators • avg • min • max • sum • count • stats • extended stats
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited bucket aggregators • global • filter • missing • terms • range • date range • ip range • histogram • date histogram • geo distance • nested
Copyright Elasticsearch 2013. Copying, publishing and/or distributing without written permission is strictly prohibited https://github.com/elasticsearch/ elasticsearch/issues/3300