ElasticSearch 101

My ElasticSearch 101 presentation to the Surrey Ruby User Group, Nov 27th 2012.

Transcript

1. ElasticSearch 101 Wednesday, 28 November 12
2. It’s for... Wednesday, 28 November 12
3. You know, Search Wednesday, 28 November 12
4. based on Apache Lucene Wednesday, 28 November 12
5. JAVA :( Wednesday, 28 November 12
6. like MongoDB Wednesday, 28 November 12
7. HTTP + JSON Wednesday, 28 November 12
8. Document based Wednesday, 28 November 12
9. Schema Free Wednesday, 28 November 12
10. $ curl -XPUT http://localhost:9200/twitter/user/kimchy -d '{ "name" : "Shay Banon" }' $ curl -XPUT http://localhost:9200/twitter/tweet/1 -d '{ "user": "kimchy", "post_date": "2009-11-15T13:12:00", "message": "Trying out elasticsearch, so far so good?" }' $ curl -XPUT http://localhost:9200/twitter/tweet/2 -d '{ "user": "kimchy", "post_date": "2009-11-15T14:12:12", "message": "You know, for Search" }' Wednesday, 28 November 12
11. Demo Wednesday, 28 November 12
12. Auto Detects data types Wednesday, 28 November 12
13. Mappings Wednesday, 28 November 12
14. $ curl -XPUT http://localhost:9200/twitter $ curl -XPUT http://localhost:9200/twitter/user/_mapping -d '{ "user" : { "properties" : { "name" : { "type" : "string" } } } }' Wednesday, 28 November 12
15. { "tweet" : { "properties" : { "user" : {"type" : "string", "index" : "not_analyzed"}, "message" : {"type" : "string", "null_value" : "na"}, "postDate" : {"type" : "date"}, "priority" : {"type" : "integer"}, "rank" : {"type" : "float"} } } } Wednesday, 28 November 12
16. getting data out Wednesday, 28 November 12
17. $ curl -XGET http://localhost:9200/twitter/tweet/ _search?q=user:kimchy $ curl -XGET http://localhost:9200/twitter/tweet/_search -d '{ "query" : { "term" : { "user": "kimchy" } } }' $ curl -XGET http://localhost:9200/twitter/_search? pretty=true -d '{ "query" : { "range" : { "post_date" : { "from" : "2009-11-15T13:00:00", "to" : "2009-11-15T14:30:00" } } } }' Wednesday, 28 November 12
18. Multi Tenancy Wednesday, 28 November 12
19. $ curl -XPUT http://localhost:9200/elasticsearch/tweet/1 -d '{ "post_date": "2009-11-15T14:12:12", "message": "Zug Zug", "tag": "warcraft" }' $ curl -XPUT http://localhost:9200/kimchy/tweet/1 -d '{ "post_date": "2009-11-15T14:12:12", "message": "Whatyouwant?", "tag": "warcraft" }' $ curl -XGET http://localhost:9200/kimchy,elasticsearch/ tweet/_search?q=tag:warcraft Wednesday, 28 November 12
20. Settings Wednesday, 28 November 12
21. $ curl -XPUT http://localhost:9200/elasticsearch/ -d '{ "settings" : { "number_of_shards" : 2, "number_of_replicas" : 3 } }' Wednesday, 28 November 12
22. Distributed Wednesday, 28 November 12
23. Replicas & Shards Wednesday, 28 November 12
24. AUTOMATIC Wednesday, 28 November 12
25. Tools Wednesday, 28 November 12
26. Curl HTTPClient etc Wednesday, 28 November 12
27. ElasticSearch-Head https:/ /github.com/mobz/elasticsearch-head Wednesday, 28 November 12
28. DEMO Wednesday, 28 November 12
29. RDMS + ElasticSearch Wednesday, 28 November 12
30. Pre Process data Wednesday, 28 November 12
31. select " pt.code as pt_code, " pt.name as pt_name, " array_agg(DISTINCT hlt.code) as high_level_term_codes, " array_agg(DISTINCT hlgt.code) as high_level_group_term_codes, " soc.code as soc_code, " lang.name as language, " lang.meddra_version as meddra_version " ... Wednesday, 28 November 12
32. { "low_level_term" : { " " " “id” : “10049364_” " "name" : "Bleeding lips", " "llt_code" : “10049364", " " " "soc_code” : “10017947", " "high_level_term_codes" : [ "123457", " " " " " "932323" " " " ], " " " ... } } Wednesday, 28 November 12
33. with Ruby? Wednesday, 28 November 12
34. Tire https:/ /github.com/karmi/tire Wednesday, 28 November 12
35. DEMO Wednesday, 28 November 12
36. With ActiveRecord? Wednesday, 28 November 12
37. class Article < ActiveRecord::Base " include Tire::Model::Search " include Tire::Model::Callbacks end Wednesday, 28 November 12
38. DEMO Wednesday, 28 November 12
39. Resources http:/ /www.elasticsearch.org https:/ /github.com/karmi/tire Wednesday, 28 November 12