Elasticsearch Symfony2 integration, data structures

Transcript

2. Symfony developer sinсe 2009 TeamLead at Exercise.com Symfony2 evangelist https://twitter.com/1cdecoder https://github.com/cystbear http://cystbear.tumblr.com/
3. elasticsearch
5. SELECT * FROM Article WHERE Text LIKE 'Symfony';
7. Shay Banon 07-Jul-2010 http://www.kimchy.org/the_future_of_compass/
10. * List * Graph * Tree * Hash * Heap * Queue * Stack
11. Tree
12. Binary search tree
13. AVL-tree
14. B-tree
15. ANOTHER WAY
16. Indexes B-Tree Spatial grid Quadtree R-Tree Hash Bitmap Reverse index Inverted index Partial index Function-based index http://habrahabr.ru/post/102785/
17. Inverted index "it is what it is" -- 0 "what is it" -- 1 "it is a banana" -- 2
18. Inverted index "it is what it is" -- 0 "what is it" -- 1 "it is a banana" -- 2 "a": {2} "banana": {2} "is": {0, 1, 2} "it": {0, 1, 2} "what": {0, 1}
19. Inverted index "it is what it is" -- 0 "what is it" -- 1 "it is a banana" -- 2 "a": {2} "banana": {2} "is": {0, 1, 2} "it": {0, 1, 2} "what": {0, 1} "what is it"
20. Inverted index "it is what it is" -- 0 "what is it" -- 1 "it is a banana" -- 2 "a": {2} "banana": {2} "is": {0, 1, 2} "it": {0, 1, 2} "what": {0, 1} "what is it" "what" "is" "it"
21. Inverted index "it is what it is" -- 0 "what is it" -- 1 "it is a banana" -- 2 "a": {2} "banana": {2} "is": {0, 1, 2} "it": {0, 1, 2} "what": {0, 1} "what is it" "what" "is" "it"
22. Inverted index "it is what it is" -- 0 "what is it" -- 1 "it is a banana" -- 2 "a": {2} "banana": {2} "is": {0, 1, 2} "it": {0, 1, 2} "what": {0, 1} "what is it" "what" "is" "it" {0,1} ⋂ {0,1,2} ⋂ {0,1,2} = {0,1}
23. Inverted index "it is what it is" -- 0 "what is it" -- 1 "it is a banana" -- 2 "a": {2} "banana": {2} "is": {0, 1, 2} "it": {0, 1, 2} "what": {0, 1} "what is it" "what" "is" "it" {0,1} ⋂ {0,1,2} ⋂ {0,1,2} = {0,1} "it is what it is", "what is it"
24. Morphology Stop words
25. elasticsearch Real time data Real time analytics Distributed High availability Multi-tenancy Full text search JSON Document oriented Conflict management Schema free RESTful API Build on top of Apache Lucene
26. elasticsearch base Index Type Document
27. elasticsearch types String Number Date Boolean Binary
28. elasticsearch CRUD curl -XPUT http://localhost:9200/blog/article/1 -d '{ "title": "New version of Elastic Search released!", "content": "...", "tags": ["announce", "elasticsearch", "release"] }'
29. http://www.amazon.com/ElasticSearch-Server-ebook/dp/B00BAOC2KQ
30. PHP/Symfony2 integration Java Lucene Elasticsearch PHP Elastica FOSElasticaBundle
31. FOSElasticaBundle External serializer (JMSserializer) Persistence: orm, mongodb, propel Native repositories Custom query builder: repo method Pagination: Pagerfanta, KnpPaginator
32. FOSElasticaBundle External serializer (JMSserializer) fos_elastica: clients: default: { host: localhost, port: 9200 } serializer: callback_class: FOS\ElasticaBundle\Serializer\Callback serializer: serializer indexes: website: client: default types: user: mappings: username: { boost: 5 } firstName: { boost: 3 } lastName: { boost: 3 } aboutMe: ~
33. FOSElasticaBundle Persistence: orm, mongodb, propel fos_elastica: clients: default: { host: localhost, port: 9200 } serializer: callback_class: FOS\ElasticaBundle\Serializer\Callback serializer: serializer indexes: website: client: default types: user: mappings: username: { boost: 5 } firstName: { boost: 3 } # more mappings... persistence: driver: mongodb model: Application\UserBundle\Document\User provider: ~
34. FOSElasticaBundle Custom query builder: repo method persistence: driver: mongod model: Application\UserBundle\Document\User provider: query_builder_method: createIsActiveQueryBuilder
35. FOSElasticaBundle Pagination: Pagerfanta, KnpPaginator $finder = $container->get('fos_elastica.finder.website.user'); /* Pagerfanta */ $userPaginator = $finder->findPaginated('bob'); /* Knp paginator */ $paginator = $this->get('knp_paginator'); $userPaginator = $paginator ->paginate($finder->createPaginatorAdapter('bob'));
36. FOSElasticaBundle Search $finder = $this->container->get('fos_elastica.finder.website.article'); $boolQuery = new \Elastica\Query\Bool(); $fieldQuery = new \Elastica\Query\Text(); $fieldQuery->setFieldQuery('title', 'I am a title string'); $fieldQuery->setFieldParam('title', 'analyzer', 'my_analyzer'); $boolQuery->addShould($fieldQuery); $tagsQuery = new \Elastica\Query\Terms(); $tagsQuery->setTerms('tags', array('tag1', 'tag2')); $boolQuery->addShould($tagsQuery); $categoryQuery = new \Elastica\Query\Terms(); $categoryQuery->setTerms('categoryIds', array('1', '2', '3')); $boolQuery->addMust($categoryQuery); $data = $finder->find($boolQuery);