Elasticsearch for Pharo Smalltalk

Elasticsearch for Pharo Smalltalk. Smalltalkで全文検索

Transcript

1. Elasticsearch for Pharo Smalltalk SmalltalkͰશจݕࡧ Sho Yoshida / @newapplesho SORABITO Inc. 2016/01/29 ୈ84ճSmalltalkษڧձ
2. About • Sho Yoshida • SORABITO Inc. Ͱಇ͍͍ͯ·͢ • ಇ͘ػցͷࠃࡍΦϯϥΠϯऔҾॴ ALLSTOCKER ( https://allstocker.com) Λ࡞͍ͬͯ ·͢
3. ͓͔͛͞·Ͱ160ΧࠃҎ্͔ΒΞΫηε͕དྷ͓ͯΓ·͢ ͜Μͳ΋ͷΛѻ͍ͬͯ·͢
4. ୈ75ճSmalltalkษڧձͷ࿩ • ୈ75ճSmalltalkษڧձͰࠓޙ΍Γ͍ͨ͜ͱͷ̍ͭʹʮશจݕࡧʯ • http://www.smalltalk-users.jp/Home/gao-zhi/dai75kaismalltalkbenkyoukai • RDS PostgreSQLΛ࢖͍ͬͯΔͷͰɺ೔ຊޠͷશจݕࡧ͕Ͱ͖ͳ͍ • ೔ӳͷશจݕࡧΛαϙʔτ͠ͳ͚Ε͹ͳΒͳ͍
5. https://www.elastic.co/products/elasticsearch
6. Elasticsearchͱ͸ • Apache LuceneϕʔεͷશจݕࡧΤϯδϯɺ ղੳαʔόʔ • εΩʔϚϨεɺυΩϡϝϯτࢦ޲ • RESTͰૢ࡞Ͱ͖Δ • ΫϥελϦϯά΋૝ఆ͍ͯ͠ΔͷͰɺجຊతͳઃఆ͸༰қʁ • ϥΠηϯε͸ Apache License v2 • JavaͰ࣮૷ • ϑΝηοτɺϋΠϥΠτݕࡧ΋Մೳ
7. ࣄྫ • GitHub • foursquare • SoundCloud • stackoverflow • ALLSTOCKER
8. GitHubΛ࢖ͬͯݟΔ https://github.com
9. શจݕࡧͱElasticsearch Elasticsearch͸సஔΠϯσοΫεʢ୯ޠͱυΩϡϝϯτIDΛࣙॻʹͯ͠ɺݕࡧ͢Δʣ https://speakerdeck.com/johtani/introduction-elasticsearch-and-elk- elasticsearchmian-qiang-hui-in-nagoya ৄ͘͠͸
10. σʔλߏ଄ RDB = Database -> Tables -> Rows -> Columns ElasticSearch = Index -> Types -> Documents -> Fields ͦ΋ͦ΋શ͘͜ͱͳΔͷͰൺ΂Δͷ΋มͰ͕͢ɾɾɾɾ
11. Elasticsearch for Pharo Smalltalk • Paul DeBruicker ͕࡞ͬͨElasticsearchͷϑΥʔΫϓϩδΣΫτ • http://ss3.gemtalksystems.com/ss/Elasticsearch.html • ࡞ऀ: @umejava, @newapplesho • ࠷৽ϦϙδτϦ͸GitHub • https://github.com/newapplesho/elasticsearch-smalltalk • Elasticsearch version 1ܥ͸αϙʔτɻ2ܥ͸ະରԠ
12. Elasticsearch for Pharo Smalltalk • ֦ு͕೉͍͠ͷΛվળ • Aggregation, QueryܥΛҰ৽ͨ͠
13. ElasticsearchͷΠϯετʔϧ 1.wget https://download.elasticsearch.org/…. 2.tar -xf elasticsearch-1.7.2.tar.gz 3../elasticsearch-1.7.2/bin/elasticsearch
14. ,VSPNPKJ㗮JOTUBMM ೔ຊޠͷܗଶૉղੳΤϯδϯ bin/plugin install elasticsearch/elasticsearch-analysis-kuromoji/2.5.0
15. &MBTUJDTFBSDIJORVJTJUPS㙊㙜㘣㘗㙦㗮㘗㙦㘬㘻㖽㙞 bin/plugin -install polyfractal/elasticsearch-inquisitor http://localhost:9200/_plugin/inquisitor/#/ Elasticsearch-inquisitor GUI͔ΒQueryΛ࣮ߦͰ͖ΔϓϥάΠϯ
16. ىಈ֬ೝ $ curl localhost:9200 { "status" : 200, "name" : "Lilandra Neramani", "cluster_name" : "elasticsearch", "version" : { "number" : "1.7.2", "build_hash" : "e43676b1385b8125d647f593f7202acbd816e8ec", "build_timestamp" : "2015-09-14T09:49:53Z", "build_snapshot" : false, "lucene_version" : "4.10.4" }, "tagline" : "You Know, for Search" }
17. elasticsearch for Pharo SmalltalkΛinstall Gofer new url: 'http://ss3.gemtalksystems.com/ss/Elasticsearch'; package: 'ConfigurationOfElasticsearch'; load. (Smalltalk at: #ConfigurationOfElasticsearch) load. Metacello new baseline: 'Elasticsearch'; repository: 'github://newapplesho/elasticsearch-smalltalk:v1.1.3/pharo-repository'; load. ·ͨ͸
18. ΠϯσοΫε࡞੒ͱϚοϐϯάͷઃఆ curl -XPUT 'localhost:9200/st_study' -d @sushi.json
19. ,VSPNPKJͷಈ࡞֬ೝ curl -XPOST 'http://localhost:9200/st_study/ _analyze?analyzer=analyzer&pretty=true' -d '༉ѹγϣϕϧ͸ݐઃ ػց'
20. ,VSPNPKJͷಈ࡞֬ೝ݁Ռ { "tokens" : [ { "token" : "༉ѹ", "start_offset" : 0, "end_offset" : 2, "type" : "word", "position" : 1 }, { "token" : "γϣϕϧ", "start_offset" : 2, "end_offset" : 6, "type" : "word", "position" : 2 }, { "token" : "͸", "start_offset" : 6, "end_offset" : 7, "type" : "word", "position" : 3 }, { "token" : "ݐઃ", "start_offset" : 7, "end_offset" : 9, "type" : "word", "position" : 4 }, { "token" : "ػց", "start_offset" : 9, "end_offset" : 11, "type" : "word", "position" : 5 } ] }
21. Sample Data "properties": { "title": { "type": "string", "store": "yes", "index": "not_analyzed" }, "description": { "type": "string", "store": "yes", "index": "analyzed" }, "price": { "type": "integer", "store": "yes" }
22. Sample (Seaside Example Sushi Store) #('Akami Maguro' 'Red Tuna' 'The lean meat near the spine of the tuna fish. It comes in various shades of red--with the lighter, shinier varieties being the best. For dieters, however, the redder the better. Easy on the palatte. The least expensive of the thre types of maguro.' 150)
23. υΩϡϝϯτͷ௥Ճ neta := JsonObject new. neta title:'Aji'; description:'This fish is pink-grey and shiny. When it''s fresh, the flesh is almost transparent. The texture is slippery and easy on the tongue--it should melt in your mouth. Aji is often eaten with soy sauce containing onion, ginger and garlic.' esDocument := ESDocument new type:'store'; content: neta. index addDocument: esDocument.
24. υΩϡϝϯτͷ࡟আ esDocument := ESDocument new id:'AVKMOVs3-FeOW1ziNoOb'; type:'store'; content: neta. esDocument deleteFromIndex: index.
25. ΠϯσοΫεͷ࡟আ index delete.
26. શ݅ݕࡧ "Match All" index := ESIndex indexNamed: 'st_study'. search := ESSearch new; index: index. query := ESMatchAllQuery new. search query: query. results := search search. results explore.
27. શ݅ݕࡧʢϖʔδϯάʣ "Match All" index := ESIndex indexNamed: 'st_study'. search := ESSearch new index: index. query := ESMatchAllQuery new. search query: query. results := search searchFrom: 0 size:2. results explore.
28. Match Query "Match" index := ESIndex indexNamed: 'st_study'. search := ESSearch new; index: index. query := ESMatchQuery new. query query:'aji'. search query: query. results := search search. results explore.
29. Term Query "ESTermQuery" index := ESIndex indexNamed: 'st_study'. search := ESSearch new index: index. query := ESTermQuery new field:'title'; query:'Aji'. search query: query. results := search search. results explore.
30. ιʔτ "sort" index := ESIndex indexNamed: 'st_study'. search := ESSearch new; index: index. query := ESTermQuery new field:'title'; query:'Aji'. sort := ESSortCriteria new fieldName: 'title'; sortDescending; yourself. search query: query. search addSortCriteria: sort. results := search search. results explore.
31. Aggregations "min Aggregations" index := ESIndex indexNamed: 'st_study'. search := ESSearch new; index: index. query := ESMatchAllQuery new. aggregation := ESMinAggregation new field:'price'. search query: query. search addAggregation: aggregation. result := search aggregate.
32. Aggregations "max Aggregations" index := ESIndex indexNamed: 'st_study'. search := ESSearch new; index: index. query := ESMatchAllQuery new. aggregation := ESMaxAggregation new field:'price'. search query: query. search addAggregation: aggregation. result := search aggregate.
33. Aggregations "avg Aggregations" index := ESIndex indexNamed: 'st_study'. search := ESSearch new; index: index. query := ESMatchAllQuery new. aggregation := ESAvgAggregation new field:'price'. search query: query. search addAggregation: aggregation. result := search aggregate.
34. DEMO
35. ࠓޙͷ༧ఆ • Elasticsearch 2.0ʹରԠ༧ఆ
36. ४උ͸੔ͬͨ ͋͞SmalltalkΛॻ͜͏ paul bica https://www.flickr.com/photos/dexxus/5820866907/