ElasticSearch入門 - Speaker Deck

ElasticSearch入門

by Jun Ohtani

Slide 1

Slide 1 text

ElasticSearchೖ໳ 2013/08/29 @johtani 13೥8݄30೔༵ۚ೔

Slide 2

Slide 2 text

ࣗݾ঺հ ࢯ໊ɿେ୩ɹ७ Twitterɿ@johtani lucene-gosenͷίϛολʔ Solrೖ໳ஶऀͷ1ਓ ϒϩάɿhttp://blog.johtani.info ॴଐɿגࣜձࣾγʔϚʔΫ 13೥8݄30೔༵ۚ೔

Slide 3

Slide 3 text

ΞδΣϯμ ݕࡧΤϯδϯͬͯʁ సஔΠϯσοΫεɺN-gramɺܗଶૉͷ࿩ ElasticSearchͱ͸ʁ ΠϯσοΫεͷ࿦ཧߏ੒ͱ෺ཧߏ੒ ػೳ֓ཁ ࢀߟࢿྉͳͲ 13೥8݄30೔༵ۚ೔

Slide 4

Slide 4 text

ݕࡧΤϯδϯͬͯʁ ʢElasticSearchͱ͸ؔ܎ͷͳ͍֓ཁతͳ࿩ʣ 13೥8݄30೔༵ۚ೔

Slide 5

Slide 5 text

શจݕࡧͬͯʁ શจݕࡧʢFull text searchʣͱ͸ɺίϯϐϡʔλʹ͓͍ͯɺෳ਺ͷจॻʢϑΝΠ ϧʣ͔ΒಛఆͷจࣈྻΛݕࡧ͢Δ͜ͱɻʮϑΝΠϧ໊ݕࡧʯ΍ʮ୯ҰϑΝΠϧ ಺ͷจࣈྻݕࡧʯͱҟͳΓɺʮෳ਺จॻʹ·͕ͨͬͯɺจॻʹؚ·ΕΔશจΛ ର৅ͱͨ͠ݕࡧʯͱ͍͏ҙຯͰ࢖༻͞ΕΔɻ ʢWikipediaΑΓʣ 13೥8݄30೔༵ۚ೔

Slide 6

Slide 6 text

༻ޠ จॻʢυΩϡϝϯτʣ ɹݕࡧΤϯδϯʹอଘ͞ΕͨσʔλɻRDBͰͷϨίʔυʹ૬౰ ΫΤϦ ɹݕࡧ৚݅ɺݕࡧࣜ εΩʔϚ ɹRDBͷςʔϒϧʹ૬౰ ϑΟʔϧυ ɹRDBͷΧϥϜʹ૬౰ λʔϜʢTermʣ/τʔΫϯʢTokenʣ ɹΠϯσοΫεͷΩʔʹͳΔ୯ޠʢจࣈྻʣ 13೥8݄30೔༵ۚ೔

Slide 7

Slide 7 text

υΩϡϝϯτొ࿥ͷྲྀΕ 1 2 ΧπΦ͸αβΤͷఋ αβΤ͸ϫΧϝͷ࢞ υΩϡϝϯτͷొ࿥ 13೥8݄30೔༵ۚ೔

Slide 8

Slide 8 text

υΩϡϝϯτొ࿥ͷྲྀΕ 1 2 ΧπΦ͸αβΤͷఋ αβΤ͸ϫΧϝͷ࢞ 1 2 ΧπΦ αβΤ ͸ ͸ ͷ ͷ αβΤ ϫΧϝ ఋ ࢞ υΩϡϝϯτͷొ࿥ ୯ޠʹ෼ׂ 13೥8݄30೔༵ۚ೔

Slide 9

Slide 9 text

υΩϡϝϯτొ࿥ͷྲྀΕ 1 2 ΧπΦ͸αβΤͷఋ αβΤ͸ϫΧϝͷ࢞ 1 2 ΧπΦ αβΤ ͸ ͸ ͷ ͷ αβΤ ϫΧϝ ఋ ࢞ ΧπΦ αβΤ 1 1 2 ͸ ͷ ࢞ ϫΧϝ 2 1 2 1 2 1 ఋ 2 υΩϡϝϯτͷొ࿥ ୯ޠʹ෼ׂ ୯ޠ͔Βidͷ഑ྻ͕ Ҿ͚ΔΑ͏ʹ ʹసஔΠϯσοΫε 13೥8݄30೔༵ۚ೔

Slide 10

Slide 10 text

ݕࡧͷྲྀΕ ΧπΦɹαβΤ ΧπΦ αβΤ 1 1 2 ͸ ͷ ࢞ ϫΧϝ 2 1 2 1 2 1 ఋ 2 ݕࡧจࣈೖྗ 13೥8݄30೔༵ۚ೔

Slide 11

Slide 11 text

ݕࡧͷྲྀΕ ΧπΦɹαβΤ ΧπΦ αβΤ ΧπΦ αβΤ 1 1 2 ͸ ͷ ࢞ ϫΧϝ 2 1 2 1 2 1 ఋ 2 AND ݕࡧจࣈೖྗ ݕࡧจࣈͷύʔε ʴݕࡧΫΤϦԽ 13೥8݄30೔༵ۚ೔

Slide 12

Slide 12 text

ݕࡧͷྲྀΕ ΧπΦɹαβΤ ΧπΦ αβΤ ΧπΦ αβΤ 1 1 2 ͸ ͷ ࢞ ϫΧϝ 2 1 2 1 2 1 ఋ 2 AND ݕࡧจࣈೖྗ ݕࡧจࣈͷύʔε ʴݕࡧΫΤϦԽ సஔΠϯσοΫεΛݕࡧ 13೥8݄30೔༵ۚ೔

Slide 13

Slide 13 text

ݕࡧͷྲྀΕ ΧπΦɹαβΤ ΧπΦ αβΤ ΧπΦ αβΤ 1 1 2 ͸ ͷ ࢞ ϫΧϝ 2 1 2 1 2 1 ఋ 2 AND ݕࡧจࣈೖྗ ݕࡧจࣈͷύʔε ʴݕࡧΫΤϦԽ సஔΠϯσοΫεΛݕࡧ ˠANDݕࡧͳͷͰidͷ ഑ྻͷANDΛͱΔ 13೥8݄30೔༵ۚ೔

Slide 14

Slide 14 text

Slide 15

Slide 15 text

N-gramͱܗଶૉղੳ సஔΠϯσοΫεͷΩʔʢ୯ޠʣͷ࡞Γํ ೔ຊޠ͸୯ޠͷ੾Ε໨͕Θ͔Βͳ͍ͷͰసஔΠϯσοΫεͷΩʔ͸ओʹͭ͗ͷ2 ͭͷख๏Ͱ࡞Δ N-gram Nʢ1Ҏ্ͷ਺ࣈʣจࣈͣͭจষΛ۠੾Δ ܗଶૉղੳ ࣙॻͳͲΛ༻͍ͯҙຯͷ͋Δ୯ޠͰ۠੾Δ 13೥8݄30೔༵ۚ೔

Slide 16

Slide 16 text

N-gram N͕2ͷ࣌ͷྫɿ ϝϦοτɿ ݕࡧ࿙Ε͕ͳ͍ σϝϦοτɿ ਫ਼౓͕ѱ͍→ʮΧπʯͰ΋ώοτͪ͠Ό͏ ΠϯσοΫε͕ංେԽ ޠװʢ୯ޠͷجຊܗͱ͔ʣͰݕࡧෆՄ ΧπΦ͸αβΤͷఋ Χπ πΦ Φ͸ ͸α αβ βΤ Τͷ ͷఋ 13೥8݄30೔༵ۚ೔

Slide 17

Slide 17 text

ܗଶૉղੳ ܗଶૉղੳͷྫɿ ϝϦοτɿ ਫ਼౓͕Α͍ɿʮΧπʯͰݕࡧ→ʮΧπΦʯώοτ͠ͳ͍ ޠװʹΑΔݕࡧ͕ՄೳɿʮҿΈʯ→ʮҿΉʯ͕ݕࡧՄ σϝϦοτɿ ৽ޠʢະ஌ޠʣʹऑ͍→ࣙॻϕʔεͷ৔߹ʹࣙॻʹͳ͍୯ޠ͕Θ͔Βͳ͍ɻࣙॻ ߋ৽ޙ͸ΠϯσοΫε࠶࡞੒ ΧπΦ͸αβΤͷఋ ΧπΦ ͸ ͷ αβΤ ఋ 13೥8݄30೔༵ۚ೔

Slide 18

Slide 18 text

υΩϡϝϯτͱϑΟʔϧυ υΩϡϝϯτ͸ෳ਺ͷϑΟʔϧυ͔Βߏ੒͞ΕΔ ϑΟʔϧυ୯ҐͰసஔΠϯσοΫεΛ࡞੒ ϑΟʔϧυ୯ҐͰݕࡧ͕Մೳʹ 13೥8݄30೔༵ۚ೔

Slide 19

Slide 19 text

ElasticSearchͱ͸ʁ 13೥8݄30೔༵ۚ೔

Slide 20

Slide 20 text

ຊ೔ͷཁ఺ 13೥8݄30೔༵ۚ೔

Slide 21

Slide 21 text

ࠓ೔͸͜Ε͚ͩ͸֮͑ͯؼͬ ͍ͯͩ͘͞ɻ 13೥8݄30೔༵ۚ೔

Slide 22

Slide 22 text

ElasticSearch͸ Amazon Web Servicesͷ αʔϏεͱ͸ؔ܎͋Γ·ͤΜ 13೥8݄30೔༵ۚ೔

Slide 23

Slide 23 text

Ҏ্ 13೥8݄30೔༵ۚ೔

Slide 24

Slide 24 text

ElasticSearchͱ͸ʁ ෼ࢄܕRESTfulݕࡧˍղੳαʔό OSSʢApache Software License Version 2.0ʣ Apache LuceneΛίΞʹ࠾༻ʢ0.90.3͸Lucene 4.4.0ʹରԠʣ ϚϧνςφϯτରԠ εΩʔϚϑϦʔˍυΩϡϝϯτࢦ޲ ָ؍తഉଞ੍ޚ ͳͲͳͲ 13೥8݄30೔༵ۚ೔

Slide 25

Slide 25 text

ElasticSearchͷ ΠϯσοΫεߏ੒ ʢ࿦ཧͱ෺ཧʣ 13೥8݄30೔༵ۚ೔

Slide 26

Slide 26 text

ΠϯσοΫεߏ੒ʢ࿦ཧʣ ʮΠϯσοΫε/λΠϓʢϚοϐϯάλΠϓʣ/υΩϡϝϯτʯͱ͍͏ߏ੒ ※Solrʹ͸λΠϓͱ͍͏֓೦͕ͳ͍ ElasticSearch indexɿbooks typeɿ novel typeɿ magazine doc1 doc2 doc3 indexɿdvds 13೥8݄30೔༵ۚ೔

Slide 27

Slide 27 text

ΠϯσοΫεߏ੒ʢ࿦ཧʣ υΩϡϝϯτ ɹɹɿRDBͷߦʹ૬౰͢Δ֓೦ɻ ɹɹɹߏ଄͕ݻఆͰͳ͍ʹεΩʔϚϑϦʔʢεΩʔϚΛఆٛ͢Δ͜ͱ΋Մೳʣ λΠϓʢϚοϐϯάλΠϓʣ ɹɹɿRDBͷςʔϒϧʹ૬౰͢Δ֓೦ɻ ɹɹɹυΩϡϝϯτΛ·ͱΊΔίϯςφతͳ΋ͷɻ ɹɹɹλΠϓຖʹεΩʔϚʢESͰ͸Ϛοϐϯάͱ͍͏ʣΛఆٛՄೳ ΠϯσοΫε ɹɹɿRDBͷσʔλϕʔεʹ૬౰͢Δ֓೦ɻ ɹɹɹ෺ཧతͳϑΝΠϧʹอଘ͞ΕΔ୯Ґ ɹɹʢλΠϓ͸͋͘·Ͱ΋֓೦తͳ΋ͷͰɺ ɹɹɹ෺ཧతʹ͸ΠϯσοΫεͷ୯ҐͰอଘɻ※෺ཧߏ੒͸ޙड़ʣ 13೥8݄30೔༵ۚ೔

Slide 28

Slide 28 text

ΠϯσοΫεߏ੒ʢ࿦ཧʣ ElasticSearchͰ͸࿦ཧߏ੒͕URLͱಉ͡ߏ੒ υΩϡϝϯτͷొ࿥ curl -XPUT http://localhost:9200/books/novel/doc1 -d ‘{...}’ υΩϡϝϯτͷݕࡧʢΠϯσοΫε୯Ґʣ curl -XGET http://localhost:9200/books/_search?q=... υΩϡϝϯτͷݕࡧʢλΠϓ୯Ґʣ curl -XGET http://localhost:9200/books/novel/_search?q=... υΩϡϝϯτͷIDʹΑΔऔಘʢυΩϡϝϯτ୯Ґʣ curl -XGET http://localhost:9200/books/novel/doc1 13೥8݄30೔༵ۚ೔

Slide 29

Slide 29 text

ΠϯσοΫεߏ੒ʢ࿦ཧʣ ෳ਺ͷΠϯσοΫεΛԣஅతʹݕࡧ΋ՄೳʢΧϯϚ۠੾ΓͰOKʣ curl -XGET http://localhost:9200/books,dvds/_search?q=... શΠϯσοΫεΛԣஅݕࡧ͢Δʹ͸ curl -XGET http://localhost:9200/_search?q=... શΠϯσοΫεͷλΠϓࢦఆͰͷݕࡧ΋Մೳ curl -XGET http://localhost:9200/_all/magazine/_search?q=... 13೥8݄30೔༵ۚ೔

Slide 30

Slide 30 text

ΠϯσοΫεߏ੒ʢ෺ཧʣ 13೥8݄30೔༵ۚ೔

Slide 31

Slide 31 text

Ϋϥελɿelasticsearch ΠϯσοΫεߏ੒ʢ෺ཧʣ ΫϥελͱϊʔυɺΠϯσοΫεͱγϟʔυʢshardʣͷؔ܎ ϊʔυɿElasticSearchϓϩηε̍ ϊʔυɿElasticSearchϓϩηε̎ booksɿprimary shard1 dvdsɿreplica shard1 dvdsɿreplica shard2 booksɿreplica shard2 dvdsɿprimary shard1 booksɿreplica shard1 dvdsɿprimary shard2 booksɿprimary shard2 13೥8݄30೔༵ۚ೔

Slide 32

Slide 32 text

ΠϯσοΫεߏ੒ʢ෺ཧʣ Ϋϥελ͸nݸͷϊʔυ͔Βߏ੒ʢcluster.name͕ಉҰͳΒಉҰΫϥελʣ ΠϯσοΫε͸nݸͷγϟʔυ͔Βߏ੒͞Εɺγϟʔυ୯ҐͰϊʔυʹ഑ஔ͞Ε Δ͜ͱͰ෼ࢄՄೳ γϟʔυ୯ҐͰϨϓϦΧΛอ࣋Մೳ σϑΥϧτͰɺ5γϟʔυɺ1ϨϓϦΧʢ/1γϟʔυʣ ※γϟʔυ਺͸ΠϯσοΫε࡞੒࣌ʹͷΈࢦఆ͕ՄೳɻϨϓϦΧ਺͸มߋՄೳ γϟʔυ෼ׂػೳ͕ͳ͍ͨΊɻSolr͸shard splittingػೳ͋Γʢ2013/04ʣ ※ಉҰϓϩηε্ʹಉҰγϟʔυͷϨϓϦΧͱϓϥΠϚϦ͕৐Βͳ͍Α͏ʹͳͬ ͍ͯΔ 13೥8݄30೔༵ۚ೔

Slide 33

Slide 33 text

Ϋϥελ؅ཧ Ϋϥελ΁ͷϊʔυ௥ՃͳͲͷϊʔυ୳ࡧ͸σϑΥϧτZen Discovery ϚϧνΩϟετorϢχΩϟετʹΑΔϊʔυ୳ࡧ ϚϧνΩϟετɿϚϧνΩϟετΛར༻ͨ͠ϊʔυ୳ࡧ͓ΑͼΫϥελߏங ϢχΩϟετɿϗετϦετΛར༻ͨ͠Ϋϥελͷߏங ΫϥελىಈޙʹϚελʔϊʔυΛબग़ʢϚϧνϚελ͕Մೳʣ Ϛελϊʔυ͕Ϋϥελશମͷো֐ݕ஌Λ࣮ࢪ http://www.elasticsearch.org/guide/reference/modules/discovery/zen/ ※ZooKeeperΛ༻͍ͨϊʔυ୳ࡧͷϓϥάΠϯ΋͋Δ 13೥8݄30೔༵ۚ೔

Slide 34

Slide 34 text

ػೳ֓ཁ 13೥8݄30೔༵ۚ೔

Slide 35

Slide 35 text

ػೳ֓ཁ ઃఆؔ࿈ ܕͷࣗಈܾఆɺಈతϚοϐϯάɺςϯϓϨʔτͳͲ σʔλߏ଄ ೖΕࢠɺ਌ࢠߏ଄ɺ෦෼ߋ৽ ศརػೳ TTLɺεϩʔΫΤϦϩάɺεϩʔΠϯσΫγϯάϩάɺϓϥάΠϯ ݕࡧɺొ࿥ػೳ Geoɺ PercoratorɺόϧΫΠϯαʔτ 13೥8݄30೔༵ۚ೔

Slide 36

Slide 36 text

ઃఆؔ࿈ 13೥8݄30೔༵ۚ೔

Slide 37

Slide 37 text

ઃఆؔ࿈ʢجຊʣ ΄ͱΜͲ͢΂ͯͷઃఆʹ͍ͭͯɺREST APIͰઃఆ͕Մೳ ઃఆϑΝΠϧͱͯ͠อଘ΋Մೳ ֬ೝ΋REST APIͰՄೳ Ϋϥελͷঢ়ଶͳͲ΋ ΠϯσοΫεͷ࡞੒ɺ࡟আ΋ curl -XPUT 'http://localhost:9200/twitter/' curl -XDELETE 'http://localhost:9200/twitter/' curl -XGET 'http://localhost:9200/_cluster/health?pretty=true' 13೥8݄30೔༵ۚ೔

Slide 38

Slide 38 text

ઃఆؔ࿈ʢܕͷܾఆػೳʣ JSONΦϒδΣΫτ͔ΒࣗಈͰϑΟʔϧυͷܕΛਪଌͯ͠ొ࿥Մೳ ʢεΩʔϚϑϦʔͱݺ͹ΕΔॴҎʣ ਺஋ɺ೔෇ɺจࣈྻͳͲΛਪଌͯ͠ϑΟʔϧυΛܾఆ ਺஋ɿ numeric_detectionʹtrue/falseΛઃఆ ೔෇ɿdynamic_date_formatsɿjoda-timeϥΠϒϥϦͷ೔෇ϑΥʔϚοτจ ࣈྻΛࢦఆʢෳ਺ࢦఆՄʣ 13೥8݄30೔༵ۚ೔

Slide 39

Slide 39 text

ܕͷࣗಈܾఆͷ஫ҙ఺ ஫ҙ఺ ͢ͰʹܕΛܾఆͨ͠ϑΟʔϧυʹҟͳΔܕͷσʔλΛ͍ΕΔͱΤϥʔʹͳͬ ͨΓɺ੾ΓࣺͯΒΕͨΓ Τϥʔྫɿ24ʢlongܕʣΛొ࿥ޙɺ”hoge”ʢstringܕʣΛొ࿥ ignore_malformed͕trueͰઃఆ͞Ε͍ͯΕ͹ΤϥʔʹͳΒͳ͍ ΤϥʔʹͳΒͳ͍ྫɿ24ʢlongܕʣΛొ࿥ޙɺ12.3ʢfloatܕʣΛొ࿥ σϑΥϧτͰ͸খ਺఺ҎԼ͕੾ΓࣺͯΒΕͯ12Ͱొ࿥͞Εͯ͠·͏ 13೥8݄30೔༵ۚ೔

Slide 40

Slide 40 text

ઃఆؔ࿈ʢಈతϚοϐϯάʣ ϑΟʔϧυ໊ͳͲʹΑΔϑΟʔϧυܕͷਪఆΛઃఆՄೳ SolrͷμΠφϛοΫϑΟʔϧυͷΑΓॊೈͳػೳ mappingsఆٛʹdynamic_templatesͷઃఆΛ഑ྻͰ௥Ճ { "person" : { "dynamic_templates" : [ { "template_1" : { "match" : "multi*", "mapping" : { "type" : "multi_field", "fields" : { "{name}" : {"type": "{dynamic_type}", "index" : "analyzed"}, "org" : {"type": "{dynamic_type}", "index" : "not_analyzed"} } } } },... 13೥8݄30೔༵ۚ೔

Slide 41

Slide 41 text

ઃఆؔ࿈ʢςϯϓϨʔτʣ ΠϯσοΫε୯Ґͷઃఆ΋ςϯϓϨʔτԽՄೳ ΠϯσοΫε໊ʹtemplate͕Ұகͨ͠΋ͷΛద༻ɻorderͷେ͖͍΋ͷͰ্ॻ͖ ྫɿجຊઃఆ͸ϨϓϦΧ0͕ͩɺha_Ͱ͸͡·ΔΠϯσοΫε͸ϨϓϦΧ5 curl -XPUT localhost:9200/_template/main_template -d ' { "template" : "*", "order" : "1", "settings" : { "index.number_of_replicas" : 0 } } curl -XPUT localhost:9200/_template/ha_template -d ' { "template" : "ha_*", "order" : "10", "settings" : { "index.number_of_replicas" : 5 } } 13೥8݄30೔༵ۚ೔

Slide 42

Slide 42 text

σʔλߏ଄ 13೥8݄30೔༵ۚ೔

Slide 43

Slide 43 text

σʔλߏ଄ʢωετʣ ωετɺ਌ࢠɺΦϒδΣΫτͳͲͷσʔλ΋ొ࿥Մೳ ʢSolr͸جຊϑϥοτͳσʔλͷΈʣ ྫɿTγϟπͷ৭ͱαΠζͷ૊Έ߹Θͤʢωετʣ { "variation" : [ { "color" : "blue", "size" : 4 }, { "name" : "green", "size" : 6 } ] } { "query" : { "nested" : { "path" : "variation", "query" : { "bool" : { "must" : [ { "term" : {"variation.name" : "green"} }, { "term" : {"variation.size" : "6"} } ] } } } } } ΫΤϦ σʔλ 13೥8݄30೔༵ۚ೔

Slide 44

Slide 44 text

σʔλߏ଄ʢ਌ࢠʣ ਌ࢠؔ܎ʹؔ͢Δݕࡧ΋ՄೳʢmappingͰઃఆ΋ඞཁʣ ࢠσʔλొ࿥࣌ʹ਌IDΛࢦఆ $ curl -XPUT localhost:9200/shop/variation/1?parent=1 -d '{ "color" : "red", "size" : "XL" }' ࢠσʔλ $ curl -XPUT localhost:9200/shop/cloth/1 -d '{ "name" : "something" }' ਌σʔλ $ curl -XPUT localhost:9200/shop/variation/2?parent=1 -d '{ "color" : "green", "size" : "S" }' ࢠσʔλ { "has_child" : { "type" : "variation", "query" : { "bool" : { "must" : [ { "term": {"size" : "XL"} }, { "term": {"color" : "red"} } ] } } } } ΫΤϦ 13೥8݄30೔༵ۚ೔

Slide 45

Slide 45 text

σʔλߏ଄ʢ෦෼ߋ৽ʣ _sourceϑΟʔϧυʹσϑΥϧτͰೖྗ͞ΕͨJSONͷσʔλΛอ࣋ ʢSolrʹ͸ͳ͍ʣ _sourceϑΟʔϧυΛ࢖༻͢Δ෦෼ߋ৽͕Մೳ curl -XPOST 'localhost:9200/test/type1/1/_update' -d '{ "script" : "ctx._source.counter += count", "params" : { "count" : 4 } }' 13೥8݄30೔༵ۚ೔

Slide 46

Slide 46 text

ศརػೳʢTTLʣ TTLʹTime To Live σʔλͷੜଘظؒΛࢦఆՄೳʢྫ͸1೔ʣ ExpireͷνΣοΫॲཧ͸60sຖʹߦΘΕΔʢมߋՄʣ { "tweet" : { "_ttl" : { "enabled" : true, "default" : "1d" } } } mapping 13೥8݄30೔༵ۚ೔

Slide 47

Slide 47 text

ศརػೳʢϩάʣ index slow log/search slow logʢSolrʹ͸ͳ͍ػೳʣ ΠϯσοΫε࣌ɺݕࡧ࣌ʹॲཧ͕͖͍࣌ؒ͠஋Λ௒͑ͨΒϩάग़ྗ ϩάϨϕϧ͝ͱʹ஋ΛઃఆՄೳ #index.search.slowlog.threshold.query.warn: 10s #index.search.slowlog.threshold.query.info: 5s #index.search.slowlog.threshold.query.debug: 2s #index.search.slowlog.threshold.query.trace: 500ms #index.search.slowlog.threshold.fetch.warn: 1s #index.search.slowlog.threshold.fetch.info: 800ms #index.search.slowlog.threshold.fetch.debug: 500ms #index.search.slowlog.threshold.fetch.trace: 200ms 13೥8݄30೔༵ۚ೔

Slide 48

Slide 48 text

ศརػೳʢϓϥάΠϯʣ ElasticSearchͷ֦ுػೳ RiverɿσʔλΛElasticSearchʹྲྀ͠ࠐΉϓϥάΠϯʢྫɿRabbitMQͱ͔ʣ AnalysisɿΞφϥΠβͷϓϥάΠϯʢྫɿKuromojiͱ͔ʣ SiteɿΫϥελ؅ཧͱ͔ ϓϥάΠϯͷΠϯετʔϧ͸෇ଐͷpluginίϚϯυʹͯՄೳ ʢ௨ৗ͸ωοτʹ઀ଓ͍ͯ͠Δඞཁ͕͋Δʣ ϓϥάΠϯͷҰཡʢhttp://www.elasticsearch.org/guide/reference/modules/ plugins/ʣ 13೥8݄30೔༵ۚ೔

Slide 49

Slide 49 text

ݕࡧػೳʢPercoratorʣ ΫΤϦΛΠϯσοΫεԽͯ͠ొ࿥ ొ࿥ࡁΈͷΫΤϦʹώοτ͢Δσʔλ͔Ͳ͏͔ΛಛఆͷϦΫΤετʹσʔλ Λૹ৴͢Δ͜ͱͰΘ͔Δ࢓૊Έʢར༻ՄೳͳΫΤϦ͸Ұ෦੍ݶ͋Γʣ curl -XPUT localhost:9200/_percolator/test/kuku -d '{ "query" : { "term" : { "field1" : "value1" } } } curl -XGET localhost:9200/test/type1/_percolate -d '{ "doc" : { "field1" : "value1" } }' And the matches are part of the response: {"ok":true, "matches":["kuku"]} percoratorͷొ࿥ percoratorͷ֬ೝ 13೥8݄30೔༵ۚ೔

Slide 50

Slide 50 text

ݕࡧػೳʢGeoʣ Ң౓ܦ౓σʔλΛར༻ͨ͠ݕࡧ Ң౓ܦ౓ɺgeohashɺgeo_shapeͳͲ த৺఺͔Βͷڑ཭ɺۣܗɺgeohashʹΑΔߜࠐͳͲ͕Մೳ ڑ཭ʹΑΔϑΝηοτ΋ 13೥8݄30೔༵ۚ೔

Slide 51

Slide 51 text

ొ࿥ػೳʢόϧΫॲཧʣ େྔͷॲཧΛߦ͏ͨΊͷAPIʢ_bulkʣ http://www.elasticsearch.org/guide/reference/api/bulk/ UDP΋ར༻Մೳ { "index" : { "_index" : "test", "_type" : "type1", "_id" : "1" } } { "field1" : "value1" } { "delete" : { "_index" : "test", "_type" : "type1", "_id" : "2" } } { "create" : { "_index" : "test", "_type" : "type1", "_id" : "3" } } { "field1" : "value3" } { "update" : {"_id" : "1", "_type" : "type1", "_index" : "index1"} } { "doc" : {"field2" : "value2"} } όϧΫॲཧσʔλྫ 13೥8݄30೔༵ۚ೔

Slide 52

Slide 52 text

ͦͷଞʢؔ࿈πʔϧͱ͔ʣ Kibana3ʴElasticSearchʴ(logstash OR fluentd) ElasticSearchΛετϨʔδʹͯ͠ϩάσʔλͷอଘͱՄࢹԽΛߦ͏ 13೥8݄30೔༵ۚ೔

Slide 53

Slide 53 text

ࢀߟࢿྉͳͲ 13೥8݄30೔༵ۚ೔

Slide 54

Slide 54 text

ࢀߟϖʔδ ຊՈˍΨΠυ http://www.elasticsearch.org http://www.elasticsearch.org/guide/ αϙʔτˍτϨʔχϯά http://elasticsearch.com Solr vs ElasticSearchͷ೔ຊޠ຋༁൛ https://github.com/minghai/ElasticSearch_VS_Solr Sematextͷϒϩά http://blog.sematext.com 13೥8݄30೔༵ۚ೔

Slide 55

Slide 55 text

ࢀߟॻ੶ͱ͔ ElasticSearch ServerʢPackt Publishingɺ2013/02݄ൃചʣ http://www.packtpub.com/elasticsearch-server-for-fast-scalable-flexible- search-solution/book http://elasticsearchserverbook.com Mastering ElasticSearchʢPackt Publishingɺ2013/12ൃച༧ఆʣ http://www.packtpub.com/mastering-elasticsearch-querying-and-data- handling/book Elasticsearch in ActionʢManning Publicationsɺ2014/य़ɺMEAPߪೖՄʣ http://www.manning.com/hinman/ 13೥8݄30೔༵ۚ೔

Slide 56

Slide 56 text

͓·͚ 13೥8݄30೔༵ۚ೔

Slide 57

Slide 57 text

LuceneͱESͷόʔδϣϯ ElasticSearch Lucene 0.90.3 4.4 0.90.2 4.3.1 0.90.1 4.3 0.90.0 4.2.1 0.90.0rc2 4.2.1 0.90.0rc1 4.2 0.20.6 3.6.2 0.20.5 3.6.2 0.90.0 beta1 4.1 13೥8݄30೔༵ۚ೔