Slide 1

Slide 1 text

Elasticsearch 2.0ͷ঺հ Jun Ohtani @johtani 2015/10/08

Slide 2

Slide 2 text

No content

Slide 3

Slide 3 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 3 about • Me, Jun Ohtani / Technical Adovocate – lucene-gosenίϛολʔ – ElasticSearch Server೔ຊޠ൛ͷ຋༁ – elasticsearch-extended-analysisͷ։ൃ – http://blog.johtani.info • Elasticsearch, founded in 2012 – OSS: Elasticsearch, Logstash, Kibana, Beats – Commercial plugins: Marvel, Sheild, Watcher – Hosted Elasticsearch: Found
 Professional services: Support & development subscriptions – Trainings

Slide 4

Slide 4 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 4 2.0? Elasticsearch 2.0

Slide 5

Slide 5 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 5 ͬ͘͟Γ • Lucent 5ϕʔε • 2500Ҏ্΋ͷPull Request • ͏ͪ850͕৽نͷ΋ͷ • 496ίϛολʔ • RC1ʂʂʂ • RC1൛͸ຊ൪Ͱ͸ར༻͠ͳ͍Ͱ͍ͩ͘͞ʂ

Slide 6

Slide 6 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 6 Breaking changes https://www.elastic.co/guide/en/elasticsearch/reference/2.0/breaking-changes-2.0.html

Slide 7

Slide 7 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 7 ಛ௃ • Simplification • Security • Resiliency • Features

Slide 8

Slide 8 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 8 Simplification Simplification

Slide 9

Slide 9 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 9 ഇࢭ͞Εͨػೳ • River – LogstashͳͲͷར༻Λ • Facet – aggregation • _shutdown API – ϓϥοτϑΥʔϜͷػߏΛ • Thrift / Memcached protocol – αϙʔτ • Bulk UDP – ௨ৗͷbulk API͔ɺLogstashʹUDPͰܦ༝Ͱ

Slide 10

Slide 10 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 10 ϓϥάΠϯʹͳͬͨػೳ • Delete by query – ./bin/plugin install delete-by-query • murmur3 – ./bin/plugin install mapper-murmur3 • size – ./bin/plugin/install mapper-size • Multicast discovery – ./bin/plugin install discovery-multicast

Slide 11

Slide 11 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 11 ओཁϓϥάΠϯΛಉࠝ • ͍͔ͭ͘ͷϓϥάΠϯΛelasticsearchͷϦϙδτϦʹҠಈ – analysis • icu, kuromoji, phonetic, smartcn, stempel – cloud • aws, azure, gce – delete-by-query – discovery • multicast – lang • expression, groovy, javascript, python – mapper-murmur3, -size

Slide 12

Slide 12 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 12 ϓϥάΠϯͷΠϯετʔϧ • ಉࠝϓϥάΠϯͷΠϯετʔϧ͕؆қԽ • ͦΕҎ֎͸͜Ε·Ͱ௨Γ $ bin/plugin install [plugin_name] $ bin/plugin install analysis-icu $ bin/plugin install [org]/[user|component]/[version] $ bin/plugin install lmenezes/elasticsearch-kopf $ bin/plugin install lmenezes/elasticsearch-kopf/1.x

Slide 13

Slide 13 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 13 Mappingͷมߋ • Conflicting field mappings • short nameͰͷϑΟʔϧυࢦఆͷېࢭ • Type name prefixͷഇࢭ • ϑΟʔϧυ໊ʹυοτ͕࢖༻ෆՄ • υοτͰ࢝·ΔλΠϓ໊Λېࢭ • 255จࣈҎ্ͷλΠϓ໊Λېࢭ • λΠϓͷ࡟আΛېࢭ • _analyzerɺindex_analyzerͷഇࢭ • date formatͷมߋ • ͳͲͳͲ

Slide 14

Slide 14 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 14 MappingͷίϯϑϦΫτͱ͸ʁ PUT my_index { "mappings": { "type_one": { "properties": { "name": { "type": "string" } ❶ } }, "type_two": { "properties": { "name": { "type": "string", "analyzer": "english" } ❷ } } } }

Slide 15

Slide 15 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 15 Fieldͷshort name͸ͳͥېࢭʁ • ʮtitleʯͱࢦఆͨ͠৔߹ɺᶄͱᶆͲͬͪʁ • ʮname.titleʯͱࢦఆͨ͠৔߹ɺᶃ-ᶄͱᶅ-ᶆͲͬͪʁ • ʮname.name.titleʯͱࢦఆͨ͠Βʁ PUT my_index { "mappings": { "name": { ❶ "properties": { "title": { "type": "string" }, ❷ "name": { ❸ "properties": { "title": { "type": "string" } ❹ } } } } } }

Slide 16

Slide 16 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 16 2.0ͰͷLookup • ʮtitleʯͱࢦఆͨ͠৔߹ɺᶄ • ʮname.titleʯͱࢦఆͨ͠৔߹ɺᶅ-ᶆ • ʮname.name.titleʯͱࢦఆͨ͠ΒɺΤϥʔ PUT my_index { "mappings": { "name": { ❶ "properties": { "title": { "type": "string" }, ❷ "name": { ❸ "properties": { "title": { "type": "string" } ❹ } } } } } }

Slide 17

Slide 17 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 17 ࢀߟɿ • ࢀߟɿhttps://www.elastic.co/blog/great-mapping-refactoring

Slide 18

Slide 18 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 18 QueryDSL • QueryͱFilterͷ౷߹ – 2.0Ҏલ • QueryɿείΞͷର৅ɺΩϟογϡෆՄ • FilterɿείΞͷର৅֎ɺΩϟογϡՄೳ – 2.0Ҏ߱ • Queryʹ౷߹ɻίϯςΩετʹΑͬͯಈ࡞͕ҟͳΔ

Slide 19

Slide 19 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 19 QueryDSL

Slide 20

Slide 20 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 20 Security Security

Slide 21

Slide 21 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 21 ωοτϫʔΫઃఆͷมߋ • σϑΥϧτͷมߋ – Unicast • Multicast͸ϓϥάΠϯʹ – localhostʹόΠϯυ • IPv4ͱIPv6 • ΑΓηΩϡΞʹ͢ΔͨΊ – transport.tcp.portͷ࠷ॳͷ5ϙʔτ͕σϑΥϧτ • ͜Ε·Ͱ௨ΓखݩͰىಈͨ͠৔߹ʹ؆୯ʹΫϥελߏ੒Մೳ

Slide 22

Slide 22 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 22 Security Managerͷಋೖ • ElasticsearchͷϓϩηεىಈʹJavaͷSecurityManagerΛ࢖༻ • Elasticsearch͕ΞΫηεͰ͖ΔݖݶΛϊʔυͷىಈ࣌ʹࢦఆ

Slide 23

Slide 23 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 23 Resiliency Resiliency

Slide 24

Slide 24 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 24 Indexૢ࡞ΛΑΓ৑௕ʹ • 2.0Ҏલ – 5ඵ͓͖ʹtransaction logΛfsync • 2.0Ҏ߱ – ֤ૢ࡞͝ͱʹfsync – ઃఆՄೳ

Slide 25

Slide 25 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 25 ෳ਺data.pathʹΑΔετϥΠϐϯά • 2.0Ҏલ – શͯͷύεʹରͯ͠શͯͷγϟʔυΛετϥΠϐϯά – shardͷϑΝΠϧ͕શͯͷύεʹ෼ࢄ • 2.0Ҏ߱ – ύε͝ͱʹͦΕͧΕͷγϟʔυΛ഑ஔ – 1γϟʔυͷϑΝΠϧ͸ಉ͡ύεʹॻ͖ࠐΈ

Slide 26

Slide 26 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 26 ෳ਺data.path

Slide 27

Slide 27 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 27 2.0Ҏલ

Slide 28

Slide 28 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 28 2.0Ҏ߱

Slide 29

Slide 29 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 29 ͦͷଞ • ClusterStateͷࠩ෼ߋ৽ • doc values͕σϑΥϧτ – 2.0ͰΠϯσοΫεΛ࡞੒ͨ͠৔߹ – not_analyzedͳindexedͷϑΟʔϧυ͸σϑΥϧτͰର৅ • ࣌ؒ΍όΠτͷ஋ͷઃఆʹ୯Ґ͕ඞਢ

Slide 30

Slide 30 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 30 Fetures Features

Slide 31

Slide 31 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 31 Pipeline Aggregations • Derivatives • Moving average • Holt Winters(prediction / anomaly detection) • Stats: Min/Max/Avg • Time-series math • ࢀߟɿhttps://www.elastic.co/blog/out-of-this-world-aggregations

Slide 32

Slide 32 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 32 Index Compression • ΠϯσοΫεαΠζ͕খ͘͞ʢ10%͔Β30ˋʣ • ΠϯσΩγϯά΍ϚʔδͷॲཧʹӨڹ͋Γ • ؀ڥʹ߹ΘͤͨσʔλѹॖΛબ୒ • ࣌ܥྻΠϯσοΫεʹ • ࢀߟɿhttps://www.elastic.co/blog/store-compression-in-lucene-and- elasticsearch

Slide 33

Slide 33 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 33 2.0΁ͷҠߦ 2.0΁ͷҠߦ

Slide 34

Slide 34 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 34 Upgrade • ϩʔϦϯάΞοϓάϨʔυ͸ෆՄ – Clusterͷఀࢭ͕ඞཁ • μ΢ϯάϨʔυෆՄ • όοΫΞοϓͱΓ·͠ΐ͏ • ·ͣ͸ςετΛʂ

Slide 35

Slide 35 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 35 Migration Plugin • 1.xܥͷϓϥάΠϯͱͯ͠Πϯετʔϧͯ͠໰୊఺ΛνΣοΫ • SiteϓϥάΠϯͳͷͰɺ࠶ىಈͤͣʹར༻Մೳ • https://github.com/elastic/elasticsearch-migration • σϞʂ

Slide 36

Slide 36 text

No content

Slide 37

Slide 37 text

12/16(⽔) @東京 ユーザーカンファレンス 開催決定! { プロダクトアップデート } { 製品デモンストレーション } { カスタマーケーススタディ } { ネットワーキング } https://www.elastic.co/elasticon/tour/2015 お問い合わせはこちらまで [email protected] とうろくは11/17までです。 Webサイトより事前のご登録お願い致します。 アジェンダ・場所など詳細が決まり次第、 ご登録アドレスへご連絡させて頂きます。

Slide 38

Slide 38 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 38 ࢀߟจݙ • Elasticsearch - The Definitive guide – http://www.elastic.co/guide/en/elasticsearch/guide/current/ index.html • ॻ੶ʢ೔ຊޠʣ – ElasticSearchServer೔ຊޠ൛
 αʔό/ΠϯϑϥΤϯδχΞ
 ɹཆ੒ಡຊɹϩάऩू

Slide 39

Slide 39 text

www.elastic.co Copyright Elastic 2015 Copying, publishing and/or distributing without written permission is strictly prohibited 39 ࢀߟαΠτ • Ϣʔεέʔε • https://www.elastic.co/use-cases • DiscussʢWebϑΥʔϥϜʣ • https://discuss.elastic.co • Elastic{ON}ͷϏσΦͱࢿྉ • https://www.elastic.co/elasticon/2015/sf/videos • αϙʔτϝχϡʔ • https://www.elastic.co/subscriptions

Slide 40

Slide 40 text

Thanks for listening! Q & A We’re hiring! https://www.elastic.co/about/careers/ We’re helping! https://www.elastic.co/subscriptions http://purchases.elastic.co