Introducing Elastic Cloud

Spoke at JJUG Night Session on September 2nd, 2016.

Transcript

1. ‹#› Kosho Owa, Solutions Architect, Elastic September 2016 Introducing Elastic Cloud The Official Hosted Elasticsearch & Kibana Offering on AWS
2. 2 Elastic Cloud Security X-Pack Kibana User Interface Elasticsearch Store, Index,
 & Analyze Ingest Logstash Beats + Elastic Stack Introducing the Elastic Stack, X-Pack, and Cloud Alerting Monitoring Reporting Graph
3. Hosted Elasticsearch & Kibana on AWS • Elasticͷ੡඼܈ͱಉظͨ͠࠷৽൛ͷఏڙ • εέʔϧΞ΢τɾΞοϓάϨʔυΛϫϯΫϦοΫ Ͱ • ແྉͷKibanaΠϯελϯεͱ30෼͝ͱͷόοΫΞ οϓ • X-Packػೳ (Security, Alerting, Monitoring, Reporting) • ݄ʑ45USD͔Β • SLAϕʔεͷαϙʔτΦϓγϣϯ 3 Elastic Stackͷ։ൃऀʹΑΔ།Ұͷ ެࣜ Elasticsearch as a Service
4. Security - ҉߸ԽͱϩʔϧϕʔεͷΞΫηε੍ޚ • ElasticsearchͷΤϯυϙΠϯτ΁ͷ HTTPSΞΫηε • ID/PasswordʹΑΔϢʔβೝূ • KibanaͷϩάΠϯμΠΞϩά • ϩʔϧ͝ͱʹΠϯσοΫεɺAPI΁ͷ ΞΫηεΛ੍ݶ 4
5. Alerting - σʔλͷมԽΛ௨஌ • εέδϡʔϧɺΫΤϦʔɺൺֱɺΞΫγϣϯ • Elasticsearchͷ͢΂ͯͷΫΤϦʔͱΞάϦήʔγϣϯΛαϙʔτ • ෳ਺ͷιʔεΛ૊Έ߹Θͤ • ϝʔϧɺΠϯσοΫεɺϩάɺςΩετϝοηʔδɺ΢ΣϒϑοΫͳͲͷΞΫγϣ ϯ 5
6. Reporting - KibanaͷDashboardΛΤΫεϙʔτ • PDF΋͘͠͸CSVΛੜ੒ • खಈͰͷੜ੒ • Alertingͱͷ૊Έ߹ΘͤͰεέδϡʔ ϧɺ΋͘͠͸ಛఆͷΠϕϯτ͕ൃੜ ͨ͠৔߹ʹ࡞੒ • ඇKibanaϢʔβͱڞ༗ 6 Earthquake - Depth Timeseries Earthquake - Heatmap Earthquake — Sun, Jan 1, 2006 12:00 AM to Fri, Sep 2, 2016 5:54 AM
7. Graph - σʔλؒͷؔ܎ΛՄࢹԽ • Elasticsearchͷsearch΍relevancyͷ ػೳΛ࢖༻ͯ͠ʮҙຯͷ͋Δؔ܎ʯ Λൃݟ • طଘͷΠϯσοΫεΛར༻ • ϦΞϧλΠϜ͔ͭεέʔϥϒϧ 7
8. Monitoring - ΫϥελʔɺϊʔυɺΠϯσοΫεͷ؂ࢹ • ElasticsearchΫϥελʔɺϊʔυɺ ΠϯσοΫεͷϝτϦοΫΛϦΞϧ λΠϜͰ؂ࢹ • ӡ༻্ͷ܏޲Λ೺Ѳɺ໰୊Λൃݟ • ΩϟύγςΟϓϥχϯά • ΫϥελʔɺΞϓϦέʔγϣϯͷ࠷ దԽ 8
9. ΠϯελϯεαΠζݟੵ΋Γ࣌ͷݕ౼ཁૉ 9 υΩϡϝϯτݕࡧ ର৅υΩϡϝϯτ(αΠζ) Ϛοϐϯά (ݕࡧϑΟʔϧυ) औಘυΩϡϝϯτ਺ ୯Ґ࣌ؒ͋ͨΓͷݕࡧ਺ ಉ࣌઀ଓ਺ ϨΠςϯγʔ ϩάͷՄࢹԽ ϩάͷαΠζ อଘظؒ ୯Ґ࣌ؒ͋ͨΓͷ౤ೖϨίʔυ਺ Dashboardͷෳࡶ͞ KibanaϢʔβʔ਺
10. esperf - ύϑΥʔϚϯεςετπʔϧ https://github.com/kosho/esperf 10 esperf [-d dictionary_file] [-r recurrence] [-t threads] [-X method] [-u user:password] url -d dictionary_file: Newline delimited strings dictionary file -r recurrence: Number of recurrence HTTP requests per thread -t threads: Number of threads to generate, not always a big number gives more pressure -u user:password: Username and password for HTTP authentication -X: HTTP method to perform $ echo '{"query": {"term": {"first_name": {"value": "$RDICT"}}}}' | ./ esperf -r 1000 -t 3 -d ./names.txt "http://localhost:9200/_search?size=1"
11. ‹#› $ echo '{"query": {"term": {"first_name": {"value": "$RDICT"}}}}' | ./esperf -t 10 -r 10000 -w 1 -d ./dict.txt localhost:9200/_search Timestamp Success Fail HTTP>400 Upload Download Response ------------------------ --------- --------- -------- -------- -------- -------- 2016-08-23T21:51:39+0900 3061 0 0 186 211 0.0032 2016-08-23T21:51:40+0900 3182 0 0 186 211 0.0031 2016-08-23T21:51:41+0900 3757 0 0 186 211 0.0026 ----------------------------------- Options ------------------------------------ Number of threads: 10 Number of recurrence: 10000 Interval (sec): 1 Warm-up (sec): 1 Timeout (sec): 0 Dictionary: ./dict.txt URL: localhost:9200/_search HTTP Method: GET Body: {"query": {"term": {"first_name": {"value": "$RDICT"}}}} ----------------------------------- Results ------------------------------------ Time after warm-up (sec): 2.00114 Number of success: 6946 Number of connection failure: 0 Number of HTTP response >400: 0 Average successful requests/sec: 3471 Upload throughput (byte/sec): 645610 Download throughput (byte/sec): 732470 Average time transfer (sec): 0.00281