Slide 1
Slide 1 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Jun Ohtani
@johtani
2015/02/13
ElasticsearchಋೖνΣοΫϦετʁ
Slide 2
Slide 2 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
about
• Me, Jun Ohtani / Technical Adovocate
lucene-gosenίϛολʔ
ElasticSearch Serverຊޠ൛ͷ༁
elasticsearch-extended-analysisͷ։ൃ
http://blog.johtani.info
• Elasticsearch, founded in 2012
Products: Elasticsearch, Logstash, Kibana, Marvel
Professional services: Support & development subscriptions
Trainings
Slide 3
Slide 3 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Agenda
• OSؔ࿈
• Configuration
• JVM Heap
• ɻɻɻ
Slide 4
Slide 4 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Πϯετʔϧ͔Βىಈ·Ͱ
Slide 5
Slide 5 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
μϯϩʔυͱىಈ
$ wget https://download.elasticsearch.org/...
$ tar -xf elasticsearch-1.4.3.tar.gz
$ ./elasticsearch-1.4.3/bin/elasticsearch
...
[2015-02-13 13:43:41,167][INFO ][node] [Araña] started
...
Also puppet modules and RPM/DEB
Slide 6
Slide 6 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ىಈͷ֬ೝ
» curl localhost:9200
{
"status" : 200,
"name" : "Fin Fang Foom",
"cluster_name" : "jupiter.local",
"version" : {
"number" : "1.4.3",
"build_hash" : "36a29a7144cfde87a960ba039091d40856fcb9af",
"build_timestamp" : "2015-02-11T14:23:15Z",
"build_snapshot" : false,
"lucene_version" : "4.10.3"
},
"tagline" : "You Know, for Search"
}
Slide 7
Slide 7 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ͦͷલʹɻɻɻ
Slide 8
Slide 8 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ͦͷલʹ
• ͳʹͱ͋ΕɺΞοϓάϨʔυ
• Elasticsearchɿ1.4.3
• Java 1.8.0_20Ҏ߱
• Java 1.7.0_55Ҏ߱
Java 1.7.0_25Ҏ߱Ͱ55ҎલSDKʹόά͋Γ
Slide 9
Slide 9 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Configuration
Slide 10
Slide 10 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
OSؔ࿈
Slide 11
Slide 11 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ϑΝΠϧσεΫϦϓλ
Slide 12
Slide 12 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ϑΝΠϧσεΫϦϓλ
• ਪɿ32,000͘͠64,000
• ֬ೝํ๏ͦͷ1ʢϩάग़ྗʣ
$ ./bin/elasticsearch -Des.max-open-files=true
[2015-02-13 14:02:13,527][INFO ][bootstrap
] max_open_files [10240]
...
Slide 13
Slide 13 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ϑΝΠϧσεΫϦϓλ
• ֬ೝํ๏ͦͷ2ʢelasticsearchʹͯʣ
» curl localhost:9200/_nodes/process?pretty
{
"cluster_name" : "jupiter.local",
"nodes" : {
"ydEmZ2aSSImgjkoJYs7WGQ" : {
"name" : "Starhawk",
…
"http_address" : "inet[/192.168.1.10:9200]",
"process" : {
"refresh_interval_in_millis" : 1000,
"id" : 7630,
"max_file_descriptors" : 10240,
"mlockall" : false
}
}…
Slide 14
Slide 14 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ϝϞϦؔ࿈
Slide 15
Slide 15 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ϝϞϦؔ࿈ʢώʔϓʣ
• ώʔϓαΠζ
ཧϝϞϦͷҎԼ
32GҎ্
MAXͱMINΛಉ͡ʹʹES_HEAP_SIZEͰࢦఆ
• ࢦఆํ๏
bin/elasticsearch.in.sh͘͠bin/elasticsearch.in.batͰ
Slide 16
Slide 16 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ϝϞϦؔ࿈ʢεϫοϓʣ
• εϫοϓ
• 1. swapΦϑ
• 2. swappiness
• 3. mlockall
Slide 17
Slide 17 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
Elasticsearchͷઃఆ
Slide 18
Slide 18 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
nameؔ࿈
Slide 19
Slide 19 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
cluster.name
Slide 20
Slide 20 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
cluster.name
• σϑΥϧτɿelasticsearch
• ઃఆํ๏
1. elasticsearch.ymlʹઃఆ
2. ىಈ࣌ʹࢦఆ
Slide 21
Slide 21 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
cluster.name
• elasticsearch.yml
• ىಈ࣌ʹࢦఆ
cluster.name: elasticsearch_production
$ ./bin/elasticsearch -Des.cluster.name=hogehoge
·ͨ
$ ./bin/elasticsearch --cluster.name=hogehoge
Slide 22
Slide 22 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
node.name
Slide 23
Slide 23 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
node.name
• σϑΥϧτɿMarvelͷώʔϩʔͷ໊લ
• ىಈ࣌ʹϥϯμϜʹܾఆ
1. elasticsearch.ymlʹઃఆ
2. ىಈ࣌ʹࢦఆ
Slide 24
Slide 24 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
node.name
• elasticsearch.yml
• ىಈ࣌ʹࢦఆ
node.name: elasticsearch_production
$ ./bin/elasticsearch -Des.node.name=hogehoge
·ͨ
$ ./bin/elasticsearch --node.name=hogehoge
Slide 25
Slide 25 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ωοτϫʔΫؔ࿈
Slide 26
Slide 26 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
network.host
• ωοτϫʔΫΞυϨεͷࢦఆ
• छྨ
• network.publish_hostɿ֎෦ଓ༻host
• network.bind_hostɿbind͢Δhost
• network.hostɿ্ه2छྨΛಉ࣌ʹઃఆ͢Δ؆୯ͳઃఆ
Slide 27
Slide 27 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
discovery.zenؔ࿈
Slide 28
Slide 28 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
discovery.zen.ping
• Unicastʹ͠·͠ΐ͏
σϑΥϧτmulticast
• ઃఆ
discovery.zen.ping.multicast.enabled:
false
discovery.zen.ping.unicast.hosts:
["host1",
"host2:port"]
Slide 29
Slide 29 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
minimum_master_nodes
• ΫϥελͷεϓϦοτϒϨΠϯࢭ
• ( n / 2 ) + 1
discovery.zen.minimum_master_nodes:
2
Slide 30
Slide 30 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
σΟϨΫτϦؔ࿈
Slide 31
Slide 31 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
path.conf
• ઃఆϑΝΠϧͷσΟϨΫτϦύε
$ ./bin/elasticsearch -Des.path.conf=./hoge
·ͨ
$ ./bin/elasticsearch --path.conf=./hoge
Slide 32
Slide 32 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ͦͷଞύε
• path.logɹϩάσΟϨΫτϦ
• path.dataɹΠϯσοΫεσʔλอଘσΟϨΫτϦ
• path.pluginsɹϓϥάΠϯΠϯετʔϧઌ
• ͜ΕΒelasticsearch.ymlʹઃఆ
Slide 33
Slide 33 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ࢀߟࢿྉ
• ެࣜΨΠυͷsetup
http://www.elasticsearch.org/guide/en/elasticsearch/reference/
current/setup.html
• The Definitive Guideͷadministration, monitoring
http://www.elasticsearch.org/guide/en/elasticsearch/guide/
current/administration.html
Slide 34
Slide 34 text
Copyright Elasticsearch 2014. Copying, publishing and/or distributing without written permission is strictly prohibited
ࢀߟ
• Github
https://github.com/elasticsearch
• ΨΠυ
http://www.elasticsearch.org/guide/
• αϙʔτ
http://www.elasticsearch.com/support/