Slide 29
Slide 29 text
Getting the data IN
29
"settings": {
"index": {
"codec": "best_compression",
"refresh_interval": "-1", // disable refresh
"number_of_shards": "10", // shoot for 40-60gb shards
"number_of_replicas": "0", // danger! danger!
"translog.durability": “async”, // fsync commit in the background
"index.merge.scheduler.max_thread_count": “1" // spinning disks
}
}
High indexing rates require optimizing settings and mappings
Getting fast ingest speeds
index settings for archive data:
Caution! these settings are for short-term indexing!
Don’t use for 30, 60, 90 day production data.