Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
使用ES的一些经验-秦强强 #ESCC#4
Search
medcl
October 17, 2015
Technology
0
130
使用ES的一些经验-秦强强 #ESCC#4
折800使用ES经验分享
medcl
October 17, 2015
Tweet
Share
More Decks by medcl
See All by medcl
Elasticsearch 在智能运维领域的运用
medcl
0
340
Elastic Stack- Past, Present, & Future
medcl
0
54
A Spider Written in Golang
medcl
1
76
又一个爬虫
medcl
0
93
Introduction to Beats and extending Beats
medcl
0
100
Elasticsearch & Bigdata
medcl
2
230
Elastic Stack V5
medcl
0
100
Elastic Stack V5
medcl
0
75
基于Elastic Stack的数据探索与分析@QConBeijing2016
medcl
1
440
Other Decks in Technology
See All in Technology
モダンUIでフルサーバーレスなAIエージェントをAmplifyとCDKでサクッとデプロイしよう
minorun365
4
230
We Built for Predictability; The Workloads Didn’t Care
stahnma
0
150
マーケットプレイス版Oracle WebCenter Content For OCI
oracle4engineer
PRO
5
1.6k
生成AIを活用した音声文字起こしシステムの2つの構築パターンについて
miu_crescent
PRO
3
230
Cloud Runでコロプラが挑む 生成AI×ゲーム『神魔狩りのツクヨミ』の裏側
colopl
0
150
CDKで始めるTypeScript開発のススメ
tsukuboshi
1
580
22nd ACRi Webinar - 1Finity Tamura-san's slide
nao_sumikawa
0
110
マネージャー視点で考えるプロダクトエンジニアの評価 / Evaluating Product Engineers from a Manager's Perspective
hiro_torii
0
190
Claude_CodeでSEOを最適化する_AI_Ops_Community_Vol.2__マーケティングx_AIはここまで進化した.pdf
riku_423
2
610
(技術的には)社内システムもOKなブラウザエージェントを作ってみた!
har1101
0
330
GitHub Copilot CLI を使いやすくしよう
tsubakimoto_s
0
110
データの整合性を保ちたいだけなんだ
shoheimitani
8
3.2k
Featured
See All Featured
What's in a price? How to price your products and services
michaelherold
247
13k
I Don’t Have Time: Getting Over the Fear to Launch Your Podcast
jcasabona
34
2.6k
Keith and Marios Guide to Fast Websites
keithpitt
413
23k
Why Mistakes Are the Best Teachers: Turning Failure into a Pathway for Growth
auna
0
56
RailsConf & Balkan Ruby 2019: The Past, Present, and Future of Rails at GitHub
eileencodes
141
34k
How to Create Impact in a Changing Tech Landscape [PerfNow 2023]
tammyeverts
55
3.3k
Ruling the World: When Life Gets Gamed
codingconduct
0
150
The Pragmatic Product Professional
lauravandoore
37
7.1k
Visualizing Your Data: Incorporating Mongo into Loggly Infrastructure
mongodb
49
9.9k
Building Better People: How to give real-time feedback that sticks.
wjessup
370
20k
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
inesmontani
PRO
3
2k
Building Applications with DynamoDB
mza
96
6.9k
Transcript
使用es的一些经验 秦强强 折800 @thanq童鞋扭曲的爱 !
• 请务必以批判地看待
ES cluster! log4j! client! other! client! kafka! collect or! collect
or!
• 一些有用的配置 • 优化mapping, 禁用_all, 不对不是查询条件的field建索引! • 打开慢查询慢索引日志和GC日志! • 限制
fielddata cache 的堆内存占比, 设置合适的 indices.breaker(断路器)! • 单机多实例时, 配置主从分片在不同的机器
• 遇到的坑 • 避免深度分页的检索! • 避免没有指定索引的检索 和 会查询很多个索引的检索
• 一些经验 • 写入压力变小时,集群的反应会变快! • 单个实例hold更少的分片和数据时,内存压力会变小,反应 会变快! • 日志检索场景下, 越新的数据检索的频率会越高;老数据的
检索需求有,但不多
• 下一步要做的事情 • 抽出独立的查询节点和master节点! • 冷热分离! • GC优化! • 更好的安全性
tribe! ES cluster! tribe! client! ! ! ! ! !
! ! ! !
tribe! cold ES cluster! tribe! client! ! ! ! !
! ! ! ! ! hot ES cluster!
Thanks !