Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ElasticSearch: things I wish I knew before

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Avatar for Cauê Guerra Cauê Guerra
April 17, 2013
Technology
0
210

ElasticSearch: things I wish I knew before

Talk given in Toronto @ Django User Group

Avatar for Cauê Guerra

Cauê Guerra

April 17, 2013
Tweet

More Decks by Cauê Guerra

See All by Cauê Guerra
Cross-Platform Game Development With Rails
Avatar for Cauê Guerra caueguerra
0
130

Other Decks in Technology

See All in Technology
顧客の言葉を、そのまま信じない勇気
Avatar for yamatai12 yamatai1212
1
360
制約が導く迷わない設計 〜 信頼性と運用性を両立するマイナンバー管理システムの実践 〜
Avatar for ないとー bwkw
3
1k
SREチームをどう作り、どう育てるか ― Findy横断SREのマネジメント
Avatar for adachi.ryo rvirus0817
0
340
30万人の同時アクセスに耐えたい！新サービスの盤石なリリースを支える負荷試験 / SRE Kaigi 2026
Avatar for GENDA genda
4
1.4k
AIと新時代を切り拓く。これからのSREとメルカリIBISの挑戦
Avatar for ktykogm 0gm
2
3.1k
Cosmos World Foundation Model Platform for Physical AI
Avatar for Takuya MINAGAWA takmin
0
970
SRE Enabling戦記 - 急成長する組織にSREを浸透させる戦いの歴史
Avatar for Masaki Ishigaki markie1009
0
170
Oracle Cloud Observability and Management Platform - OCI 運用監視サービス概要 -
Avatar for oracle4engineer oracle4engineer
PRO
2
14k
CDKで始めるTypeScript開発のススメ
Avatar for つくぼし tsukuboshi
1
530
AIが実装する時代、人間は仕様と検証を設計する
Avatar for Gota gotalab555
1
100
20260208_第66回 コンピュータビジョン勉強会
Avatar for KeiichiIto1978 keiichiito1978
0
190
量子クラウドサービスの裏側　〜Deep Dive into OQTOPUS〜
Avatar for OQTOPUS oqtopus
0
140

Featured

See All Featured
Leveraging Curiosity to Care for An Aging Population
Avatar for Cassini Nazir cassininazir
1
170
Helping Users Find Their Own Way: Creating Modern Search Experiences
Avatar for Dan Newman danielanewman
31
3.1k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
55
12k
Ethics towards AI in product and experience design
Avatar for Skipper Chong Warson skipperchong
2
200
JavaScript: Past, Present, and Future - NDC Porto 2020
Avatar for David Neal reverentgeek
52
5.8k
My Coaching Mixtape
Avatar for mlcsv mlcsv
0
49
Code Review Best Practice
Avatar for Trisha Gee trishagee
74
20k
VelocityConf: Rendering Performance Case Studies
Avatar for Addy Osmani addyosmani
333
24k
Put a Button on it: Removing Barriers to Going Fast.
Avatar for kastner kastner
60
4.2k
10 Git Anti Patterns You Should be Aware of
Avatar for Lemi Orhan Ergin lemiorhan
PRO
659
61k
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
32
2.8k
Beyond borders and beyond the search box: How to win the global "messy middle" with AI-driven SEO
Avatar for David Carrasco davidcarrasco
1
57

Transcript

  1. ElasticSearch Things I wish I had known before

  2. Self Lead Developer @ 500px ex-ThoughtWorker Brazilian @caueguerra

  3. Who doesn’t know what ElasticSearch is?

  4. Brief introduction

  5. Shards, replicas and nodes

  6. Impact on migrating to ElasticSearch @ 500px

  7. Deleted 4 cache tables ... and countless cron jobs

  8. Realtime updates on search-results

  9. What we learned

  10. Speeding up import process

  11. use aliases

  12. photos photos-2013-03-01

  13. photos photos-2013-03-01 photos-2013-04-17

  14. photos photos-2013-03-01 photos-2013-04-17

  15. photos photos-2013-03-01 photos-2013-04-17

  16. photos photos-2013-04-17

  17. Evenly distribute your shards across your nodes

  18. Be careful not to trigger unneeded reindexing (and avoid joins)

  19. try to search as narrow as possible

  20. return only the fields that will be needed

  21. avoid indexing fields with high cardinality

  22. what is the ideal setup?

  23. plugins

  24. https://github.com/polyfractal/elasticsearch-inquisitor

  25. https://github.com/karmi/elasticsearch-paramedic

  26. https://github.com/lukas-vlcek/bigdesk

  27. ... and many more

  28. Questions?