Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ElasticSearch: things I wish I knew before

Avatar for Cauê Guerra Cauê Guerra
April 17, 2013
Technology
210
0

ElasticSearch: things I wish I knew before

Talk given in Toronto @ Django User Group

Avatar for Cauê Guerra

Cauê Guerra

April 17, 2013

More Decks by Cauê Guerra

See All by Cauê Guerra
Cross-Platform Game Development With Rails
Avatar for Cauê Guerra caueguerra
0
130

Other Decks in Technology

See All in Technology
AI駆動開発が変える、大規模開発の前提 ーHuman in the Loop から Human on the Loop へ / AIE2026
Avatar for Visional Engineering ＆ Design visional_engineering_and_design
2
1.5k
サイバーセキュリティ概論 / Introduction to Cybersecurity
Avatar for Kenji Saito ks91
PRO
0
120
オンコールの負荷軽減のためのBits Assistant 活用方法 / How to Use Bits Assistant to Reduce the Workload on On-Call Staff
Avatar for SMS tech sms_tech
1
370
「嘘をつくテスト」の失敗例から学ぶ 良いテストコード #frontend_phpcon_do
Avatar for asumikam asumikam
0
140
oracle-to-databricks-migration-with-llm-and-dbt
Avatar for case-k-git casek
1
410
「コーディング」しない人のための Claude Code 入門　ChatGPT の次の一歩 — 業務に組み込む 育成・共有・自動化
Avatar for ふくだ（fukuda ryu） rfdnxbro
2
1.1k
Dynamic Workersについて
Avatar for Yusuke Wada yusukebe
2
570
Platform Engineering as a Product: Criteria for Improvement and Multi-Tenant Design
Avatar for Kumo Ishikawa kumorn5s
0
470
Oracle AI Database@AWS：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
4
2.8k
インフラが苦手でも大丈夫！ 紙芝居 Kubernetes -WWGT 10周年編-
Avatar for Aoi Takahashi aoi1
1
330
探して_入れて_作って_使う_Agent_Skills___LT.pdf
Avatar for 松尾淳平 peintangos
2
150
Oracle AI Database@Google Cloud：サービス概要のご紹介
Avatar for oracle4engineer oracle4engineer
PRO
6
1.5k

Featured

See All Featured
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
Avatar for soudai sone soudai
PRO
200
74k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
191
11k
Leading Effective Engineering Teams in the AI Era
Avatar for Addy Osmani addyosmani
9
2k
The Mindset for Success: Future Career Progression
Avatar for Greg Gifford greggifford
PRO
0
350
The Illustrated Guide to Node.js - THAT Conference 2024
Avatar for David Neal reverentgeek
1
370
Jamie Indigo - Trashchat’s Guide to Black Boxes: Technical SEO Tactics for LLMs
Avatar for Tech SEO Connect techseoconnect
PRO
0
150
Responsive Adventures: Dirty Tricks From The Dark Corners of Front-End
Avatar for Vitaly Friedman smashingmag
254
22k
What does AI have to do with Human Rights?
Avatar for Per Axbom axbom
PRO
1
2.2k
Ethics towards AI in product and experience design
Avatar for Skipper Chong Warson skipperchong
2
300
The SEO Collaboration Effect
Avatar for Kristina Bergwall kristinabergwall1
1
470
Primal Persuasion: How to Engage the Brain for Learning That Lasts
Avatar for Mike Taylor tmiket
0
350
Max Prin - Stacking Signals: How International SEO Comes Together (And Falls Apart)
Avatar for Tech SEO Connect techseoconnect
PRO
0
170

Transcript

  1. ElasticSearch Things I wish I had known before

  2. Self Lead Developer @ 500px ex-ThoughtWorker Brazilian @caueguerra

  3. Who doesn’t know what ElasticSearch is?

  4. Brief introduction

  5. Shards, replicas and nodes

  6. Impact on migrating to ElasticSearch @ 500px

  7. Deleted 4 cache tables ... and countless cron jobs

  8. Realtime updates on search-results

  9. What we learned

  10. Speeding up import process

  11. use aliases

  12. photos photos-2013-03-01

  13. photos photos-2013-03-01 photos-2013-04-17

  14. photos photos-2013-03-01 photos-2013-04-17

  15. photos photos-2013-03-01 photos-2013-04-17

  16. photos photos-2013-04-17

  17. Evenly distribute your shards across your nodes

  18. Be careful not to trigger unneeded reindexing (and avoid joins)

  19. try to search as narrow as possible

  20. return only the fields that will be needed

  21. avoid indexing fields with high cardinality

  22. what is the ideal setup?

  23. plugins

  24. https://github.com/polyfractal/elasticsearch-inquisitor

  25. https://github.com/karmi/elasticsearch-paramedic

  26. https://github.com/lukas-vlcek/bigdesk

  27. ... and many more

  28. Questions?