Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ElasticSearch: things I wish I knew before

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Cauê Guerra Cauê Guerra
April 17, 2013
Technology
0
210

ElasticSearch: things I wish I knew before

Talk given in Toronto @ Django User Group

Avatar for Cauê Guerra

Cauê Guerra

April 17, 2013
Tweet

More Decks by Cauê Guerra

See All by Cauê Guerra
Cross-Platform Game Development With Rails
Avatar for Cauê Guerra caueguerra
0
130

Other Decks in Technology

See All in Technology
茨城の思い出を振り返る ～CDKのセキュリティを添えて～ / 20260201 Mitsutoshi Matsuo
Avatar for SHIFT EVOLVE shift_evolve
PRO
1
380
Red Hat OpenStack Services on OpenShift
Avatar for Tatsuya Amemiya tamemiya
0
130
会社紹介資料 / Sansan Company Profile
Avatar for Sansan, Inc. sansan33
PRO
15
400k
Exadata Fleet Update
Avatar for oracle4engineer oracle4engineer
PRO
0
1.1k
AIと新時代を切り拓く。これからのSREとメルカリIBISの挑戦
Avatar for ktykogm 0gm
2
3.1k
【Oracle Cloud ウェビナー】[Oracle AI Database + AWS] Oracle Database@AWSで広がるクラウドの新たな選択肢とAI時代のデータ戦略
Avatar for oracle4engineer oracle4engineer
PRO
2
180
小さく始めるBCP ― 多プロダクト環境で始める最初の一歩
Avatar for kekke-n kekke_n
1
560
顧客との商談議事録をみんなで読んで顧客解像度を上げよう
Avatar for shibayu36 shibayu36
0
290
Agile Leadership Summit Keynote 2026
Avatar for seki at druby.org m_seki
1
670
外部キー制約の知っておいて欲しいこと - RDBMSを正しく使うために必要なこと / FOREIGN KEY Night
Avatar for soudai sone soudai
PRO
12
5.6k
プロポーザルに込める段取り八分
Avatar for ShoheiMitani shoheimitani
1
630
予期せぬコストの急増を障害のように扱う――「コスト版ポストモーテム」の導入とその後の改善
Avatar for Masahiro Yoshizawa muziyoshiz
1
2k

Featured

See All Featured
Conquering PDFs: document understanding beyond plain text
Avatar for Ines Montani inesmontani
PRO
4
2.3k
From π to Pie charts
Avatar for Rasagy Sharma rasagy
0
130
Building AI with AI
Avatar for Ines Montani inesmontani
PRO
1
700
How Software Deployment tools have changed in the past 20 years
Avatar for Geshan Manandhar geshan
0
32k
Designing Dashboards & Data Visualisations in Web Apps
Avatar for Des Traynor destraynor
231
54k
Keith and Marios Guide to Fast Websites
Avatar for Keith Pitt keithpitt
413
23k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
37
7.1k
Redefining SEO in the New Era of Traffic Generation
Avatar for Szymon szymonslowik
1
220
Darren the Foodie - Storyboard
Avatar for Kevinho.art khoart
PRO
2
2.4k
Practical Tips for Bootstrapping Information Extraction Pipelines
Avatar for Matthew Honnibal honnibal
25
1.7k
B2B Lead Gen: Tactics, Traps & Triumph
Avatar for Sophie Logan marketingsoph
0
57
Fight the Zombie Pattern Library - RWD Summit 2016
Avatar for Marcelo Somers marcelosomers
234
17k

Transcript

  1. ElasticSearch Things I wish I had known before

  2. Self Lead Developer @ 500px ex-ThoughtWorker Brazilian @caueguerra

  3. Who doesn’t know what ElasticSearch is?

  4. Brief introduction

  5. Shards, replicas and nodes

  6. Impact on migrating to ElasticSearch @ 500px

  7. Deleted 4 cache tables ... and countless cron jobs

  8. Realtime updates on search-results

  9. What we learned

  10. Speeding up import process

  11. use aliases

  12. photos photos-2013-03-01

  13. photos photos-2013-03-01 photos-2013-04-17

  14. photos photos-2013-03-01 photos-2013-04-17

  15. photos photos-2013-03-01 photos-2013-04-17

  16. photos photos-2013-04-17

  17. Evenly distribute your shards across your nodes

  18. Be careful not to trigger unneeded reindexing (and avoid joins)

  19. try to search as narrow as possible

  20. return only the fields that will be needed

  21. avoid indexing fields with high cardinality

  22. what is the ideal setup?

  23. plugins

  24. https://github.com/polyfractal/elasticsearch-inquisitor

  25. https://github.com/karmi/elasticsearch-paramedic

  26. https://github.com/lukas-vlcek/bigdesk

  27. ... and many more

  28. Questions?