Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ElasticSearch: things I wish I knew before

Sponsored · Ship Features Fearlessly Turn features on and off without deploys. Used by thousands of Ruby developers. →
Avatar for Cauê Guerra Cauê Guerra
April 17, 2013
Technology
0
210

ElasticSearch: things I wish I knew before

Talk given in Toronto @ Django User Group

Avatar for Cauê Guerra

Cauê Guerra

April 17, 2013
Tweet

More Decks by Cauê Guerra

See All by Cauê Guerra
Cross-Platform Game Development With Rails
Avatar for Cauê Guerra caueguerra
0
130

Other Decks in Technology

See All in Technology
Oracle AI Database 移行・アップグレード勉強会 - RAT活用編
Avatar for oracle4engineer oracle4engineer
PRO
0
110
Bill One急成長の舞台裏 開発組織が直面した失敗と教訓
Avatar for SansanTech sansantech
PRO
2
400
Webhook best practices for rock solid and resilient deployments
Avatar for Guillaume Laforge glaforge
2
310
Context Engineeringが企業で不可欠になる理由
Avatar for Hirosato Gamo hirosatogamo
PRO
3
660
顧客との商談議事録をみんなで読んで顧客解像度を上げよう
Avatar for shibayu36 shibayu36
0
300
30万人の同時アクセスに耐えたい！新サービスの盤石なリリースを支える負荷試験 / SRE Kaigi 2026
Avatar for GENDA genda
4
1.4k
GitHub Issue Templates + Coding Agentで簡単みんなでIaC/Easy IaC for Everyone with GitHub Issue Templates + Coding Agent
Avatar for AEON aeonpeople
1
260
AIが実装する時代、人間は仕様と検証を設計する
Avatar for Gota gotalab555
1
190
usermode linux without MMU - fosdem2026 kernel devroom
Avatar for Hajime Tazaki thehajime
0
240
SREのプラクティスを用いた3領域同時 マネジメントへの挑戦 〜SRE・情シス・セキュリティを統合した チーム運営術〜
Avatar for coconala_engineer coconala_engineer
2
770
StrandsとNeptuneを使ってナレッジグラフを構築する
Avatar for やくも yakumo
1
130
FinTech SREのAWSサービス活用/Leveraging AWS Services in FinTech SRE
Avatar for maaaato maaaato
0
130

Featured

See All Featured
WCS-LA-2024
Avatar for Leonardo Collado-Torres lcolladotor
0
450
The Anti-SEO Checklist Checklist. Pubcon Cyber Week
Avatar for Ryan Jones ryanjones
0
70
Building Flexible Design Systems
Avatar for Yesenia Perez-Cruz yeseniaperezcruz
330
40k
The Myth of the Modular Monolith - Day 2 Keynote - Rails World 2024
Avatar for Eileen M. Uchitelle eileencodes
26
3.3k
Taking LLMs out of the black box: A practical guide to human-in-the-loop distillation
Avatar for Ines Montani inesmontani
PRO
3
2k
Dominate Local Search Results - an insider guide to GBP, reviews, and Local SEO
Avatar for Greg Gifford greggifford
PRO
0
79
Designing for humans not robots
Avatar for Tammie Lister tammielis
254
26k
Technical Leadership for Architectural Decision Making
Avatar for Kenny Baas-Schwegler baasie
2
250
RailsConf 2023
Avatar for Aaron Patterson tenderlove
30
1.3k
職位にかかわらず全員がリーダーシップを発揮するチーム作り / Building a team where everyone can demonstrate leadership regardless of position
Avatar for MADOX madoxten
58
50k
Templates, Plugins, & Blocks: Oh My! Creating the theme that thinks of everything
Avatar for Michelle Schulp Hunt marktimemedia
31
2.7k
Agile Actions for Facilitating Distributed Teams - ADO2019
Avatar for Mark Kilby mkilby
0
120

Transcript

  1. ElasticSearch Things I wish I had known before

  2. Self Lead Developer @ 500px ex-ThoughtWorker Brazilian @caueguerra

  3. Who doesn’t know what ElasticSearch is?

  4. Brief introduction

  5. Shards, replicas and nodes

  6. Impact on migrating to ElasticSearch @ 500px

  7. Deleted 4 cache tables ... and countless cron jobs

  8. Realtime updates on search-results

  9. What we learned

  10. Speeding up import process

  11. use aliases

  12. photos photos-2013-03-01

  13. photos photos-2013-03-01 photos-2013-04-17

  14. photos photos-2013-03-01 photos-2013-04-17

  15. photos photos-2013-03-01 photos-2013-04-17

  16. photos photos-2013-04-17

  17. Evenly distribute your shards across your nodes

  18. Be careful not to trigger unneeded reindexing (and avoid joins)

  19. try to search as narrow as possible

  20. return only the fields that will be needed

  21. avoid indexing fields with high cardinality

  22. what is the ideal setup?

  23. plugins

  24. https://github.com/polyfractal/elasticsearch-inquisitor

  25. https://github.com/karmi/elasticsearch-paramedic

  26. https://github.com/lukas-vlcek/bigdesk

  27. ... and many more

  28. Questions?