Upgrade to Pro — share decks privately, control downloads, hide ads and more …

ElasticSearch: things I wish I knew before

Avatar for Cauê Guerra Cauê Guerra
April 17, 2013
Technology
0
210

ElasticSearch: things I wish I knew before

Talk given in Toronto @ Django User Group

Avatar for Cauê Guerra

Cauê Guerra

April 17, 2013
Tweet

More Decks by Cauê Guerra

See All by Cauê Guerra
Cross-Platform Game Development With Rails
Avatar for Cauê Guerra caueguerra
0
130

Other Decks in Technology

See All in Technology
データモデリング通り #2オンライン勉強会 ～方法論の話をしよう～
Avatar for データ横丁 datayokocho
0
190
結局QUICで通信は速くなるの？
Avatar for kota-yata kota_yata
8
7.4k
Segment Anything Modelの最新動向：SAM2とその発展系
Avatar for TakatoYoshikawa tenten0727
0
920
JAWS-UG のイベントで使うハンズオンシナリオを Amazon Q Developer for CLI で作ってみた話
Avatar for kazzpapa3 kazzpapa3
0
120
AIが住民向けコンシェルジュに？ Amazon Connectと生成AIで実現する自治体AIエージェント！
Avatar for yuyeah yuyeah
0
180
Engineering Failure-Resilient Systems
Avatar for Mark Irozuru infraplumber0
0
130
事業特性から逆算したインフラ設計
Avatar for UPSIDER, Inc. Tech&Product div. upsider_tech
0
220
UDDのススメ - 拡張版 -
Avatar for マグロ隊長kinTV maguroalternative
1
610
JAWS AI/ML #30 AI コーディング IDE "Kiro" を触ってみよう
Avatar for Riku INADA inariku
3
400
Amazon Q と『音楽』-ゲーム音楽もAmazonQで作成してみた感想-
Avatar for いのうえ senseofunity129
0
170
サイボウズフロントエンドの横断活動から考える AI時代にできること
Avatar for mugi / Hajime Mugishima mugi_uno
2
580
[OCI Technical Deep Dive] OCIで生成AIを活用するためのソリューション解説(2025年8月5日開催)
Avatar for oracle4engineer oracle4engineer
PRO
0
120

Featured

See All Featured
Mobile First: as difficult as doing things right
Avatar for Swwweet swwweet
223
9.9k
The World Runs on Bad Software
Avatar for Brandon Keepers bkeepers
PRO
70
11k
Designing Experiences People Love
Avatar for Jonathan Moore moore
142
24k
Faster Mobile Websites
Avatar for Dean Hume deanohume
309
31k
Visualization
Avatar for Eitan Lees eitanlees
146
16k
GraphQLとの向き合い方2022年版
Avatar for Yosuke Kurami quramy
49
14k
Why Our Code Smells
Avatar for Brandon Keepers bkeepers
PRO
338
57k
Testing 201, or: Great Expectations
Avatar for Joseph Mastey jmmastey
45
7.6k
Music & Morning Musume
Avatar for Bryan Veloso bryan
46
6.7k
Understanding Cognitive Biases in Performance Measurement
Avatar for Philip Tellis bluesmoon
29
1.8k
YesSQL, Process and Tooling at Scale
Avatar for Rocio Delgado rocio
173
14k
The Pragmatic Product Professional
Avatar for Laura Van Doore lauravandoore
36
6.8k

Transcript

  1. ElasticSearch Things I wish I had known before

  2. Self Lead Developer @ 500px ex-ThoughtWorker Brazilian @caueguerra

  3. Who doesn’t know what ElasticSearch is?

  4. Brief introduction

  5. Shards, replicas and nodes

  6. Impact on migrating to ElasticSearch @ 500px

  7. Deleted 4 cache tables ... and countless cron jobs

  8. Realtime updates on search-results

  9. What we learned

  10. Speeding up import process

  11. use aliases

  12. photos photos-2013-03-01

  13. photos photos-2013-03-01 photos-2013-04-17

  14. photos photos-2013-03-01 photos-2013-04-17

  15. photos photos-2013-03-01 photos-2013-04-17

  16. photos photos-2013-04-17

  17. Evenly distribute your shards across your nodes

  18. Be careful not to trigger unneeded reindexing (and avoid joins)

  19. try to search as narrow as possible

  20. return only the fields that will be needed

  21. avoid indexing fields with high cardinality

  22. what is the ideal setup?

  23. plugins

  24. https://github.com/polyfractal/elasticsearch-inquisitor

  25. https://github.com/karmi/elasticsearch-paramedic

  26. https://github.com/lukas-vlcek/bigdesk

  27. ... and many more

  28. Questions?