Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Improving Search With One Weird Trick

xyu
January 26, 2017

Improving Search With One Weird Trick

xyu

January 26, 2017
Tweet

More Decks by xyu

Other Decks in Technology

Transcript

  1. WordPress.com + Elasticsearch • 22.4 billion views • 73.9 million

    posts • 49.0 million comments • 16.2 TB primary shards • 4.4 billion docs • 1.3 billion queries (+0.5 billion langdetect)
  2. S1 S2 S3 S4 S5 S6 S7 S8 S9 S10

    S11 S12 S13 S14 S15 S16 S17 S18 S19 S20 Day 0 Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9
  3. 60 6 ~18 ~33% Shards / Index Skip Multiple (10

    day cycle) Shard Batch (~30% load) Fresh Content / Day
  4. One Weird Trick S1 S2 S3 S4 S5 S6 S7

    S8 S9 S10 S11 S12 S13 S14 S15 S16 S17 S18 S19 S20 Day 0 Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9