Improving Search With One Weird Trick

Transcript

1. Xiao Yu / Automattic xyu.io Improving Search With One Weird Trick Elasticsearch Meetup 2017
2. WordPress.com • 22.4 billion views • 73.9 million posts • 49.0 million comments
3. WordPress.com + Elasticsearch • 22.4 billion views • 73.9 million posts • 49.0 million comments • 16.2 TB primary shards • 4.4 billion docs • 1.3 billion queries (+0.5 billion langdetect)
5. Recommending Content Globally
7. It’s a hackathon, so…
11. Fake it 'til you make it
17. GET /_search?routing= ${USER}${N*DAY}, ${USER}${N*DAY+1}, ${USER}${N*DAY+2}, ${USER}${N*DAY+3},… { “query”:{…} }
18. S1 S2 S3 S4 S5 S6 S7 S8 S9 S10 S11 S12 S13 S14 S15 S16 S17 S18 S19 S20 Day 0 Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9
19. 60 6 ~18 ~33% Shards / Index Skip Multiple (10 day cycle) Shard Batch (~30% load) Fresh Content / Day
20. One Weird Trick S1 S2 S3 S4 S5 S6 S7 S8 S9 S10 S11 S12 S13 S14 S15 S16 S17 S18 S19 S20 Day 0 Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9
21. automattic.com/work-with-us/search-wrangler/
22. Xiao Yu / Automattic xyu.io Thanks! Elasticsearch Meetup 2017