$30 off During Our Annual Pro Sale. View Details »

Improving Search With One Weird Trick

xyu
January 26, 2017
Technology
0
47

Improving Search With One Weird Trick

xyu

January 26, 2017
Tweet

More Decks by xyu

See All by xyu
Better Performance & Uptime Through Async
xyu
0
71
Dealing With Time Travelers in Analytics
xyu
0
55
Scaling WordPress Queries With Elasticsearch
xyu
1
13k
Scale Out Don't Scale Up
xyu
2
150
Understanding Language and Fixing WP Search
xyu
1
130
Jetpack Related Posts for Power Users
xyu
1
490
WP ❤️ Elasticsearch
xyu
1
290
Elasticsearch & 63 Million WordPress Sites
xyu
1
170
Cloud Powered WordPress for Everyone
xyu
0
77

Other Decks in Technology

See All in Technology
StackHawkを使ってWebアプリケーションの脆弱性を診断する
smokeymonkey
0
480
バンダイナムコスタジオにおけるクラウドネイティブなゲーム開発スタジオの挑戦
yaegashi
2
190
今年やったこと_20年以上続くWebサービスのリプレイス_書いたコード_私がモダンかもと思うPerl
masashi_sutou
0
710
Technologies that Support the Data Solution Business
techverse_2022
PRO
0
300
はじめよう Kubernetes PersistentVolume のバックアップ
ysakashita
2
250
データ操作について
miyakemito
0
260
KubernetesとTerraformのセキュリティ/ガバナンス向上委員会 with OPA
saramune
1
200
PyTorchの最近の動向
hamukazu
0
350
ユーザー数100万人規模の事業成長を止めずに、レガシーコードと戦う / JJUG CCC 2022 Fall
visional_engineering_and_design
2
230
スタートアップ企業で始めるAWSセキュリティ対策 ～内部統制の観点から～ / aws-security-and-internal-audit-at-a-startup
yuj1osm
2
970
Contributing to Global Development Through Handling for the LINE iOS App
techverse_2022
PRO
0
140
Easy and Fast Website Creation, Brand UI Design System
techverse_2022
PRO
0
190

Featured

See All Featured
Building an army of robots
kneath
301
40k
No one is an island. Learnings from fostering a developers community.
thoeni
11
1.5k
Product Roadmaps are Hard
iamctodd
35
7.5k
Building Adaptive Systems
keathley
25
1.3k
Practical Orchestrator
shlominoach
178
8.9k
Distributed Sagas: A Protocol for Coordinating Microservices
caitiem20
317
19k
Fireside Chat
paigeccino
16
1.6k
Learning to Love Humans: Emotional Interface Design
aarron
262
38k
Ruby is Unlike a Banana
tanoku
92
9.5k
Git: the NoSQL Database
bkeepers
PRO
417
60k
Fashionably flexible responsive web design (full day workshop)
malarkey
396
63k
A Modern Web Designer's Workflow
chriscoyier
690
180k

Transcript

  1. Xiao Yu / Automattic xyu.io Improving Search With One Weird

    Trick Elasticsearch Meetup 2017

  2. WordPress.com • 22.4 billion views • 73.9 million posts •

    49.0 million comments

  3. WordPress.com + Elasticsearch • 22.4 billion views • 73.9 million

    posts • 49.0 million comments • 16.2 TB primary shards • 4.4 billion docs • 1.3 billion queries (+0.5 billion langdetect)
  4. None

  5. Recommending Content Globally

  6. None

  7. It’s a hackathon, so…

  8. None
  9. None
  10. None

  11. Fake it 'til you make it

  12. None
  13. None
  14. None
  15. None
  16. None

  17. GET /_search?routing= ${USER}${N*DAY}, ${USER}${N*DAY+1}, ${USER}${N*DAY+2}, ${USER}${N*DAY+3},… { “query”:{…} }

  18. S1 S2 S3 S4 S5 S6 S7 S8 S9 S10

    S11 S12 S13 S14 S15 S16 S17 S18 S19 S20 Day 0 Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9

  19. 60 6 ~18 ~33% Shards / Index Skip Multiple (10

    day cycle) Shard Batch (~30% load) Fresh Content / Day

  20. One Weird Trick S1 S2 S3 S4 S5 S6 S7

    S8 S9 S10 S11 S12 S13 S14 S15 S16 S17 S18 S19 S20 Day 0 Day 1 Day 2 Day 3 Day 4 Day 5 Day 6 Day 7 Day 8 Day 9

  21. automattic.com/work-with-us/search-wrangler/

  22. Xiao Yu / Automattic xyu.io Thanks! Elasticsearch Meetup 2017