Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Speaker Deck
PRO
Sign in
Sign up for free
Elasticsearch & 63 Million WordPress Sites
xyu
February 06, 2014
Technology
1
170
Elasticsearch & 63 Million WordPress Sites
Overview of the Elasticsearch infrastructure that Automattic maintains to support WordPress.com.
xyu
February 06, 2014
Tweet
Share
More Decks by xyu
See All by xyu
Improving Search With One Weird Trick
xyu
0
47
Better Performance & Uptime Through Async
xyu
0
69
Dealing With Time Travelers in Analytics
xyu
0
53
Scaling WordPress Queries With Elasticsearch
xyu
1
13k
Scale Out Don't Scale Up
xyu
2
140
Understanding Language and Fixing WP Search
xyu
1
130
Jetpack Related Posts for Power Users
xyu
1
480
WP ❤️ Elasticsearch
xyu
1
280
Cloud Powered WordPress for Everyone
xyu
0
68
Other Decks in Technology
See All in Technology
失敗から学ぶAWSコスト管理入門 ~想定の50倍以上の請求がきた話~
msato
0
480
LINE API Update 20220525
line_developers_tw
PRO
0
100
CAMのサービス開発の歴史と共通基盤を使った 開発スタイルへの変遷について
ishikawa_pro
0
110
Agile and Requirement : アジャイルな要件定義について考える
kawaguti
PRO
12
3.7k
Remixの凄みを紹介したい
aiji42
5
3.4k
KubeCon Recap -Platform migration at Scale-
inductor
0
130
プロダクトの理想と現実はなぜ乖離しがち?プロダクト作りに潜む問題を考える
suzukentaro
0
270
Puny to Powerful PostgreSQL Rails Apps
andyatkinson
PRO
0
420
ヘキサゴナルアーキテクチャを利用したLambda 関数のドメインモデルの実装 Live
fatsushi
4
790
セマフォでタスクの同時実行数制限
hankehly
0
140
動的ルーティング・ゲートウェイ (DRG) 概要
ocise
0
130
Declarative Clients in Spring
olgamaciaszek
0
120
Featured
See All Featured
In The Pink: A Labor of Love
frogandcode
130
21k
The Most Common Mistakes in Cover Letters
jrick
PRO
4
24k
Rebuilding a faster, lazier Slack
samanthasiow
62
7.2k
Refactoring Trust on Your Teams (GOTO; Chicago 2020)
rmw
19
1.4k
How to train your dragon (web standard)
notwaldorf
57
3.8k
The Success of Rails: Ensuring Growth for the Next 100 Years
eileencodes
4
670
Automating Front-end Workflow
addyosmani
1351
200k
Writing Fast Ruby
sferik
612
57k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
38
12k
Streamline your AJAX requests with AmplifyJS and jQuery
dougneiner
125
8.5k
Practical Orchestrator
shlominoach
178
8.6k
Fontdeck: Realign not Redesign
paulrobertlloyd
73
4.1k
Transcript
Elasticsearch & 63 Million WordPress Sites Elasticsearch Boston (Feb. 2014)
Xiao Yu Code Wrangler — Automattic @HypertextRanch me@xyu.io xyu
VaultPress Jetpack Simplenote Akismet Polldaddy Gravatar VideoPress IntenseDebate
Simperium Code Poet Cloudup
Cluster Stats • 63M Sites • 743M Documents • 12TB
Primary + Replicas • 51M Query Ops / Day • 15M Index Ops / Day 2 Major Use Cases • Global Search ! • Local Search Elasticsearch + WordPress.com
Infrastructure Layout Internal API Cache REST API PHP Node 1
Node 2 Cluster A Node 1 Node 2 Node 3 Node n Cluster B Stats
Documents & Types /index/post { blog_id: 123, post_id: 456, title:
"Search!", content: "…", blog: { lang: "en", … }, … } /index/blog { blog_id: 123, url: "www.xyu.io", follower_ids: [ 789, … ], lang: "en", indexable: true, … }
Storage Strategy • Grow Number of Indices (10M Sites /
Index) • 25 Shards / Index (400K Sites / Shard) • 3 Copies of Data (1 Primary + 2 Replicas) 2 Major Use Cases • Global Search • Query All Shards • Local Search • Query One Shard Indicies & Shards
Nodes & Clusters Warning, YMMV! !
Monitoring Cluster Health
Monitoring Cluster Health
Monitoring Cluster Health
Monitoring Cluster Health
Thanks! @HypertextRanch me@xyu.io xyu