Upgrade to Pro
— share decks privately, control downloads, hide ads and more …
Speaker Deck
Features
Speaker Deck
PRO
Sign in
Sign up for free
Search
Search
Elasticsearch & 63 Million WordPress Sites
Search
xyu
February 06, 2014
Technology
1
240
Elasticsearch & 63 Million WordPress Sites
Overview of the Elasticsearch infrastructure that Automattic maintains to support WordPress.com.
xyu
February 06, 2014
Tweet
Share
More Decks by xyu
See All by xyu
Improving Search With One Weird Trick
xyu
0
120
Better Performance & Uptime Through Async
xyu
0
160
Dealing With Time Travelers in Analytics
xyu
0
110
Scaling WordPress Queries With Elasticsearch
xyu
1
13k
Scale Out Don't Scale Up
xyu
2
270
Understanding Language and Fixing WP Search
xyu
1
200
Jetpack Related Posts for Power Users
xyu
1
700
WP ❤️ Elasticsearch
xyu
1
430
Cloud Powered WordPress for Everyone
xyu
0
160
Other Decks in Technology
See All in Technology
広島発!スタートアップ開発の裏側
tsankyo
0
250
Goでマークダウンの独自記法を実装する
lag129
0
220
AIとTDDによるNext.js「隙間ツール」開発の実践
makotot
6
710
Evolution on AI Agent and Beyond - AGI への道のりと、シンギュラリティの3つのシナリオ
masayamoriofficial
0
190
株式会社ARAV 採用案内
maqui
0
360
[OCI Skill Mapping] AWSユーザーのためのOCI(2025年8月20日開催)
oracle4engineer
PRO
2
150
LLM時代の検索とコンテキストエンジニアリング
shibuiwilliam
2
1.1k
TypeScript入門
recruitengineers
PRO
23
7.2k
JOAI発表資料 @ 関東kaggler会
joai_committee
1
360
会社にデータエンジニアがいることでできるようになること
10xinc
9
1.6k
Goss: New Production-Ready Go Binding for Faiss #coefl_go_jp
bengo4com
0
1.1k
Product Management Conference -AI時代に進化するPdM-
kojima111
0
220
Featured
See All Featured
Docker and Python
trallard
45
3.5k
Large-scale JavaScript Application Architecture
addyosmani
512
110k
Building Better People: How to give real-time feedback that sticks.
wjessup
367
19k
Chrome DevTools: State of the Union 2024 - Debugging React & Beyond
addyosmani
7
820
How to train your dragon (web standard)
notwaldorf
96
6.2k
Speed Design
sergeychernyshev
32
1.1k
Reflections from 52 weeks, 52 projects
jeffersonlam
351
21k
The Pragmatic Product Professional
lauravandoore
36
6.8k
A better future with KSS
kneath
239
17k
What’s in a name? Adding method to the madness
productmarketing
PRO
23
3.6k
実際に使うSQLの書き方 徹底解説 / pgcon21j-tutorial
soudai
PRO
183
54k
"I'm Feeling Lucky" - Building Great Search Experiences for Today's Users (#IAC19)
danielanewman
229
22k
Transcript
Elasticsearch & 63 Million WordPress Sites Elasticsearch Boston (Feb. 2014)
Xiao Yu Code Wrangler — Automattic @HypertextRanch
[email protected]
xyu
VaultPress Jetpack Simplenote Akismet Polldaddy Gravatar VideoPress IntenseDebate
Simperium Code Poet Cloudup
Cluster Stats • 63M Sites • 743M Documents • 12TB
Primary + Replicas • 51M Query Ops / Day • 15M Index Ops / Day 2 Major Use Cases • Global Search ! • Local Search Elasticsearch + WordPress.com
Infrastructure Layout Internal API Cache REST API PHP Node 1
Node 2 Cluster A Node 1 Node 2 Node 3 Node n Cluster B Stats
Documents & Types /index/post { blog_id: 123, post_id: 456, title:
"Search!", content: "…", blog: { lang: "en", … }, … } /index/blog { blog_id: 123, url: "www.xyu.io", follower_ids: [ 789, … ], lang: "en", indexable: true, … }
Storage Strategy • Grow Number of Indices (10M Sites /
Index) • 25 Shards / Index (400K Sites / Shard) • 3 Copies of Data (1 Primary + 2 Replicas) 2 Major Use Cases • Global Search • Query All Shards • Local Search • Query One Shard Indicies & Shards
Nodes & Clusters Warning, YMMV! !
Monitoring Cluster Health
Monitoring Cluster Health
Monitoring Cluster Health
Monitoring Cluster Health
Thanks! @HypertextRanch
[email protected]
xyu