Elasticsearch & 63 Million WordPress Sites

Overview of the Elasticsearch infrastructure that Automattic maintains to support WordPress.com.

1. Elasticsearch & 63 Million WordPress Sites Elasticsearch Boston (Feb. 2014)
2. Xiao Yu Code Wrangler — Automattic @HypertextRanch me@xyu.io xyu    
3.   VaultPress Jetpack Simplenote Akismet Polldaddy Gravatar VideoPress IntenseDebate Simperium Code Poet Cloudup
4. 
5. Cluster Stats • 63M Sites • 743M Documents • 12TB Primary + Replicas • 51M Query Ops / Day • 15M Index Ops / Day 2 Major Use Cases • Global Search ! • Local Search Elasticsearch + WordPress.com
6. Infrastructure Layout Internal API Cache REST API PHP Node 1 Node 2 Cluster A Node 1 Node 2 Node 3 Node n Cluster B Stats
7. Documents & Types /index/post {
 blog_id: 123,
 post_id: 456,
 title: "Search!",
 content: "…",
 blog: {
 lang: "en",
 …
 },
 …
 } /index/blog {
 blog_id: 123,
 url: "www.xyu.io",
 follower_ids: [
 789,
 …
 ],
 lang: "en",
 indexable: true,
 …
 }
8. Storage Strategy • Grow Number of Indices
 (10M Sites / Index) • 25 Shards / Index
 (400K Sites / Shard) • 3 Copies of Data
 (1 Primary + 2 Replicas) 2 Major Use Cases • Global Search • Query All Shards • Local Search • Query One Shard Indicies & Shards
9. Nodes & Clusters Warning, YMMV! !  
10. Monitoring Cluster Health
11. Monitoring Cluster Health
12. Monitoring Cluster Health
13. Monitoring Cluster Health
14. Thanks! @HypertextRanch me@xyu.io xyu   