Slide 1
Slide 1 text
Microservices Platform at Mercari
Taichi Nakashima
Tech Lead (Microservices platform)
Slide 2
Slide 2 text
Tech Lead
Microservices platform
Taichi Nakashima
Slide 3
Slide 3 text
Microservices
https://www.flickr.com/photos/ronduong/37605344086
Slide 4
Slide 4 text
1000
Engineers Org.
https://www.flickr.com/photos/owyzzz/3626718695
Slide 5
Slide 5 text
Speed
https://www.flickr.com/photos/szymipl/6093250294
Slide 6
Slide 6 text
https://itrevolution.com/book/accelerate/
ACCELERATE
The Science of Lean Software
and DevOps: Building and
Scaling High Performing
Technology Organizations
Slide 7
Slide 7 text
https://itrevolution.com/book/accelerate/
Slide 8
Slide 8 text
https://itrevolution.com/book/accelerate/
Slide 9
Slide 9 text
https://itrevolution.com/book/accelerate/
Organization Design
Slide 10
Slide 10 text
Develop
Monolith
Test Deploy Operate
Slide 11
Slide 11 text
Develop
Monolith
Test Deploy Operate
Backend Team
QA team SRE team
Slide 12
Slide 12 text
Test Deploy Operate
Backend Team
QA team SRE team
Develop
Service B
Develop
Service A
Develop
Service C
Slide 13
Slide 13 text
Test Deploy Operate
Backend Team
SRE team
Develop
Service B
Develop
Service A
Develop
Service C
QA team
Slide 14
Slide 14 text
Test Deploy Operate
Backend Team
SRE team
Develop
Service B
Develop
Service A
Develop
Service C
QA team
Slide 15
Slide 15 text
Test Deploy Operate
Backend Team
SRE team
Develop
Service B
Develop
Service A
Develop
Service C
QA team
Slide 16
Slide 16 text
Develop
Service B
Test Deploy Operate
Service B Team
Develop
Service A
Test Deploy Operate
Service A Team
Develop
Service C
Test Deploy Operate
Service C Team
Slide 17
Slide 17 text
https://medium.com/netflix-techblog/full-cycle-developers-at-netflix-a08c31f83249
Slide 18
Slide 18 text
Develop
Service B
Test Deploy Operate
Service Team B
Develop
Service A
Test Deploy Operate
Service Team A
Develop
Service C
Test Deploy Operate
Service Team C
Slide 19
Slide 19 text
Develop
Service B
Test Deploy Operate
Service Team B
Develop
Service A
Test Deploy Operate
Service Team A
Develop
Service C
Test Deploy Operate
Service Team C
Developers need to act
as SWE, SET and SRE
Slide 20
Slide 20 text
Develop
Service B
Test Deploy Operate
Service Team B
Develop
Service A
Test Deploy Operate
Service Team A
Develop
Service C
Test Deploy Operate
Service Team C
Too much expected
Slide 21
Slide 21 text
No content
Slide 22
Slide 22 text
1 year
Slide 23
Slide 23 text
73
Developing
19
Production
Slide 24
Slide 24 text
What We Achieved
Slide 25
Slide 25 text
Pave the “Base” Road
https://www.flickr.com/photos/martin_borjesson/7725354722
Slide 26
Slide 26 text
https://www.flickr.com/photos/martin_borjesson/7725354722
Architecture
DevOps Culture
Slide 27
Slide 27 text
API Gateway
Communication
Template
Access manage
Slide 28
Slide 28 text
MySQL Solr
Monolith API
Slide 29
Slide 29 text
API gateway
MySQL Solr
Kubernetes
Monolith API
Slide 30
Slide 30 text
API gateway
Authority
Service A
MySQL Solr
Kubernetes
Monolith API
Slide 31
Slide 31 text
API gateway
Authority
Service A
MySQL Solr
Kubernetes
Monolith API
Service B
Slide 32
Slide 32 text
API gateway
Authority
Service A
Spanner
MySQL Solr
Kubernetes
Monolith API
CloudSQL
Service B
Slide 33
Slide 33 text
No content
Slide 34
Slide 34 text
API gateway
Authority
Service A
Spanner
MySQL Solr
Kubernetes
Monolith API
CloudSQL
Service B
Slide 35
Slide 35 text
API Gateway
Communication
Template
Access manage
Slide 36
Slide 36 text
API gateway
Authority
Service A
CloudSQL
Spanner
MySQL Solr
Kubernetes
Service B
Monolith API
Slide 37
Slide 37 text
No content
Slide 38
Slide 38 text
No content
Slide 39
Slide 39 text
Service Team PR generate
platform-proto CircleCI
Slide 40
Slide 40 text
API Gateway
Communication
Template
Access manage
Slide 41
Slide 41 text
No content
Slide 42
Slide 42 text
No content
Slide 43
Slide 43 text
Monitoring
Error reporting
Health checking
Dockerfile
CI setting
Slide 44
Slide 44 text
API Gateway
Communication
Template
Access manage
Slide 45
Slide 45 text
API gateway
Authority
Service A
CloudSQL
Spanner
MySQL Solr
Kubernetes
Service B
Monolith API
SRE team
Slide 46
Slide 46 text
API gateway
Authority
Service A
CloudSQL
Spanner
MySQL Solr
Kubernetes
Service B
Monolith API
Service Team B
Service Team A
Slide 47
Slide 47 text
GCP Project: Kubernetes
Platform Team
Kubernetes
IAM
Slide 48
Slide 48 text
GCP Project: Kubernetes
Platform Team
Kubernetes
IAM
Service A Team
Slide 49
Slide 49 text
GCP Project: Kubernetes
Platform Team
Namespace: Service A
Kubernetes
IAM
RBAC
Service A Team
Slide 50
Slide 50 text
GCP Project: Kubernetes
Platform Team
Namespace: Service A
Kubernetes
IAM
RBAC
Container A
Container A
Container A
Service A Team
Slide 51
Slide 51 text
GCP Project: Kubernetes
Platform Team
Namespace: Service A
Kubernetes
IAM
RBAC
Container A
Container A
Container A
GCP Project: Service A
IAM
Service A Team
Slide 52
Slide 52 text
GCP Project: Kubernetes
Platform Team
Namespace: Service A
Kubernetes
IAM
RBAC
Container A
Container A
Container A
Spanner
GCP Project: Service A
IAM
Service A Team
Slide 53
Slide 53 text
GCP Project: Kubernetes
Platform Team
Namespace: Service A
Kubernetes
IAM
RBAC
Container A
Container A
Container A
Spanner
GCP Project: Service A
IAM
Service B Team
Service A Team
Slide 54
Slide 54 text
GCP Project: Kubernetes
Platform Team
Spanner
Namespace: Service A
Kubernetes
GCP Project: Service A
Namespace: Service B
GCP Project: Service B
RBAC
IAM
RBAC
IAM
IAM
Container A
Container A
Container A
Service B Team
Service A Team
Slide 55
Slide 55 text
API Gateway
Communication
Template
Access manage
Slide 56
Slide 56 text
https://www.flickr.com/photos/martin_borjesson/7725354722
Architecture
DevOps Culture
Slide 57
Slide 57 text
https://www.flickr.com/photos/marc_sud13/8453080595
Provisioning
Deploying
Slide 58
Slide 58 text
GCP Project: Kubernetes
Platform Team
Namespace: Service A
Kubernetes
GCP Project: Service A
RBAC
IAM
IAM
Service A Team
Spanner
Slide 59
Slide 59 text
Infrastructure as Code
https://www.flickr.com/photos/trilanes/4714198782/
Slide 60
Slide 60 text
No content
Slide 61
Slide 61 text
No content
Slide 62
Slide 62 text
Starter-kit
as terraform module
Slide 63
Slide 63 text
GCP Project: Kubernetes
Platform Team
Namespace: Service A
Kubernetes
GCP Project: Service A
Service A Team
RBAC
IAM
IAM
Slide 64
Slide 64 text
No content
Slide 65
Slide 65 text
GCP Project: Kubernetes
Platform Team
Namespace: Service A
Kubernetes
GCP Project: Service A
Service A Team
RBAC
IAM
IAM
Spanner
Slide 66
Slide 66 text
PR Plan & Apply
Platform Team
Review
microservices-terraform CircleCI
Service A Team
Slide 67
Slide 67 text
Service B Team
Service A Team
Service C Team
PR
PR
PR
Plan & Apply
Platform Team
Review
microservices-terraform CircleCI
Slide 68
Slide 68 text
PR Plan & Apply
PR
PR
Platform Team
Review
microservices-terraform CircleCI
Service B Team
Service A Team
Service C Team
Slide 69
Slide 69 text
PR Plan & Apply
PR
PR
Platform Team
Review
microservices-terraform CircleCI
Service B Team
Service A Team
Service C Team
CODEOWNERS
Slide 70
Slide 70 text
Plan & Apply
PR
Platform Team
Review
microservices-terraform CircleCI
Service B Team
Service A Team
Service C Team
PR & Review
PR & Review
Slide 71
Slide 71 text
No content
Slide 72
Slide 72 text
No content
Slide 73
Slide 73 text
https://www.flickr.com/photos/marc_sud13/8453080595
Provisioning
Deploying
Slide 74
Slide 74 text
No content
Slide 75
Slide 75 text
GCP Project: Kubernetes
Namespace: Service A
Kubernetes
Namespace: Service B
Container A
Container A
Container A
Container A
Container A
Container B
Service A Team
Service B Team
Slide 76
Slide 76 text
No content
Slide 77
Slide 77 text
60+ pipelines
Slide 78
Slide 78 text
No content
Slide 79
Slide 79 text
GUI ...
Slide 80
Slide 80 text
Infrastructure as Code
https://www.flickr.com/photos/trilanes/4714198782/
Slide 81
Slide 81 text
Kubernetes v2 provider
https://www.flickr.com/photos/trilanes/4714198782/
Slide 82
Slide 82 text
No content
Slide 83
Slide 83 text
GCP Project: Kubernetes
Namespace: Service A
Kubernetes
Namespace: Service B
Container A
Container A
Container A
Container A
Container A
Container B
Service Team A
Service Team B
PR
PR
Sync
Platform Team
Review
microservices-kubernetes
Slide 84
Slide 84 text
GCP Project: Kubernetes
Namespace: Service A
Kubernetes
Namespace: Service B
Container A
Container A
Container A
Container A
Container A
Container B
Service Team A
Service Team B
PR
PR
Sync
Platform Team
Review
microservices-kubernetes
Developers can learn
k8s YAML, too
Slide 85
Slide 85 text
What’s Next?
Slide 86
Slide 86 text
73
Developing
19
Production
Slide 87
Slide 87 text
73
Developing
19
Production
Reliable Service
Operation
Slide 88
Slide 88 text
SLI/SLO
Driven Operation
https://www.flickr.com/photos/samarthshyamanur/8347584639
Slide 89
Slide 89 text
Chaos Testing
https://www.flickr.com/photos/foxgrrl/9671201784/
Slide 90
Slide 90 text
Service Mesh
https://www.flickr.com/photos/mjsonline/1971492464
Slide 91
Slide 91 text
No content
Slide 92
Slide 92 text
No content