Slide 1
Slide 1 text
Custom Kubernetes Controllers at Mercari
Yuki Ito (@mrno110)
Kubernetes Casual Talk
Slide 2
Slide 2 text
Merpay / Mercoin
Architect
Mercari
Microservices Platform CI/CD
Yuki Ito
@mrno110
Slide 3
Slide 3 text
Agenda
ɾCustom Kubernetes Controllers
ɾCode Generation
Slide 4
Slide 4 text
Agenda
ɾCustom Kubernetes Controllers
ɾCode Generation
Slide 5
Slide 5 text
spanner-autoscaler
Autoscaler for the Google Cloud Spanner Instances
Slide 6
Slide 6 text
spanner-autoscaler
apiVersion: spanner.mercari.com/v1alpha1
kind: SpannerAutoscaler
metadata:
name: spannerautoscaler-sample
namespace: your-namespace
spec:
scaleTargetRef:
projectId: your-gcp-project-id
instanceId: your-spanner-instance-id
minNodes: 1
maxNodes: 4
maxScaleDownNodes: 1
targetCPUUtilization:
highPriority: 60
Autoscaler for the Google Cloud Spanner Instances
Slide 7
Slide 7 text
spanner-autoscaler
Google Cloud Day 2020
https://cloudonair.withgoogle.com/events/google-cloud-day-digital?talk=d3-da07
Slide 8
Slide 8 text
Bootes
Bootes
Namespace: a Namespace: b
app: foo app: bar app: foo app: bar app: foo app: bar
Namespace: c
xDS Control Plane Kubernetes Controller
Slide 9
Slide 9 text
Bootes
xDS Control Plane Kubernetes Controller
apiVersion: bootes.io/v1
kind: Cluster
metadata:
name: example-cluster
namespace: foo
spec:
config:
name: example-cluster
connect_timeout: 1s
type: EDS
lb_policy: ROUND_ROBIN
http2_protocol_options: {}
eds_cluster_config:
eds_config:
ads: {}
Slide 10
Slide 10 text
Bootes
Envoy Meetup Tokyo #2
https://envoytokyo.connpass.com/event/175256/
Slide 11
Slide 11 text
Pull Request Replication Controller
Slide 12
Slide 12 text
Service Routing Controller
Slide 13
Slide 13 text
Service Routing Controller
Merpay Tech Fest 2021
https://events.merpay.com/techfest-2021/
Slide 14
Slide 14 text
Agenda
ɾCustom Kubernetes Controllers
ɾCode Generation
Slide 15
Slide 15 text
Agenda
ɾCustom Kubernetes Controllers
ɾCode Generation
Slide 16
Slide 16 text
De
fi
ne CRDs as Protocol Buffers
message Repository {
string owner = 1;
string repository = 2;
}
type Repository struct {
state protoimpl.MessageState
sizeCache protoimpl.SizeCache
unknownFields protoimpl.UnknownFields
Owner string `protobuf:...`
Repository string `protobuf:...`
}
Protocol Buffers
func (in *Repository) DeepCopyInto(out *Repository) {
p := proto.Clone(in).(*Repository)
*out = *p
}
func (in *Repository) DeepCopy() *Repository {
if in == nil {
return nil
}
out := new(Repository)
in.DeepCopyInto(out)
return out
}
protoc-gen-go protoc-gen-deepcopy
Slide 17
Slide 17 text
istio / tools / protoc-gen-deepcopy
https://github.com/istio/tools/tree/master/cmd/protoc-gen-deepcopy
Slide 18
Slide 18 text
Generic protoc-gen-deepcopy
https://github.com/protobuf-tools/protoc-gen-deepcopy
Slide 19
Slide 19 text
De
fi
ne CRDs as Protocol Buffers
type Repository struct {
state protoimpl.MessageState
sizeCache protoimpl.SizeCache
unknownFields protoimpl.UnknownFields
Owner string `protobuf:...`
Repository string `protobuf:...`
}
Protocol Buffers
protoc-gen-go
type Repository struct {
v1.TypeMeta
v1.ObjectMeta
// Proto Buffer Struct
Spec apisv1alpha1.Repository
}
kubetype-gen
Slide 20
Slide 20 text
istio / tools / kubetype-gen
https://github.com/istio/tools/tree/master/cmd/kubetype-gen
Slide 21
Slide 21 text
Generic kubetype-gen
https://github.com/110y/kubetype-gen
Slide 22
Slide 22 text
De
fi
ne CRDs as Protocol Buffers
Protocol Buffers
protoc-gen-go / protoc-gen-deepcopy
Protocol Buffer Go Struct (+ DeepCopy)
Kubernetes Go Types
Custom Resource De
fi
nitions (YAML)
kubetype-gen
controller-gen
Slide 23
Slide 23 text
De
fi
ne CRDs as Protocol Buffers
Protocol Buffers
Advanced
Custom Resource De
fi
nitions (YAML)
istio /tools / cue-gen