Tweet
Tweet

Slide 1

Slide 1 text

Ingress GCE & Problem Kubernetes Meetup Tokyo #14 2018/11/08 @tjun

Slide 2

Slide 2 text

Who am I? - @tjun - Merpay SRE, EM - (Sometimes) Working with Mercari Microservices Platform Team - We are hiring!

Slide 3

Slide 3 text

Ingress-GCE ● Ingress controller for Google Cloud ○ GCE L7 load balancer controller ○ Configured through the Kubernetes Ingress API

Slide 4

Slide 4 text

L7 Load balancing on Kubernetes GCP resources are created with $ kubectl apply -f ingress.yaml Global Forwarding Rule -> TargetHttpProxy -> URL Map -> Backend Service -> Instance Group or Network Endpoint Group

Slide 5

Slide 5 text

Ingress GCE or Ingress Nginx https://medium.com/omnius/kubernetes-ingress-gce-vs-nginx-controllers-1-3-d89d6dd3da73

Slide 6

Slide 6 text

Merpay architecture Clients Merpay API Gateway API ServiceA ServiceA ServiceA API

Slide 7

Slide 7 text

Ingress GCE problem on GKE v1.10.6 GKE Release Notes

Slide 8

Slide 8 text

Ingress GCE problem on GKE v1.10.6 When we recreate an Ingress: ● External IP is never attached ● Backend Services are not created What we did: ● kubectl describe ing xxxxx / kubectl get events ● Check TLS on secret and ● Check kube-apiserver logs and cert-manager logs ● Recreate ingress without static-ip -> OK ● Recreate ingress with 1 backend -> sometimes OK

Slide 9

Slide 9 text

Ingress GCE problem on GKE v1.10.6 Ask GCP support

Slide 10

Slide 10 text

Our workaround until cluster upgrade $ kubectl apply -f merpay-ingress1.yaml $ kubectl apply -f merpay-ingress2.yaml $ kubectl apply -f merpay-ingress3.yaml -> OK $ kubectl apply -f merpay-ingress4.yaml

Slide 11

Slide 11 text

Summary 今は直っているので、IngressGCEめちゃ便利です。GKE最高！