Pull Request Replication Controller

https://mercari.connpass.com/event/227024/
で発表しました。

アーカイブはYouTubeから見れます！
https://www.youtube.com/watch?v=u5Eq-uJBvzg

ちなみに、TLA+チートシートは以下
https://zenn.dev/riita10069/articles/bc689cae1c7bc0

Transcript

1. View Slide

2. View Slide

3. View Slide

4. GitHub
   API PRRC
   Kubernetes
   Deployment
   Create/Update/Delete Virtual Service
   

   View Slide

5. Pros.
   Cons.
   

   View Slide

6. GitHub
   Open
   Close
   kube-github
   
   
   operator
   Kubernetes
   Deployment
   WebHook
   WebHook
   Create/Update/Delete
   Virtual Service
   Pull Request
   Repository
   Repository PRRC
   Correspond
   

   View Slide

7. Pros.
   Cons.
   

   View Slide

8. How was it implemented?
   

   View Slide

9. https://hackernoon.com/level-triggering-and-reconciliation-in-kubernetes-1f17fe30333d
   Level
   
   
   Triggering
   
   
   Architecture
   

   View Slide

10. Repository1
    Repository2
    Repository3
    GitHub WebHook
    
    
    mercari/Repository2/#12
    #12 #14
    #7 #11
    #68 #100 #100
    #65
    

    View Slide

11. Repository1
    Repository2
    Repository3
    GitHub WebHook
    
    
    mercari/Repository2/#12
    #12 #14
    #7 #11
    #68 #100 #100
    #65
    #12
    

    View Slide

12. Repository1
    Repository2
    Repository3
    GitHub WebHook
    
    
    mercari/Repository1/#12
    #12 #14
    #7 #11
    #68 #100 #100
    #65
    #12
    

    View Slide

13. Repository1
    Repository2
    Repository3
    GitHub WebHook
    
    
    mercari/Repository1/#12
    #12 #14
    #7 #11
    #68 #100 #100
    #65
    Updated!!
    #12
    

    View Slide

14. Repository1
    Repository2
    Repository3
    GitHub WebHook
    
    
    mercari/Repository3/#100
    #12 #14
    #7 #11
    #68 #100 #100
    #65
    #12
    

    View Slide

15. Repository1
    Repository2
    Repository3
    GitHub WebHook
    
    
    mercari/Repository3/#100
    #12 #14
    #7 #11
    #68 #100
    #65
    Updated!!
    Deleted!!
    #12
    

    View Slide

16. Repository1
    Repository2
    Repository3
    GitHub WebHook
    
    
    mercari/Repository4/#1
    #12 #14
    #7 #11
    #68 #100
    #65
    #12
    

    View Slide

17. Repository1
    Repository2
    Repository3
    GitHub WebHook
    
    
    mercari/Repository4/#1
    #12 #14
    #7 #11
    #68 #100
    #65
    #12
    Not Found!!
    

    View Slide

18. Is that really correct?
    

    View Slide

19. Distributed systems are dif
    f
    icult.
    

    View Slide

20. https://github.com/tlaplus/tlaplus
    

    View Slide

21. https://zenn.dev/riita10069/articles/bc689cae1c7bc0
    

    View Slide

22. View Slide

23. View Slide

24. #3 #3
    #1 #2
    GitHub WebHook
    
    
    mercari/Repository1/#3’
    Repository1
    GitHub WebHook
    
    
    mercari/Repository1/#3’’
    Updated!!
    #3’’
    #1 #2
    Repository1
    Updated!!
    #3’
    #1 #2
    Repository1
    

    View Slide

25. Assume that WebHooks for the same PR do not come instantly.
    

    View Slide

26. Verify the webhook is latest by timestamp
    

    View Slide

27. GitHub
    API
    Kubernetes
    Pull Request
    Create/Update/Delete
    kube-github
    
    
    operator
    

    View Slide

28. View Slide

29. https://cloudark.medium.com/kubernetes-custom-controllers-b6c7d0668fdf
    Informer is a component which monitors object changes
    

    and stores data in a thread-safe in-memory cache.
    Lister is a component which gets list of resources.
    

    View Slide

30. Create Index
    Create Key and Value
    Call Lister with filter
    

    View Slide

31. https://github.com/kubernetes/client-go/blob/8aceb98010c1c18b6b54a35b52fd5b46905e3d7f/tools/cache/store.go#L68
    Key: Namespace/Name
    
    
    Value: Resource Object
    There is no need to O(N) to find an object with a specific NamespacedName.
    

    View Slide

32. Controller API Server
    

    View Slide

33. Controller
    Client Logic Repository
    API Server
    Knows GitHub
    Knows API
    Knows Nothing
    Sync Worker
    

    View Slide

34. Controller envtest
    Download these binary directly
    Logic Repository
    Knows envtest
    Knows Nothing
    

    View Slide

35. Logic Repository
    Knows Nothing
    https://github.com/sanposhiho/gomockhandler
    mock gomock gomockhandler
    https://github.com/golang/mock
    

    View Slide

36. $ gomockhandler -config=/path/to/gomockhandler.json -source=foo.go -destination=./mock/
    Configuring a new mock
    $ gomockhandler mockgen
    Generate mock
    $ gomockhandler check
    Verify the mock is up to date
    

    View Slide

37. View Slide

38. Kubernetes
    WebHook
    kubectl
    

    View Slide