KubeCon CloudNativeCon 2018 Seattle Recap 〜Vitess〜

Cloud Native Meetup Tokyo #6 KubeCon + CNCon Recap

Transcript

1. KubeCon + CloudNativeCon 2018 Seattle Recap ~ Vitess ~ Cloud Native Meetup Tokyo #6 KubeCon + CNCon Recap 2019.1.9 @CyberAgent © cyberblack28
2. Profile Twitter:cyberblack28 Hatena Blog:https://cyberblack28.hatenablog.com/ Job Educational Solution Architect Developer Advocate/Technical Evangelist Infrastructure Engineer Frontend Engineer Community Music,Live,FES !! Take a picture !! https://www.flickr.com/photos/cyberblack ISBN-10: 4798155373 ISBN-13: 978-4798155371 I wrote the Chapter 6 Rancher 2.0 part. Release on March 15, 2018 ! #rancherjp #kujiraya #deepcn
3. Company
4. Agenda 1. Session’s Summary 2. Vitess 3. Details of session
5. Session’s Summary
6. Session’s Summary Documents http://u0u1.net/P1uc Slide Movie https://www.youtube.com/watch?v=ZjTraLkMjYM Vitess at HubSpot: How We Moved Hundreds of MySQL Databases into Kubernetes Session
7. Session’s Summary 20173F!
   HubSpot2 AEMNMySQL4ABD
   /6
   ) :8 1000=EC2++ 1. <> % -, ,0  92'
   865)%@ /37 ?(*&")   ;.P! `RZ(<C
   VitessKubernetes(];&  '$WE>%H   b_
   MySQL'!#$5CG%(e U7` = )Lf
   h/*
   Sa-1(dg (VitessD `Kubernetes OperatorBIcK"X ) KubernetesMySQL.,0+(O9T:#\V&!Q@ 
   #Vitess [4?^-1& 
   #%Y :J&    MySQL cloud-native nirvana
8. Vitess
9. Vitess Intro: Vitess Deep Dive: Vitess https://www.youtube.com/watch?v=XeG-XTvymeY https://www.youtube.com/watch?v=bd1na3mqJ7M Slide Movie Slide Movie http://u0u1.net/P1J6 http://u0u1.net/P1Jg
10. Vitess What’s Vitess • MySQLSharding 8I? 4HK 0CB>@. &'#( $!* . ! #, • 201852653
    CNCF)1%  16J=+ %:9@G Incubation • YouTube<7
    20115)1"-2D? • Go E
    gRPC .2%;AGo,Java,Python,PHP.2%. (./F
11. Vitess Vitess Stats • Started 2010
    first commit • 7,000+ stars • 15,000+ commits • 100+ contributors • 500+ Slack members • v3.0 Release (MySQL8,MariaDB10.3)
12. Vitess The adoption is increasing !! 10,000+ Tablets on Kubernetes 20% Migrated to Vitess Cash App fully runs on Vitess Cash App = 
    
13. Vitess Architecture application vttablet mysqld vtctl Topology vttablet mysqld vttablet mysqld vtctld application application application vtgate interact with topology command runtime admin command line GUI server server server
14. Vitess Vitess on Kubernetes application vttablet mysqld vtctl etcd vttablet mysqld vttablet mysqld vtctld application application application vtgate interact with topology command runtime admin command line GUI tablet tablet tablet vtgate service etcd service vtctld service Shard0 Shard1 Shard2 PV Pod Pod Pod Pod Pod Pod Pod PV PV Master Replica Ronly
15. Vitess Technical terms vtgate application!-)64J0vttablet(KN@2M706I31MB(#EL5:9ND tablet mysqld&vttablet)<>B vttablet MySQL(mysqld))("/.EL5:9ND64J) '64J!-MySQL0 #. , . vtctld Vitess6I;=)(GUI))&'.HTTP9ND vtctl Vitess6I;=)OCLIP#.$+)8GMCI3M?NK Topology Vitess6I;=) 0#.H=AN=;B1Kubernetes%*etcdetcd
    %*ZooKeeper0 9FNB
16. Vitess Sharding • 2.&!  "- ,0 • Shard/*  
     '!#$ Vitess’s Sharding • Vertical Sharding3+ 2 1% " ,0 • Horizontal Sharding)( 1. 1% Shard "-
    1% " ,0
17. Vitess Table Sharding VSchema Sharding(
    ! VTworkerVSchema&-Sharding $' VSchema&- +# Shard  Keyspace
    , Shard  %  application 1)  "*
18. Vitess Reference Docs • Vitess is a database clustering system for horizontal scaling of MySQL https://vitess.io/ • Vitess Twitter https://twitter.com/vitessio • CrashAcademy CNDJP  #8 Vitess 
        https://crash.academy/ng/video/412/1736 • Vitess Slack https://vitess.slack.com/ • Vitess Github https://github.com/vitessio/vitess
19. Vitess Rancher & Vitess https://rancher.com/blog/2018/2018-08-31-intro-to-vitess-on-kubernetes/ Introduction to Vitess: Using Vitess on Kubernetes Rancher Labs Official BlogRancher Vitess    
20. Details of session
21. Details of session What’s HubSpot ? SaaS
         https://www.hubspot.jp/
22. Details of session Background   Web   http://urx.space/P2DD 10AWS EC2 EBS S3 ELB 2500EC2    
     30Google Cloud Platform
23. Details of session Consideration for Microservice and Globalization   Web   EC2 EBS S3 ELB 2500EC2   
     Singularity Cloud Load Balancing Compute Engine + Singularity +   1 530+  
    1 8000  
24. Details of session Reason why we decided to Vitess • 
      • Kubernetes •
    
     • 
25. Details of session About release 500    
    Helm  Operator 
26. Details of session Custom Resources
27. Details of session Anatomy of a Pod PersistentVolume Directory
    Data Pull Log
28. Details of session Lots of other work • VtgatePool CRD   CRD • JdbcgRPC  • TLS • Orchestrator IntegrationMySQL high availability and replication management tool • SQL GrammarSQL https://github.com/github/orchestrator
29. Details of session Migration
30. Details of session Protecting against cluster maintenance  Pod '&" $ PodDisruptionBudget # !%    
    
31. Details of session Injecting Vault secrets into Pods Secret CRD Updater Operator 
       
32. Details of session Parameterizing configuration in Docker images Configmap     Python 
    Docker    
33. Details of session Terminating Pods gracefully Vttablet    Pod 
    
34. Details of session Optimizing Vitess Backups EBS 
     Pod PV 
         Pod  
35. Details of session Controlling StatefulSet rollouts Replica-Replica-Master  OperatorStatefulSet   
    
36. Details of session Lessons learned: It’s a transplant
37. Details of session Summary • YouTube7F: • -2# 13?8G
    A&,' !? • KubernetesD>; 6 • "%/4 <@EB8$0)3C9 • .*!(+" Vitess as a Service 5 = !?
38. Thank you for your attention !!