Save 37% off PRO during our Black Friday Sale! »

KubeCon CloudNativeCon 2018 Seattle Recap 〜Vitess〜

7bcf6f29a0b9a348fe422a31a4f44752?s=47 cyberblack28
January 09, 2019

KubeCon CloudNativeCon 2018 Seattle Recap 〜Vitess〜

Cloud Native Meetup Tokyo #6 KubeCon + CNCon Recap

7bcf6f29a0b9a348fe422a31a4f44752?s=128

cyberblack28

January 09, 2019
Tweet

Transcript

  1. KubeCon + CloudNativeCon 2018 Seattle Recap ~ Vitess ~ Cloud

    Native Meetup Tokyo #6 KubeCon + CNCon Recap 2019.1.9 @CyberAgent © cyberblack28
  2. Profile Twitter:cyberblack28 Hatena Blog:https://cyberblack28.hatenablog.com/ Job Educational Solution Architect Developer Advocate/Technical

    Evangelist Infrastructure Engineer Frontend Engineer Community Music,Live,FES !! Take a picture !! https://www.flickr.com/photos/cyberblack ISBN-10: 4798155373 ISBN-13: 978-4798155371 I wrote the Chapter 6 Rancher 2.0 part. Release on March 15, 2018 ! #rancherjp #kujiraya #deepcn
  3. Company

  4. Agenda 1. Session’s Summary 2. Vitess 3. Details of session

  5. Session’s Summary

  6. Session’s Summary Documents http://u0u1.net/P1uc Slide Movie https://www.youtube.com/watch?v=ZjTraLkMjYM Vitess at HubSpot:

    How We Moved Hundreds of MySQL Databases into Kubernetes Session
  7. Session’s Summary 20173F!HubSpot2 AEMNMySQL4ABD/6) :8 1000=EC2++ 1. <> % -,

    ,0  92'865)%@ /37 ?(*&")   ;.P! `RZ(<CVitessKubernetes(];&  '$WE>%H   b_MySQL'!#$5CG%(e U7` = )Lfh/*Sa-1(dg (VitessD `Kubernetes OperatorBIcK"X ) KubernetesMySQL.,0+(O9T:#\V&!Q@ #Vitess [4?^-1& #%Y :J&    MySQL cloud-native nirvana
  8. Vitess

  9. Vitess Intro: Vitess Deep Dive: Vitess https://www.youtube.com/watch?v=XeG-XTvymeY https://www.youtube.com/watch?v=bd1na3mqJ7M Slide Movie

    Slide Movie http://u0u1.net/P1J6 http://u0u1.net/P1Jg
  10. Vitess What’s Vitess • MySQLSharding 8I? 4HK 0CB>@. &'#( $!*

    . ! #, • 201852653CNCF)1%  16J=+ %:9@G Incubation • YouTube<7 20115)1"-2D? • Go EgRPC .2%;AGo,Java,Python,PHP.2%. (./F
  11. Vitess Vitess Stats • Started 2010first commit • 7,000+ stars

    • 15,000+ commits • 100+ contributors • 500+ Slack members • v3.0 Release (MySQL8,MariaDB10.3)
  12. Vitess The adoption is increasing !! 10,000+ Tablets on Kubernetes

    20% Migrated to Vitess Cash App fully runs on Vitess Cash App =  
  13. Vitess Architecture application vttablet mysqld vtctl Topology vttablet mysqld vttablet

    mysqld vtctld application application application vtgate interact with topology command runtime admin command line GUI server server server
  14. Vitess Vitess on Kubernetes application vttablet mysqld vtctl etcd vttablet

    mysqld vttablet mysqld vtctld application application application vtgate interact with topology command runtime admin command line GUI tablet tablet tablet vtgate service etcd service vtctld service Shard0 Shard1 Shard2 PV Pod Pod Pod Pod Pod Pod Pod PV PV Master Replica Ronly
  15. Vitess Technical terms vtgate application!-)64J0vttablet(KN@2M706I31MB(#EL5:9ND tablet mysqld&vttablet)<>B vttablet MySQL(mysqld))("/.EL5:9ND64J) '64J!-MySQL0

    #. , . vtctld Vitess6I;=)(GUI))&'.HTTP9ND vtctl Vitess6I;=)OCLIP#.$+)8GMCI3M?NK Topology Vitess6I;=) 0#.H=AN=;B1Kubernetes%*etcdetcd %*ZooKeeper0 9FNB
  16. Vitess Sharding • 2.&!  "- ,0 • Shard/* 

     '!#$ Vitess’s Sharding • Vertical Sharding3+ 2 1% " ,0 • Horizontal Sharding)( 1. 1% Shard "- 1% " ,0
  17. Vitess Table Sharding VSchema Sharding( ! VTworkerVSchema&-Sharding $' VSchema&- +#

    Shard  Keyspace , Shard  %  application 1)  "*
  18. Vitess Reference Docs • Vitess is a database clustering system

    for horizontal scaling of MySQL https://vitess.io/ • Vitess Twitter https://twitter.com/vitessio • CrashAcademy CNDJP  #8 Vitess      https://crash.academy/ng/video/412/1736 • Vitess Slack https://vitess.slack.com/ • Vitess Github https://github.com/vitessio/vitess
  19. Vitess Rancher & Vitess https://rancher.com/blog/2018/2018-08-31-intro-to-vitess-on-kubernetes/ Introduction to Vitess: Using Vitess

    on Kubernetes Rancher Labs Official BlogRancher Vitess    
  20. Details of session

  21. Details of session What’s HubSpot ? SaaS   

       https://www.hubspot.jp/
  22. Details of session Background   Web   http://urx.space/P2DD

    10AWS EC2 EBS S3 ELB 2500EC2       30Google Cloud Platform
  23. Details of session Consideration for Microservice and Globalization  

    Web   EC2 EBS S3 ELB 2500EC2     Singularity Cloud Load Balancing Compute Engine + Singularity +   1 530+   1 8000  
  24. Details of session Reason why we decided to Vitess •

      • Kubernetes •   • 
  25. Details of session About release 500    

    Helm  Operator 
  26. Details of session Custom Resources

  27. Details of session Anatomy of a Pod PersistentVolume Directory Data

    Pull Log
  28. Details of session Lots of other work • VtgatePool CRD

      CRD • JdbcgRPC  • TLS • Orchestrator IntegrationMySQL high availability and replication management tool • SQL GrammarSQL https://github.com/github/orchestrator
  29. Details of session Migration

  30. Details of session Protecting against cluster maintenance  Pod '&"

    $ PodDisruptionBudget # !%    
  31. Details of session Injecting Vault secrets into Pods Secret CRD

    Updater Operator     
  32. Details of session Parameterizing configuration in Docker images Configmap 

       Python Docker    
  33. Details of session Terminating Pods gracefully Vttablet   

    Pod 
  34. Details of session Optimizing Vitess Backups EBS  Pod PV

         Pod  
  35. Details of session Controlling StatefulSet rollouts Replica-Replica-Master  OperatorStatefulSet 

      
  36. Details of session Lessons learned: It’s a transplant

  37. Details of session Summary • YouTube7F: • -2# 13?8GA&,' !?

    • KubernetesD>; 6 • "%/4 <@EB8$0)3C9 • .*!(+" Vitess as a Service 5 = !?
  38. Thank you for your attention !!