『マネージドMySQL提供に向けた挑戦』@ CIU Tech Meetup#1

Transcript

1. ϚωʔδυMySQLఏڙʹ޲͚ͨ௅ઓ גࣜձࣾαΠόʔΤʔδΣϯτ CIU Development Div ޙ౻ल৴ CIU Tech Meetup #1 @2023/06/07
2. ޙ౻ल৴ • גࣜձࣾαΠόʔΤʔδΣϯτ 
 ɹɹɹάϧʔϓITਪਐຊ෦ CIU Development Div • 2016೥9݄ த్ೖࣾ (લ৬͸SIer) • ϓϥΠϕʔτΫϥ΢υͷίϯϙʔωϯτ։ൃ • Go, Kubernetes, Linux, Python, DB 

3. 1.։ൃͷഎܠ 2.։ൃͷํ਑ 3.ར༻ٕज़ͱΞʔΩςΫνϟ 4.ಈ࡞֓ཁͷઆ໌ 5.·ͱΊ
4. ։ൃͷํ਑
5. ։ൃͷํ਑ • ίϚϯυ਺ൃͰDBߏஙɺࣗಈνϡʔχϯά • F/O͸ඞਢɺ෮چޙ΋ࣗಈ૊ΈࠐΈ • MySQLͷఏڙ • ֤ϝτϦΫεɺϩάɺόοΫΞοϓ • Ϣʔβ؅ཧ
6. ։ൃͷํ਑ • k8sͷOperatorΛ׆༻Ͱ͖Δ͔? 
 ɹɹ👍 એݴతAPIͰ؅ཧͰ͖Δ ɹɹ👍 ։ൃ͕੝ΜͰجຊతʹ͸҆ఆ͍ͯ͠Δ ɹɹ👍 F/Oʹ͍ͭͯ΋໰୊ͳ͘ߦ͏͜ͱ͕Ͱ͖Δ
7. ։ൃͷํ਑ • k8sͷOperatorΛ׆༻Ͱ͖Δ͔? 
 ɹɹ🌪 kubernetesʹԿ͔͋ͬͨ࣌ͷಈ࡞୲อ ɹɹ🌪 ݖݶ؅ཧͷෑډ (جຊVM΁ͷΞΫηεෆՄ) ɹɹ🌪 Platformతʹखಈઃఆ͕ඞཁͳՕॴ͕͋Δ
8. ։ൃͷํ਑ • MySQLؔ࿈ͷπʔϧΛ׆༻Ͱ͖Δ͔? 
 ɹɹ👍 ؅ཧπʔϧͷOrchestrator͸஌ݟ͕ଟ͍ ɹɹ👍 ϝτϦΫεऔಘͰ͖ΔOSS΋͋Δ
9. ։ൃͷํ਑ • MySQLؔ࿈ͷπʔϧΛ׆༻Ͱ͖Δ͔? 
 ɹɹ🌪 MySQL5ܥରԠ͕ඞཁͳͨΊπʔϧ͕ݶఆత ɹɹ🌪 ӡ༻ਓ਺͕গͳ͍ͨΊɺࣗಈ෮چ͍ͤͨ͞
10. طଘOperatorɺπʔϧ͚ͩͰ͸ݫ͍͠ ɹ͍͑͑ɺ࡞ͬͯ͠·͑ɹ
11. ։ൃͷํ਑ • ເΛ٧ΊࠐΜͰΈΔ • DB͸VMͱͯ͠ಈ࡞ͤ͞Δ • એݴతAPI͸ੵۃతʹ࢖͍͖͍ͬͯͨ • 5ܥ΋8ܥ΋ԣஅɺڞ௨؅ཧ͕Ͱ͖Δ • Կ͔͋ͬͯ΋جຊతʹ͸ࣗಈ෮چ
12. CDB (Cycloud Database) ͦͷ໊΋
13. ར༻ٕज़ͱ 
 ΞʔΩςΫνϟ
14. ར༻ٕज़ • Kubernetes ؅ཧίϯϙʔωϯτσϓϩΠɹ • Custom Resource / Controllerɹɹ 
 CDBϦιʔεͱͯ͠ఆٛ • MySQL Orchestrator MySQLͷF/Oʹར༻ • OpenStack DBΠϯελϯεͷ࡞੒ • Terraform ίϯτϩʔϥʔ಺Ͱ࣮ߦ
15. ར༻ٕज़ • Kubernetes ؅ཧίϯϙʔωϯτσϓϩΠɹ • Custom Resource / Controllerɹɹ 
 CDBϦιʔεͱͯ͠ఆٛ • MySQL Orchestrator MySQLͷF/Oʹར༻ • OpenStack DBΠϯελϯεͷ࡞੒ • Terraform ίϯτϩʔϥʔ಺Ͱ࣮ߦ
16. Custom Resource / Controller • Custom Resource •Kubernetes APIͷ֦ு •ಛఆͷAPIΦϒδΣΫτͷίϨΫγϣϯΛอ࣋ • Custom Controller •ϦιʔεΛ͋Δ΂͖ঢ়ଶʹಉظ͠؅ཧ • Custom Resourceͱ૊Έ߹ΘͤͯCDBͷػೳΛఏڙ https://github.com/kubernetes-sigs/kubebuilder
17. ར༻ٕज़ • Kubernetes ؅ཧίϯϙʔωϯτσϓϩΠɹ • Custom Resource / Controllerɹɹ 
 CDBϦιʔεͱͯ͠ఆٛ • MySQL Orchestrator MySQLͷF/Oʹར༻ • OpenStack DBΠϯελϯεͷ࡞੒ • Terraform ίϯτϩʔϥʔ಺Ͱ࣮ߦ
18. MySQL Orchestrator • MySQLͷϨϓϦέʔγϣϯঢ়ଶͷ؅ཧ • F/OͷڍಈΛࡉ͔͘ϋϯυϦϯάͰ͖Δ • ίϯϙʔωϯτࣗମ͸RaftΛ࢖ͬͯ৑௕Խ • API΋๛෋ʹ༻ҙ͞Ε͍ͯΔ https://github.com/openark/orchestrator
19. MySQL Orchestrator • MySQLͷϨϓϦέʔγϣϯঢ়ଶͷ؅ཧ • F/OͷڍಈΛࡉ͔͘ϋϯυϦϯάͰ͖Δ • ίϯϙʔωϯτࣗମ͸RaftΛ࢖ͬͯ৑௕Խ • API΋๛෋ʹ༻ҙ͞Ε͍ͯΔ https://github.com/openark/orchestrator
20. ར༻ٕज़ • Kubernetes ؅ཧίϯϙʔωϯτσϓϩΠɹ • Custom Resource / Controllerɹɹ 
 CDBϦιʔεͱͯ͠ఆٛ • MySQL Orchestrator MySQLͷF/Oʹར༻ • OpenStack DBΠϯελϯεͷ࡞੒ • Terraform ίϯτϩʔϥʔ಺Ͱ࣮ߦ
21. OpenStack • Cycloud ͷ IaaSج൫ • όʔδϣϯ͸ Queensʹ৭ʑͱύονద༻ • VM / ϘϦϡʔϜͷ࡞੒࡟আ΍Ξλον/ σλονૢ࡞ • αʔϏεଆͷΤϯδχΞ΋IaaSͱͯ͠࢖͍ͬͯΔج൫ https://github.com/openstack

22. ར༻ٕज़ • Kubernetes ؅ཧίϯϙʔωϯτσϓϩΠɹ • Custom Resource / Controllerɹɹ 
 CDBϦιʔεͱͯ͠ఆٛ • MySQL Orchestrator MySQLͷF/Oʹར༻ • OpenStack DBΠϯελϯεͷ࡞੒ • Terraform ίϯτϩʔϥʔ಺Ͱ࣮ߦ
23. Terraform • IaCͷπʔϧͷ1ͭ • એݴతʹϦιʔεΛ؅ཧ • hclͱ͍͏ݴޠͰهड़͢Δ • ֤Ϋϥ΢υͷϓϩόΠμʔ͕༻ҙ͞Ε͍ͯΔ https://github.com/hashicorp/terraform https://github.com/isaaguilar/terraform-operator
24. ͜ͷลΓΛྑ͖͔ͳ૊Έ߹Θͤͯ CDB͸ಈ͍ͯ·͢
25. ࡞੒࣌ίϚϯυ
26. ࡞੒࣌ίϚϯυ
27. ࡞੒࣌ίϚϯυ DNSϨίʔυΛDBͷ 
 ΤϯυϙΠϯτͱͯ͠ར༻
28. ࡞੒ϑϩʔ gateway mysql controller܈ instance controller setting controller܈ gRPC ೝূ
29. ࡞੒ϑϩʔ gateway mysql controller܈ instance controller setting controller܈ gRPC ೝূ
30. ࡞੒ϑϩʔ gateway mysql controller܈ instance controller setting controller܈ gRPC ೝূ
31. ࡞੒ϑϩʔ gateway mysql controller instance controller setting controller܈ gRPC ೝূ apiVersion: cdb.cycloud.io/v1 kind: MysqlCon fi g metadata: name: xxxxxxxxx namespace: xxxxxxxxx spec: connect_timeout: 100 engine_version: 8 expire_log_days: 10
32. ࡞੒ϑϩʔ gateway mysql controller܈ instance controller setting controller܈ gRPC ೝূ apiVersion: v1 kind: Con fi gMap metadata: name: xxxxxxxxx namespace: xxxxxxxxx data: connect_timeout: "100" expire_log_days: "10"
33. ࡞੒ϑϩʔ gateway mysql controller܈ instance controller setting controller gRPC ೝূ apiVersion: cdb.cycloud.io/v1 kind: MySQL metadata: name: xxxxxxxxx namespace: xxxxxxxx spec: fl avor: large replica: 1 storage: kind: xxxxxxxx size_gib: 45
34. ࡞੒ϑϩʔ gateway mysql controller܈ instance controller setting controller gRPC ೝূ apiVersion: cdb.cycloud.io/v1 kind: Instance metadata: name: xxxxxxxxx namespace: xxxxxxxx spec: dataVolume: size: 45 volumeType: xxxxx version: 8.0.28 fl avor: xxxxxxxxxx ༷ʑͳIaaSج൫ʹ
 ରԠͰ͖ΔΑ͏ʹந৅Խ
35. ࡞੒ϑϩʔ gateway mysql controller܈ instance controller setting controller܈ gRPC ೝূ OpenStack API
36. ࡞੒ϑϩʔ gateway mysql controller܈ instance controller setting controller܈ gRPC ೝূ OpenStack API DBࣗମ͸VMͱͯ͠
 OpenStack্ʹߏங
37. CDBͷΧελϜϦιʔεʢΫϥελܥʣ • MySQL • DBΫϥελϦϯάͷͨΊͷϝΠϯϦιʔε • Instance • ΠϯελϯεߏஙͷͨΊͷϦιʔε • Connector • F/OΛ୲౰͢ΔϦιʔε • Orchestrator • MySQL OrchestratorΛ؅ཧ͢ΔϦιʔε
38. CDBͷΧελϜϦιʔεʢઃఆܥʣ • LoggingConfig • MySQLͷϩάؔ࿈ͷอଘઃఆ • LoginRootUser • RootϢʔβͷઃఆ • MetricsConfig • ϝτϦΫεؔ࿈ͷઃఆ • MysqlBackup / MysqlSnapshot • σʔλͷόοΫΞοϓܥͷઃఆ • MysqlConfig • MySQLͷઃఆؔ܎
39. apiVersion: cdb.cycloud.io/v1 kind: MySQL metadata: name: xxxxxxxxx namespace: xxxxxxxx spec: fl avor: large replica: 1 storage: kind: xxxxxxxx size_gib: 45 VMىಈޙ Mysqllet Mysqllet ओͳ΍ΓͱΓ ɹDBઃఆ৘ใͷऔಘ ɹϓϩδΣΫτ৘ใͷऔಘ ɹϓϥΠϚϦɺηΧϯμϦ৘ใͷऔಘ ɹߏஙঢ়گͷใࠂ DNSaaS
40. apiVersion: cdb.cycloud.io/v1 kind: MySQL metadata: name: xxxxxxxxx namespace: xxxxxxxx spec: fl avor: large replica: 1 storage: kind: xxxxxxxx size_gib: 45 VMىಈޙ Mysqllet Mysqllet DNSaaS ɹConnectorϦιʔεΛར༻
 ɹϓϥΠϚϦɺηΧϯμϦ౳Λ൓ө
41. apiVersion: cdb.cycloud.io/v1 kind: MySQL metadata: name: xxxxxxxxx namespace: xxxxxxxx spec: fl avor: large replica: 1 storage: kind: xxxxxxxx size_gib: 45 VMىಈޙ Mysqllet Mysqllet DNSaaS
42. ༷ʑͳCustom Resourceɺ 
 Custome ControllerΛར༻ͯ͠DBΛߏங
43. F/O࣌ͷಈ࡞ ϔϧενΣοΫ
44. F/O࣌ͷಈ࡞ ϔϧενΣοΫ
45. F/O࣌ͷಈ࡞ ϔϧενΣοΫ apiVersion: cdb.cycloud.io/v1 kind: Connector metadata: name: xxxxxxxxx namespace: xxxxxxxx spec: owner: meetup rw: dummy.record.hoge.io rw_ip: XXX.XXX.XXX.XXX mysql controller
46. F/O࣌ͷಈ࡞ ϔϧενΣοΫ apiVersion: cdb.cycloud.io/v1 kind: Connector metadata: name: xxxxxxxxx namespace: xxxxxxxx spec: owner: meetup rw: dummy.record.hoge.io rw_ip: XXX.XXX.XXX.XXX mysql controller DNSaaS
47. ༷ʑͳCustom Resourceɺ 
 Custom ControllerΛར༻ͯ͠DBͷՄ༻ੑΛ୲อ
48. ·ͱΊ • νϡʔχϯά͸ࣗಈͰ͓͢͢ΊઃఆʹͳΔ • DBΤϯδχΞͱڠྗͯ͠஋ͷܾఆ • ΦϯϥΠϯͰ޷Έͷ஋ʹ΋मਖ਼Մೳ • ֤छϝτϦΫεʹ΋ରԠ
49. ·ͱΊ • ϚωʔδυMySQLͰ͋ΔCDBͷ঺հ • MySQLΛίϯςφ → VM΁ • DNSͷ੾Γସ͑ͰF/OΛ࣮ݱ • Kubernetes͕མͪͯ + DB΋མͪͳ͍ͱӨڹͳ͠ • MySQL͸೉͍͠
50. ͋Γ͕ͱ͏͍͟͝·ͨ͠