Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OCI技術資料 : OCIで考える高可用性アーキテクチャ

OCI技術資料 : OCIで考える高可用性アーキテクチャ

クラウドは本格的な普及期を迎え、大規模な基幹システムの稼働事例も増えています。
オラクルは、こういったミッションクリティカルなシステムをどう堅牢に稼働させるかについてデータベースを中心に豊富な実績を持ち、その知見をMAA(Maximum Availability Architecture)というプラクティスにまとめてきました。本セッションでは、MAAをクラウドで活用し大規模基幹システムを構築したお客様事例を中心に、クラウド時代に求められる高可用性システム構築のエッセンスについてお伝えします。

More Decks by Oracle Cloud Infrastructure ソリューション・エンジニア

Other Decks in Technology

Transcript

  1. Oracle Cloud Copyright © 2021, Oracle and/or its affiliates. 4

    • 2018 1 15 • Intel Spectre • ( ) • AD 3 ( )
  2. Design For Failure – ! Copyright © 2021, Oracle and/or

    its affiliates. 5 • • Oracle Cloud • IaaS/PaaS • OS IaaS OS PaaS OS SaaS
  3. “ ” Copyright © 2021, Oracle and/or its affiliates. 7

    : High Availability; HA IT HA HA IT ( : Wikipedia) :Availability; ( : Wikipedia)
  4. Copyright © 2021, Oracle and/or its affiliates. 8 (Fault Tolerance)

    = • • (Resiliency) = • • • ( ) •
  5. Copyright © 2021, Oracle and/or its affiliates. 9 • (Fault

    Tolerances) (Resiliency) • ! • or • How?
  6. Copyright © 2021, Oracle and/or its affiliates. 10 MAA –

    Maxiumum Availability Architecture ? ?
  7. https://www.oracle.com/jp/database/technologies/high-availability/maa.html Oracle Maximum Availability Architecture Copyright © 2021, Oracle and/or

    its affiliates. 11 Oracle Oracle MAA SLA データベースから発展し、クラウド、ミドルウェア、アプリケーションなどの システムの広い領域をカバー ⾼可⽤性、ディザスタ・リカバリおよびデータ保護を重視
  8. Press Release Oracle Cloud Infrastructure Oracle Cloud Infrastructure Oracle Exadata

    100 2 200 2 Oracle Exadata Cloud Service Tokyo, Japan—2021/03/01 • Oracle Cloud Maximum Availability Architecture(MAA) 24 365 頃 • Oracle Real Application Testing • Oracle GoldenGate Oracle GoldenGate Veridata 3 Copyright © 2021, Oracle and/or its affiliates. 13
  9. • ( ) • • • DB Data Guard •

    AP • MAA GOLD Copyright © 2021, Oracle and/or its affiliates. 14 DNS FD1 FD2 Database (RAC) WebAP FD1 FD2 Database (RAC) WebAP Backup Backup or Data Guard Replication
  10. BRONZE - Copyright © 2021, Oracle and/or its affiliates. 15

    : RPO < / RTO < • ( ) • • Web/AP DB • • DB FD1 Backup LB Subnet Web/AP Subnet DB Subnet
  11. Copyright © 2021, Oracle and/or its affiliates. 16 1 •

    iSCSI • Performance SLA iSCSI 翻 • NVMe SSD • 1 50 GB – 32 TB (1GB ) • 1 32 ( 1PB) Block Volume
  12. Oracle Database DenseIO( SSD) IO • IaaS + BYOL •

    DenseIO Oracle Database • NVMe SSD IO • RMAN • DBF DenseIO Copyright © 2021, Oracle and/or its affiliates. 17 VM.DenseIO2.16 Oracle Database NVMe SSD Block Volume .dbf .dbf RMAN backup … as copy
  13. Copyright © 2021, Oracle and/or its affiliates. 18 ORACLE CLOUD

    INFRASTRUCTURE (REGION) Availability Domain 1 Availability Domain 2 Availability Domain 3 • 3 • ( ) • 99.999999999% (Eleven-nine) • 1TB Standard ¥3,060/ , Archive ¥312/ • • • • (LA) 3
  14. OCI DNS DNS DoS Copyright © 2021, Oracle and/or its

    affiliates. 19 • DNS( IP DNS ) • OCI (Dyn.com) • OCI CDN DNS • • • • AS • IP Cloud1 Datacenter1 IP Group A IP Group B IP Group C Cloud2 CDN ISP IP Group D DNS DNS
  15. OCI • • • API OCI • • • or

    PagerDuty • Events • (absence) • Hinemos • JP1 • Zabbix OCI Monitioring Copyright © 2021, Oracle and/or its affiliates. 20 ち Oracle Cloud Service • Notifications( ) OCI Oracle Cloud Infrastructure METRICS ALARMS Notifications CPU: 80 CPU: 90 CPU: 40 CPU: 50 Customer Applications, Services, Resources Oracle Cloud Infrastructure Console Customer Monitoring Tool Monitoring
  16. • ( ) ( ) • • • • •

    (AD) ( ) Copyright © 2021, Oracle and/or its affiliates. 21 launch
  17. GPU VM VM • VM 1 • • 5 VM

    Recovery Due to Infrastructure Failure Copyright © 2021, Oracle and/or its affiliates. 22 VM
  18. (Instance Pool) • • ( ) • ( ) 1

    • • ※ (15~20 ) Copyright © 2021, Oracle and/or its affiliates. 23 Instance Pool Provisioning : 3
  19. • • ( or ) • Oracle • Copyright ©

    2021, Oracle and/or its affiliates. 25
  20. ( ) BRONZE Copyright © 2021, Oracle and/or its affiliates.

    26 • IP • /etc/host DNS • • cloud-init( ) • • (RDBMS FSS Object Storage) • (Redis Coherence ) • (Object Storage) ? • OK • • • • Kubernetes Blue-Green
  21. SILVER - Copyright © 2021, Oracle and/or its affiliates. 27

    : RPO 0 / RTO <30 • ( ) • • • Web/AP DB FD2 Backup LB Subnet Web/AP Subnet DB Subnet FD1 Database (RAC or Data Guard)
  22. Copyright © 2021, Oracle and/or its affiliates. 28 (AD) :

    • 1 • AD AD 1 • AD (Phoenix, Ashburn, Frankfurt, London) • (AD) (>=1Tb/sec) (< 0.5ms) ( ) (FD) : • AD • 1 3 • AD1 AD2 AD3 Rack Rack Rack FD1 FD2 FD3
  23. OCI Copyright © 2021, Oracle and/or its affiliates. 29 1

    1 1 2 3 1 2 3 Transit POP Transit POP 1AD • x 1 • x 3 • Transit POP (FastConnect ) x 1 • : Equinix TY4 • : NTT
  24. Copyright © 2021, Oracle and/or its affiliates. 30 OCI (

    ) 4 • : 翻 • : 翻 • : • : Oracle Cloud Infrastructure - Phoenix - Asuburn AD1 AD2 AD3 AD1 AD2 AD3
  25. https : //docs.us-phoenix-1.oraclecloud.com/Content/General/Concepts/regions.htm IAM , , , , , ,

    , Federation, API signing key DNS DNS , DNS , DNS , WAF Compute Block Volume Network VCN, , , DHCP , , DRG, CPE, Local Peering Gateway(LPG), IP, Container , , Load Balancer , (w/ ) Object Storage Block Volume , Network , (Ephemeral) IP Load Balancer (w/ ) Compute Database Container Copyright © 2021, Oracle and/or its affiliates. 31
  26. Copyright © 2021, Oracle and/or its affiliates. 32 • 1

    • (AD) • LB • or • AVAILABILITY DOMAIN-1 AVAILABILITY DOMAIN-2 VCN REGIONAL SUBNET 2 Backend Servers Backend Servers REGIONAL SUBNET 1 Load Balancer (Active) Load Balancer (Failover) IP Load Balancer Pair Internet Gateway
  27. (Autoscaling) Copyright © 2021, Oracle and/or its affiliates. 33 If

    CPU or Memory > 70% add 2 Instances If CPU or Memory < 70% remove 2 instances • (CPU/ 翻 ) • •
  28. VIP-2 IP-1 IP • NIC(VNIC) IP ( VIP-2) • VM1

    VIP-2 VM2 • IP : Pacemaker IP AD Virtual IP IP Copyright © 2021, Oracle and/or its affiliates. 34 ORACLE CLOUD INFRASTRUCTURE (REGION) AD-1 AD-2 IP-1 VIP-2 VNIC1 primary Regional Subnet 10.0.1.0/24 VNIC1 primary primary primary VM1 VM2
  29. • read/write • • / • / – • –

    • / - read/write – sharable • • OCI • OCI Oracle RAC OCI Database ExaCS ADB PaaS IaaS RAC HA Copyright © 2021, Oracle and/or its affiliates. 35 or
  30. Kubernetes Container Engine for Kubernetes (OKE) Copyright © 2021, Oracle

    and/or its affiliates. 38 • • / • • Virtual Machine OKE OCI Registry Service Broker Load Balancer Object Storage Database System
  31. Oracle DB Exadata Cloud Service Autonomous Database Copyright © 2021,

    Oracle and/or its affiliates. 39 Oracle Database Exadata • • • Real Application Cluster & Oracle Clusterware : DB • Service : • SCAN Listener : • Automatic Storage Management : Oracle Clusterware Real Application Clusters Service Automatic Storage Management SCAN Listener
  32. PaaS Data Guard Copyright © 2021, Oracle and/or its affiliates.

    40 AD-1 AD-2 Region-A Standby DB Exadata System Primary DB Exadata System Standby DB Exadata System 同⼀AD 別AD Region-B AD-1 別リージョン Standby DB Exadata System DBCS : Data Guard • AD AD DB • • 1 • Data Guard Broker • Data Guard • (2 30) • White Paper: Hybrid Data Guard to Exadata Cloud Services OCI Documentation( ) Exadata DB System > Using Oracle Data Guard with Exadata DB Systems OCI Documentation( ) Exadata DB > Exadata DB Oracle Data Guard
  33. DB • Oracle Real Application Clusters 翻 • • •

    • TAC 翻 1 • : (TAC) Copyright © 2021, Oracle and/or its affiliates. 41 /
  34. VPN Copyright © 2021, Oracle and/or its affiliates. 43 Transit

    POP Virtual Machine Database System (CPE) VPN IPsec VPN • VPN (DRG : Dynamic Routing Gateway) 2 VPN • IPsec • OCI (ECMP)
  35. FastConnect x2 • / (Transit POP) Transit POP FastConnect •

    FastConnect 2 • ( ) ( or ) ( ) :FastConnect : VPN • BGP / Copyright © 2021, Oracle and/or its affiliates. 44 Transit POP Virtual Machine Database System (CPE) FastConnect
  36. GOLD & PLATINUM - Copyright © 2021, Oracle and/or its

    affiliates. 45 : RPO <30 / RTO <30 : RPO 0 / RTO 0 • ( ) • Active-Active Active- Passive • • • Web/AP DB FD1 FD2 FD1 FD2 or Data Guard Replication (rsync ) DNS WebAP WebAP Database (RAC) Database (RAC) Backup Backup
  37. Copyright © 2021, Oracle and/or its affiliates. 46 1 Oracle

    Cloud Infrastructure 1 ( ) Subscribe To This Region
  38. 2021 5 29 9 Oracle Cloud Infrastructure Global Footprint Copyright

    © 2021, Oracle and/or its affiliates. 47 SAN JOSE, CA PHOENIX CHICAGO ASHBURN TORONTO MONTREAL SANTIAGO VINHEDO SAO PAULO NEWPORT AMSTERDAM FRANKFURT ZURICH LONDON SWEDEN ITALY FRANCE JEDDAH ISRAEL DUBAI MUMBAI HYDERABAD SINGAPORE CHUNCHEON SEOUL TOKYO OSAKA JOHANNESBURG SYDNEY MELBOURNE Commercial Commercial Planned Government Government Planned Microsoft Interconnect Azure SAUDI 2 UAE 2 / 2 ( - ) Oracle Backbone OCI OCI
  39. • VCN • Oracle VCN WAN ORACLE CLOUD INFRASTRUCTURE (REGION

    1) AD1 AD2 AD3 ORACLE CLOUD INFRASTRUCTURE (REGION 2) AD1 AD2 AD3 Copyright © 2021, Oracle and/or its affiliates. 48
  40. DR • • VPN • VCN (B38327) • 10TB/ :

    • 10TB / : 3 /GB • - 8ms • FastConnect Copyright © 2021, Oracle and/or its affiliates. 49 OCI OCI OCI
  41. • DR • Vault • • RPO 1 • •

    Tokyo → Osaka Seoul • Osaka → Tokyo Copyright © 2021, Oracle and/or its affiliates. OCI Tokyo OCI Osaka 50
  42. • DR • • • • Read Only Copyright ©

    2021, Oracle and/or its affiliates. 51 Tokyoリージョン VCN Osakaリージョン VCN
  43. OCI Copyright © 2021, Oracle and/or its affiliates. 52 Traffic

    Management DNS Alarm OCI UI Your Server @ OCI • 23 Vantage Point AWS, Azure, GCP – North and South America – Europe – Asia & Australia • HTTP , HTTPS , Ping(TCP , ICMP) • Optional HTTP Header value check
  44. Copyright © 2021, Oracle and/or its affiliates. 53 User Recursive

    Server OCI DNS Primary Region Redundant Region Outage Available OCI DNS OCI 翻 • • • ASN • IP (Traffic Management)
  45. Zero Down Time Migration/Upgrade GoldenGate 1) 2) 3) DB DB

    DB DB DB DB GoldenGate GoldenGate GoldenGate 54 Copyright © 2021, Oracle and/or its affiliates. 54
  46. GOLD & PLATINUM – ( ) Copyright © 2021, Oracle

    and/or its affiliates. 55 : RPO <30 / RTO <30 : RPO 0 / RTO 0 • • OCI DNS / • / Data Guard GoldenGate RMAN FD1 FD2 Data Guard GoldenGate Replication (rsync ) DNS WebAP WebAP Database (RAC) Database (RAC) Backup SLB RMAN Backup FastConnect
  47. Copyright © 2021, Oracle and/or its affiliates. 56 ü Design

    For Failure : ü ü ü MAA(Maximum Availability Architecture)
  48. : OCI (2021 6 !!) Copyright © 2021, Oracle and/or

    its affiliates. 58 Oracle Cloud Infrastructure (OCI) 1 Connpass Oracle Code Night https://oracle-code-tokyo-dev.connpass.com/
  49. Oracle Cloud Copyright © 2021, Oracle and/or its affiliates. 59

    http://qiita.com/organizations/oracle http://www.slideshare.net/oracle4engineer/ Oracle Cloud • https://cloud.oracle.com/ja_JP ( ) Oracle Cloud • https://community.oracle.com/groups/oracle- cloud-japan-blog www.facebook.com/OracleCloudComputing @OracleCloudZone #OracleCloud
  50. Oracle Cloud Infrastructure Copyright © 2021, Oracle and/or its affiliates.

    60 Oracle Cloud Infrastructure ( / ) • https://docs.cloud.oracle.com/iaas/api/ - API • https://docs.cloud.oracle.com/ja-jp/iaas/Content/General/Reference/aqswhitepapers.htm - • https://docs.cloud.oracle.com/iaas/releasenotes/ - • https://docs.cloud.oracle.com/ja-jp/iaas/Content/knownissues.htm - (Known Issues) • https://docs.cloud.oracle.com/ja-jp/iaas/Content/General/Reference/graphicsfordiagrams.htm - OCI (PPT SVG Visio ) ※
  51. Oracle Cloud Infrastructure Copyright © 2021, Oracle and/or its affiliates.

    61 Oracle Cloud Infrastructure • https://oracle-japan.github.io/ocidocs/ - Oracle Cloud Infrastructure • https://oracle-japan.github.io/ocitutorials/ Oracle • https://www.oracle.com/search/events/ ( Filter Locations -> Asia Pacific -> Japan ) Oracle Cloud Infrastructure – General Forum ( ) • https://cloudcustomerconnect.oracle.com/resources/9c8fa8f96f/summary
  52. Oracle Cloud Service Copyright © 2021, Oracle and/or its affiliates.

    62 Oracle Cloud Service l 30 300 l l 1 Oracle Cloud Infrastructure PaaS / IaaS l Oracle Cloud Service ! l FAQ https://faq.oracle.co.jp/app/answers/detail/a_id/2809