クラウドは本格的な普及期を迎え、大規模な基幹システムの稼働事例も増えています。 オラクルは、こういったミッションクリティカルなシステムをどう堅牢に稼働させるかについてデータベースを中心に豊富な実績を持ち、その知見をMAA(Maximum Availability Architecture)というプラクティスにまとめてきました。本セッションでは、MAAをクラウドで活用し大規模基幹システムを構築したお客様事例を中心に、クラウド時代に求められる高可用性システム構築のエッセンスについてお伝えします。
Oracle Cloudで考える⾼可⽤性アーキテクチャOracle Cloud Infrastructure High Availability ArchitectureOracle Cloud Infrastructure2021 5
View Slide
Copyright © 2021, Oracle and/or its affiliates.2
Copyright © 2021, Oracle and/or its affiliates.3
Oracle CloudCopyright © 2021, Oracle and/or its affiliates.4• 2018 1 15• Intel Spectre•( )• AD 3( )
Design For Failure – !Copyright © 2021, Oracle and/or its affiliates.5•• Oracle Cloud• IaaS/PaaS•OSIaaSOSPaaSOSSaaS
Copyright © 2021, Oracle and/or its affiliates.6クラウドで「⾼可⽤性」をどう実現するか?
“ ”Copyright © 2021, Oracle and/or its affiliates.7: High Availability; HAITHAHA IT( :Wikipedia):Availability;( : Wikipedia)
Copyright © 2021, Oracle and/or its affiliates.8(Fault Tolerance)=••(Resiliency)=••• ( )•
Copyright © 2021, Oracle and/or its affiliates.9• (Fault Tolerances) (Resiliency)•!• or•How?
Copyright © 2021, Oracle and/or its affiliates.10MAA – Maxiumum Availability Architecture? ?
https://www.oracle.com/jp/database/technologies/high-availability/maa.htmlOracle Maximum Availability ArchitectureCopyright © 2021, Oracle and/or its affiliates.11OracleOracleMAA SLAデータベースから発展し、クラウド、ミドルウェア、アプリケーションなどのシステムの広い領域をカバー⾼可⽤性、ディザスタ・リカバリおよびデータ保護を重視
Oracle Maximum Availability ArchitectureCopyright © 2021, Oracle and/or its affiliates.12Bronze Platinum 4
Press ReleaseOracle Cloud InfrastructureOracle Cloud InfrastructureOracle Exadata 1002 2002 OracleExadata Cloud ServiceTokyo, Japan—2021/03/01• Oracle Cloud Maximum AvailabilityArchitecture(MAA)24365 頃•Oracle Real ApplicationTesting• OracleGoldenGate Oracle GoldenGateVeridata3Copyright © 2021, Oracle and/or its affiliates.13
• ( )••• DB Data Guard• AP•MAA GOLDCopyright © 2021, Oracle and/or its affiliates.14DNSFD1 FD2Database (RAC)WebAPFD1 FD2Database (RAC)WebAPBackup BackuporData GuardReplication
BRONZE -Copyright © 2021, Oracle and/or its affiliates.15: RPO < / RTO <• ( )•• Web/AP DB•• DBFD1BackupLB SubnetWeb/AP SubnetDB Subnet
Copyright © 2021, Oracle and/or its affiliates.161• iSCSI• Performance SLA iSCSI翻•NVMe SSD• 1 50 GB – 32 TB (1GB )• 1 32 ( 1PB)Block Volume
Oracle Database DenseIO(SSD) IO• IaaS + BYOL• DenseIO Oracle Database• NVMe SSDIO•RMAN• DBFDenseIOCopyright © 2021, Oracle and/or its affiliates.17VM.DenseIO2.16OracleDatabaseNVMe SSDBlock Volume.dbf .dbfRMANbackup … as copy
Copyright © 2021, Oracle and/or its affiliates.18ORACLE CLOUD INFRASTRUCTURE (REGION)Availability Domain 1 Availability Domain 2 Availability Domain 3• 3• ()• 99.999999999% (Eleven-nine)• 1TB Standard ¥3,060/ , Archive ¥312/•••• (LA)3
OCI DNS DNS DoSCopyright © 2021, Oracle and/or its affiliates.19• DNS( IPDNS )• OCI(Dyn.com)• OCI CDNDNS•••• AS• IPCloud1Datacenter1IP Group AIP Group BIP Group CCloud2CDNISPIP Group DDNSDNS
OCI••• APIOCI••• or PagerDuty• Events• (absence)• Hinemos• JP1• ZabbixOCI MonitioringCopyright © 2021, Oracle and/or its affiliates.20ち Oracle Cloud Service• Notifications( )OCIOracle CloudInfrastructureMETRICS ALARMSNotificationsCPU: 80CPU: 90CPU: 40CPU: 50Customer Applications,Services, ResourcesOracle CloudInfrastructureConsoleCustomerMonitoring ToolMonitoring
• () ( )••••• (AD)( )Copyright © 2021, Oracle and/or its affiliates.21launch
GPU VMVM• VM 1•• 5VM Recovery Due to Infrastructure FailureCopyright © 2021, Oracle and/or its affiliates.22VM
(Instance Pool)•• ( )•()1••※(15~20 )Copyright © 2021, Oracle and/or its affiliates.23Instance PoolProvisioning: 3
Oracle Cloud Infrastructure VM••VMCopyright © 2021, Oracle and/or its affiliates.24VM
••( or )•Oracle•Copyright © 2021, Oracle and/or its affiliates.25
( )BRONZECopyright © 2021, Oracle and/or its affiliates.26• IP• /etc/host DNS•• cloud-init( )•• (RDBMS FSS ObjectStorage)• (RedisCoherence )• (Object Storage)?•OK•••• Kubernetes Blue-Green
SILVER -Copyright © 2021, Oracle and/or its affiliates.27: RPO 0 / RTO <30• ( )••• Web/AP DBFD2BackupLB SubnetWeb/AP SubnetDB SubnetFD1Database (RAC or Data Guard)
Copyright © 2021, Oracle and/or its affiliates.28(AD) :• 1• AD AD 1• AD (Phoenix, Ashburn, Frankfurt, London)• (AD) (>=1Tb/sec) (< 0.5ms) ( )(FD) :• AD• 1 3•AD1 AD2 AD3Rack Rack RackFD1 FD2 FD3
OCICopyright © 2021, Oracle and/or its affiliates.291 1123123Transit POP Transit POP1AD• x 1• x 3• Transit POP (FastConnect ) x 1• : Equinix TY4• : NTT
Copyright © 2021, Oracle and/or its affiliates.30OCI () 4• :翻• :翻• :• :Oracle Cloud Infrastructure- Phoenix - AsuburnAD1 AD2 AD3 AD1 AD2 AD3
https : //docs.us-phoenix-1.oraclecloud.com/Content/General/Concepts/regions.htmIAM, , , , , ,, Federation, API signing keyDNS DNS , DNS , DNS , WAFComputeBlock VolumeNetworkVCN, , , DHCP , ,DRG, CPE, Local Peering Gateway(LPG), IP,Container , ,Load Balancer , (w/ )Object StorageBlock Volume ,Network , (Ephemeral) IPLoad Balancer (w/ )ComputeDatabaseContainerCopyright © 2021, Oracle and/or its affiliates.31
Copyright © 2021, Oracle and/or its affiliates.32• 1• (AD)•LB• or•AVAILABILITY DOMAIN-1 AVAILABILITY DOMAIN-2VCNREGIONAL SUBNET 2Backend Servers Backend ServersREGIONAL SUBNET 1Load Balancer(Active)Load Balancer(Failover)IPLoad Balancer PairInternetGateway
(Autoscaling)Copyright © 2021, Oracle and/or its affiliates.33If CPU or Memory > 70% add 2 InstancesIf CPU or Memory < 70% remove 2 instances• (CPU/ 翻 )••
VIP-2IP-1IP• NIC(VNIC)IP ( VIP-2)• VM1 VIP-2 VM2• IP:Pacemaker IP ADVirtual IP IPCopyright © 2021, Oracle and/or its affiliates.34ORACLE CLOUD INFRASTRUCTURE (REGION)AD-1 AD-2IP-1VIP-2VNIC1primaryRegional Subnet10.0.1.0/24VNIC1primaryprimary primaryVM1 VM2
•read/write•• /• / –• –• / - read/write – sharable•• OCI• OCI Oracle RAC OCI Database ExaCS ADBPaaS IaaS RACHACopyright © 2021, Oracle and/or its affiliates.35or
https://jpn.nec.com/clusterpro/blog/20200602.html?NEC CLUSTERPRO HACopyright © 2021, Oracle and/or its affiliates.36
https://bccs.sios.jp/news/2020/oracle_cloud_ha.htmlSIOS Lifekeeper HACopyright © 2021, Oracle and/or its affiliates.37
KubernetesContainer Engine for Kubernetes (OKE)Copyright © 2021, Oracle and/or its affiliates.38•• /••Virtual MachineOKEOCI RegistryServiceBrokerLoadBalancerObjectStorageDatabaseSystem
Oracle DBExadata Cloud Service Autonomous DatabaseCopyright © 2021, Oracle and/or its affiliates.39Oracle DatabaseExadata••• Real Application Cluster & Oracle Clusterware : DB• Service :• SCAN Listener :• Automatic Storage Management :Oracle ClusterwareReal Application ClustersServiceAutomatic Storage ManagementSCAN Listener
PaaS Data GuardCopyright © 2021, Oracle and/or its affiliates.40AD-1 AD-2Region-AStandby DBExadataSystemPrimary DBExadataSystemStandby DBExadataSystem同⼀AD 別ADRegion-BAD-1別リージョンStandby DBExadataSystemDBCS : Data Guard• AD AD DB•• 1• Data Guard Broker• Data Guard•(2 30)• White Paper: Hybrid Data Guard to Exadata CloudServicesOCI Documentation( ) Exadata DB System > Using Oracle Data Guard with Exadata DB SystemsOCI Documentation( ) Exadata DB > Exadata DB Oracle Data Guard
DB•Oracle Real Application Clusters 翻•••• TAC 翻 1• :(TAC)Copyright © 2021, Oracle and/or its affiliates.41/
DB 1 1Copyright © 2021, Oracle and/or its affiliates.42
VPNCopyright © 2021, Oracle and/or its affiliates.43TransitPOPVirtualMachineDatabaseSystem(CPE)VPNIPsecVPN• VPN (DRG : DynamicRouting Gateway) 2 VPN•IPsec• OCI(ECMP)
FastConnect x2• /(Transit POP) Transit POP FastConnect• FastConnect 2• ( ) (or )( ):FastConnect :VPN• BGP/Copyright © 2021, Oracle and/or its affiliates.44TransitPOPVirtualMachineDatabaseSystem(CPE)FastConnect
GOLD & PLATINUM -Copyright © 2021, Oracle and/or its affiliates.45: RPO <30 / RTO <30: RPO 0 / RTO 0• ( )• Active-Active Active-Passive••• Web/AP DBFD1 FD2 FD1 FD2orData GuardReplication(rsync )DNSWebAP WebAPDatabase (RAC) Database (RAC)Backup Backup
Copyright © 2021, Oracle and/or its affiliates.461 OracleCloud Infrastructure1( )Subscribe To This Region
2021 5 29 9Oracle Cloud Infrastructure Global FootprintCopyright © 2021, Oracle and/or its affiliates.47SAN JOSE, CAPHOENIXCHICAGOASHBURNTORONTO MONTREALSANTIAGOVINHEDOSAO PAULONEWPORTAMSTERDAMFRANKFURTZURICHLONDONSWEDENITALYFRANCEJEDDAHISRAELDUBAIMUMBAIHYDERABADSINGAPORECHUNCHEONSEOUL TOKYOOSAKAJOHANNESBURGSYDNEYMELBOURNECommercialCommercial PlannedGovernmentGovernment PlannedMicrosoft Interconnect AzureSAUDI 2UAE 2/2(- )Oracle BackboneOCI OCI
• VCN• OracleVCN WANORACLE CLOUD INFRASTRUCTURE (REGION 1)AD1 AD2 AD3ORACLE CLOUD INFRASTRUCTURE (REGION 2)AD1 AD2 AD3Copyright © 2021, Oracle and/or its affiliates.48
DR•• VPN•VCN(B38327)• 10TB/ :• 10TB / : 3 /GB• - 8ms•FastConnectCopyright © 2021, Oracle and/or its affiliates.49OCI OCIOCI
• DR• Vault•• RPO 1•• Tokyo → Osaka Seoul• Osaka → TokyoCopyright © 2021, Oracle and/or its affiliates.OCI Tokyo OCI Osaka50
• DR•••• Read OnlyCopyright © 2021, Oracle and/or its affiliates.51TokyoリージョンVCNOsakaリージョンVCN
OCICopyright © 2021, Oracle and/or its affiliates.52Traffic Management DNS AlarmOCI UIYourServer@ OCI• 23 Vantage Point AWS, Azure,GCP– North and South America– Europe– Asia & Australia• HTTP , HTTPS , Ping(TCP , ICMP)• Optional HTTP Header value check
Copyright © 2021, Oracle and/or its affiliates.53UserRecursiveServerOCI DNSPrimary RegionRedundant RegionOutageAvailableOCI DNSOCI 翻••• ASN• IP(Traffic Management)
Zero Down Time Migration/UpgradeGoldenGate1) 2) 3)DB DB DB DB DB DBGoldenGate GoldenGate GoldenGate54 Copyright © 2021, Oracle and/or its affiliates.54
GOLD & PLATINUM – ( )Copyright © 2021, Oracle and/or its affiliates.55: RPO <30 / RTO <30: RPO 0 / RTO 0•• OCI DNS /• / Data GuardGoldenGate RMANFD1 FD2Data GuardGoldenGateReplication(rsync )DNSWebAP WebAPDatabase (RAC) Database (RAC)BackupSLBRMAN BackupFastConnect
Copyright © 2021, Oracle and/or its affiliates.56ü Design For Failure :üüü MAA(Maximum Availability Architecture)
AppendixCopyright © 2021, Oracle and/or its affiliates.57
: OCI (2021 6 !!)Copyright © 2021, Oracle and/or its affiliates.58Oracle Cloud Infrastructure (OCI)1Connpass Oracle Code Nighthttps://oracle-code-tokyo-dev.connpass.com/
Oracle CloudCopyright © 2021, Oracle and/or its affiliates.59http://qiita.com/organizations/oraclehttp://www.slideshare.net/oracle4engineer/Oracle Cloud• https://cloud.oracle.com/ja_JP( )Oracle Cloud• https://community.oracle.com/groups/oracle-cloud-japan-blogwww.facebook.com/OracleCloudComputing@OracleCloudZone #OracleCloud
Oracle Cloud InfrastructureCopyright © 2021, Oracle and/or its affiliates.60Oracle Cloud Infrastructure ( / )• https://docs.cloud.oracle.com/iaas/api/ - API• https://docs.cloud.oracle.com/ja-jp/iaas/Content/General/Reference/aqswhitepapers.htm -• https://docs.cloud.oracle.com/iaas/releasenotes/ -• https://docs.cloud.oracle.com/ja-jp/iaas/Content/knownissues.htm - (Known Issues)• https://docs.cloud.oracle.com/ja-jp/iaas/Content/General/Reference/graphicsfordiagrams.htm -OCI (PPT SVG Visio )※
Oracle Cloud InfrastructureCopyright © 2021, Oracle and/or its affiliates.61Oracle Cloud Infrastructure• https://oracle-japan.github.io/ocidocs/- Oracle Cloud Infrastructure• https://oracle-japan.github.io/ocitutorials/Oracle• https://www.oracle.com/search/events/( Filter Locations -> Asia Pacific -> Japan )Oracle Cloud Infrastructure – General Forum ( )• https://cloudcustomerconnect.oracle.com/resources/9c8fa8f96f/summary
Oracle Cloud ServiceCopyright © 2021, Oracle and/or its affiliates.62Oracle Cloud Servicel 30 300ll 1 Oracle Cloud InfrastructurePaaS / IaaSlOracle Cloud Service!l FAQhttps://faq.oracle.co.jp/app/answers/detail/a_id/2809