OCI技術資料 : OCIで考える高可用性アーキテクチャ

クラウドは本格的な普及期を迎え、大規模な基幹システムの稼働事例も増えています。
オラクルは、こういったミッションクリティカルなシステムをどう堅牢に稼働させるかについてデータベースを中心に豊富な実績を持ち、その知見をMAA(Maximum Availability Architecture)というプラクティスにまとめてきました。本セッションでは、MAAをクラウドで活用し大規模基幹システムを構築したお客様事例を中心に、クラウド時代に求められる高可用性システム構築のエッセンスについてお伝えします。

Transcript

1. Oracle Cloudで考える
   ⾼可⽤性アーキテクチャ
   Oracle Cloud Infrastructure High Availability Architecture
   Oracle Cloud Infrastructure
   2021 5
   

   View Slide

2. Copyright © 2021, Oracle and/or its affiliates.
   2
   

   View Slide

3. Copyright © 2021, Oracle and/or its affiliates.
   3
   

   View Slide

4. Oracle Cloud
   Copyright © 2021, Oracle and/or its affiliates.
   4
   • 2018 1 15
   • Intel Spectre
   •
   ( )
   • AD 3
   ( )
   

   View Slide

5. Design For Failure – !
   Copyright © 2021, Oracle and/or its affiliates.
   5
   •
   • Oracle Cloud
   • IaaS/PaaS
   •
   OS
   IaaS
   OS
   PaaS
   OS
   SaaS
   

   View Slide

6. Copyright © 2021, Oracle and/or its affiliates.
   6
   クラウドで「⾼可⽤性」をどう実現するか?
   

   View Slide

7. “ ”
   Copyright © 2021, Oracle and/or its affiliates.
   7
   : High Availability; HA
   IT
   HA
   HA IT
   ( :
   Wikipedia)
   :Availability;
   ( : Wikipedia)
   

   View Slide

8. Copyright © 2021, Oracle and/or its affiliates.
   8
   (Fault Tolerance)
   =
   •
   •
   (Resiliency)
   =
   •
   •
   • ( )
   •
   

   View Slide

9. Copyright © 2021, Oracle and/or its affiliates.
   9
   • (Fault Tolerances) (Resiliency)
   •
   !
   • or
   •
   How?
   

   View Slide

10. Copyright © 2021, Oracle and/or its affiliates.
    10
    MAA – Maxiumum Availability Architecture
    ? ?
    

    View Slide

11. https://www.oracle.com/jp/database/technologies/high-availability/maa.html
    Oracle Maximum Availability Architecture
    Copyright © 2021, Oracle and/or its affiliates.
    11
    Oracle
    Oracle
    MAA SLA
    データベースから発展し、クラウド、ミドルウェア、アプリケーションなどの
    システムの広い領域をカバー
    ⾼可⽤性、ディザスタ・リカバリおよびデータ保護を重視
    

    View Slide

12. Oracle Maximum Availability Architecture
    Copyright © 2021, Oracle and/or its affiliates.
    12
    Bronze Platinum 4
    

    View Slide

13. Press Release
    Oracle Cloud Infrastructure
    Oracle Cloud Infrastructure
    Oracle Exadata 100
    2 200
    2 Oracle
    Exadata Cloud Service
    Tokyo, Japan—2021/03/01
    • Oracle Cloud Maximum Availability
    Architecture(MAA)
    24
    365 頃
    •
    Oracle Real Application
    Testing
    • Oracle
    GoldenGate Oracle GoldenGate
    Veridata
    3
    Copyright © 2021, Oracle and/or its affiliates.
    13
    

    View Slide

14. • ( )
    •
    •
    • DB Data Guard
    • AP
    •
    MAA GOLD
    Copyright © 2021, Oracle and/or its affiliates.
    14
    DNS
    FD1 FD2
    Database (RAC)
    WebAP
    FD1 FD2
    Database (RAC)
    WebAP
    Backup Backup
    or
    Data Guard
    Replication
    

    View Slide

15. BRONZE -
    Copyright © 2021, Oracle and/or its affiliates.
    15
    : RPO < / RTO <
    • ( )
    •
    • Web/AP DB
    •
    • DB
    FD1
    Backup
    LB Subnet
    Web/AP Subnet
    DB Subnet
    

    View Slide

16. Copyright © 2021, Oracle and/or its affiliates.
    16
    1
    • iSCSI
    • Performance SLA iSCSI
    翻
    •
    NVMe SSD
    • 1 50 GB – 32 TB (1GB )
    • 1 32 ( 1PB)
    Block Volume
    

    View Slide

17. Oracle Database DenseIO(
    SSD) IO
    • IaaS + BYOL
    • DenseIO Oracle Database
    • NVMe SSD
    IO
    •
    RMAN
    • DBF
    DenseIO
    Copyright © 2021, Oracle and/or its affiliates.
    17
    VM.DenseIO2.16
    Oracle
    Database
    NVMe SSD
    Block Volume
    .dbf .dbf
    RMAN
    backup … as copy
    

    View Slide

18. Copyright © 2021, Oracle and/or its affiliates.
    18
    ORACLE CLOUD INFRASTRUCTURE (REGION)
    Availability Domain 1 Availability Domain 2 Availability Domain 3
    • 3
    • (
    )
    • 99.999999999% (Eleven-nine)
    • 1TB Standard ¥3,060/ , Archive ¥312/
    •
    •
    •
    • (LA)
    3
    

    View Slide

19. OCI DNS DNS DoS
    Copyright © 2021, Oracle and/or its affiliates.
    19
    • DNS( IP
    DNS )
    • OCI
    (Dyn.com)
    • OCI CDN
    DNS
    •
    •
    •
    • AS
    • IP
    Cloud1
    Datacenter1
    IP Group A
    IP Group B
    IP Group C
    Cloud2
    CDN
    ISP
    IP Group D
    DNS
    DNS
    

    View Slide

20. OCI
    •
    •
    • API
    OCI
    •
    •
    • or PagerDuty
    • Events
    • (absence)
    • Hinemos
    • JP1
    • Zabbix
    OCI Monitioring
    Copyright © 2021, Oracle and/or its affiliates.
    20
    ち Oracle Cloud Service
    • Notifications( )
    OCI
    Oracle Cloud
    Infrastructure
    METRICS ALARMS
    Notifications
    CPU: 80
    CPU: 90
    CPU: 40
    CPU: 50
    Customer Applications,
    Services, Resources
    Oracle Cloud
    Infrastructure
    Console
    Customer
    Monitoring Tool
    Monitoring
    

    View Slide

21. • (
    ) ( )
    •
    •
    •
    •
    • (AD)
    ( )
    Copyright © 2021, Oracle and/or its affiliates.
    21
    launch
    

    View Slide

22. GPU VM
    VM
    • VM 1
    •
    • 5
    VM Recovery Due to Infrastructure Failure
    Copyright © 2021, Oracle and/or its affiliates.
    22
    VM
    

    View Slide

23. (Instance Pool)
    •
    • ( )
    •
    (
    )
    1
    •
    •
    ※
    (15~20 )
    Copyright © 2021, Oracle and/or its affiliates.
    23
    Instance Pool
    Provisioning
    : 3
    

    View Slide

24. Oracle Cloud Infrastructure VM
    •
    •
    VM
    Copyright © 2021, Oracle and/or its affiliates.
    24
    VM
    

    View Slide

25. •
    •
    ( or )
    •
    Oracle
    •
    Copyright © 2021, Oracle and/or its affiliates.
    25
    

    View Slide

26. ( )
    BRONZE
    Copyright © 2021, Oracle and/or its affiliates.
    26
    • IP
    • /etc/host DNS
    •
    • cloud-init( )
    •
    • (RDBMS FSS Object
    Storage)
    • (Redis
    Coherence )
    • (Object Storage)
    ?
    •
    OK
    •
    •
    •
    • Kubernetes Blue-Green
    

    View Slide

27. SILVER -
    Copyright © 2021, Oracle and/or its affiliates.
    27
    : RPO 0 / RTO <30
    • ( )
    •
    •
    • Web/AP DB
    FD2
    Backup
    LB Subnet
    Web/AP Subnet
    DB Subnet
    FD1
    Database (RAC or Data Guard)
    

    View Slide

28. Copyright © 2021, Oracle and/or its affiliates.
    28
    (AD) :
    • 1
    • AD AD 1
    • AD (Phoenix, Ashburn, Frankfurt, London)
    • (AD) (>=1Tb/sec) (< 0.5ms) ( )
    (FD) :
    • AD
    • 1 3
    •
    AD1 AD2 AD3
    Rack Rack Rack
    FD1 FD2 FD3
    

    View Slide

29. OCI
    Copyright © 2021, Oracle and/or its affiliates.
    29
    1 1
    1
    2
    3
    1
    2
    3
    Transit POP Transit POP
    1AD
    • x 1
    • x 3
    • Transit POP (FastConnect ) x 1
    • : Equinix TY4
    • : NTT
    

    View Slide

30. Copyright © 2021, Oracle and/or its affiliates.
    30
    OCI (
    ) 4
    • :
    翻
    • :
    翻
    • :
    • :
    Oracle Cloud Infrastructure
    - Phoenix - Asuburn
    AD1 AD2 AD3 AD1 AD2 AD3
    

    View Slide

31. https : //docs.us-phoenix-1.oraclecloud.com/Content/General/Concepts/regions.htm
    IAM
    , , , , , ,
    , Federation, API signing key
    DNS DNS , DNS , DNS , WAF
    Compute
    Block Volume
    Network
    VCN, , , DHCP , ,
    DRG, CPE, Local Peering Gateway(LPG), IP,
    Container , ,
    Load Balancer , (w/ )
    Object Storage
    Block Volume ,
    Network , (Ephemeral) IP
    Load Balancer (w/ )
    Compute
    Database
    Container
    Copyright © 2021, Oracle and/or its affiliates.
    31
    

    View Slide

32. Copyright © 2021, Oracle and/or its affiliates.
    32
    • 1
    • (AD)
    •
    LB
    • or
    •
    AVAILABILITY DOMAIN-1 AVAILABILITY DOMAIN-2
    VCN
    REGIONAL SUBNET 2
    Backend Servers Backend Servers
    REGIONAL SUBNET 1
    Load Balancer
    (Active)
    Load Balancer
    (Failover)
    IP
    Load Balancer Pair
    Internet
    Gateway
    

    View Slide

33. (Autoscaling)
    Copyright © 2021, Oracle and/or its affiliates.
    33
    If CPU or Memory > 70% add 2 Instances
    If CPU or Memory < 70% remove 2 instances
    • (CPU/ 翻 )
    •
    •
    

    View Slide

34. VIP-2
    IP-1
    IP
    • NIC(VNIC)
    IP ( VIP-2)
    • VM1 VIP-2 VM2
    • IP
    :
    Pacemaker IP AD
    Virtual IP IP
    Copyright © 2021, Oracle and/or its affiliates.
    34
    ORACLE CLOUD INFRASTRUCTURE (REGION)
    AD-1 AD-2
    IP-1
    VIP-2
    VNIC1
    primary
    Regional Subnet
    10.0.1.0/24
    VNIC1
    primary
    primary primary
    VM1 VM2
    

    View Slide

35. •
    read/write
    •
    • /
    • / –
    • –
    • / - read/write – sharable
    •
    • OCI
    • OCI Oracle RAC OCI Database ExaCS ADB
    PaaS IaaS RAC
    HA
    Copyright © 2021, Oracle and/or its affiliates.
    35
    or
    

    View Slide

36. https://jpn.nec.com/clusterpro/blog/20200602.html?
    NEC CLUSTERPRO HA
    Copyright © 2021, Oracle and/or its affiliates.
    36
    

    View Slide

37. https://bccs.sios.jp/news/2020/oracle_cloud_ha.html
    SIOS Lifekeeper HA
    Copyright © 2021, Oracle and/or its affiliates.
    37
    

    View Slide

38. Kubernetes
    Container Engine for Kubernetes (OKE)
    Copyright © 2021, Oracle and/or its affiliates.
    38
    •
    • /
    •
    •
    Virtual Machine
    OKE
    OCI Registry
    Service
    Broker
    Load
    Balancer
    Object
    Storage
    Database
    System
    

    View Slide

39. Oracle DB
    Exadata Cloud Service Autonomous Database
    Copyright © 2021, Oracle and/or its affiliates.
    39
    Oracle Database
    Exadata
    •
    •
    • Real Application Cluster & Oracle Clusterware : DB
    • Service :
    • SCAN Listener :
    • Automatic Storage Management :
    Oracle Clusterware
    Real Application Clusters
    Service
    Automatic Storage Management
    SCAN Listener
    

    View Slide

40. PaaS Data Guard
    Copyright © 2021, Oracle and/or its affiliates.
    40
    AD-1 AD-2
    Region-A
    Standby DB
    Exadata
    System
    Primary DB
    Exadata
    System
    Standby DB
    Exadata
    System
    同⼀AD 別AD
    Region-B
    AD-1
    別リージョン
    Standby DB
    Exadata
    System
    DBCS : Data Guard
    • AD AD DB
    •
    • 1
    • Data Guard Broker
    • Data Guard
    •
    (2 30)
    • White Paper: Hybrid Data Guard to Exadata Cloud
    Services
    OCI Documentation( ) Exadata DB System > Using Oracle Data Guard with Exadata DB Systems
    OCI Documentation( ) Exadata DB > Exadata DB Oracle Data Guard
    

    View Slide

41. DB
    •
    Oracle Real Application Clusters 翻
    •
    •
    •
    • TAC 翻 1
    • :
    (TAC)
    Copyright © 2021, Oracle and/or its affiliates.
    41
    /
    

    View Slide

42. DB 1 1
    Copyright © 2021, Oracle and/or its affiliates.
    42
    

    View Slide

43. VPN
    Copyright © 2021, Oracle and/or its affiliates.
    43
    Transit
    POP
    Virtual
    Machine
    Database
    System
    (CPE)
    VPN
    IPsec
    VPN
    • VPN (DRG : Dynamic
    Routing Gateway) 2 VPN
    •
    IPsec
    • OCI
    (ECMP)
    

    View Slide

44. FastConnect x2
    • /
    (Transit POP) Transit POP FastConnect
    • FastConnect 2
    • ( ) (
    or )
    ( )
    :FastConnect :
    VPN
    • BGP
    /
    Copyright © 2021, Oracle and/or its affiliates.
    44
    Transit
    POP
    Virtual
    Machine
    Database
    System
    (CPE)
    FastConnect
    

    View Slide

45. GOLD & PLATINUM -
    Copyright © 2021, Oracle and/or its affiliates.
    45
    : RPO <30 / RTO <30
    : RPO 0 / RTO 0
    • ( )
    • Active-Active Active-
    Passive
    •
    •
    • Web/AP DB
    FD1 FD2 FD1 FD2
    or
    Data Guard
    Replication
    (rsync )
    DNS
    WebAP WebAP
    Database (RAC) Database (RAC)
    Backup Backup
    

    View Slide

46. Copyright © 2021, Oracle and/or its affiliates.
    46
    1 Oracle
    Cloud Infrastructure
    1
    ( )
    Subscribe To This Region
    

    View Slide

47. 2021 5 29 9
    Oracle Cloud Infrastructure Global Footprint
    Copyright © 2021, Oracle and/or its affiliates.
    47
    SAN JOSE, CA
    PHOENIX
    CHICAGO
    ASHBURN
    TORONTO MONTREAL
    SANTIAGO
    VINHEDO
    SAO PAULO
    NEWPORT
    AMSTERDAM
    FRANKFURT
    ZURICH
    LONDON
    SWEDEN
    ITALY
    FRANCE
    JEDDAH
    ISRAEL
    DUBAI
    MUMBAI
    HYDERABAD
    SINGAPORE
    CHUNCHEON
    SEOUL TOKYO
    OSAKA
    JOHANNESBURG
    SYDNEY
    MELBOURNE
    Commercial
    Commercial Planned
    Government
    Government Planned
    Microsoft Interconnect Azure
    SAUDI 2
    UAE 2
    /
    2
    (
    - )
    Oracle Backbone
    OCI OCI
    

    View Slide

48. • VCN
    • Oracle
    VCN WAN
    ORACLE CLOUD INFRASTRUCTURE (REGION 1)
    AD1 AD2 AD3
    ORACLE CLOUD INFRASTRUCTURE (REGION 2)
    AD1 AD2 AD3
    Copyright © 2021, Oracle and/or its affiliates.
    48
    

    View Slide

49. DR
    •
    • VPN
    •
    VCN
    (B38327)
    • 10TB/ :
    • 10TB / : 3 /GB
    • - 8ms
    •
    FastConnect
    Copyright © 2021, Oracle and/or its affiliates.
    49
    OCI OCI
    OCI
    

    View Slide

50. • DR
    • Vault
    •
    • RPO 1
    •
    • Tokyo → Osaka Seoul
    • Osaka → Tokyo
    Copyright © 2021, Oracle and/or its affiliates.
    OCI Tokyo OCI Osaka
    50
    

    View Slide

51. • DR
    •
    •
    •
    • Read Only
    Copyright © 2021, Oracle and/or its affiliates.
    51
    Tokyoリージョン
    VCN
    Osakaリージョン
    VCN
    

    View Slide

52. OCI
    Copyright © 2021, Oracle and/or its affiliates.
    52
    Traffic Management DNS Alarm
    OCI UI
    Your
    Server
    @ OCI
    • 23 Vantage Point AWS, Azure,
    GCP
    – North and South America
    – Europe
    – Asia & Australia
    • HTTP , HTTPS , Ping(TCP , ICMP)
    • Optional HTTP Header value check
    

    View Slide

53. Copyright © 2021, Oracle and/or its affiliates.
    53
    User
    Recursive
    Server
    OCI DNS
    Primary Region
    Redundant Region
    Outage
    Available
    OCI DNS
    OCI 翻
    •
    •
    • ASN
    • IP
    (Traffic Management)
    

    View Slide

54. Zero Down Time Migration/Upgrade
    GoldenGate
    1) 2) 3)
    DB DB DB DB DB DB
    GoldenGate GoldenGate GoldenGate
    54 Copyright © 2021, Oracle and/or its affiliates.
    54
    

    View Slide

55. GOLD & PLATINUM – ( )
    Copyright © 2021, Oracle and/or its affiliates.
    55
    : RPO <30 / RTO <30
    : RPO 0 / RTO 0
    •
    • OCI DNS /
    • / Data Guard
    GoldenGate RMAN
    FD1 FD2
    Data Guard
    GoldenGate
    Replication
    (rsync )
    DNS
    WebAP WebAP
    Database (RAC) Database (RAC)
    Backup
    SLB
    RMAN Backup
    FastConnect
    

    View Slide

56. Copyright © 2021, Oracle and/or its affiliates.
    56
    ü Design For Failure :
    ü
    ü
    ü MAA(Maximum Availability Architecture)
    

    View Slide

57. Appendix
    Copyright © 2021, Oracle and/or its affiliates.
    57
    

    View Slide

58. : OCI (2021 6 !!)
    Copyright © 2021, Oracle and/or its affiliates.
    58
    Oracle Cloud Infrastructure (OCI)
    1
    Connpass Oracle Code Night
    https://oracle-code-tokyo-dev.connpass.com/
    

    View Slide

59. Oracle Cloud
    Copyright © 2021, Oracle and/or its affiliates.
    59
    http://qiita.com/organizations/oracle
    http://www.slideshare.net/oracle4engineer/
    Oracle Cloud
    • https://cloud.oracle.com/ja_JP
    ( )
    Oracle Cloud
    • https://community.oracle.com/groups/oracle-
    cloud-japan-blog
    www.facebook.com/OracleCloudComputing
    @OracleCloudZone #OracleCloud
    

    View Slide

60. Oracle Cloud Infrastructure
    Copyright © 2021, Oracle and/or its affiliates.
    60
    Oracle Cloud Infrastructure ( / )
    • https://docs.cloud.oracle.com/iaas/api/ - API
    • https://docs.cloud.oracle.com/ja-jp/iaas/Content/General/Reference/aqswhitepapers.htm -
    • https://docs.cloud.oracle.com/iaas/releasenotes/ -
    • https://docs.cloud.oracle.com/ja-jp/iaas/Content/knownissues.htm - (Known Issues)
    • https://docs.cloud.oracle.com/ja-jp/iaas/Content/General/Reference/graphicsfordiagrams.htm -
    OCI (PPT SVG Visio )
    ※
    

    View Slide

61. Oracle Cloud Infrastructure
    Copyright © 2021, Oracle and/or its affiliates.
    61
    Oracle Cloud Infrastructure
    • https://oracle-japan.github.io/ocidocs/
    - Oracle Cloud Infrastructure
    • https://oracle-japan.github.io/ocitutorials/
    Oracle
    • https://www.oracle.com/search/events/
    ( Filter Locations -> Asia Pacific -> Japan )
    Oracle Cloud Infrastructure – General Forum ( )
    • https://cloudcustomerconnect.oracle.com/resources/9c8fa8f96f/summary
    

    View Slide

62. Oracle Cloud Service
    Copyright © 2021, Oracle and/or its affiliates.
    62
    Oracle Cloud Service
    l 30 300
    l
    l 1 Oracle Cloud Infrastructure
    PaaS / IaaS
    l
    Oracle Cloud Service
    !
    l FAQ
    https://faq.oracle.co.jp/app/answers/detail/a_id/2809
    

    View Slide

63. View Slide