Upgrade to Pro — share decks privately, control downloads, hide ads and more …

OCI技術資料 : OCIで考える高可用性アーキテクチャ

OCI技術資料 : OCIで考える高可用性アーキテクチャ

クラウドは本格的な普及期を迎え、大規模な基幹システムの稼働事例も増えています。
オラクルは、こういったミッションクリティカルなシステムをどう堅牢に稼働させるかについてデータベースを中心に豊富な実績を持ち、その知見をMAA(Maximum Availability Architecture)というプラクティスにまとめてきました。本セッションでは、MAAをクラウドで活用し大規模基幹システムを構築したお客様事例を中心に、クラウド時代に求められる高可用性システム構築のエッセンスについてお伝えします。

More Decks by Oracle Cloud Infrastructure ソリューション・エンジニア

Other Decks in Technology

Transcript

  1. Oracle Cloudで考える
    ⾼可⽤性アーキテクチャ
    Oracle Cloud Infrastructure High Availability Architecture
    Oracle Cloud Infrastructure
    2021 5

    View Slide

  2. Copyright © 2021, Oracle and/or its affiliates.
    2

    View Slide

  3. Copyright © 2021, Oracle and/or its affiliates.
    3

    View Slide

  4. Oracle Cloud
    Copyright © 2021, Oracle and/or its affiliates.
    4
    • 2018 1 15
    • Intel Spectre

    ( )
    • AD 3
    ( )

    View Slide

  5. Design For Failure – !
    Copyright © 2021, Oracle and/or its affiliates.
    5

    • Oracle Cloud
    • IaaS/PaaS

    OS
    IaaS
    OS
    PaaS
    OS
    SaaS

    View Slide

  6. Copyright © 2021, Oracle and/or its affiliates.
    6
    クラウドで「⾼可⽤性」をどう実現するか?

    View Slide

  7. “ ”
    Copyright © 2021, Oracle and/or its affiliates.
    7
    : High Availability; HA
    IT
    HA
    HA IT
    ( :
    Wikipedia)
    :Availability;
    ( : Wikipedia)

    View Slide

  8. Copyright © 2021, Oracle and/or its affiliates.
    8
    (Fault Tolerance)
    =


    (Resiliency)
    =


    • ( )

    View Slide

  9. Copyright © 2021, Oracle and/or its affiliates.
    9
    • (Fault Tolerances) (Resiliency)

    !
    • or

    How?

    View Slide

  10. Copyright © 2021, Oracle and/or its affiliates.
    10
    MAA – Maxiumum Availability Architecture
    ? ?

    View Slide

  11. https://www.oracle.com/jp/database/technologies/high-availability/maa.html
    Oracle Maximum Availability Architecture
    Copyright © 2021, Oracle and/or its affiliates.
    11
    Oracle
    Oracle
    MAA SLA
    データベースから発展し、クラウド、ミドルウェア、アプリケーションなどの
    システムの広い領域をカバー
    ⾼可⽤性、ディザスタ・リカバリおよびデータ保護を重視

    View Slide

  12. Oracle Maximum Availability Architecture
    Copyright © 2021, Oracle and/or its affiliates.
    12
    Bronze Platinum 4

    View Slide

  13. Press Release
    Oracle Cloud Infrastructure
    Oracle Cloud Infrastructure
    Oracle Exadata 100
    2 200
    2 Oracle
    Exadata Cloud Service
    Tokyo, Japan—2021/03/01
    • Oracle Cloud Maximum Availability
    Architecture(MAA)
    24
    365 頃

    Oracle Real Application
    Testing
    • Oracle
    GoldenGate Oracle GoldenGate
    Veridata
    3
    Copyright © 2021, Oracle and/or its affiliates.
    13

    View Slide

  14. • ( )


    • DB Data Guard
    • AP

    MAA GOLD
    Copyright © 2021, Oracle and/or its affiliates.
    14
    DNS
    FD1 FD2
    Database (RAC)
    WebAP
    FD1 FD2
    Database (RAC)
    WebAP
    Backup Backup
    or
    Data Guard
    Replication

    View Slide

  15. BRONZE -
    Copyright © 2021, Oracle and/or its affiliates.
    15
    : RPO < / RTO <
    • ( )

    • Web/AP DB

    • DB
    FD1
    Backup
    LB Subnet
    Web/AP Subnet
    DB Subnet

    View Slide

  16. Copyright © 2021, Oracle and/or its affiliates.
    16
    1
    • iSCSI
    • Performance SLA iSCSI


    NVMe SSD
    • 1 50 GB – 32 TB (1GB )
    • 1 32 ( 1PB)
    Block Volume

    View Slide

  17. Oracle Database DenseIO(
    SSD) IO
    • IaaS + BYOL
    • DenseIO Oracle Database
    • NVMe SSD
    IO

    RMAN
    • DBF
    DenseIO
    Copyright © 2021, Oracle and/or its affiliates.
    17
    VM.DenseIO2.16
    Oracle
    Database
    NVMe SSD
    Block Volume
    .dbf .dbf
    RMAN
    backup … as copy

    View Slide

  18. Copyright © 2021, Oracle and/or its affiliates.
    18
    ORACLE CLOUD INFRASTRUCTURE (REGION)
    Availability Domain 1 Availability Domain 2 Availability Domain 3
    • 3
    • (
    )
    • 99.999999999% (Eleven-nine)
    • 1TB Standard ¥3,060/ , Archive ¥312/



    • (LA)
    3

    View Slide

  19. OCI DNS DNS DoS
    Copyright © 2021, Oracle and/or its affiliates.
    19
    • DNS( IP
    DNS )
    • OCI
    (Dyn.com)
    • OCI CDN
    DNS



    • AS
    • IP
    Cloud1
    Datacenter1
    IP Group A
    IP Group B
    IP Group C
    Cloud2
    CDN
    ISP
    IP Group D
    DNS
    DNS

    View Slide

  20. OCI


    • API
    OCI


    • or PagerDuty
    • Events
    • (absence)
    • Hinemos
    • JP1
    • Zabbix
    OCI Monitioring
    Copyright © 2021, Oracle and/or its affiliates.
    20
    ち Oracle Cloud Service
    • Notifications( )
    OCI
    Oracle Cloud
    Infrastructure
    METRICS ALARMS
    Notifications
    CPU: 80
    CPU: 90
    CPU: 40
    CPU: 50
    Customer Applications,
    Services, Resources
    Oracle Cloud
    Infrastructure
    Console
    Customer
    Monitoring Tool
    Monitoring

    View Slide

  21. • (
    ) ( )




    • (AD)
    ( )
    Copyright © 2021, Oracle and/or its affiliates.
    21
    launch

    View Slide

  22. GPU VM
    VM
    • VM 1

    • 5
    VM Recovery Due to Infrastructure Failure
    Copyright © 2021, Oracle and/or its affiliates.
    22
    VM

    View Slide

  23. (Instance Pool)

    • ( )

    (
    )
    1



    (15~20 )
    Copyright © 2021, Oracle and/or its affiliates.
    23
    Instance Pool
    Provisioning
    : 3

    View Slide

  24. Oracle Cloud Infrastructure VM


    VM
    Copyright © 2021, Oracle and/or its affiliates.
    24
    VM

    View Slide



  25. ( or )

    Oracle

    Copyright © 2021, Oracle and/or its affiliates.
    25

    View Slide

  26. ( )
    BRONZE
    Copyright © 2021, Oracle and/or its affiliates.
    26
    • IP
    • /etc/host DNS

    • cloud-init( )

    • (RDBMS FSS Object
    Storage)
    • (Redis
    Coherence )
    • (Object Storage)
    ?

    OK



    • Kubernetes Blue-Green

    View Slide

  27. SILVER -
    Copyright © 2021, Oracle and/or its affiliates.
    27
    : RPO 0 / RTO <30
    • ( )


    • Web/AP DB
    FD2
    Backup
    LB Subnet
    Web/AP Subnet
    DB Subnet
    FD1
    Database (RAC or Data Guard)

    View Slide

  28. Copyright © 2021, Oracle and/or its affiliates.
    28
    (AD) :
    • 1
    • AD AD 1
    • AD (Phoenix, Ashburn, Frankfurt, London)
    • (AD) (>=1Tb/sec) (< 0.5ms) ( )
    (FD) :
    • AD
    • 1 3

    AD1 AD2 AD3
    Rack Rack Rack
    FD1 FD2 FD3

    View Slide

  29. OCI
    Copyright © 2021, Oracle and/or its affiliates.
    29
    1 1
    1
    2
    3
    1
    2
    3
    Transit POP Transit POP
    1AD
    • x 1
    • x 3
    • Transit POP (FastConnect ) x 1
    • : Equinix TY4
    • : NTT

    View Slide

  30. Copyright © 2021, Oracle and/or its affiliates.
    30
    OCI (
    ) 4
    • :

    • :

    • :
    • :
    Oracle Cloud Infrastructure
    - Phoenix - Asuburn
    AD1 AD2 AD3 AD1 AD2 AD3

    View Slide

  31. https : //docs.us-phoenix-1.oraclecloud.com/Content/General/Concepts/regions.htm
    IAM
    , , , , , ,
    , Federation, API signing key
    DNS DNS , DNS , DNS , WAF
    Compute
    Block Volume
    Network
    VCN, , , DHCP , ,
    DRG, CPE, Local Peering Gateway(LPG), IP,
    Container , ,
    Load Balancer , (w/ )
    Object Storage
    Block Volume ,
    Network , (Ephemeral) IP
    Load Balancer (w/ )
    Compute
    Database
    Container
    Copyright © 2021, Oracle and/or its affiliates.
    31

    View Slide

  32. Copyright © 2021, Oracle and/or its affiliates.
    32
    • 1
    • (AD)

    LB
    • or

    AVAILABILITY DOMAIN-1 AVAILABILITY DOMAIN-2
    VCN
    REGIONAL SUBNET 2
    Backend Servers Backend Servers
    REGIONAL SUBNET 1
    Load Balancer
    (Active)
    Load Balancer
    (Failover)
    IP
    Load Balancer Pair
    Internet
    Gateway

    View Slide

  33. (Autoscaling)
    Copyright © 2021, Oracle and/or its affiliates.
    33
    If CPU or Memory > 70% add 2 Instances
    If CPU or Memory < 70% remove 2 instances
    • (CPU/ 翻 )


    View Slide

  34. VIP-2
    IP-1
    IP
    • NIC(VNIC)
    IP ( VIP-2)
    • VM1 VIP-2 VM2
    • IP
    :
    Pacemaker IP AD
    Virtual IP IP
    Copyright © 2021, Oracle and/or its affiliates.
    34
    ORACLE CLOUD INFRASTRUCTURE (REGION)
    AD-1 AD-2
    IP-1
    VIP-2
    VNIC1
    primary
    Regional Subnet
    10.0.1.0/24
    VNIC1
    primary
    primary primary
    VM1 VM2

    View Slide


  35. read/write

    • /
    • / –
    • –
    • / - read/write – sharable

    • OCI
    • OCI Oracle RAC OCI Database ExaCS ADB
    PaaS IaaS RAC
    HA
    Copyright © 2021, Oracle and/or its affiliates.
    35
    or

    View Slide

  36. https://jpn.nec.com/clusterpro/blog/20200602.html?
    NEC CLUSTERPRO HA
    Copyright © 2021, Oracle and/or its affiliates.
    36

    View Slide

  37. https://bccs.sios.jp/news/2020/oracle_cloud_ha.html
    SIOS Lifekeeper HA
    Copyright © 2021, Oracle and/or its affiliates.
    37

    View Slide

  38. Kubernetes
    Container Engine for Kubernetes (OKE)
    Copyright © 2021, Oracle and/or its affiliates.
    38

    • /


    Virtual Machine
    OKE
    OCI Registry
    Service
    Broker
    Load
    Balancer
    Object
    Storage
    Database
    System

    View Slide

  39. Oracle DB
    Exadata Cloud Service Autonomous Database
    Copyright © 2021, Oracle and/or its affiliates.
    39
    Oracle Database
    Exadata


    • Real Application Cluster & Oracle Clusterware : DB
    • Service :
    • SCAN Listener :
    • Automatic Storage Management :
    Oracle Clusterware
    Real Application Clusters
    Service
    Automatic Storage Management
    SCAN Listener

    View Slide

  40. PaaS Data Guard
    Copyright © 2021, Oracle and/or its affiliates.
    40
    AD-1 AD-2
    Region-A
    Standby DB
    Exadata
    System
    Primary DB
    Exadata
    System
    Standby DB
    Exadata
    System
    同⼀AD 別AD
    Region-B
    AD-1
    別リージョン
    Standby DB
    Exadata
    System
    DBCS : Data Guard
    • AD AD DB

    • 1
    • Data Guard Broker
    • Data Guard

    (2 30)
    • White Paper: Hybrid Data Guard to Exadata Cloud
    Services
    OCI Documentation( ) Exadata DB System > Using Oracle Data Guard with Exadata DB Systems
    OCI Documentation( ) Exadata DB > Exadata DB Oracle Data Guard

    View Slide

  41. DB

    Oracle Real Application Clusters 翻



    • TAC 翻 1
    • :
    (TAC)
    Copyright © 2021, Oracle and/or its affiliates.
    41
    /

    View Slide

  42. DB 1 1
    Copyright © 2021, Oracle and/or its affiliates.
    42

    View Slide

  43. VPN
    Copyright © 2021, Oracle and/or its affiliates.
    43
    Transit
    POP
    Virtual
    Machine
    Database
    System
    (CPE)
    VPN
    IPsec
    VPN
    • VPN (DRG : Dynamic
    Routing Gateway) 2 VPN

    IPsec
    • OCI
    (ECMP)

    View Slide

  44. FastConnect x2
    • /
    (Transit POP) Transit POP FastConnect
    • FastConnect 2
    • ( ) (
    or )
    ( )
    :FastConnect :
    VPN
    • BGP
    /
    Copyright © 2021, Oracle and/or its affiliates.
    44
    Transit
    POP
    Virtual
    Machine
    Database
    System
    (CPE)
    FastConnect

    View Slide

  45. GOLD & PLATINUM -
    Copyright © 2021, Oracle and/or its affiliates.
    45
    : RPO <30 / RTO <30
    : RPO 0 / RTO 0
    • ( )
    • Active-Active Active-
    Passive


    • Web/AP DB
    FD1 FD2 FD1 FD2
    or
    Data Guard
    Replication
    (rsync )
    DNS
    WebAP WebAP
    Database (RAC) Database (RAC)
    Backup Backup

    View Slide

  46. Copyright © 2021, Oracle and/or its affiliates.
    46
    1 Oracle
    Cloud Infrastructure
    1
    ( )
    Subscribe To This Region

    View Slide

  47. 2021 5 29 9
    Oracle Cloud Infrastructure Global Footprint
    Copyright © 2021, Oracle and/or its affiliates.
    47
    SAN JOSE, CA
    PHOENIX
    CHICAGO
    ASHBURN
    TORONTO MONTREAL
    SANTIAGO
    VINHEDO
    SAO PAULO
    NEWPORT
    AMSTERDAM
    FRANKFURT
    ZURICH
    LONDON
    SWEDEN
    ITALY
    FRANCE
    JEDDAH
    ISRAEL
    DUBAI
    MUMBAI
    HYDERABAD
    SINGAPORE
    CHUNCHEON
    SEOUL TOKYO
    OSAKA
    JOHANNESBURG
    SYDNEY
    MELBOURNE
    Commercial
    Commercial Planned
    Government
    Government Planned
    Microsoft Interconnect Azure
    SAUDI 2
    UAE 2
    /
    2
    (
    - )
    Oracle Backbone
    OCI OCI

    View Slide

  48. • VCN
    • Oracle
    VCN WAN
    ORACLE CLOUD INFRASTRUCTURE (REGION 1)
    AD1 AD2 AD3
    ORACLE CLOUD INFRASTRUCTURE (REGION 2)
    AD1 AD2 AD3
    Copyright © 2021, Oracle and/or its affiliates.
    48

    View Slide

  49. DR

    • VPN

    VCN
    (B38327)
    • 10TB/ :
    • 10TB / : 3 /GB
    • - 8ms

    FastConnect
    Copyright © 2021, Oracle and/or its affiliates.
    49
    OCI OCI
    OCI

    View Slide

  50. • DR
    • Vault

    • RPO 1

    • Tokyo → Osaka Seoul
    • Osaka → Tokyo
    Copyright © 2021, Oracle and/or its affiliates.
    OCI Tokyo OCI Osaka
    50

    View Slide

  51. • DR



    • Read Only
    Copyright © 2021, Oracle and/or its affiliates.
    51
    Tokyoリージョン
    VCN
    Osakaリージョン
    VCN

    View Slide

  52. OCI
    Copyright © 2021, Oracle and/or its affiliates.
    52
    Traffic Management DNS Alarm
    OCI UI
    Your
    Server
    @ OCI
    • 23 Vantage Point AWS, Azure,
    GCP
    – North and South America
    – Europe
    – Asia & Australia
    • HTTP , HTTPS , Ping(TCP , ICMP)
    • Optional HTTP Header value check

    View Slide

  53. Copyright © 2021, Oracle and/or its affiliates.
    53
    User
    Recursive
    Server
    OCI DNS
    Primary Region
    Redundant Region
    Outage
    Available
    OCI DNS
    OCI 翻


    • ASN
    • IP
    (Traffic Management)

    View Slide

  54. Zero Down Time Migration/Upgrade
    GoldenGate
    1) 2) 3)
    DB DB DB DB DB DB
    GoldenGate GoldenGate GoldenGate
    54 Copyright © 2021, Oracle and/or its affiliates.
    54

    View Slide

  55. GOLD & PLATINUM – ( )
    Copyright © 2021, Oracle and/or its affiliates.
    55
    : RPO <30 / RTO <30
    : RPO 0 / RTO 0

    • OCI DNS /
    • / Data Guard
    GoldenGate RMAN
    FD1 FD2
    Data Guard
    GoldenGate
    Replication
    (rsync )
    DNS
    WebAP WebAP
    Database (RAC) Database (RAC)
    Backup
    SLB
    RMAN Backup
    FastConnect

    View Slide

  56. Copyright © 2021, Oracle and/or its affiliates.
    56
    ü Design For Failure :
    ü
    ü
    ü MAA(Maximum Availability Architecture)

    View Slide

  57. Appendix
    Copyright © 2021, Oracle and/or its affiliates.
    57

    View Slide

  58. : OCI (2021 6 !!)
    Copyright © 2021, Oracle and/or its affiliates.
    58
    Oracle Cloud Infrastructure (OCI)
    1
    Connpass Oracle Code Night
    https://oracle-code-tokyo-dev.connpass.com/

    View Slide

  59. Oracle Cloud
    Copyright © 2021, Oracle and/or its affiliates.
    59
    http://qiita.com/organizations/oracle
    http://www.slideshare.net/oracle4engineer/
    Oracle Cloud
    • https://cloud.oracle.com/ja_JP
    ( )
    Oracle Cloud
    • https://community.oracle.com/groups/oracle-
    cloud-japan-blog
    www.facebook.com/OracleCloudComputing
    @OracleCloudZone #OracleCloud

    View Slide

  60. Oracle Cloud Infrastructure
    Copyright © 2021, Oracle and/or its affiliates.
    60
    Oracle Cloud Infrastructure ( / )
    • https://docs.cloud.oracle.com/iaas/api/ - API
    • https://docs.cloud.oracle.com/ja-jp/iaas/Content/General/Reference/aqswhitepapers.htm -
    • https://docs.cloud.oracle.com/iaas/releasenotes/ -
    • https://docs.cloud.oracle.com/ja-jp/iaas/Content/knownissues.htm - (Known Issues)
    • https://docs.cloud.oracle.com/ja-jp/iaas/Content/General/Reference/graphicsfordiagrams.htm -
    OCI (PPT SVG Visio )

    View Slide

  61. Oracle Cloud Infrastructure
    Copyright © 2021, Oracle and/or its affiliates.
    61
    Oracle Cloud Infrastructure
    • https://oracle-japan.github.io/ocidocs/
    - Oracle Cloud Infrastructure
    • https://oracle-japan.github.io/ocitutorials/
    Oracle
    • https://www.oracle.com/search/events/
    ( Filter Locations -> Asia Pacific -> Japan )
    Oracle Cloud Infrastructure – General Forum ( )
    • https://cloudcustomerconnect.oracle.com/resources/9c8fa8f96f/summary

    View Slide

  62. Oracle Cloud Service
    Copyright © 2021, Oracle and/or its affiliates.
    62
    Oracle Cloud Service
    l 30 300
    l
    l 1 Oracle Cloud Infrastructure
    PaaS / IaaS
    l
    Oracle Cloud Service
    !
    l FAQ
    https://faq.oracle.co.jp/app/answers/detail/a_id/2809

    View Slide

  63. View Slide