Exadata Fleet Update

Exadata Fleet Update 概要、設定⽅法⽇本オラクル株式会社テクノロジー事業戦略統括部データベースソリューション部 2024/2/16 Takeshi Maruyama

メンテナンスの課題 2 Copyright © 2024, Oracle and/or its affiliates |
⼤規模なフリート環境では画⾯からメンテナンス作業を実⾏する場合、数⼗から数百のステップが必要スクリプトを指定する必要があるスクリプト化されていない場合、⼀度に1つのターゲットにしか実⾏できないスケジュール機能が無い

• Exadata Database Service on Dedicated Infrastructure、 Exadata Database Service
on Cloud@Customer での⼤規模なデータベース・デプロイメント環境のメンテナンス操作を⾃動化 • データベースとグリッド・インフラストラクチャのグループを単⼀のメンテナンス・スケジュールとメンテナンス・サイクルで更新可能 • ネイティブOCIサービス • クラウドでサポートされているすべての Oracle Database バージョンに対応 • Exadata Database Service on Dedicated Infrastructure、 Exadata Database Service on Cloud@Customer に含まれるサービス Exadata Fleet Update *とは︖ Copyright © 2024, Oracle and/or its affiliates | 3

Exadata Fleet Update で解決できる問題メンテナンスの簡素化管理にかかる時間の短縮化 4 Copyright © 2024,
Oracle and/or its affiliates |

Fleet Patching & Provisioning パッチ適⽤をシンプルに 5 • Fleet Patching &
Provisioning (FPP)は、⼤規模な Oracle Database環境に対して、標準化されたアウトオブプレース・パッチ適⽤⼿法について、繰返し可能な⾃動化を提供 • Fleet Patching & Provisioning (FPP)の機能 • ゴールドイメージベースのドリフト検出 • 統合されたジョブ・スケジューリング • 拡張性のためのユーザー・アクション • 包括的なExadataパッチ適⽤ • 常に最新のMAAベスト・プラクティスに準拠 • Oracle Database 23cは、FPPを簡素化および強化して最新のRAC機能を活⽤し、フルスタックのExadataパッチ適⽤の拡張機能を提供 Copyright © 2023, Oracle and/or its affiliates.

FPPはアウトオブプレース・パッチ適⽤を使⽤標準化とローリング・パッチ適⽤への道のり Copyright © 2024, Oracle and/or its affiliates |
6 UP UP UP UP DOWN DOWN DOWN DOWN UP UP UP UP STOP ALL SERVICES UP PATCH BINARIES PATCH DBs インプレース・パッチ適⽤: • 簡単なロールバックは無い • ⻑いダウンタイム • 複雑なプロセス • エラー発⽣ • 標準は適⽤されない UP UP UP UP DOWN DOWN DOWN DOWN UP UP UP UP INSTALL NEW BINARIES STOP, MOVE, PATCH ONE BY ONE アウトオブプレース・パッチ適⽤ • ロールバックが簡単 • ダウンタイムが短縮 • バイナリを1回構築してあらゆる場所で使⽤ • 計画が容易 • 組み込まれた標準化 ORACLE 推奨

Fleet Patching and Provisioning の機能の歴史 Copyright © 2024, Oracle and/or
its affiliates | 7 RHP 12.1.0.2 RHP 12.2 RHP 18 FPP 19 FPP 21 •First release of Rapid Home Provisioning (RHP) as part of Grid Infrastructure •DB Home Provisioning •Database Patching • Grid Infrastructure Support (deployment, patching, upgrade) • Database Major Upgrades (with DBUA) • Zero Downtime Upgrade • REST APIs • Exadata Support • Dry-run evaluation • Drift Reporting • Authentication Plugins • Command Scheduler • Local Mode (DB patching and GI patching) • Renamed to FPP (Fleet Patching and Provisioning) • Zero Downtime Oracle Grid Infrastructure Patching • PDB Patching and Relocation • Oracle Restart Support • Automated Session Draining for GI rolling maintenance • Server Peering • Integration with Autoupgrade

Exadata Fleet Update フリートを維持する最も簡単な⽅法 8 Copyright © 2024, Oracle and/or
its affiliates |

Exadata Fleet Update の仕組み Copyright © 2024, Oracle and/or its
affiliates | 9 OCIリージョン ExaDB-D ExaDB-D Grid Infrastructure Collection ExaDB-C@C ExaDB-C@C Database Collection Grid Infrastructure Collection Database Collection Collection を作成 (設定は⼀度) 1 2 2 1 Maintenance Cycle を定義

Grid Infrastructure Oracle Database Collection の作成⽅法 Copyright © 2024, Oracle
and/or its affiliates | 10 Major version コンパートメント RU Version/ Custom Image DB Name/ DB Unique name Oracle Home VM Cluster Exadata Infrastructure

ターゲットの Collections へのグループ化 Copyright © 2024, Oracle and/or its affiliates
| 11 ① ターゲット • Exadata Database Service • Database • Grid Infrastructure ② ターゲット • 同⼀ Oracle Exadata Cloud Service タイプの複数のインフラストラクチャにまたがることが可能 ③ 同じタイプのターゲットを Collection にグループ化可能 • Oracle Databases • Oracle Grid Infrastructure ④ Collectionは1つのリージョンで定義される。複数のコンパートメントにまたがることが可能 ExaDB-C@C ExaDB-D 1 2 3 4 Region 2

Maintenance Cycle とは Copyright © 2024, Oracle and/or its affiliates
| 12 定義ターゲット・バージョン Standard RU または Custom Image ローリングまたは⾮ローリング・メンテナンス Drain Timeout 無視可能なパッチその他のオプション

Maintenance Cycle の仕組み Copyright © 2024, Oracle and/or its affiliates
| 13 Maintenance Actions 必須ステップオプションのステップ Stage software ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Apply update ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (apply) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (stage) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Cleanup ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ)

Exadata Fleet Update インタフェース希望の⽅法を利⽤可能 OCIコンソール OCIコマンドライン OCI API 14
Copyright © 2024, Oracle and/or its affiliates |

Exadata Fleet Update 機能ネイティブ・フリート・ワイド・パッチ適⽤メンテナンス・アクションは、個々のターゲットではなく、グループに対して実⾏される拡張(ローリング)パッチ・オプション
• ⼀度に1つのノードへ適⽤（ローリング、デフォルト） • 50/50 （ローリングで半分づつに適⽤） • スマート・バッチ • ⾮ローリング • ドレイン・タイムアウトの指定（デフォルト600秒）スケジュールメンテナンス処理をスケジュール可能アウトオブプレースのパッチ適⽤ Standard Software Images またはカスタム・データベース・ソフトウェア・イメージに基づいて新しいホームがインストールされる Copyright © 2024, Oracle and/or its affiliates | 15

• Exadata Database Service の更新の簡素化、標準化、および強化 • インターフェースの選択 • OCI
コンソール • OCI API • OCI コマンドライン • 完全なネイティブOCIサービス • 無料 OCIリージョン ExaDB-D ExaDB-D まとめ ExaDB-D データベース Collection Grid Infrastructure Collection Copyright © 2024, Oracle and/or its affiliates | 16

• マニュアル • Exadata Fleet Update Administrator's Guide • https://docs.oracle.com/en/engineered-systems/exadata-cloud-
service/edsfu/index.html#Oracle%C2%AE-Exadata • Exadataフリート更新管理者ガイド • https://docs.oracle.com/cd/F56555_01/edsfu/index.html#Oracle%C2%AE-Exadata • ブログ • https://blogs.oracle.com/oracle4engineer/post/exadata-fleet-update-concepts-jp • デモビデオ • https://www.youtube.com/playlist?list=PLdtXkK5KBY56u9bIE2PkAtE5eYdA_82WK リソース Copyright © 2024, Oracle and/or its affiliates | 17

Copyright © 2024, Oracle and/or its affiliates | 18 12.
Exadata Fleet Update • Collections の管理（DB） • Maintenance Cycles の管理（DB） • Grid Infrastructure の場合の Collections、Maintenance Cycle の管理 • Topics、Rulesの設定

Copyright © 2024, Oracle and/or its affiliates | 19 Exadata
Fleet Update • Collections の管理（DB） • Maintenance Cycles の管理（DB） • Grid Infrastructure の場合の Collections、Maintenance Cycle の管理 • Topics、Rulesの設定

Resource-Types • 集約リソース・タイプ • fleet-software-update-family • 個々のリソース・タイプ • fleet-software-update-discoveries •
fleet-software-update-collections • fleet-software-update-cycles • fleet-software-update-actions • fleet-software-update-jobs • fleet-software-update-work-requests • fleet-software-update-images • fleet-software-update-homes Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 20

Collection の管理 IAM Policies の設定 Dynamic Groups Exadata Fleet Update
Copyright © 2024, Oracle and/or its affiliates | 21 作成済みの Dynamic Group を利⽤

Collection の管理 IAM Policies の設定 Exadata Fleet Update Collection の管理に必要なポリシー
allow dynamic-group project-exadatacloud_dynamic_group to manage fleet-software-update-discoveries in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to manage fleet-software-update-collections in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to read fleet-software-update-work-requests in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to inspect database-software-images in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to inspect db-homes in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to inspect databases in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to inspect cloud-exadata-infrastructures in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to inspect db-nodes in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use cloud-vmclusters in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use vcns in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use subnets in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use vnics in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use private-ips in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use network-security-groups in compartment exadatacloud Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 22

Collection の管理必要なネットワーク設定 Exadata Fleet Update Copyright © 2024, Oracle
and/or its affiliates | 26 Security List > Ingress Rules Add Ingress Rules 利⽤しているVCN

and/or its affiliates | 27 Stateless: No (all rules must be stateful) Source Type: CIDR Source CIDR: Client subnet's CIDR IP Protocol: TCP Source Port Range: All Destination Port Range: 7085

and/or its affiliates | 28 作成された Security List

Collection の管理 Collection の作成 Exadata Fleet Update Copyright © 2024,
Oracle and/or its affiliates | 29 Oracle Database Exadata Fleet Update

Oracle and/or its affiliates | 30 Collections Create collection

Oracle and/or its affiliates | 31 Collection type: Database Grid Infrastructure どちらか選択（今回は Database） Cloud service: Oracle Exadata Database Service on Cloud@Customer (ExaDB- C@C) Oracle Exadata Database Service on Dedicated Infrastructure (ExaDB-D) どちらか選択 Current major version: コレクション内のターゲットは同じバージョンである必要があるが、異なるパッチ・レベルにすることが可能） Next

Oracle and/or its affiliates | 32 Edit search criteria 対象のデータベースの検索基準 Database name: アスタリスク利⽤可能 Apply Add targets Edit search criteria

Oracle and/or its affiliates | 33 検索結果の候補 Next

Oracle and/or its affiliates | 34 Review Create collection

Oracle and/or its affiliates | 35 Collection 作成中

Oracle and/or its affiliates | 36 Collection 作成完了 Targets

Collection の管理 Collection の作成現在の ORACLE_HOME、DBRU、opatch のバージョン確認 [oracle@kara-vpvao1 ~]$ env
| grep ORA ORACLE_UNQNAME=DB1106_552_kix ORACLE_SID=DB11061 ORACLE_BASE=/u02/app/oracle ORACLE_HOSTNAME=kara-vpvao1.sub04210756190.exavcn.oraclevcn.com ORACLE_HOME=/u02/app/oracle/product/19.0.0.0/dbhome_4 [oracle@kara-vpvao1 ~]$ which opatch /u02/app/oracle/product/19.0.0.0/dbhome_4/OPatch/opatch [oracle@kara-vpvao1 ~]$ opatch version OPatch Version: 12.2.0.1.36 OPatch succeeded. [oracle@kara-vpvao1 ~]$ opatch lspatches 34835593;REFERENCE BUG 34792490 - SCHEDULER LAYER CHANGES TO AVOID CYCLIC DEPENDENCY ON DBMS_AQADM_SYS PACKAGE 34792490;FADBRWT STRESS FA ORA-00060 DEADLOCK DETECTED DURING DATAPATCH 34699616;DSTV40 UPDATE - TZDATA2022E - NEED OJVM FIX 34777391;JDK BUNDLE PATCH 19.0.0.0.230117 34786990;OJVM RELEASE UPDATE: 19.18.0.0.230117 (34786990) 34768559;OCW RELEASE UPDATE 19.18.0.0.0 (34768559) 34765931;DATABASE RELEASE UPDATE : 19.18.0.0.230117 (REL-JAN230131) (34765931) OPatch succeeded. [oracle@kara-vpvao1 ~]$ [oracle@kara-vpvao1 ~]$ opatch version OPatch Version: 12.2.0.1.36 OPatch succeeded. [oracle@kara-vpvao1 ~]$ Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 37

Collection の管理 Collection の作成現在の ORACLE_HOME、DBRU のバージョン確認 [oracle@kara-vpvao1 ~]$ .
DB11062.env [oracle@kara-vpvao1 ~]$ env | grep ORA ORACLE_UNQNAME=DB11062_sxh_kix ORACLE_SID=DB110621 ORACLE_BASE=/u02/app/oracle ORACLE_HOSTNAME=kara-vpvao1.sub04210756190.exavcn.oraclevcn.com ORACLE_HOME=/u02/app/oracle/product/19.0.0.0/dbhome_5 [oracle@kara-vpvao1 ~]$ opatch lspatches 35556847;MERGE ON DATABASE RU 19.18.0.0.0 OF 35527937 35412607 35471762;KZTDE KZTSMTKI ENCRYPTION WALLET LOCATION MESSAGES FLOODING ALERT LOG POST 19.18 35386601;MERGE ON DATABASE RU 19.18.0.0.0 OF 34997479 35242133 35320424;MRP INTERMITTENT HANG ON TWO STANDBY DATABASES REGR_FIX 35246710;HIGH DIRECT PATH READ AFTER 19.18 DBRU PATCHING 35213579;MERGE ON DATABASE RU 19.18.0.0.0 OF 35037877 35046819 35162446;NEED BEHAVIOR CHANGE TO BE SWITCHED OFF 35160800;GG IE FAILS WITH ORA-14400 AT SYSTEM.LOGMNRC_USER AFTER ORACLE DB UPGRADE TO 19.18DBRU 35156936;ORA-7445 [KFFBNEW()+351] AFTER CONVERT TO ASM FLEX DISKGROUP 34988484;ORA-600 [KTUGETTEMPRSP NO TSO] EVEN WITH PATCH 34615905 APPLIED 34879016;ALL SESSIONS HANG DUE TO INST_RCV BUFFER IS NOT GETTING WRITE PERMISSION 34861493;RESYNC CATALOG FAILED IN ZDLRA CATALOG AFTER PROTECTED DATABASE PATCHED TO 19.17 34847038;ORA-16856 TRANSPORT LAG COULD NOT BE DETERMINED | TRANSPORT LAG (UNKNOWN) | NO LAG | 19.16.0.0 34832725;ORA-4031 KSU STATS_FREELIST AND KGLSESHTTABLE ERRORS IN 19C 34810252;SPIN OFF FOR BUG 34808861 [ORA-00600 INTERNAL ERROR CODE, ARGUMENTS [KFDS_GETSEGREUSEENQ01] TERMINATED ALL DB INSTANCES 34809715;SQL WITH CASE EXPRESSION MAY FAIL WITH ORA-00932 IN 19.17 AND ABOVE 34793099;STRESS FA CDB CREATION FAILS ON 19.17 WITH THE ORA-00704 BOOTSTRAP PROCESS FAILURE WHILE OPENING PDB$SEED 34783802;PARALLEL QUERY ON PARTITIONED TABLE RETURNS WRONG RESULT 34632426;FADBRWT STRESS FA HITTING MULTIPLE INCIDENTS OF ORA-12850 IN ALERT LOG EVEN WITHOUT EXPLICITLY SETTING 12850 ERROR EVENT IN 19.17RU 34557500;CTWR CAUSED MULTIPLE INSTANCES IN HUNG STATE ON THE RAC STANDBY DATABASE 34340632;AQAH SMART MONITORING & RESILIENCY IN QUEUE KGL MEMORY USAGE 33973908;DBWR NOT PICKING UP WRITES FOR SOME TIME 32727143;TRANSACTION-LEVEL CONTENT ISOLATION FOR TRANSACTION-DURATION GLOBAL TEMPORARY TABLES 31222103;STRESS RAC ATPD FAN EVENTS ARE NOT GETTING PROCESSED WITH 21C GI AND 19.4 DB 34835593;REFERENCE BUG 34792490 - SCHEDULER LAYER CHANGES TO AVOID CYCLIC DEPENDENCY ON DBMS_AQADM_SYS PACKAGE 34792490;FADBRWT STRESS FA ORA-00060 DEADLOCK DETECTED DURING DATAPATCH 34699616;DSTV40 UPDATE - TZDATA2022E - NEED OJVM FIX 34777391;JDK BUNDLE PATCH 19.0.0.0.230117 34786990;OJVM RELEASE UPDATE: 19.18.0.0.230117 (34786990) 34768559;OCW RELEASE UPDATE 19.18.0.0.0 (34768559) 34765931;DATABASE RELEASE UPDATE : 19.18.0.0.230117 (REL-JAN230131) (34765931) OPatch succeeded. Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 38

Fleet Update • Collections の管理（DB） • Maintenance Cycle の管理（DB） • Grid Infrastructure の場合の Collections、Maintenance Cycle の管理 • Topics、Rulesの設定 Stage software ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) Apply update ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) Precheck (apply) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) Precheck (stage) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) Cleanup ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ) ジョブ(ターゲットごとに 1つ)

Maintenance Cycle の管理 IAM Policies の設定 Maintenance Cycle の管理に必要なポリシー allow
dynamic-group project-exadatacloud_dynamic_group to read db-nodes in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use database-software-images in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to manage db-homes in compartment exadatacloud where any {request.permission='DB_HOME_CREATE', request.permission='DB_HOME_UPDATE', request.permission='DB_HOME_INSPECT'} allow dynamic-group project-exadatacloud_dynamic_group to manage databases in compartment exadatacloud where any {request.permission='DATABASE_CREATE', request.permission='DATABASE_UPDATE', request.permission='DATABASE_INSPECT'} allow dynamic-group project-exadatacloud_dynamic_group to use cloud-vmclusters in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use vcns in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use subnets in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use vnics in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to use private-ips in compartment exadatacloud allow service fppcsprod to use cloud-vmclusters in compartment exadatacloud Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 40

Maintenance Cycle の管理 IAM Policies の設定 Maintenance Cycle の管理に必要なポリシー Exadata
Fleet Update Copyright © 2024, Oracle and/or its affiliates | 41

Maintenance Cycle の管理 IAM Policies の設定 Maintenance Cycle の管理に必要なポリシー Exadata
Fleet Update Copyright © 2024, Oracle and/or its affiliates | 42

Maintenance Cycle の管理 IAM Policies の設定 Maintenance Cycle のCleanupに必要なポリシー allow
dynamic-group project-exadatacloud_dynamic_group to manage db-homes in compartment exadatacloud where request.permission='DB_HOME_DELETE' allow dynamic-group project-exadatacloud_dynamic_group to manage databases in compartment exadatacloud where request.permission='DATABASE_DELETE’ マニュアルを読み飛ばしがちなので注意！ Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 43

Maintenance Cycle の管理 IAM Policies の設定 Maintenance Cycle のCleanupに必要なポリシー Exadata
Fleet Update Copyright © 2024, Oracle and/or its affiliates | 44 Create Policy Policy

Maintenance Cycle の管理 IAM Policies の設定 Maintenance Cycle のCleanupに必要なポリシー Exadata
Fleet Update Copyright © 2024, Oracle and/or its affiliates | 45 Create Policy Policy

Maintenance Cycle の管理 IAM Policies の設定 Maintenance Cycle、アクションリソースの付与 allow dynamic-group
project-exadatacloud_dynamic_group to use fleet-software-update-collections in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to manage fleet-software-update-cycles in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to manage fleet-software-update-actions in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to manage fleet-software-update-jobs in compartment exadatacloud allow dynamic-group project-exadatacloud_dynamic_group to manage fleet-software-update-work-requests in compartment exadatacloud allow group project-exadatacloud_dynamic_group to use database-software-images in compartment exadatacloud allow group project-exadatacloud_dynamic_group to manage db-homes in compartment exadatacloud allow group project-exadatacloud_dynamic_group to use cloud-vmclusters in compartment exadatacloud allow group project-exadatacloud_dynamic_group to manage databases in compartment exadatacloud where any {request.permission='DATABASE_CREATE', request.permission='DATABASE_UPDATE', request.permission='DATABASE_INSPECT'} allow group project-exadatacloud_dynamic_group to use vmclusters in compartment exadatacloud allow group project-exadatacloud_dynamic_group to inspect exadata-infrastructures in compartment exadatacloud Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 46

Maintenance Cycle の管理 IAM Policies の設定 Exadata Fleet Update Copyright
© 2024, Oracle and/or its affiliates | 47 Create Policy Policy

Maintenance Cycle の管理 IAM Policies の設定 Exadata Fleet Update Copyright
© 2024, Oracle and/or its affiliates | 48 Policy

Maintenance Cycle の管理 Maintenance Cycle の作成 Exadata Fleet Update Copyright
© 2024, Oracle and/or its affiliates | 49 Maintenance cycle Create Maintenance cycle Collections exadbupdate

© 2024, Oracle and/or its affiliates | 52 Target database image: 適⽤後のバージョン Maintenance Method 適⽤⽅式 • One node at a time (rolling): (Default) • 50/50 (rolling): • VMの半分にあるデータベース・インスタンスは、1つのバッチで更新され、残りの半分は別のバッチで更新される。 2つのバッチは、データベース・サービスの構成によって決まります。これにより、すべてのサービスが使⽤可能になる • Enable one batch at a time: • ⼀度に1つのバッチに更新を適⽤するには、このチェック・ボックスを選択します。適⽤アクションでは、 1つ⽬のバッチの更新を適⽤すると、2つ⽬のバッチを開始する前に、続⾏が待機される • Non-rolling: • Smart batch (rolling): • データベース・インスタンスは、⼀度に 1つ以上のVMで更新されます。 VMは、構成されたデータベース・サービスに基づいてバッチされる。これにより、必要なバッチの合計数を最⼩限に抑えながら、複数のノードにすべてのサービスを構成しているかぎり、すべてのサービスが使⽤可能になる Database home Create new home 新しいDBHOMEを作成 Use existing home 選択したイメージの既存のホームがターゲット・データベースの VMクラスタに⾒つからない場合は、新しいDBHOMEが作成される。選択したイメージの複数の既存のホームが⾒つかった場合は、データベース数が最も少ない DBHOMEが使⽤される。複数のホームにデータベース数が最も少ない場合、DBHOME はランダムに選択される。

© 2024, Oracle and/or its affiliates | 54 Database start/stop options: Maximum drain timeout (in seconds): ノード間のドレイン・タイムアウトを秒単位で指定。これは、ローリング更新中に使⽤され、データベース接続の再配置の時間を提供する。使⽤されるドレイン・タイムアウトは、この値の最⼤値、または特定のインスタンスで実⾏されているサービスの最⼤構成ドレイン・タイムアウトになる。デフォルトは600。 Keep service placement: 有効にすると、データベース・サービスは、更新を適⽤アクションの前に配置にリストアされる

© 2024, Oracle and/or its affiliates | 55 Software update options: Ignore missing patches （マニュアルはIgnore missing bug fixes）ソースのDBHOMEに存在するバグ修正に対するパッチが、ターゲットのDBHOMEに無い場合でも、ソフトウェア更新の⼀部としてmoveを実⾏する場合は、このチェック・ボックスを選択

© 2024, Oracle and/or its affiliates | 56 Ignore missing patches （マニュアルはIgnore missing bug fixes）選択すると Bug numbers to ignore: オプションで、無視するバグ番号を⼊⼒します。（カンマ区切り）バグ番号を指定しない場合、ソースで修正されているがターゲットにないバグは無視されます。 Create Maintenance Cycle

Maintenance Cycle の管理アクションの実⾏ Precheck(stage) Exadata Fleet Update Copyright ©
2024, Oracle and/or its affiliates | 58 Maintenance Cycle Precheck Stage software ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Apply update ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (apply) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (stage) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Cleanup ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ)

2024, Oracle and/or its affiliates | 59 Precheck prior to staging software Run precheck

Maintenance Cycle の管理アクションの実⾏ Precheck(stage) 失敗例 Exadata Fleet Update Copyright
© 2024, Oracle and/or its affiliates | 60 Download failed job logs

Maintenance Cycle の管理アクションの実⾏ Precheck(stage) 失敗例 Starting Collection check of
DB targets. ======================JOB_EXECUTION_DETAILS_START====================== User: opc Client: fppcsdp-ad1-prod-1 Scheduled job command: "rhpctl manageTargetInCollection" Job execution start time: 2023-11-22 03:58:56 Job execution end time: 2023-11-22 03:59:26 Current status: FAILED =======================JOB_EXECUTION_DETAILS_END======================= failed to establish connectivity to target DbNodes Error returned by Unknown operation operation in Unknown service service.(404, NotAuthorizedOrNotFound, false) Authorization failed or requested resource not found. (opc-request-id: 3C583AC8747D437A82067B0AE4364876/F5B24EFB33B09CC44454D082EB9967B1/AE21567BDA4A015B2EB8A74C3C942494) Timestamp: 2023-11-22T03:59:24.944Z Client version: Oracle-JavaSDK/2.66.0 Request Endpoint: Unknown request endpoint Troubleshooting Tips: See https://docs.oracle.com/en-us/iaas/Content/API/References/apierrors.htm#apierrors_404__404_notauthorizedornotfound for more information about resolving this error Also see Unknown API reference link for details on this operation's requirements. To get more info on the failing request, you can enable debug level logs as mentioned in `Using SLF4J for Logging section` in https://docs.oracle.com/en- us/iaas/Content/API/SDKDocs/javasdkconfig.htm. If you are unable to resolve this Unknown service issue, please contact Oracle support and provide them this full error message. Error returned by Unknown operation operation in Unknown service service.(404, NotAuthorizedOrNotFound, false) Authorization failed or requested resource not found. (opc-request-id: 3C583AC8747D437A82067B0AE4364876/F5B24EFB33B09CC44454D082EB9967B1/AE21567BDA4A015B2EB8A74C3C942494) Timestamp: 2023-11-22T03:59:24.945Z Client version: Oracle-JavaSDK/2.66.0 Request Endpoint: Unknown request endpoint Troubleshooting Tips: See https://docs.oracle.com/en-us/iaas/Content/API/References/apierrors.htm#apierrors_404__404_notauthorizedornotfound for more information about resolving this error Also see Unknown API reference link for details on this operation's requirements. To get more info on the failing request, you can enable debug level logs as mentioned in `Using SLF4J for Logging section` in https://docs.oracle.com/en- us/iaas/Content/API/SDKDocs/javasdkconfig.htm. If you are unable to resolve this Unknown service issue, please contact Oracle support and provide them this full error message. Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 62

2024, Oracle and/or its affiliates | 64 再び precheck

2024, Oracle and/or its affiliates | 65 Precheck(stage) の内容を確認したいとき Precheck Succeeded

2024, Oracle and/or its affiliates | 66 Precheck(stage) Precheck Succeeded した job の内容

2024, Oracle and/or its affiliates | 67 成功したときのログを⾒たいとき View log

2024, Oracle and/or its affiliates | 68

Maintenance Cycle の管理アクションの実⾏ Precheck(stage) precheck成功時のログ Starting Collection check of
DB targets. Cycle plan for action 'ocid1.fsuaction.oc1.ap-osaka-1.amaaaaaassl65iqagdwqvgmzu4gqvwyd5n7qm6lefw5maw5rxmsyjcvpcvhq' is successfully validated ======================JOB_EXECUTION_DETAILS_START====================== User: opc Client: fppcsdp-ad1-prod-1 Scheduled job command: "rhpctl add workingcopy -eval -targetnode kara-vpvao1.sub04210756190.exavcn.oraclevcn.com -skipclone -user oracle -image db-4pXuw7BFBu4EzE48TzCHAsKseUsrJpEZ-20231122050946 -schedule 2023- 11-22T05:12:26Z -workingcopy wc_XQdpyUVOKPyTqByvWCffD3h4bFJ6m1Ux_20231122050946 -direct -skipcopy -auth restauth -oraclebase /u02/app/oracle -groups OSDBA=dba,OSOPER=racoper,OSBACKUP=dba,OSDG=dba,OSKM=dba,OSRAC=dba -json -path /u02/app/oracle/product/19.0.0.0/dbhome_4 -arg5 tlskeystore:/fpp/base/chkbase/scheduled/jksKeyStore-ocid1.cloudvmcluster.oc1.ap- osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-177201156 -arg4 tlstruststore:/fpp/base/chkbase/scheduled/jksTrustStore-ocid1.cloudvmcluster.oc1.ap-osaka- 1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-177201157 -arg1 restendpointfile:/fpp/base/chkbase/scheduled/restaddrfile-ocid1.cloudvmcluster.oc1.ap-osaka- 1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-177201158" Job execution start time: 2023-11-22 05:12:26 Job execution end time: 2023-11-22 05:12:49 Current status: SUCCEEDED =======================JOB_EXECUTION_DETAILS_END======================= 2023-11-22 05:12:26.496 UTC : Evaluation in progress for "add workingcopy" ... 2023-11-22 05:12:42.290 UTC : Option storagetype is set to the following default value: LOCAL. 2023-11-22 05:12:49.093 UTC : Evaluation finished successfully for "add workingcopy". Successfully provisioned new source working copy wc_XQdpyUVOKPyTqByvWCffD3h4bFJ6m1Ux_20231122050946 on cluster ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q in home ocid1.dbhome.oc1.ap-osaka-1.anvwsljrkrdj45ia4wqcka6m7ifzd7vbszpgkd327wlmuw556nz4tqgzjseq having path /u02/app/oracle/product/19.0.0.0/dbhome_4 ======================JOB_EXECUTION_DETAILS_START====================== User: opc Client: fppcsdp-ad1-prod-1 Scheduled job command: "rhpctl add workingcopy -eval -targetnode kara-vpvao1.sub04210756190.exavcn.oraclevcn.com -skipclone -user oracle -image db-xcA2cxrotUQeIkzlkMNiM6p6noNibGFR-20231122050918 -schedule 2023- 11-22T05:13:19Z -workingcopy wc_c61znITXbu1yvglqoOib8jQPIbDBsZvw_20231122050919 -direct -skipcopy -auth restauth -oraclebase /u02/app/oracle -groups OSDBA=dba,OSOPER=racoper,OSBACKUP=dba,OSDG=dba,OSKM=dba,OSRAC=dba -json -path /u02/app/oracle/product/ -arg5 tlskeystore:/fpp/base/chkbase/scheduled/jksKeyStore-ocid1.cloudvmcluster.oc1.ap-osaka- 1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-177148017 -arg4 tlstruststore:/fpp/base/chkbase/scheduled/jksTrustStore-ocid1.cloudvmcluster.oc1.ap-osaka- 1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-177148018 -arg1 restendpointfile:/fpp/base/chkbase/scheduled/restaddrfile-ocid1.cloudvmcluster.oc1.ap-osaka- 1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-177148019" Job execution start time: 2023-11-22 05:13:26 Job execution end time: 2023-11-22 05:13:52 Current status: SUCCEEDED =======================JOB_EXECUTION_DETAILS_END======================= 2023-11-22 05:13:26.492 UTC : Evaluation in progress for "add workingcopy" ... 2023-11-22 05:13:44.930 UTC : Option storagetype is set to the following default value: LOCAL. 2023-11-22 05:13:52.025 UTC : Evaluation finished successfully for "add workingcopy". Successfully provisioned new goal working copy wc_c61znITXbu1yvglqoOib8jQPIbDBsZvw_20231122050919 on cluster ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q in home ocid.dbhome.oc1..aaaaaaaakttteeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeest1 having path /u02/app/oracle/product/ Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 69

Maintenance Cycle の管理アクションの実⾏ Stage software Exadata Fleet Update Copyright
© 2024, Oracle and/or its affiliates | 70 Maintenance Cycle Stage software Stage software ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Apply update ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (apply) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (stage) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Cleanup ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ)

Maintenance Cycle の管理アクションの実⾏ Stage software ステージング中にあらたに指定されたバージョンで DBHOME が作成される {
"eventType" : "com.oraclecloud.databaseservice.createdbhome.end", "cloudEventsVersion" : "0.1", "eventTypeVersion" : "2.0", "source" : "DatabaseService", "eventTime" : "2023-11-24T03:01:54Z", "contentType" : "application/json", "data" : { "compartmentId" : "ocid1.compartment.oc1..aaaaaaaa5lyxq3znb3vnngfmlpkdcksqw4oxe5zzg3i37iydjpezoghgmh7a", "compartmentName" : "exadatacloud", "resourceName" : "fppcs_goalHome20231124025321", "resourceId" : "ocid1.dbhome.oc1.ap-osaka-1.anvwsljrkrdj45ia2k3grn2hzyvwxgdmjoe5m6zm5dgyxhewyo3ayf3m5naq", "availabilityDomain" : "TGjA:AP-OSAKA-1-AD-1", "additionalDetails" : { "lifecycleState" : "AVAILABLE", "recordVersion" : 4, "displayName" : "fppcs_goalHome20231124025321", "dbVersion" : "19.20.0.0", "timeUpdated" : "2023-11-24T03:01:54.185Z", "patchHistoryEntries" : "null", "timeCreated" : "2023-11-24T02:53:22.924Z", "dbSystemId" : "ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q" } }, "eventID" : "766e4650-775e-4f30-ac96-472d55f05a43", "extensions" : { "compartmentId" : "ocid1.compartment.oc1..aaaaaaaa5lyxq3znb3vnngfmlpkdcksqw4oxe5zzg3i37iydjpezoghgmh7a" } } Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 75

Maintenance Cycle の管理アクションの実⾏ Stage software 2つのDBHOMEが作成されている [root@kara-vpvao1 19.0.0.0]# ls
-lart total 44 drwxr-xr-x 3 oracle oinstall 4096 Oct 18 05:05 .. drwxr-x--- 73 oracle oinstall 4096 Oct 18 05:25 dbhome_1 drwxr-xr-x 73 oracle oinstall 4096 Oct 31 04:55 dbhome_2 drwxr-xr-x 73 oracle oinstall 4096 Nov 2 06:18 dbhome_3 drwxr-xr-x 73 oracle oinstall 4096 Nov 6 07:54 dbhome_6 drwxr-x--- 73 oracle oinstall 4096 Nov 15 07:34 dbhome_7 drwxr-xr-x 73 oracle oinstall 4096 Nov 22 07:20 dbhome_5 drwxr-x--- 73 oracle oinstall 4096 Nov 22 07:20 dbhome_4 drwxr-xr-x 71 oracle oinstall 4096 Nov 24 02:56 dbhome_8 drwxr-xr-x 11 oracle oinstall 4096 Nov 24 03:02 . drwxr-xr-x 71 oracle oinstall 4096 Nov 24 03:05 dbhome_9 [root@kara-vpvao1 19.0.0.0]# date Fri Nov 24 05:18:42 UTC 2023 [root@kara-vpvao1 19.0.0.0]# pwd /u02/app/oracle/product/19.0.0.0 [root@kara-vpvao1 19.0.0.0]# Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 76

Maintenance Cycle の管理アクションの実⾏ Precheck(apply) Exadata Fleet Update Copyright ©
2024, Oracle and/or its affiliates | 78 Precheck(Apply) （ボタンが同じなので間違えないように。。） Stage software ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Apply update ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (apply) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (stage) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Cleanup ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ)

2024, Oracle and/or its affiliates | 79 Precheck prior to applying software updates

2024, Oracle and/or its affiliates | 80 Precheck(apply) Failed

2024, Oracle and/or its affiliates | 81 Download failed job logs

Maintenance Cycle の管理アクションの実⾏ Precheck(apply) 失敗例 Target: ocid1.database.oc1.ap-osaka-1.anvwsljrssl65iqaync3eeabz5g4zdmkppl5rogbw5sq4ubdcjcwvks575ra, EfuJob: ocid1.fsujob.oc1.ap-osaka-
1.amaaaaaassl65iqarx2avbq7v7jq6kwea6ovury5pco4aawhc2tggedjjlpq, WorkRequestId: ocid1.fsuworkrequest.oc1.ap-osaka- 1.amaaaaaassl65iqae3emjnahd6hqhloqf5puchw3iuqo7nu4lvzksngli3ya ---------------------------------------------- Starting Collection check of DB targets. No Data Guard Associations for target ocid1.database.oc1.ap-osaka-1.anvwsljrssl65iqaync3eeabz5g4zdmkppl5rogbw5sq4ubdcjcwvks575ra, nothing to check. Starting precheck apply for action ocid1.fsuaction.oc1.ap-osaka-1.amaaaaaassl65iqaqilqzsdgloj4u5zymcemujrj455l7afkzclkjmwxz6sa Cycle plan for action 'ocid1.fsuaction.oc1.ap-osaka-1.amaaaaaassl65iqaqilqzsdgloj4u5zymcemujrj455l7afkzclkjmwxz6sa' is successfully validated ======================JOB_EXECUTION_DETAILS_START====================== User: opc Client: cl-cet6m23q Scheduled job command: "rhpctl move database -eval -targetnode kara-vpvao1.sub04210756190.exavcn.oraclevcn.com -dbname DB11062_sxh_kix -sourcewc wc_I0G0L6HZBet4q3VnsvI7mJbKDWjL8akn_20231122062801 -schedule 2023-11-22T07:18:07Z -direct -patchedwc wc_jDRtDrknQu01bms3lSekFoSJx4rUOvzl_20231122062745 -auth restauth - drain_timeout 600 -json -arg5 tlskeystore:/fpp/base/chkbase/scheduled/jksKeyStore-ocid1.cloudvmcluster.oc1.ap-osaka- 1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-169660876 -arg4 tlstruststore:/fpp/base/chkbase/scheduled/jksTrustStore-ocid1.cloudvmcluster.oc1.ap- osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-169660877 -arg1 restendpointfile:/fpp/base/chkbase/scheduled/restaddrfile- ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-169660878" Job execution start time: 2023-11-22 07:18:27 Job execution end time: 2023-11-22 07:23:54 Current status: FAILED =======================JOB_EXECUTION_DETAILS_END======================= 2023-11-22 07:18:27.073 UTC : Evaluation in progress for "move database" ... 2023-11-22 07:23:34.271 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying versions of Oracle homes ... 2023-11-22 07:23:34.272 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying owners of Oracle homes ... 2023-11-22 07:23:34.273 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying groups of Oracle homes ... 2023-11-22 07:23:54.467 UTC : PRGO-1774 : The evaluation revealed potential failure for command "move database". PRGO-1571 : The move operation was rejected because the patched working copy "wc_jDRtDrknQu01bms3lSekFoSJx4rUOvzl_20231122062745" is missing the patches for bug numbers "34835593,34792490" which are present in the source working copy "wc_I0G0L6HZBet4q3VnsvI7mJbKDWjL8akn_20231122062801". ---------------------------------------------- 続く Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 82

Maintenance Cycle の管理アクションの実⾏ Precheck(apply) 失敗例続き ---------------------------------------------- Target: ocid1.database.oc1.ap-osaka-1.anvwsljrssl65iqagtb5fv72idtr2gtdmtwbhs7v623beuz54nkms6lei7lq,
EfuJob: ocid1.fsujob.oc1.ap-osaka- 1.amaaaaaassl65iqaj3qh44mrop7fvs5a6u6jfh7nbkrv3sblgwkmzpj7ddpq, WorkRequestId: ocid1.fsuworkrequest.oc1.ap-osaka- 1.amaaaaaassl65iqaeag5cbtwjijbvtw2dudj6wkug4ohz4igmabjcrxrs3kq ---------------------------------------------- Starting Collection check of DB targets. No Data Guard Associations for target ocid1.database.oc1.ap-osaka-1.anvwsljrssl65iqagtb5fv72idtr2gtdmtwbhs7v623beuz54nkms6lei7lq, nothing to check. Starting precheck apply for action ocid1.fsuaction.oc1.ap-osaka-1.amaaaaaassl65iqaqilqzsdgloj4u5zymcemujrj455l7afkzclkjmwxz6sa Cycle plan for action 'ocid1.fsuaction.oc1.ap-osaka-1.amaaaaaassl65iqaqilqzsdgloj4u5zymcemujrj455l7afkzclkjmwxz6sa' is successfully validated ======================JOB_EXECUTION_DETAILS_START====================== User: opc Client: cl-cet6m23q Scheduled job command: "rhpctl move database -eval -targetnode kara-vpvao1.sub04210756190.exavcn.oraclevcn.com -dbname DB1106_552_kix -sourcewc wc_zmR260FsODL7tQxiPxp5XjGGlWWkJTeE_20231122062801 -schedule 2023-11-22T07:18:23Z -direct -patchedwc wc_ZBFQ8bdKdmatjVHrenLnO3CIfgpFz50c_20231122062745 -auth restauth - drain_timeout 600 -json -arg5 tlskeystore:/fpp/base/chkbase/scheduled/jksKeyStore-ocid1.cloudvmcluster.oc1.ap-osaka- 1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-169644162 -arg4 tlstruststore:/fpp/base/chkbase/scheduled/jksTrustStore-ocid1.cloudvmcluster.oc1.ap- osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-169644163 -arg1 restendpointfile:/fpp/base/chkbase/scheduled/restaddrfile- ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-169644164" Job execution start time: 2023-11-22 07:18:27 Job execution end time: 2023-11-22 07:22:29 Current status: FAILED =======================JOB_EXECUTION_DETAILS_END======================= 2023-11-22 07:18:27.073 UTC : Evaluation in progress for "move database" ... 2023-11-22 07:22:08.930 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying versions of Oracle homes ... 2023-11-22 07:22:08.931 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying owners of Oracle homes ... 2023-11-22 07:22:08.931 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying groups of Oracle homes ... 2023-11-22 07:22:29.415 UTC : PRGO-1774 : The evaluation revealed potential failure for command "move database". PRGO-1571 : The move operation was rejected because the patched working copy "wc_ZBFQ8bdKdmatjVHrenLnO3CIfgpFz50c_20231122062745" is missing the patches for bug numbers "34835593,34792490" which are present in the source working copy "wc_zmR260FsODL7tQxiPxp5XjGGlWWkJTeE_20231122062801". ---------------------------------------------- Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 83

Maintenance Cycle の管理アクションの実⾏ Precheck(apply) 失敗例 PRGO-1571: パッチ適⽤済作業⽤コピー“{0}“にソース作業⽤コピー“{2}“に存在するバグ番号“{1}“のパッチがないため、 move操作は拒否されました。原因:
作業コピーに含まれていない⼀部のパッチが、ソースの作業コピーには含まれていました。処置: 移動コマンドをʻ-ignorewcpatchesʼオプションで再実⾏するか、ソース作業コピーと少なくとも同じパッチが適⽤されたパッチ作業コピーを指定してください https://docs.oracle.com/cd/F19136_01/errmg/PRGO-01003.html#GUID-A3079418-4270-4F64-87BA-F7BEF572A327 [oracle@kara-vpvao1 ~]$ . DB1106.env [oracle@kara-vpvao1 ~]$ opatch lspatches 34835593;REFERENCE BUG 34792490 - SCHEDULER LAYER CHANGES TO AVOID CYCLIC DEPENDENCY ON DBMS_AQADM_SYS PACKAGE 34792490;FADBRWT STRESS FA ORA-00060 DEADLOCK DETECTED DURING DATAPATCH 34699616;DSTV40 UPDATE - TZDATA2022E - NEED OJVM FIX 34777391;JDK BUNDLE PATCH 19.0.0.0.230117 34786990;OJVM RELEASE UPDATE: 19.18.0.0.230117 (34786990) 34768559;OCW RELEASE UPDATE 19.18.0.0.0 (34768559) 34765931;DATABASE RELEASE UPDATE : 19.18.0.0.230117 (REL-JAN230131) (34765931) OPatch succeeded. [oracle@kara-vpvao1 ~]$ Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 84

Maintenance Cycle の管理アクションの実⾏ Precheck(apply) 失敗例 Exadata Fleet Update Copyright
© 2024, Oracle and/or its affiliates | 85 More actions >Edit maintenance cycle （メンテナンスサイクル実⾏中しか変更できない） Show advanced options > Software update options Ø Ignore missing patches Ø Bug numbers to ignore Ø エラーで出⼒された bug番号を記載 Ø Save changes

Maintenance Cycle の管理アクションの実⾏ Precheck(apply) 失敗例 Exadata Fleet Update Copyright
© 2024, Oracle and/or its affiliates | 86 Update maintenance cycle Succeeded 再度 Precheck(apply)

2024, Oracle and/or its affiliates | 87 再び Precheck prior to applying software updates

2024, Oracle and/or its affiliates | 88 Precheck(apply) Succeeded

2024, Oracle and/or its affiliates | 89 Precheck (apply) precheck_apply_soft ware

Maintenance Cycle の管理アクションの実⾏ Apply update Exadata Fleet Update Copyright
© 2024, Oracle and/or its affiliates | 90 Apply update Stage software ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Apply update ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (apply) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (stage) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Cleanup ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ)

Maintenance Cycle の管理アクションの実⾏ Apply update env ファイル Maintenance Cycle
前 [oracle@kara-vpvao1 ~]$ ls -lart total 56 -rw-r--r-- 1 oracle oinstall 231 Nov 23 2021 .bashrc -rw-r--r-- 1 oracle oinstall 18 Nov 23 2021 .bash_logout -rw-r--r-- 1 oracle oinstall 172 Aug 9 2022 .kshrc drwxr-xr-x 8 root root 91 Oct 17 10:53 .. -rw-r--r-- 1 oracle oinstall 169 Oct 17 11:06 .bash_profile drwx------ 2 oracle oinstall 108 Oct 17 11:07 .ssh -rw-r----- 1 oracle oinstall 0 Oct 18 05:25 DB1017.env2023-10-18_05:25:19 -rw-r----- 1 oracle oinstall 635 Oct 18 05:25 DB1017.env -rwxrwx--- 1 oracle oinstall 653 Oct 31 05:34 DB1032.env -rwxrwx--- 1 oracle oinstall 653 Nov 6 04:19 DB1106.env -rwxrwx--- 1 oracle oinstall 656 Nov 6 06:00 DB11062.env -rw-r----- 1 oracle oinstall 0 Nov 6 10:13 DB1033.env2023-11-06_10:13:08 drwxr-xr-x 2 oracle oinstall 4096 Nov 13 09:35 .sqlcl -rw-r----- 1 oracle oinstall 0 Nov 15 08:07 DB1033.env2023-11-15_08:07:01 -rw-r----- 1 oracle oinstall 635 Nov 15 08:07 DB1033.env drwx------ 5 oracle oinstall 4096 Nov 20 07:26 . drwxr-xr-x 3 oracle oinstall 66 Nov 20 07:26 patch -rw------- 1 oracle oinstall 9075 Nov 24 06:22 .bash_history Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 96

Maintenance Cycle の管理アクションの実⾏ Apply update env ファイル Maintenance Cycle
後更新されている [oracle@kara-vpvao1 ~]$ ls -lart total 56 -rw-r--r-- 1 oracle oinstall 231 Nov 23 2021 .bashrc -rw-r--r-- 1 oracle oinstall 18 Nov 23 2021 .bash_logout -rw-r--r-- 1 oracle oinstall 172 Aug 9 2022 .kshrc drwxr-xr-x 8 root root 91 Oct 17 10:53 .. -rw-r--r-- 1 oracle oinstall 169 Oct 17 11:06 .bash_profile drwx------ 2 oracle oinstall 108 Oct 17 11:07 .ssh -rw-r----- 1 oracle oinstall 0 Oct 18 05:25 DB1017.env2023-10-18_05:25:19 -rw-r----- 1 oracle oinstall 635 Oct 18 05:25 DB1017.env -rwxrwx--- 1 oracle oinstall 653 Oct 31 05:34 DB1032.env -rw-r----- 1 oracle oinstall 0 Nov 6 10:13 DB1033.env2023-11-06_10:13:08 drwxr-xr-x 2 oracle oinstall 4096 Nov 13 09:35 .sqlcl -rw-r----- 1 oracle oinstall 0 Nov 15 08:07 DB1033.env2023-11-15_08:07:01 -rw-r----- 1 oracle oinstall 635 Nov 15 08:07 DB1033.env drwxr-xr-x 3 oracle oinstall 66 Nov 20 07:26 patch -rw------- 1 oracle oinstall 9096 Nov 24 06:44 .bash_history lrwxrwxrwx 1 oracle oinstall 23 Nov 24 07:05 DB1106_552_kix.env -> /home/oracle/DB1106.env -rwxrwx--- 1 oracle oinstall 692 Nov 24 07:05 DB1106.env lrwxrwxrwx 1 oracle oinstall 24 Nov 24 07:08 DB11062_sxh_kix.env -> /home/oracle/DB11062.env drwx------ 5 oracle oinstall 4096 Nov 24 07:08 . -rwxrwx--- 1 oracle oinstall 695 Nov 24 07:08 DB11062.env [oracle@kara-vpvao1 ~]$ Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 97

Maintenance Cycle の管理アクションの実⾏ Apply update ORACLE_HOME が move されている
[oracle@kara-vpvao1 ~]$ . DB1106.env [oracle@kara-vpvao1 ~]$ env | grep ORA ORACLE_UNQNAME=DB1106_552_kix ORACLE_SID=DB11061 ORACLE_BASE=/u02/app/oracle ORACLE_HOSTNAME=kara-vpvao1.sub04210756190.exavcn.oraclevcn.com ORACLE_HOME=/u02/app/oracle/product/19.0.0.0/dbhome_9 [oracle@kara-vpvao1 ~]$ opatch lspatches 34697081;NOT SHIPPING LIBAUTH_SDK_IAM.SO IN 23 SHIPHOME INSTALL 35116173;OCW Interim patch for 35116173 35336174;JDK BUNDLE PATCH 19.0.0.0.230718 35585502;Fix for Bug 35585502 35598272;TRACKING BUG FOR SQLCL CHANGES IN SQLDEVELOPER 21.4.10 35239280;DSTV42 UPDATE - TZDATA2023C - NEED OJVM FIX 35354406;OJVM RELEASE UPDATE: 19.20.0.0.230718 (35354406) 35320081;Database Release Update : 19.20.0.0.230718 (35320081) OPatch succeeded. opatch も新しいバージョンに置き換わる [oracle@kara-vpvao1 ~]$ opatch version OPatch Version: 12.2.0.1.39 OPatch succeeded. [oracle@kara-vpvao1 ~]$ Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 98

Maintenance Cycle の管理アクションの実⾏ Cleanup Exadata Fleet Update Copyright ©
2024, Oracle and/or its affiliates | 101 Cleanup Apply update アクションが成功すると、メンテナンス・サイクルは「Succeeded」状態に移⾏し、Cleanup アクションが使⽤可能になります。Cleanup 処理は、メンテナンス・サイクルでのオプションの処理です。メンテナンス・サイクルが正常に完了した後、Cleanup アクションを実⾏して、メンテナンス・サイクルのソースの DBHOME および Grid Infrastructure HOME を削除します。すぐにクリーンアップを実⾏またはクリーンアップをスケジュール可能です Stage software ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Apply update ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (apply) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Precheck (stage) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) Cleanup ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ) ジョブ(ターゲットごとに1つ)

2024, Oracle and/or its affiliates | 102 Cleanup

Maintenance Cycle の管理アクションの実⾏ Cleanup 失敗例1 Exadata Fleet Update Copyright
© 2024, Oracle and/or its affiliates | 104 Failed Download failed job logs DB1106: Need attention DB11062: Failed

Maintenance Cycle の管理アクションの実⾏ Cleanup 失敗例1 Target: ocid1.database.oc1.ap-osaka-1.anvwsljrssl65iqaync3eeabz5g4zdmkppl5rogbw5sq4ubdcjcwvks575ra, EfuJob: ocid1.fsujob.oc1.ap-osaka-
1.amaaaaaassl65iqacx7cktppx7gpgrjydgob5kpwippwdv7v74qcmlwuqw3a, WorkRequestId: ocid1.fsuworkrequest.oc1.ap-osaka- 1.amaaaaaassl65iqaraelasadyodu3xfdkzzarsqdexgp7aea4y6ivdrkrkza ---------------------------------------------- Failed to delete Oracle Database Home 'ocid1.dbhome.oc1.ap-osaka-1.anvwsljrkrdj45iamv64qo7skptnbwqxtl2zwshywxc4fpsqlkh4kocrckwq' due to: Authorization failed or Not Found error on OCI Service call. ---------------------------------------------- よく分からない。。？ Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 105

© 2024, Oracle and/or its affiliates | 107 先ほどと同じログ Failed to delete Oracle Database Home 'ocid1.dbhome.oc1.ap- osaka- 1.anvwsljrkrdj45iamv64 qo7skptnbwqxtl2zwshyw xc4fpsqlkh4kocrckwq' due to: Authorization failed or Not Found error on OCI Service call. 権限関連のエラー

© 2024, Oracle and/or its affiliates | 109 他のDBで使われていると The database home ocid1.dbhome.oc1.a p-osaka- 1.anvwsljrkrdj45ia4 wqcka6m7ifzd7vbszp gkd327wlmuw556nz 4tqgzjseq was not deleted because it is still in use by one or more databases.

Maintenance Cycle の管理アクションの実⾏ Cleanup 失敗例1 allow dynamic-group project-exadatacloud_dynamic_group to
manage db-homes in compartment exadatacloud where request.permission='DB_HOME_DELETE' allow dynamic-group project-exadatacloud_dynamic_group to manage databases in compartment exadatacloud where request.permission='DATABASE_DELETE’ マニュアルを読み飛ばして設定が漏れていたので再設定 Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 110

2024, Oracle and/or its affiliates | 111 もう⼀度 Cleanup

© 2024, Oracle and/or its affiliates | 115 Succeededの DB11062 の View log ====================== JOB_EXECUTION_DETAILS_START= ===================== User: opc Client: cl-cet6m23q Scheduled job command: "rhpctl delete workingcopy -metadataonly - force -json -schedule 2023-11- 29T07:52:48Z -workingcopy wc_I0G0L6HZBet4q3VnsvI7mJbKD WjL8akn_20231122062801" Job execution start time: 2023-11- 29 07:52:48 Job execution end time: 2023-11-29 07:52:48 Current status: SUCCEEDED ====================== =JOB_EXECUTION_DETAILS_END= ======================

© 2024, Oracle and/or its affiliates | 116 Need attention の DB1106 Starting Collection check of DB targets. Starting Cleanup workflow for action ocid1.fsuaction.oc1.ap- osaka- 1.amaaaaaassl65iqab3fmyymu wbfrqsexqqeq7h3h6d4teumeyi qz5yerlyea The database home ocid1.dbhome.oc1.ap-osaka- 1.anvwsljrkrdj45ia4wqcka6m7i fzd7vbszpgkd327wlmuw556nz 4tqgzjseq was not deleted because it is still in use by one or more databases.

Maintenance Cycle の管理 dbhome_5 が削除、DB11062 の DBHOME は dbhome_8. DB1106
の DBHOME は dbhome_9 に変わっている [root@kara-vpvao1 ~]# cat /etc/oratab #Backup file is /u01/app/grid/crsdata/kara-vpvao1/output/oratab.bak.kara-vpvao1.grid line added by Agent # # This file is used by ORACLE utilities. It is created by root.sh # and updated by either Database Configuration Assistant while creating # a database or ASM Configuration Assistant while creating ASM instance. # A colon, ':', is used as the field terminator. A new line terminates # the entry. Lines beginning with a pound sign, '#', are comments. # # Entries are of the form: # $ORACLE_SID:$ORACLE_HOME:<N|Y>: # # The first and second fields are the system identifier and home # directory of the database respectively. The third field indicates # to the dbstart utility that the database should , "Y", or should not, # "N", be brought up at system boot time. # # Multiple entries with the same $ORACLE_SID are not allowed. # # DB1017_9k6_kix:/u02/app/oracle/product/19.0.0.0/dbhome_1:N DB1032_c25_kix:/u02/app/oracle/product/19.0.0.0/dbhome_3:Y DB1033_vrr_kix:/u02/app/oracle/product/19.0.0.0/dbhome_4:N DB1106_552_kix:/u02/app/oracle/product/19.0.0.0/dbhome_9:Y DB11062_sxh_kix:/u02/app/oracle/product/19.0.0.0/dbhome_8:Y +ASM1:/u02/app/19.0.0.0/grid_1:Y [root@kara-vpvao1 ~]# ls -al /u02/app/oracle/product/19.0.0.0/ total 40 drwxr-xr-x 10 oracle oinstall 4096 Nov 29 07:48 . drwxr-xr-x 3 oracle oinstall 4096 Oct 18 05:05 .. drwxr-x--- 73 oracle oinstall 4096 Oct 18 05:25 dbhome_1 drwxr-xr-x 73 oracle oinstall 4096 Oct 31 04:55 dbhome_2 drwxr-xr-x 73 oracle oinstall 4096 Nov 2 06:18 dbhome_3 drwxr-x--- 73 oracle oinstall 4096 Nov 22 07:20 dbhome_4 drwxr-xr-x 73 oracle oinstall 4096 Nov 6 07:54 dbhome_6 drwxr-x--- 73 oracle oinstall 4096 Nov 15 07:34 dbhome_7 drwxr-xr-x 72 oracle oinstall 4096 Nov 24 06:51 dbhome_8 drwxr-xr-x 72 oracle oinstall 4096 Nov 24 06:47 dbhome_9 [root@kara-vpvao1 ~]# Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 120

Grid Infrastructureの場合のCollections, Maintenance Cycle Exadata Fleet Update Copyright © 2024,
Oracle and/or its affiliates | 122 Create collection

Oracle and/or its affiliates | 123 Collection type Grid Infrastructure を選択

Oracle and/or its affiliates | 124 Grid infrastructure release update に表記が変わる

Grid Infrastructureの場合のCollections, Maintenance Cycle 現在のバージョン [grid@kara-vpvao1 ~]$ opatch lspatches 34243634;AIM
ORA-600 [ATBMMN 1] - ATBMMN_MAKE_MODV_NULLABLE 34697081;NOT SHIPPING LIBAUTH_SDK_IAM.SO IN 23 SHIPHOME INSTALL 35080170;APPLIANCE.MODE IS DEFAULTED TO FALSE WITH ASM DISKGROUPS ON X10 EF CELLS AND CANNOT BE CHANGED 34993018;CLSF NEEDS TO CHECK I/O OSS ERROR CODE 34975490;14 SECS BLACKOUT WITH GRACEFUL CELL SERVICES SHUTDOWN 34810987;CACHE ASM METADATA IOS INTO EXADATA FLASHCACHE 35309390;OCW Interim patch for 35309390 35099674;DSTV41 UPDATE - TZDATA2022G - NEED OJVM FIX 35004974;JDK BUNDLE PATCH 19.0.0.0.230418 35050341;OJVM RELEASE UPDATE: 19.19.0.0.230418 (35050341) 35107512;TOMCAT RELEASE UPDATE 19.0.0.0.0 (35107512) 35050325;ACFS RELEASE UPDATE 19.19.0.0.0 (35050325) 35042068;Database Release Update : 19.19.0.0.230418 (35042068) 33575402;DBWLM RELEASE UPDATE 19.0.0.0.0 (33575402) OPatch succeeded. [grid@kara-vpvao1 ~]$ opatch version OPatch Version: 12.2.0.1.37 OPatch succeeded. [grid@kara-vpvao1 ~]$ Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 125

Oracle and/or its affiliates | 126 VMCluster-3が選択されている

Oracle and/or its affiliates | 127 Maintenance Cycle Create Maintenance Cycle 作成された Collection exagiupdate

Oracle and/or its affiliates | 128 Target Grid Infrastructure Image 19.21

Oracle and/or its affiliates | 129 Target Grid Infrastructure version: 19.21 Precheck

Oracle and/or its affiliates | 130 Precheck prior to staging software

Oracle and/or its affiliates | 131 Precheck(stage) Succeeded Stage software

Oracle and/or its affiliates | 132 Stage software

Oracle and/or its affiliates | 133 Stage software Succeeded Precheck(Apply)

Oracle and/or its affiliates | 134 Precheck prior to staging software （本来は Stage software: Succeeded のあとなので、 Precheck prior to applying software updates の表⽰になるべき。

Grid Infrastructureの場合のCollections, Maintenance Cycle 失敗例 Exadata Fleet Update Copyright ©
2024, Oracle and/or its affiliates | 135 Failed Action icon View logs

Grid Infrastructureの場合のCollections, Maintenance Cycle ログ Target: ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q, EfuJob: ocid1.fsujob.oc1.ap-osaka- 1.amaaaaaassl65iqauz4u4dg6qxbabetmubajhcsb5kzvc2zjg5ghdm76rvoa,
WorkRequestId: ocid1.fsuworkrequest.oc1.ap-osaka-1.amaaaaaassl65iqahvxxgc35cezyhiz4j3qi53aig4nyqvdjzhskviwjc6eq ---------------------------------------------- Starting Collection check of DB targets. Related Fleet Software Collection ocid1.fsucollection.oc1.ap-osaka-1.amaaaaaassl65iqawfqpsriwdi7hygp4tpl7gk3kn53dhvekbzlnkz6qdpkq is of type GI, no Data Guard Association check is needed. Starting precheck apply for action ocid1.fsuaction.oc1.ap-osaka-1.amaaaaaassl65iqa6t7pvrpk5nrvjaw2ecn5pqm7dkhxvf6wsv3dni2poimq Cycle plan for action 'ocid1.fsuaction.oc1.ap-osaka-1.amaaaaaassl65iqa6t7pvrpk5nrvjaw2ecn5pqm7dkhxvf6wsv3dni2poimq' is successfully validated ======================JOB_EXECUTION_DETAILS_START====================== User: opc Client: cl-cet6m23q Scheduled job command: "rhpctl move gihome -eval -targetnode kara-vpvao1.sub04210756190.exavcn.oraclevcn.com -auth restauth -destwc wc_XYeOKPFGgYPByBB5LLC1PNPyZLqKgeup_20231127043106 - drain_timeout 600 -json -sourcewc wc_pfl09nheEeNiakfruURs86tINKxAN8eq_20231127025511 -schedule 2023-11-27T05:01:12Z -direct -arg5 tlskeystore:/fpp/base/chkbase/scheduled/jksKeyStore- ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-254124456 -arg4 tlstruststore:/fpp/base/chkbase/scheduled/jksTrustStore- ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-254124455 -arg1 restendpointfile:/fpp/base/chkbase/scheduled/restaddrfile- ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-254124454" Job execution start time: 2023-11-27 05:01:32 Job execution end time: 2023-11-27 05:03:12 Current status: FAILED =======================JOB_EXECUTION_DETAILS_END======================= 2023-11-27 05:01:32.224 UTC : Evaluation in progress for "move gihome" ... 2023-11-27 05:02:59.730 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying versions of Oracle homes ... 2023-11-27 05:02:59.731 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying owners of Oracle homes ... 2023-11-27 05:02:59.731 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying groups of Oracle homes ... 2023-11-27 05:03:12.433 UTC : PRGO-1774 : The evaluation revealed potential failure for command "move gihome". PRGO-1571 : The move operation was rejected because the patched working copy "wc_XYeOKPFGgYPByBB5LLC1PNPyZLqKgeup_20231127043106" is missing the patches for bug numbers "12565410,12949919,14112098,15897884,16799766,17443054,18759260,19397646,20875943,22037067,22873666,23614160,24701882,25173172,25881271,27015468,28127287,28852334,29997959,31335142,32327 208,33613833,34006650,34533150,34699616,35099674,29445548,29254623,29540327,29774362,30134746,30160625,30534662,29512125,29942275,30855101,31306261,31359215,30895577,29224710,26716835,31 668872,32165759,32069696,32032733,30889443,30674373,32167592,32523206,29415774,28777073,32124570,31247838,29540831,32892883,31776121,33223248,33563137,33184467,31844357,31727233,31494420 ,28209601,31311732,33805155,34149263,33872610,33822881,34473578,34450366,34461697,34346865,30408443,34604941,34786432,35021301,28674263,30796980,32587721" which are present in the source working copy "wc_pfl09nheEeNiakfruURs86tINKxAN8eq_20231127025511". ---------------------------------------------- Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 136

Grid Infrastructureの場合のCollections, Maintenance Cycle 通知 { "eventType" : "com.oraclecloud.fsu.fsuaction.critical", "cloudEventsVersion"
: "0.1", "eventTypeVersion" : "2.0", "source" : "FSU", "eventTime" : "2023-11-27T05:03:46Z", "contentType" : "application/json", "data" : { "compartmentId" : "ocid1.compartment.oc1..aaaaaaaa5lyxq3znb3vnngfmlpkdcksqw4oxe5zzg3i37iydjpezoghgmh7a", "compartmentName" : "exadatacloud", "resourceName" : "fsuaction-20231127045048", "resourceId" : "ocid1.fsuaction.oc1.ap-osaka-1.amaaaaaassl65iqa6t7pvrpk5nrvjaw2ecn5pqm7dkhxvf6wsv3dni2poimq", "availabilityDomain" : "ad1", "freeformTags" : { }, "definedTags" : { }, "additionalDetails" : { "fsuActionType" : "PRECHECK", "fsuActionOutput" : "======================JOB_EXECUTION_DETAILS_START======================¥nUser: opc¥nClient: cl-cet6m23q¥nScheduled job command: ¥"rhpctl move gihome -eval -targetnode kara- vpvao1.sub04210756190.exavcn.oraclevcn.com -auth restauth -destwc wc_XYeOKPFGgYPByBB5LLC1PNPyZLqKgeup_20231127043106 -drain_timeout 600 -json -sourcewc wc_pfl09nheEeNiakfruURs86tINKxAN8eq_20231127025511 - schedule 2023-11-27T05:01:12Z -direct -arg5 tlskeystore:/fpp/base/chkbase/scheduled/jksKeyStore-ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-254124456 -arg4 tlstruststore:/fpp/base/chkbase/scheduled/jksTrustStore-ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-254124455 -arg1 restendpointfile:/fpp/base/chkbase/scheduled/restaddrfile-ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-254124454¥"¥nJob execution start time: 2023-11-27 05:01:32¥nJob execution end time: 2023-11-27 05:03:12¥nCurrent status: FAILED¥n=======================JOB_EXECUTION_DETAILS_END=======================¥n¥n¥n 2023-11-27 05:01:32.224 UTC : Evaluation in progress for ¥"move gihome¥" ...¥n 2023-11-27 05:02:59.730 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying versions of Oracle homes ...¥n 2023-11-27 05:02:59.731 UTC : fppcsdp-ad1-prod- 1.dpapp1.fppcs.oraclevcn.com: verifying owners of Oracle homes ...¥n 2023-11-27 05:02:59.731 UTC : fppcsdp-ad1-prod-1.dpapp1.fppcs.oraclevcn.com: verifying groups of Oracle homes ...¥n 2023-11-27 05:03:12.433 UTC : PRGO-1774 : The evaluation revealed potential failure for command ¥"move gihome¥".¥nPRGO-1571 : The move operation was rejected because the patched working copy ¥"wc_XYeOKPFGgYPByBB5LLC1PNPyZLqKgeup_20231127043106¥" is missing the patches for bug numbers ¥"12565410,12949919,14112098,15897884,16799766,17443054,18759260,19397646,20875943,22037067,22873666,23614160,24701882,25173172,25881271,27015468,28127287,28852334,29997959,31335142,32327208,33613833,34006650,3 4533150,34699616,35099674,29445548,29254623,29540327,29774362,30134746,30160625,30534662,29512125,29942275,30855101,31306261,31359215,30895577,29224710,26716835,31668872,32165759,32069696,32032733,30889443,3067 4373,32167592,32523206,29415774,28777073,32124570,31247838,29540831,32892883,31776121,33223248,33563137,33184467,31844357,31727233,31494420,28209601,31311732,33805155,34149263,33872610,33822881,34473578,3445036 6,34461697,34346865,30408443,34604941,34786432,35021301,28674263,30796980,32587721¥" which are present in the source working copy ¥"wc_pfl09nheEeNiakfruURs86tINKxAN8eq_20231127025511¥".", "fsuCycleId" : "ocid1.fsucycle.oc1.ap-osaka-1.amaaaaaassl65iqaebcdfv56co4dg4vbz5wqzar53cdiokmhr6usrzm53fha", "description" : "FSU Action needs attention.", "fsuCollectionType" : "GI", "fsuCollectionServiceType" : "EXACS", "fsuCollectionId" : "ocid1.fsucollection.oc1.ap-osaka-1.amaaaaaassl65iqawfqpsriwdi7hygp4tpl7gk3kn53dhvekbzlnkz6qdpkq" } }, "eventID" : "4dfc4e39-09e8-469e-9554-1f83e9b7a29f", "extensions" : { "compartmentId" : "ocid1.compartment.oc1..aaaaaaaa5lyxq3znb3vnngfmlpkdcksqw4oxe5zzg3i37iydjpezoghgmh7a" } } Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 137

Oracle and/or its affiliates | 138 Edit maintenance cycle 前ページのパッチ番号をカンマ区切りで記載

Oracle and/or its affiliates | 139 Precheck Update maintenance cycle Succeeded

Oracle and/or its affiliates | 140 Precheck prior to applying software updates 表⽰が直った︖

Oracle and/or its affiliates | 141 Apply update Precheck(apply) Succeeded

Oracle and/or its affiliates | 142 Apply software updates

Grid Infrastructureの場合のCollections, Maintenance Cycle { "eventType" : "com.oraclecloud.databaseservice.updatecloudvmcluster.begin", "cloudEventsVersion" :
"0.1", "eventTypeVersion" : "2.0", "source" : "DatabaseService", "eventTime" : "2023-11-27T05:50:00Z", "contentType" : "application/json", "data" : { "compartmentId" : "ocid1.compartment.oc1..aaaaaaaa5lyxq3znb3vnngfmlpkdcksqw4oxe5zzg3i37iydjpezoghgmh7a", "compartmentName" : "exadatacloud", "resourceName" : "VMCluster-3", "resourceId" : "ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q", "availabilityDomain" : "", "freeformTags" : { }, "definedTags" : { }, "additionalDetails" : { "timeCreated" : "2023-10-17T08:57:11Z", "timeUpdated" : "2023-11-27T05:50:00Z", "lifecycleState" : "UPDATING", "cloudExadataInfrastructureId" : "ocid1.cloudexadatainfrastructure.oc1.ap-osaka-1.anvwsljrssl65iqahnam65ke3dv23mokrqqphbimcnezxukfkx7uuhda4b3a", "cpuCoreCount" : 4, "ocpuCountFractional" : 4.0, "dataStorageSizeInTBs" : 0, "dataStorageSizeInGBs" : 0, "licenseType" : "LICENSE_INCLUDED", "giVersion" : "19.19.0.0.0", "dbNodeIds" : "[ocid1.dbnode.oc1.ap-osaka-1.anvwsljrssl65iqabg3qmqnunnnxtdsbcj27cttnxjnhtk6k52twwkmy7fjq, ocid1.dbnode.oc1.ap-osaka- 1.anvwsljrssl65iqaulcowr7eqg6tsq3vgqrjtvhlt6wl3s6u4nf4d7ab4ada]", "timeZone" : "UTC" } }, "eventID" : "164fffdc-99ad-4a02-b7f3-18f770e90a33", "extensions" : { "compartmentId" : "ocid1.compartment.oc1..aaaaaaaa5lyxq3znb3vnngfmlpkdcksqw4oxe5zzg3i37iydjpezoghgmh7a" } } Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 143

Oracle and/or its affiliates | 144 Apply update: Succeeded このあと Cleanup が押せるまではしばらく待つ必要があるみたい

Oracle and/or its affiliates | 145 Databases Updating

Oracle and/or its affiliates | 146 Work requests Apply Cloud VM Cluster GI patch

Oracle and/or its affiliates | 147 Grid infrastructure version: 19.21

Grid Infrastructureの場合のCollections, Maintenance Cycle GIRU が適用され、opatch も新しくなる [grid@kara-vpvao1 ~]$ opatch
lspatches 34697081;NOT SHIPPING LIBAUTH_SDK_IAM.SO IN 23 SHIPHOME INSTALL 35638318;JDK BUNDLE PATCH 19.0.0.0.231017 35762404;OCW Interim patch for 35762404 35763448;ENFORCE V2 CHECKS ONLY FOR CLIENT CLOUD MNEMONIC QUERIES 35652062;ACFS RELEASE UPDATE 19.21.0.0.0 (35652062) 35643107;Database Release Update : 19.21.0.0.231017 (35643107) 35553096;TOMCAT RELEASE UPDATE 19.0.0.0.0 (35553096) 33575402;DBWLM RELEASE UPDATE 19.0.0.0.0 (33575402) OPatch succeeded. [grid@kara-vpvao1 ~]$ opatch version OPatch Version: 12.2.0.1.40 OPatch succeeded. Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 148

Grid Infrastructureの場合のCollections, Maintenance Cycle { "eventType" : "com.oraclecloud.databaseservice.updatecloudvmcluster.end", "cloudEventsVersion" :
"0.1", "eventTypeVersion" : "2.0", "source" : "DatabaseService", "eventTime" : "2023-11-27T06:43:04Z", "contentType" : "application/json", "data" : { "compartmentId" : "ocid1.compartment.oc1..aaaaaaaa5lyxq3znb3vnngfmlpkdcksqw4oxe5zzg3i37iydjpezoghgmh7a", "compartmentName" : "exadatacloud", "resourceName" : "VMCluster-3", "resourceId" : "ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q", "availabilityDomain" : "", "freeformTags" : { }, "definedTags" : { }, "additionalDetails" : { "timeCreated" : "2023-10-17T08:57:11Z", "timeUpdated" : "2023-11-27T06:43:04Z", "lifecycleState" : "AVAILABLE", "cloudExadataInfrastructureId" : "ocid1.cloudexadatainfrastructure.oc1.ap-osaka-1.anvwsljrssl65iqahnam65ke3dv23mokrqqphbimcnezxukfkx7uuhda4b3a", "cpuCoreCount" : 4, "ocpuCountFractional" : 4.0, "dataStorageSizeInTBs" : 0, "dataStorageSizeInGBs" : 0, "licenseType" : "LICENSE_INCLUDED", "giVersion" : "19.21.0.0.0", "dbNodeIds" : "[ocid1.dbnode.oc1.ap-osaka-1.anvwsljrssl65iqabg3qmqnunnnxtdsbcj27cttnxjnhtk6k52twwkmy7fjq, ocid1.dbnode.oc1.ap-osaka- 1.anvwsljrssl65iqaulcowr7eqg6tsq3vgqrjtvhlt6wl3s6u4nf4d7ab4ada]", "timeZone" : "UTC" } }, "eventID" : "7682efd7-2caf-4f2f-b2f8-11c94d10385f", "extensions" : { "compartmentId" : "ocid1.compartment.oc1..aaaaaaaa5lyxq3znb3vnngfmlpkdcksqw4oxe5zzg3i37iydjpezoghgmh7a" } } Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 149

Grid Infrastructureの場合のCollections, Maintenance Cycle GI も MOVE で ORACLE_HOME を移すので、/u02
以下に移った [grid@kara-vpvao1 ~]$ env | grep ORA ORACLE_SID=+ASM1 ORACLE_HOSTNAME=kara-vpvao1 ORACLE_HOME=/u02/app/19.0.0.0/grid_1 [grid@kara-vpvao1 ~]$ env | grep HOME HOME=/home/grid ORACLE_HOME=/u02/app/19.0.0.0/grid_1 [grid@kara-vpvao1 ~]$ Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 150

Grid Infrastructureの場合のCollections, Maintenance Cycle [root@kara-vpvao1 ~]# cat /etc/oratab #Backup file
is /u01/app/grid/crsdata/kara-vpvao1/output/oratab.bak.kara-vpvao1.grid line added by Agent # # This file is used by ORACLE utilities. It is created by root.sh # and updated by either Database Configuration Assistant while creating # a database or ASM Configuration Assistant while creating ASM instance. # A colon, ':', is used as the field terminator. A new line terminates # the entry. Lines beginning with a pound sign, '#', are comments. # # Entries are of the form: # $ORACLE_SID:$ORACLE_HOME:<N|Y>: # # The first and second fields are the system identifier and home # directory of the database respectively. The third field indicates # to the dbstart utility that the database should , "Y", or should not, # "N", be brought up at system boot time. # # Multiple entries with the same $ORACLE_SID are not allowed. # # DB1017_9k6_kix:/u02/app/oracle/product/19.0.0.0/dbhome_1:N DB1032_c25_kix:/u02/app/oracle/product/19.0.0.0/dbhome_3:Y DB1033_vrr_kix:/u02/app/oracle/product/19.0.0.0/dbhome_4:N DB1106_552_kix:/u02/app/oracle/product/19.0.0.0/dbhome_9:Y DB11062_sxh_kix:/u02/app/oracle/product/19.0.0.0/dbhome_8:Y +ASM1:/u02/app/19.0.0.0/grid_1:Y [root@kara-vpvao1 ~]# [root@kara-vpvao1 ~]# cat /etc/oraInst.loc inventory_loc=/u01/app/oraInventory inst_group=oinstall [root@kara-vpvao1 ~]# ls -al /etc/oraInst.loc -rw-r--r-- 1 root root 56 Oct 17 11:08 /etc/oraInst.loc [root@kara-vpvao1 ~]# Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 151

Oracle and/or its affiliates | 152 Cleanup が押せるようになった

Oracle and/or its affiliates | 153 Cleanup

Oracle and/or its affiliates | 154 In progress

Oracle and/or its affiliates | 155 Failed Action icon View logs

Oracle and/or its affiliates | 156 View Log 次ページ

Grid Infrastructureの場合のCollections, Maintenance Cycle Target: ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q, EfuJob: ocid1.fsujob.oc1.ap-osaka- 1.amaaaaaassl65iqa63f7eptfnclqbs3isu2ed4ynrgztw4qkov2xkmnv5lqq, WorkRequestId:
ocid1.fsuworkrequest.oc1.ap-osaka- 1.amaaaaaassl65iqavnemc2tlj5vndw2o7a63k552sbvu3uh5ykjxyb4jhb4q ---------------------------------------------- Starting Collection check of DB targets. Starting Cleanup workflow for action ocid1.fsuaction.oc1.ap-osaka-1.amaaaaaassl65iqaluutyc6gs4uaij5g5l5w62i3r2frcubu7di3iefjyjfq ======================JOB_EXECUTION_DETAILS_START====================== User: opc Client: cl-cet6m23q Scheduled job command: "rhpctl delete workingcopy -targetnode kara-vpvao1.sub04210756190.exavcn.oraclevcn.com -auth restauth -json -schedule 2023-11- 29T09:16:28Z -workingcopy wc_pfl09nheEeNiakfruURs86tINKxAN8eq_20231127025511 -direct -arg5 tlskeystore:/fpp/base/chkbase/scheduled/jksKeyStore- ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-442240977 -arg4 tlstruststore:/fpp/base/chkbase/scheduled/jksTrustStore-ocid1.cloudvmcluster.oc1.ap-osaka-1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q- 442240976 -arg1 restendpointfile:/fpp/base/chkbase/scheduled/restaddrfile-ocid1.cloudvmcluster.oc1.ap-osaka- 1.anvwsljrssl65iqajtlichus76533umwtu5np7uuif472s54ib2pcet6m23q-442240975" Job execution start time: 2023-11-29 09:16:48 Job execution end time: 2023-11-29 09:17:07 Current status: FAILED =======================JOB_EXECUTION_DETAILS_END======================= PRGO-1664 : The specified source working copy "wc_pfl09nheEeNiakfruURs86tINKxAN8eq_20231127025511" is a software-only working copy. ---------------------------------------------- Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 157

Grid Infrastructureの場合のCollections, Maintenance Cycle https://docs.oracle.com/cd/F19136_01/errmg/PRGO-01003.html#GUID-A3079418-4270-4F64-87BA-F7BEF572A327 PRGO-1664: 指定したソース作業⽤コピー“{0}“は、ソフトウェア専⽤の作業⽤コピーです。原因: Oracle Grid Infrastructure作業コピーを移動またはアップグレードしようとする試みは、⽰された
作業コピーがソフトウェアのみの作業コピーであったため拒否されました。処置: アクティブな、構成済みのOracle Grid Infrastructureホームをソースとして指定して、操作を再試⾏してください。 Bug : 35039868 :OPC :ADB-D: GI PRECHECK ERROR ON RHP EVAL PRGO-1664 : THE SPECIFIED SOURCE WORKING COPY GI1916 IS A SOFTWARE-ONLY WORKING COPY. bug 修正済みのようなのだが。。これ以上は不明なので諦め Exadata Fleet Update Copyright © 2024, Oracle and/or its affiliates | 158

affiliates | 163 Create Subscriptions Topic: FSU

affiliates | 164 Configure Subscription Create

affiliates | 165 Observability & Management Ø Events Service Ø Rules Create Rule

affiliates | 166 Service Name: FSU To create rules, see Creating an Events Rule. Note that you must select FSU to filter Exadata Fleet Update service events. Event Type: Table 5-3 Exadata Fleet Update Event Types が⼀覧

affiliates | 167 com.oraclecloud.fsu.create fsuaction.begin com.oraclecloud.fsu.create action.end com.oraclecloud.fsu.delete fsuaction.begin com.oraclecloud.fsu.delete action.end 等々 Table 5-3 Exadata Fleet Update Event Types 下へスクロール

affiliates | 168 Create Rule Actions Action Type: Notifications Notifications Compartment: コンパートメント名 Topic: 作成したトピック名

affiliates | 169 Event Matching Event Types

affiliates | 170 Actions Action Type: Notifications Details: Topic=FSU

affiliates | 171 Topic: FSU Subscriptions: State: Pending

affiliates | 172 Subscribe to the topic: FSU Confirm subscription

affiliates | 173 Subscription confirmed

affiliates | 174 Topic: FSU State: Active

Exadata Fleet Update

Exadata Fleet Update

More Decks by oracle4engineer

Other Decks in Technology

Featured

Transcript