required by MOS for some SR Diagnostic collections accelerate SR resolution Cluster-aware ADR log inspection and management Advanced system and log monitoring Incident control and notification Connect to MOS SMTP, REST APIs Monthly releases (versioned as YY.M e.g. 24.8)
checks • 400 identified as critical/failures • Severe problem check daily: 2AM • All known problem check weekly: 3AM Sunday Auto-generates a collection when problems detected • Everything required to diagnose & resolve • Results delivered to the notification email
Run commands for all, some nodes • Cross-node configuration and file inspection • Central management for ADR • Consolidated diagnostic collection Fix Flow identifies and recommends resolution for issues • ORA-4031, ORA-7445
with Daemon installations However: • No automatic or remote diagnostics, collections • Only files visibile to the ORACLE_HOME owner • /var/log/messages • Some Grid Infrastructure logs
• A version downloaded from MOS • A version included in Grid Infrastructure install & patches The GI version is not fully featured GI and MOS versions can interfere/conflict
d in $(find / -name uninstalltfa) do cd $(dirname $d) ./tfactl uninstall # cd .. && rm -fr . done # Insure ALL AHF/TFA processes are stopped/inactive prior to uninstall # PERFORM THIS STEP ON ALL NODES
-srdc <srdc_profile> diagcollect -srdc -help <srdc_profile> can be any of the following, DBCORRUPT Required Diagnostic Data Collection for a Generic Database Corruption DBDATAGUARD Required Diagnostic Data Collection for Data Guard issues including Broker Listener_Services SRDC - Data Collection for TNS-12516 / TNS-12518 / TNS-12519 / TNS-12520. Naming_Services SRDC - Data Collection for ORA-12154 / ORA-12514 / ORA-12528. ORA-00020 SRDC for database ORA-00020 Maximum number of processes exceeded ORA-00060 SRDC for ORA-00060. Internal error code. ORA-00494 SRDC for ORA-00494. ORA-00600 SRDC for ORA-00600. Internal error code. ... ora4023 SRDC - ORA-4023 : Checklist of Evidence to Supply ora4063 SRDC - ORA-4063 : Checklist of Evidence to Supply ora445 SRDC - ORA-445 or Unable to Spawn Process: Checklist of Evidence to Supply ora600 SRDC - Required Diagnostic Data Collection for XDB ORA-00600 and ORA-07445 zlgeneric SRDC - Zero Data Loss Recovery Appliance (ZDLRA) Data Collection.
... -defips -sr <SR#> -node <all|local|n1,n2,..> -defips Include in the default collection the IPS Packages for: ASM, CRS and Databases -sr Enter SR number to which the collection will be uploaded -node Specify comma separated list of host names for collection
-last <n><m|h|d> -since -from <time> -to <time> -for <time> -last <n><m|h|d> Files from last 'n' [m]inutes, 'n' [d]ays or 'n' [h]ours -since Same as -last. Kept for backward compatibility. -from "Mon/dd/yyyy hh:mm:ss" From <time> or "yyyy-mm-dd hh:mm:ss" or "yyyy-mm-ddThh:mm:ss" or "yyyy-mm-dd" -to "Mon/dd/yyyy hh:mm:ss" To <time> or "yyyy-mm-dd hh:mm:ss" or "yyyy-mm-ddThh:mm:ss" or "yyyy-mm-dd" -for "Mon/dd/yyyy" For <date>
-nocopy -notrim -tag <tagname> -z <zipname> -collectalldirs -collectdir <dir1,dir2..> -collectfiles <file1,..,fileN,dir1,..,dirN> [-onlycollectfiles] -nocopy Does not copy back the zip files to initiating node from all nodes -notrim Does not trim the files collected -tag <tagname> The files will be collected into tagname directory inside the repository -z <zipname> The collection zip file will be given this name in the collection repo -collectalldirs Collect all files from a directory marked "Collect All” flag to true -collectdir Specify a comma separated list of directories and the collection will include all files from these irrespective of type and time constraints in addition to the components specified -collectfiles Specify a comma separated list of files/directories and the collection will include the files and directories in addition to the components specified. if -onlycollectfiles is also used, then no other components will be collected.
-mask | -sanitize tfactl set redact=mask tfactl set redact=sanitize tfactl set redact=none sanitize: Replaces sensitive data in collections with random characters mask: Replaces sensitive data in collections with asterisks (*)
and Zip all files updated in the last 1 hours as well as chmos/osw data from across the cluster and collect at the initiating node Note: This collection could be larger than required but is there as the simplest way to capture diagnostics if an issue has recently occurred. tfactl diagcollect -last 8h Trim and Zip all files updated in the last 8 hours as well as chmos/osw data from across the cluster and collect at the initiating node tfactl diagcollect -database hrdb,fdb -last 1d -z foo Trim and Zip all files from databases hrdb & fdb in the last 1 day and collect at the initiating node tfactl diagcollect -crs -os -node node1,node2 -last 6h Trim and Zip all crs files, o/s logs and chmos/osw data from node1 & node2 updated in the last 6 hours and collect at the initiating node
-node node1 -from "Mar/15/2022" -to "Mar/15/2022 21:00:00" Trim and Zip all ASM logs from node1 updated between from and to time and collect at the initiating node tfactl diagcollect -for "Mar/15/2022" Trim and Zip all log files updated on "Mar/15/2022" and collect at the collect at the initiating node tfactl diagcollect -for "Mar/15/2022 21:00:00" Trim and Zip all log files updated from 09:00 on "Mar/15/2022" to 09:00 on “Mar/16/2022"(i.e. 12 hours before and after the time given) and collect at the initiating node tfactl diagcollect -crs -collectdir /tmp_dir1,/tmp_dir2 Trim and Zip all crs files updated in the last 1 hours Also collect all files from /tmp_dir1 and /tmp_dir2 at the initiating node
DB, ASM, GI, system, OS Watcher logs/output tfactl analyze # Options: -search "pattern" # Search in DB and CRS alert logs # Sets the search period to -last 1h # Override with -last xh|xd -verbose timeline file1 file2 # Shows timeline for specified files
host : vna1 ------------------------------ Error: pstack command not found in system. If its installed, please set the PATH and try again. yum install -y gdb tfactl> pstack mmon Output from host : vna1 ------------------------------ # pstack output for pid : 15318 #0 0x00007f33bac6928a in semtimedop () from /lib64/libc.so.6 #1 0x0000000011c58285 in sskgpwwait () #2 0x0000000011c543db in skgpwwait () #3 0x000000001144ccba in ksliwat () #4 0x000000001144c06c in kslwaitctx () #5 0x0000000011a6fd40 in ksarcv () #6 0x00000000038174fa in ksbabs () #7 0x0000000003835ab3 in ksbrdp () #8 0x0000000003c19a4d in opirip () #9 0x00000000024c23e5 in opidrv ()
Drill-down into areas of interest Related metrics displayed in a single view Drag and click to zoom into specific times • All graphs remap to the new timeslice Built-in analytics and recommendations Run with: ahf analysis create --type insights
oraclesean
tatsutaka
masaruogura
cryptopeg
yutaokafuji
iwashi86
masahirokawahara
askokc
oracle4engineer
moepy_stats
junki
nrug_member
musubi
aleyda
ianozsvald
keithpitt
asonas
dougneiner
sarafernandez
csswizardry
livdayseo
eileencodes
nmsamuel
techseoconnect
![www.viscosityna.com @ViscosityNA status vs statusahf [root@node1 ~]# tfactl status .---------------------------------------------------------------------------------------------.](https://files.speakerdeck.com/presentations/862ad2543b7e469d982cc77428a4153b/slide_22.jpg){kind=link}
![www.viscosityna.com @ViscosityNA status vs statusahf [root@node1 ~]# tfactl statusahf .---------------------------------------------------------------------------------------------.](https://files.speakerdeck.com/presentations/862ad2543b7e469d982cc77428a4153b/slide_23.jpg){kind=link}
![www.viscosityna.com @ViscosityNA AHF Diagnostic Collections diagcollect [ [component1] [component2] ...](https://files.speakerdeck.com/presentations/862ad2543b7e469d982cc77428a4153b/slide_31.jpg){kind=link}
![www.viscosityna.com @ViscosityNA AHF Diagnostic Collections - components diagcollect [ [component1]](https://files.speakerdeck.com/presentations/862ad2543b7e469d982cc77428a4153b/slide_32.jpg){kind=link}
![www.viscosityna.com @ViscosityNA AHF - changes [root@node1 ~]# tfactl changes -last](https://files.speakerdeck.com/presentations/862ad2543b7e469d982cc77428a4153b/slide_44.jpg){kind=link}
![www.viscosityna.com @ViscosityNA AHF - events [root@node1 ~]# tfactl events -last](https://files.speakerdeck.com/presentations/862ad2543b7e469d982cc77428a4153b/slide_46.jpg){kind=link}
![www.viscosityna.com @ViscosityNA Questions? Contact Me! [email protected] https://linktr.ee/oraclesean](https://files.speakerdeck.com/presentations/862ad2543b7e469d982cc77428a4153b/slide_83.jpg){kind=link}
