Cisco MCS-7825-H3-IPC1 Service Guide - Page 115

Chapter 3 Managing and Monitoring the Health of Cisco Unified Communications Manager Systems RTMT Monitoring of Cisco Unified CM System Health When a service crashes, the corresponding trace files may have been overwritten. Cisco TAC needs the trace files to troubleshoot the crash. In the case of CoreDumpFileFound, CodeYellow, and CriticalServiceDown, the Enable Trace Download option should be enabled to assist Cisco TAC. % IOwait Monitoring High %IOwait indicates high disk input/output (I/O) activities. Consider the following high IOwait conditions: • Heavy memory swapping-Check %CPU Time for Swap Partition to see if there is high level of memory swapping activity. One potential cause of high memory swapping is memory leak. • DB activity-Database accesses Active Partition. If %CPU Time for Active Partition is high, then most likely there are a lot of DB activities. • Common (or Log) Partition in the trace and log files storage location-Check the following: - Trace Log Center to see if there is any trace collection activity going on. If call processing is impacted (ie, CodeYellow), then consider adjusting trace collection schedule. If zip option is used, please turning it off. - Trace setting at the detailed level because Cisco Unified CM generates a lot of trace. If high %iowait and/or Cisco Unified CM is in CodeYellow state, and Cisco Unified CM service trace setting is at Detailed, please chance trace setting to "Error" to reduce the trace writing. You can use RTMT to identify processes that are responsible for high %IOwait: • If %IOwait is high enough to cause CPUPegging alert, check the alert message to check processes waiting for disk IO. • Go to RTMT Process page, sort by Status. Check for processes in Uninterruptible Disk Sleep state • Download RIS Data Collector PerfMonLog file to examine the process status for longer period of time. Figure 3-4 shows an example of RTMT Process window sorted by Status. Check for processes in Uninterruptible Disk Sleep state. The FTP process is in the Uninterruptible Disk Sleep state. Figure 3-4 FTP Process in Uninterruptible Disk Sleep State OL-22523-01 Cisco Unified Communications Manager Managed Services Guide 3-15