Product SiteDocumentation Site

  • pcp-users-and-administrators-guide

Performance Co-Pilot™ User's and Administrator's Guide

Edition 3

Maintained by 
The Performance Co-Pilot Development Team

Legal Notice


Permission is granted to copy, distribute, and/or modify this document under the terms of the Creative Commons Attribution-Share Alike, Version 3.0 or any later version published by the Creative Commons Corp. A copy of the license is available at

Legal Notice


Silicon Graphics, SGI and the SGI logo are registered trademarks and Performance Co-Pilot is a trademark of Silicon Graphics, Inc.
Red Hat and the Shadowman logo are trademarks of Red Hat, Inc., registered in the United States and other countries.
Cisco is a trademark of Cisco Systems, Inc. Linux is a registered trademark of Linus Torvalds, used with permission. UNIX is a registered trademark of The Open Group.

Table of Contents

About This Guide
1. What This Guide Contains
2. Audience for This Guide
3. Related Resources
4. Man Pages
5. Web Site
6. Conventions
7. Reader Comments
1. Introduction to PCP
1.1. Objectives
1.1.1. PCP Target Usage
1.1.2. Empowering the PCP User
1.1.3. Unification of Performance Metric Domains
1.1.4. Uniform Naming and Access to Performance Metrics
1.1.5. PCP Distributed Operation
1.1.6. Dynamic Adaptation to Change
1.1.7. Logging and Retrospective Analysis
1.1.8. Automated Operational Support
1.1.9. PCP Extensibility
1.1.10. Metric Coverage
1.2. Conceptual Foundations
1.2.1. Performance Metrics
1.2.2. Performance Metric Instances
1.2.3. Current Metric Context
1.2.4. Sources of Performance Metrics and Their Domains
1.2.5. Distributed Collection
1.2.6. Performance Metrics Name Space
1.2.7. Descriptions for Performance Metrics
1.2.8. Values for Performance Metrics
1.2.9. Collector and Monitor Roles
1.2.10. Retrospective Sources of Performance Metrics
1.2.11. Product Extensibility
1.3. Overview of Component Software
1.3.1. Performance Monitoring and Visualization
1.3.2. Collecting, Transporting, and Archiving Performance Information
1.3.3. Operational and Infrastructure Support
1.3.4. Application and Agent Development
2. Installing and Configuring Performance Co-Pilot
2.1. Product Structure
2.2. Performance Metrics Collection Daemon (PMCD)
2.2.1. Starting and Stopping the PMCD
2.2.2. Restarting an Unresponsive PMCD
2.2.3. PMCD Diagnostics and Error Messages
2.2.4. PMCD Options and Configuration Files
2.3. Managing Optional PMDAs
2.3.1. PMDA Installation on a PCP Collector Host
2.3.2. PMDA Removal on a PCP Collector Host
2.4. Troubleshooting
2.4.1. Performance Metrics Name Space
2.4.2. Missing and Incomplete Values for Performance Metrics
2.4.3. Kernel Metrics and the PMCD
3. Common Conventions and Arguments
3.1. Alternate Metrics Source Options
3.1.1. Fetching Metrics from Another Host
3.1.2. Fetching Metrics from an Archive Log
3.2. General PCP Tool Options
3.2.1. Common Directories and File Locations
3.2.2. Alternate Performance Metric Name Spaces
3.3. Time Duration and Control
3.3.1. Performance Monitor Reporting Frequency and Duration
3.3.2. Time Window Options
3.3.3. Timezone Options
3.4. PCP Environment Variables
3.5. Running PCP Tools through a Firewall
3.5.1. The pmproxy service
3.6. Transient Problems with Performance Metric Values
3.6.1. Performance Metric Wraparound
3.6.2. Time Dilation and Time Skew
4. Monitoring System Performance
4.1. The pmstat Command
4.2. The pmrep Command
4.3. The pmval Command
4.4. The pminfo Command
4.5. The pmstore Command
5. Performance Metrics Inference Engine
5.1. Introduction to pmie
5.2. Basic pmie Usage
5.2.1. pmie use of PCP services
5.2.2. Simple pmie Usage
5.2.3. Complex pmie Examples
5.3. Specification Language for pmie
5.3.1. Basic pmie Syntax
5.3.2. Setting Evaluation Frequency
5.3.3. pmie Metric Expressions
5.3.4. pmie Rate Conversion
5.3.5. pmie Arithmetic Expressions
5.3.6. pmie Logical Expressions
5.3.7. pmie Rule Expressions
5.3.8. pmie Intrinsic Operators
5.4. pmie Examples
5.5. Developing and Debugging pmie Rules
5.6. Caveats and Notes on pmie
5.6.1. Performance Metrics Wraparound
5.6.2. pmie Sample Intervals
5.6.3. pmie Instance Names
5.6.4. pmie Error Detection
5.7. Creating pmie Rules with pmieconf
5.8. Management of pmie Processes
5.8.1. Add a pmie crontab Entry
5.8.2. Global Files and Directories
5.8.3. pmie Instances and Their Progress
6. Archive Logging
6.1. Introduction to Archive Logging
6.1.1. Archive Logs and the PMAPI
6.1.2. Retrospective Analysis Using Archive Logs
6.1.3. Using Archive Logs for Capacity Planning
6.2. Using Archive Logs with Performance Tools
6.2.1. Coordination between pmlogger and PCP tools
6.2.2. Administering PCP Archive Logs Using cron Scripts
6.2.3. Archive Log File Management
6.3. Cookbook for Archive Logging
6.3.1. Primary Logger
6.3.2. Other Logger Configurations
6.3.3. Archive Log Administration
6.4. Other Archive Logging Features and Services
6.4.1. PCP Archive Folios
6.4.2. Manipulating Archive Logs with pmlogextract
6.4.3. Summarizing Archive Logs with pmlogsummary
6.4.4. Primary Logger
6.4.5. Using pmlc
6.5. Archive Logging Troubleshooting
6.5.1. pmlogger Cannot Write Log
6.5.2. Cannot Find Log
6.5.3. Primary pmlogger Cannot Start
6.5.4. Identifying an Active pmlogger Process
6.5.5. Illegal Label Record
6.5.6. Empty Archive Log Files or pmlogger Exits Immediately
7. Performance Co-Pilot Deployment Strategies
7.1. Basic Deployment
7.2. PCP Collector Deployment
7.2.1. Principal Server Deployment
7.2.2. Quality of Service Measurement
7.3. PCP Archive Logger Deployment
7.3.1. Deployment Options
7.3.2. Resource Demands for the Deployment Options
7.3.3. Operational Management
7.3.4. Exporting PCP Archive Logs
7.4. PCP Inference Engine Deployment
7.4.1. Deployment Options
7.4.2. Resource Demands for the Deployment Options
7.4.3. Operational Management
8. Customizing and Extending PCP Services
8.1. PMDA Customization
8.1.1. Customizing the Summary PMDA
8.2. PCP Tool Customization
8.2.1. Archive Logging Customization
8.2.2. Inference Engine Customization
8.3. PMNS Management
8.3.1. PMNS Processing Framework
8.3.2. PMNS Syntax
8.4. PMDA Development
8.5. PCP Tool Development
A. Acronyms