Managing Data Effectively [ HP RXForecast Users Manual for MPE Systems ] MPE/iX 5.0 Documentation
HP RXForecast Users Manual for MPE Systems
Managing Data Effectively
Forecasting is a technique that predicts the future based on past trends.
The more information you have about the past, the better your chance of
accurately predicting the future.
HP RXForecast relies on the HP LaserRX/MPE SCOPE collector to provide the
data on which to forecast. By collecting system information for a long
time, you can more accurately recognize trends and predict system
resource requirements.
You can use the HP LaserRX/MPE EXTRACT program to build logfiles that are
optimal for HP RXForecast use. EXTRACT lets you extract data from either
raw logfiles (specifying the LOGGLOB file) or from previously extracted
logfiles. For HP RXForecast, you would use both of these features to
create ideal logfiles. For information about how to use EXTRACT, see the
HP LaserRX/MPE User's Manual: Collection Software.
For example, suppose you size all SCOPE logfiles to hold 40 days of data.
This provides a normal month of data and 10 days of additional space if
needed. Monthly, you use EXTRACT to create an extracted logfile with all
data, including global summaries and detail, application summaries and
detail, and process detail. You could name this file using a naming
convention of systemyymm. Thus, if the system name were MOE and the data
pertains to January 1989, the filename would be MOE8901.
NOTE If you upgrade your system, you should not extract logfiles to the
same system name. If you do, you will get misleading information
about the system.
Then, from the extracted file you have created, you would extract only
global and application summaries and append this data to the yearly
summary file (called, in this example, MOE1989) for the same system. You
would archive each monthly file to tape when the new monthly extract is
completed, but keep the yearly file on line for forecasting and long-term
analysis. Even after you create yearly files, you can use EXTRACT to
append them together to build a file that contains several years of data.
As needed, you can restore the monthly files from tape and extract other
sets of data, or just use the detail information for in-depth analysis.
It is imperative that you extract all data (summaries and detail) to the
monthly logfiles. You cannot get data from a logfile on a subsequent
extraction that is not included in the original extraction. If you
extract only summaries from a logfile, you cannot get detail data on it
later. You cannot recreate detail data from summaries.
And remember, you do not have to stop the SCOPE collector to run EXTRACT
on a logfile, even a logfile that is currently being used by the SCOPE
collector.
Tip We strongly recommend that you forecast from extracted logfiles
(hourly summaries), rather than from raw logfiles (5-minute
summaries). Forecasts from raw logfiles are needlessly
time-consuming. Also, there are unusual instances in which the raw
logfiles will give you a different forecast than one based on an
extracted logfile.
Maintaining Forecast Logfiles
It is recommended that you continually maintain both global and
application logfiles for forecasting. Ideally, you will keep up to 3
years of data from which to forecast. That much data could become
prohibitively large unless you maintain separate global and application
logfiles.
You can use the EXTRACT program to extract global and application data
every month and append these monthly logfiles to your ongoing global and
application forecast logfiles.
Furthermore, you can use this "extract and append" technique to eliminate
unusual or irrelevant data from your forecast logfiles. Such data would
be any data from a time period that you consider atypical for your
system, such as holidays.
For instance, you may want to forecast from data spanning October through
January. You know, however, that this period was marked by several
holidays during which your company experienced little activity. Any
forecast you make from all of the data is not likely to be valid. But
you don't want to ignore all of the data just because some of it is
unusual.
The solution is to extract and append. That is, you create extracted
logfiles that exclude unusual activity and append them together for
forecasting. In our example, you would extract a logfile up to the
Thanksgiving holiday (November 22 and 23, 1990). You would append this
logfile to your ongoing forecast logfile. Then you would extract and
append data from the beginning of December up to the Christmas and New
Year holidays.
The forecast will be based only on those data points included in the
logfile, so the graph will contain blank spaces for the periods of
activity you eliminated. Note that zeros are NOT substituted for the
missing data, as this would skew the forecast. Instead, in creating the
forecast, HP RXForecast just disregards the dates you've excluded.
By maintaining global and application logfiles of data typical of your
system, you can use HP RXForecast effectively to forecast system resource
utilization.
MPE/iX 5.0 Documentation