HP 3000 Manuals

Precision of Numbers [ HP ALLBASE/BRW Reference Manual ] MPE/iX 5.0 Documentation


HP ALLBASE/BRW Reference Manual

Precision of Numbers 

You can define the precision for any type of number on the Project Items
screen if you want the precision changed at this stage of the report.
Changing the precision of an item on the Project Items screen only
affects how the item is used outside the current table.

You can set the precision for these number types:

   *   Fixed-point Numeric (N)
   *   Integer (I)
   *   Floating-point Real (R)

You can change the numeric precision in a report at the following stages:

   *   with the result of a table calculated item, defined on the Table
       Calc Item screen

   *   when an item is projected from a table via the Project Items
       screen

   *   with the result of a layout calculated item on the Layout Calc
       Item screen

   *   when an item is used in a lineset or with the result of a column
       calculation on the Define Lines screen

   *   when an item is to be printed and is defined using
       scaling/decimals on the Item Edits screen

Note that all parts of the report performed later will use the item with
the new precision.

The number indicates the power of 10, or 10th exponent that indicates the
precision.

Valid number ranges are as follows:

           Value                       NumPrec                       Result 

--------------------------------------------------------------------------------------

1024.3849                                -2R              1024.38

864186.46                                 3C              865000.00



MPE/iX 5.0 Documentation