Re: [Re: RPGILE V4.3 Gotcha]

[Jim Langston <jlangston@xxxxxxxxxxxxxxxx>]

Well, dang, that's no good at all!  This being the case you can't do any
type of floating point math with anything resembling any accuracy.

Other languages use a fixed size for a floating point value.  Why not
just bump the size to 30,20 (or however your largest floating point
value is) and forget about it?  Or are you saying your Mantissa can
only store 30 significant digits?

This now tells me to NEVER, NEVER, NEVER do any type of
floating point math in RPG.

Regards,

Jim Langston

boldt@ca.ibm.com wrote:

> <SNIP>
> Let's look at one of your statements in detail:
>
>        EVAL(H)   DAABE(07) = RCDNC1 / 100.00 * DTITRD * DTIQNS
>                              (11,3)   (5,2)    (15,4)   (11,3)
>
> The evaluation of this expression proceeds as follows:
>
> 1) RCDNC1 / 100.0    ->   (11,3) / (5,2)     =>  (30,20)
> 2) (temp) * DTITRD   ->   (30,20) * (15,4)   =>  (45,24) => (30,9)
> 3) (temp) * DTIQNS   ->   (30,9) * (11,3)    =>  (41,12) => (30,1)
>
> As a result of applying the precision rules, you end up with a
> decimal precision of (30,1), which is what you see in the answer.
> (I'll leave it to you to work out how the other answers are computed.)

<SNIP>

+---
| This is the RPG/400 Mailing List!
| To submit a new message, send your mail to RPG400-L@midrange.com.
| To subscribe to this list send email to RPG400-L-SUB@midrange.com.
| To unsubscribe from this list send email to RPG400-L-UNSUB@midrange.com.
| Questions should be directed to the list owner/operator: david@midrange.com
+---