Re: Unexpected division quotient

On 2012-07-02, at 7:43 PM, rpg400-l-request@xxxxxxxxxxxx wrote:

I should be safe because the greatest value we receive is 4 currently (and that's been true for 10 years), and at most we currently store up to 6 decimals, although to be safe (since RevDec is 2,0) I could check for a value of 13 and error it. Or I could change it to a loop, which would still be better than having to check for each possible value of RevDec (which is what it currently does today).

Why not just store the appropriate multiplier value for each value of RevDec in an array and index into it. No divide - no float ...

D revDevScale DS
D val1 5p 5 Inz(0.1)
D val2 5p 5 Inz(0.01)
....
D scale 5p 5 Overlay(revDevScale) Dim(4)

/Free

result = value * scale( ds_Inp.RevDec );

Bit more typing to create - much faster to execute I suspect.


Jon Paris

www.partner400.com
www.SystemiDeveloper.com