× The internal search function is temporarily non-functional. The current search engine is no longer viable and we are researching alternatives.
As a stop gap measure, we are using Google's custom search engine service.
If you know of an easy to use, open source, search engine ... please contact support@midrange.com.


  1.  Home
  2. RPG400-L
  3. September 2005

Re: Calculation Truncation Problem

Richard,
Please read the "Precision Rules for Numeric Operations" topic in the ILE RPG Reference manual for your release and tell us if you still have a question.
In your case, I'm guessing that the natural precision of the result of your expression is more than 31 digits. 


On Wed, 14 Sep 2005, Weber, Richard wrote:


I'm having trouble with the following line of code:

Sum_x_PJS = SumOProjD * P1_PjSlsDol;

Where the input variables are:

P1_PJSLSDOL = 0000000000000.01
SUMOPROJD = 0000000000000.0005

When step through the program the result of this is SUM_X_PJS =
0000000000000.0000000.   Of course the result should be .00005.  So, what's
going on?  I have the receiving variable SUMOPROJD small enough to hold the
result, 7 below the decimal.  What am I missing?

As an Amazon Associate we earn from qualifying purchases.

This thread ...
Replies:
Follow On AppleNews
Return to Archive home page | Return to MIDRANGE.COM home page

This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].

Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.