× The internal search function is temporarily non-functional. The current search engine is no longer viable and we are researching alternatives.
As a stop gap measure, we are using Google's custom search engine service.
If you know of an easy to use, open source, search engine ... please contact support@midrange.com.


  1.  Home
  2. RPG400-L
  3. November 2015

Re: Losing decimal precision...

Yea, define the variable as 4p3. If you 12.3 on a calculator and divide by
100 you get .123 but you have the variable defined 1 decimal point so it
truncates off.

On Fri, Nov 6, 2015 at 2:59 PM, Robert Rogerson <rrogerson@xxxxxxxxxxx>
wrote:

Hi, how do I code this statement so num1 = .123 not .1?

D num1 s 7p 3
D num2 s 4p 1

/Free
num2 = 12.3;
num1 = num2 / 100;
/Endif


Can I do this without creating a temp variable?

D num1 s 7p 3
D num2 s 4p 1
d num3 s 4p 3

/Free
num2 = 12.3;
num3 = num2 / 100;
num1 = num3;
/Endif

Thanks, I think it's one of those Friday afternoon things....

Rob
--
This is the RPG programming on the IBM i (AS/400 and iSeries) (RPG400-L)
mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.



As an Amazon Associate we earn from qualifying purchases.

This thread ...
Replies:
Follow On AppleNews
Return to Archive home page | Return to MIDRANGE.COM home page

This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].

Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.