Re: Calculation gives wrong result -- RPG400-L

× The internal search function is temporarily non-functional. The current search engine is no longer viable and we are researching alternatives.
As a stop gap measure, we are using Google's custom search engine service.
If you know of an easy to use, open source, search engine ... please contact support@midrange.com.

Subject: Re: Calculation gives wrong result
From: Justin Taylor <jtaylor.0ab@xxxxxxxxx>
Date: Tue, 30 Aug 2022 13:02:38 -0500
List-archive: <https://archive.midrange.com/rpg400-l/>
List-post: <mailto:rpg400-l@lists.midrange.com>
List-subscribe: <https://lists.midrange.com/mailman/listinfo/rpg400-l>, <mailto:rpg400-l-request@lists.midrange.com?subject=subscribe>
List-unsubscribe: <https://lists.midrange.com/mailman/options/rpg400-l>, <mailto:rpg400-l-request@lists.midrange.com?subject=unsubscribe>

Here's the page I was looking at:
Precision of Intermediate Results
https://www.ibm.com/docs/en/i/7.3?topic=operations-precision-intermediate-results#prectdf

date: Tue, 30 Aug 2022 08:46:13 +1000

from: Don Brown via RPG400-L <rpg400-l@xxxxxxxxxxxxxxxxxx>
subject: Re: Calculation gives wrong result

Hi Jon

Just curious for the intermediate calculation what precision is used ?
(Not that it would make much difference unless zero decimal places)

Cheers

Don

As an Amazon Associate we earn from qualifying purchases.

Follow-Ups:

AW: Calculation gives wrong result , myibmi

This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].

Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.