|
Suppose you entered the following calculation (not likely to happen, but
exaggeration for the point of emphasis, right.)
999999999999999999999999999999.999999999999999999999999999999 /
999999999999999999999999999999.999999999999999999999999999998
(30 digits and 30 decimal places) divided by (30 digits and
30 decimal places)
The value would be converted to a character string that is 60 digits long
divided by a 60 digit number. Clearly the answer is approx. 1, but
because the fields are longer than the maximum number of digits allowed in
a numerical field, how would you programmable divide this value. You
would have to break it up some how.
For a SLOW method, you could call a REXX procedure. REXX can do
arbitrary-precision arithmetic. I think Java has some such capability too,
with special classes for it. Other than that, find a book on algorithms, I
guess.
Ken Rokos
As an Amazon Associate we earn from qualifying purchases.
This mailing list archive is Copyright 1997-2025 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].
Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.