|
I haven't had any problems. This is basically the IBM one. The original IBM one produced wrong results 99% of the time (ie 1.9999999 instead of 2). So I just added a half adjust and so far it's worked flawlessly for 3 years or more. Brad > -----Original Message----- > From: bmorris@ca.ibm.com [mailto:bmorris@ca.ibm.com] > Sent: Wednesday, November 29, 2000 5:25 PM > To: RPG400-L@midrange.com > Subject: RE: Character to Numeric > > > > >From: Stone, Brad V (TC) [mailto:bvstone@taylorcorp.com] > >Sent: Monday, November 27, 2000 5:32 AM > > > >I have an ILE subprocedure at www.bvstools.com in the source > downloads > >section. If not there, check the source samples at > www.netshare400.com. > > Brad, your subprocedure uses floating point to calculate the result > (the result of 10 ** DecPos is a floating point value). This > means that > every once in a while you will return a result that isn't the same > as the input value. > > A while ago I posted a subprocedure here that doesn't use > floating point, > but instead builds up a zoned(30,9) value using character processing. > > Barbara Morris > > > +--- > | This is the RPG/400 Mailing List! > | To submit a new message, send your mail to RPG400-L@midrange.com. > | To subscribe to this list send email to RPG400-L-SUB@midrange.com. > | To unsubscribe from this list send email to > RPG400-L-UNSUB@midrange.com. > | Questions should be directed to the list owner/operator: > david@midrange.com > +--- > +--- | This is the RPG/400 Mailing List! | To submit a new message, send your mail to RPG400-L@midrange.com. | To subscribe to this list send email to RPG400-L-SUB@midrange.com. | To unsubscribe from this list send email to RPG400-L-UNSUB@midrange.com. | Questions should be directed to the list owner/operator: david@midrange.com +---
As an Amazon Associate we earn from qualifying purchases.
This mailing list archive is Copyright 1997-2025 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].
Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.