|
Floating point precision doesn't' really become a program until you get to rather large or rather small values. I am not sure what range of precision the AS/400 gives, but I remember checking it out on PCs and it was quite impressive (something like 15 decimal places with long float, 30 places total counting the integer part). Regards, Jim Langston Alan Campin wrote: > Wouldn't you have problems with floating point precision? Floating point is > an approximation of the number from what I understand. That approximation > may or may not be converted correctly. > > Also, in his example, he indicated something like "123,". How would atof > handle something like that. > > -----Original Message----- > From: Ravi Raghu [mailto:rraghu@RCCL.COM] > Sent: Friday, November 05, 1999 11:02 AM > To: 'RPG400-L@midrange.com' > Subject: Re: Challenge > > Hi, > Check ,this works > > H Bnddir('QC2LE') DftActGrp(*NO) > d atof PR 8f Extproc('atof') > d char 30 CONST > > dCharValue s 30 INZ('12345.678 ') > d Float s 8f INZ > > dPacked s 10p 5 INZ > c Eval Float = atof(CharValue) > c Eval Packed = Float > c Eval *INLR = *ON > > Regards, > Ravi Raghu > 305-982-2456 > > Lurton Keel <Lurton.Keel@serx.com> on 11/05/99 11:01:55 AM > > Please respond to RPG400-L@midrange.com > > To: "'RPG400-L@midrange.com'" <RPG400-L@midrange.com> > cc: (bcc: Ravi Raghu/IT/MIA/RCL) > > Subject: Challenge > > I have a little RPG challenge. > I get an 8 character string that has a number that may or may not have a > decimal position. > Examples: 12345.78 or 123 or 1.23456, etc. > I need to convert this to a number (10,5). > The way it was done in RPG prior was to move to an array and scan for the > decimal, do a bunch of move, movels. > > Is there a more elegant way to do this in ILE? > > +--- > | This is the RPG/400 Mailing List! > | To submit a new message, send your mail to RPG400-L@midrange.com. > | To subscribe to this list send email to RPG400-L-SUB@midrange.com. > | To unsubscribe from this list send email to RPG400-L-UNSUB@midrange.com. > | Questions should be directed to the list owner/operator: > david@midrange.com > +--- > > +--- > | This is the RPG/400 Mailing List! > | To submit a new message, send your mail to RPG400-L@midrange.com. > | To subscribe to this list send email to RPG400-L-SUB@midrange.com. > | To unsubscribe from this list send email to RPG400-L-UNSUB@midrange.com. > | Questions should be directed to the list owner/operator: > david@midrange.com > +--- > +--- > | This is the RPG/400 Mailing List! > | To submit a new message, send your mail to RPG400-L@midrange.com. > | To subscribe to this list send email to RPG400-L-SUB@midrange.com. > | To unsubscribe from this list send email to RPG400-L-UNSUB@midrange.com. > | Questions should be directed to the list owner/operator: david@midrange.com > +--- +--- | This is the RPG/400 Mailing List! | To submit a new message, send your mail to RPG400-L@midrange.com. | To subscribe to this list send email to RPG400-L-SUB@midrange.com. | To unsubscribe from this list send email to RPG400-L-UNSUB@midrange.com. | Questions should be directed to the list owner/operator: david@midrange.com +---
As an Amazon Associate we earn from qualifying purchases.
This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].
Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.