× The internal search function is temporarily non-functional. The current search engine is no longer viable and we are researching alternatives.
As a stop gap measure, we are using Google's custom search engine service.
If you know of an easy to use, open source, search engine ... please contact support@midrange.com.



I suspect the reason Dennis was using atof() is because it'll read the number up til it finds a non-numeric character, and return the numeric portion.

By contrast, %DEC will simply back an exception, and return nothing when it encounters non-numeric data. So you have to add code to find the non-numeric data, and strip out only the part you want. In that way, atof() is simpler.

But I agree with you about the precision problems with floatin point -- this is why I didn't use it in my version.

On 9/12/2012 2:59 PM, Barbara Morris wrote:

Don't use atof; it returns a float result which might lose some
accuracy, especially if you forget to use EVAL(H).

Use %DECH instead; it returns a decimal result with no loss of accuracy.

result = %DECH(p : 63: 31);


As an Amazon Associate we earn from qualifying purchases.

This thread ...

Follow-Ups:
Replies:

Follow On AppleNews
Return to Archive home page | Return to MIDRANGE.COM home page

This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].

Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.