× The internal search function is temporarily non-functional. The current search engine is no longer viable and we are researching alternatives.
As a stop gap measure, we are using Google's custom search engine service.
If you know of an easy to use, open source, search engine ... please contact support@midrange.com.



24 bits is the precision of the significand. The remaining 8 bits are the exponent. See http://en.wikipedia.org/wiki/Floating_point. This is IEEE standard floating point behavior.

-----Original Message-----
From: java400-l-bounces@xxxxxxxxxxxx [mailto:java400-l-bounces@xxxxxxxxxxxx] On Behalf Of James H. H. Lampert
Sent: Wednesday, March 20, 2013 6:12 PM
To: Java Programming on and around the IBM i
Subject: Some weird numbers coming from resultSetMetaData.getPrecision

I just noticed this today:

It seems that for a field defined as single-precision floating point (4-byte floating point, real*4), resultSetMetaData returns 13 for
getColumnDisplaySize() (reasonable, except that it doesn't allow for a sign), and 24 for getPrecision().

Any clue as to where it's getting 24 for getPrecision?

--
JHHL
--
This is the Java Programming on and around the IBM i (JAVA400-L) mailing list To post a message email: JAVA400-L@xxxxxxxxxxxx To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/java400-l
or email: JAVA400-L-request@xxxxxxxxxxxx Before posting, please take a moment to review the archives at http://archive.midrange.com/java400-l.




As an Amazon Associate we earn from qualifying purchases.

This thread ...

Replies:

Follow On AppleNews
Return to Archive home page | Return to MIDRANGE.COM home page

This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].

Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.