×
The internal search function is temporarily non-functional. The current search engine is no longer viable and we are researching alternatives.
As a stop gap measure, we are using Google's custom search engine service.
If you know of an easy to use, open source, search engine ... please contact support@midrange.com.
24 bits is the precision of the significand. The remaining 8 bits are the exponent. See
http://en.wikipedia.org/wiki/Floating_point. This is IEEE standard floating point behavior.
-----Original Message-----
From: java400-l-bounces@xxxxxxxxxxxx [mailto:java400-l-bounces@xxxxxxxxxxxx] On Behalf Of James H. H. Lampert
Sent: Wednesday, March 20, 2013 6:12 PM
To: Java Programming on and around the IBM i
Subject: Some weird numbers coming from resultSetMetaData.getPrecision
I just noticed this today:
It seems that for a field defined as single-precision floating point (4-byte floating point, real*4), resultSetMetaData returns 13 for
getColumnDisplaySize() (reasonable, except that it doesn't allow for a sign), and 24 for getPrecision().
Any clue as to where it's getting 24 for getPrecision?
--
JHHL
--
This is the Java Programming on and around the IBM i (JAVA400-L) mailing list To post a message email: JAVA400-L@xxxxxxxxxxxx To subscribe, unsubscribe, or change list options,
visit:
http://lists.midrange.com/mailman/listinfo/java400-l
or email: JAVA400-L-request@xxxxxxxxxxxx Before posting, please take a moment to review the archives at
http://archive.midrange.com/java400-l.
midrange.com
