Re: Process a file with DBCS data

First of all you need to understand that there is usually a _reason_ for DBCS data - it is because it won’t map to a conventional 8 bit character. The Shift-in x’0E’ and shift-out characters x’0F’ represent the beginning and end of a double-byte sequence. In your case that appears to be the whole field.

It has been a very long time since I did any DBCS work but this article seems to have it about right http://www.itjungle.com/fhg/fhg081909-story01.html.

It is possible that while your data is in two byte form, only characters that can be represented in SBCS form are present. If that is the case then conversion should not be an issue. If that is not the case then you have to decide what to do about the characters that cannot be mapped.

I’m not sure though why you think you need to do this as DBCS data can be handled by SQL and the clean up routine that Michael showed in the article above would work to clean up any unmatched SI/SO pairs - which does happen.


Jon Paris

www.partner400.com
www.SystemiDeveloper.com

On Jun 6, 2016, at 3:07 PM, IBMiSoftwareEngineer <ibmisoftwareengineer@xxxxxxxxx> wrote:

I have been provided a file/table from a customer that appears to contain
DBCS data in a few of the fields/columns. The data in the columns begins
with x'0E' and end with x'0F' and the CCSID is 937.

Can I convert the data to CCSID 37 and to our normal SBCS data that we can
use in an RPG program and also SQL SELECT statements? Any examples or
links to helpful info would be greatly appreciated. My googling has not
resulted in a working solution.

I have attempted to use the QtqIconvOpen, iconv, and iconv_close API's to
convert from CCSID 937 to 37 but the data is still not readable. My thought
is I also need to convert it from DBCS to SBCS.

Thanks in advance for any assistance or direction.
--
This is the RPG programming on the IBM i (AS/400 and iSeries) (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.

Please contact support@xxxxxxxxxxxx for any subscription related questions.