Re: Processing XML that has emojis - any pointers?

Nathan

At this time we want it not to blow up - I think we get a message about invalid XML.

This is information from work done in the field and is stuff like what a service person found. The field personnel use iPhones now, and they are able to enter all this stuff.

We don't need the emojis on the IBM i - we reprint the invoices as spooled files and send out perhaps printing to paper or as PDFs converted from the spooled files.

As I say, the first step is to be able to have the data come in __at all__, then we can figure out what we want to do - as you suggest, maybe strip it out, maybe store it for a data warehouse/business intel side of things to print to browser, etc.

Thanks
Vern

On 2/13/2017 4:35 PM, Nathan Andelin wrote:

Vern, you didn't way what you want to do with the XML, nor the emojis (i.e.
store it in a database, render it in a browser, parse and strip-out the
emojis).


On Mon, Feb 13, 2017 at 3:29 PM, Vernon Hamberg <vhamberg@xxxxxxxxxxxxxxx>
wrote:

A little more on what the code is - here is what I believe is processing
the nodes in question -

when event = *XML_UCS2_REF
or event = *XML_ATTR_UCS2_REF;
stackval(depth) += %char(%subst( ucs2val : 1
: %div(stringLen:2) ));

UCS2VAL is declared as a data type C, that's all.

We are at 7.1 of the OS, so I think we do not have the newer support for
CCSIDs and all.

How about changing UCS2VAL to and H type? Then do whatever we need to do
with it?

Or have a table with a column that is UTF-8? And pull into the variable
association with that? Am I being crazy?

Regards
Vern


On 2/13/2017 3:29 PM, Vernon Hamberg wrote:

Y'all

We have data coming in that MIGHT contain emojis - not sure if we can
have a corporate rule to say don't do that, but it still might.

We are using XML-SAX to process the XML - it works fine - until someone
puts an emoji to send the customer a bouquet or a nice face.

I've suggested the source app put the text in a CDATA block - does this
look as if it should work?

If not, other suggestions are welcome.

Emojjs appear to have their own block in Unicode - the one's I saw
appeared to be 4-byte sequences - but I see there can be several lengths,
as, IIRC, UTF-8 can have.

I've wondered about using a 1208-CCSID variable to pull in the data - I'm
trying to find where the source code is hiding right now!

Help much appreciated!

Vern

--
This is the RPG programming on the IBM i (AS/400 and iSeries) (RPG400-L)
mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.

Please contact support@xxxxxxxxxxxx for any subscription related
questions.

Help support midrange.com by shopping at amazon.com with our affiliate
link: http://amzn.to/2dEadiD