Re: Processing XML that has emojis - any pointers?

In regards to invalid XML, what generates that? I would think that iPhones
transform emoji into valid character data before posting it to a server -
that a server process handles it before generating XML. If the character
data is invalid, shouldn't it be fixed in the process that generates it,
rather than the process that receives it?

The following example shows a couple character sequences that display
smiley faces in browsers:

http://www.w3schools.com/charsets/tryit.asp?deci=9786

Wouldn't it be a matter of a process monitoring for such character steams,
received from say iPhones?



On Mon, Feb 13, 2017 at 4:16 PM, Vernon Hamberg <vhamberg@xxxxxxxxxxxxxxx>
wrote:

Nathan

At this time we want it not to blow up - I think we get a message about
invalid XML.

This is information from work done in the field and is stuff like what a
service person found. The field personnel use iPhones now, and they are
able to enter all this stuff.

We don't need the emojis on the IBM i - we reprint the invoices as spooled
files and send out perhaps printing to paper or as PDFs converted from the
spooled files.

As I say, the first step is to be able to have the data come in __at
all__, then we can figure out what we want to do - as you suggest, maybe
strip it out, maybe store it for a data warehouse/business intel side of
things to print to browser, etc.

Thanks
Vern


On 2/13/2017 4:35 PM, Nathan Andelin wrote:

Vern, you didn't way what you want to do with the XML, nor the emojis
(i.e.
store it in a database, render it in a browser, parse and strip-out the
emojis).


On Mon, Feb 13, 2017 at 3:29 PM, Vernon Hamberg <vhamberg@xxxxxxxxxxxxxxx

wrote:

A little more on what the code is - here is what I believe is processing

the nodes in question -

when event = *XML_UCS2_REF
or event = *XML_ATTR_UCS2_REF;
stackval(depth) += %char(%subst( ucs2val : 1
: %div(stringLen:2) ));

UCS2VAL is declared as a data type C, that's all.

We are at 7.1 of the OS, so I think we do not have the newer support for
CCSIDs and all.

How about changing UCS2VAL to and H type? Then do whatever we need to do
with it?

Or have a table with a column that is UTF-8? And pull into the variable
association with that? Am I being crazy?

Regards
Vern


On 2/13/2017 3:29 PM, Vernon Hamberg wrote:

Y'all

We have data coming in that MIGHT contain emojis - not sure if we can
have a corporate rule to say don't do that, but it still might.

We are using XML-SAX to process the XML - it works fine - until someone
puts an emoji to send the customer a bouquet or a nice face.

I've suggested the source app put the text in a CDATA block - does this
look as if it should work?

If not, other suggestions are welcome.

Emojjs appear to have their own block in Unicode - the one's I saw
appeared to be 4-byte sequences - but I see there can be several
lengths,
as, IIRC, UTF-8 can have.

I've wondered about using a 1208-CCSID variable to pull in the data -
I'm
trying to find where the source code is hiding right now!

Help much appreciated!

Vern

--

This is the RPG programming on the IBM i (AS/400 and iSeries) (RPG400-L)
mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.

Please contact support@xxxxxxxxxxxx for any subscription related
questions.

Help support midrange.com by shopping at amazon.com with our affiliate
link: http://amzn.to/2dEadiD

--
This is the RPG programming on the IBM i (AS/400 and iSeries) (RPG400-L)
mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.

Please contact support@xxxxxxxxxxxx for any subscription related
questions.

Help support midrange.com by shopping at amazon.com with our affiliate
link: http://amzn.to/2dEadiD