Re: XML performance issue

It generally takes a lot more time to parse and consume XML than to
generate. Is your generation / send process somehow synchronized with the
parse / consume process?

-Nathan



________________________________
From: Åke Olsson <ake.olsson@xxxxxx>
To: "rpg400-l@xxxxxxxxxxxx" <rpg400-l@xxxxxxxxxxxx>
Sent: Friday, September 14, 2012 5:45 AM
Subject: XML performance issue

We are about to roll out an integration to a remote system where XML is
the decided way to go. We create messages with all the information for one
product and send via MQ.

We have the process in place messages are created, syntactically correct
and sent.

That would seem all right would it not?

Not quite. It is all going pretty slow.

Some metrics:

Each XML message is from 15Kto 30K characters in length. Characters not
bytes - since the messages are in UTF-16 (CCSID-1200) the message length in
bytes is double that.

Generating and sending messages for 64K products took just over 6 and half
hours. This to me seems like a lot.

I have tried using blocked SQL fetch to speed up the reading of all the
involved files - no significant change.
All possible indexes have been applied.

As for the XML message creation this is done by regular string handling,
building the MQ message step by step. I have a hard time finding anything
horribly wrong there either.

Question: Is there any high performance tool out there that could
significantly speed up the generation of XML?


Med vänlig hälsning / Best regards

Åke H Olsson
[Description: cid:image001.png@01CA1FE6.387A03A0]
Box 433 SE 551 16 Jönköping Sweden visit: Brunnsgatan 11
phone: +46 (0)36 342976 mobile: +46 (0)705 482976 fax: +46 (0)36 34 29
29
ake.olsson@xxxxxx<mailto:ake.olsson@xxxxxx> www.pdb.se


--
This is the RPG programming on the IBM i / System i (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.
--
This is the RPG programming on the IBM i / System i (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.