Re: XML performance issue

[Henrik Rützou <hr@xxxxxxxxxxxx>]

I made a little test

I can generate 1 mio XML elements in storage (total 90MB saved in CCSID
1200) in 23 seconds.

It takes about 2 seconds to save it to IFS

On Fri, Sep 14, 2012 at 3:46 PM, Nathan Andelin <nandelin@xxxxxxxxx> wrote:

> It generally takes a lot more time to parse and consume XML than to
> generate. Is your generation / send process somehow synchronized with the
> parse / consume process?
>
> -Nathan
>
>
>
> ________________________________
>  From: Åke Olsson <ake.olsson@xxxxxx>
> To: "rpg400-l@xxxxxxxxxxxx" <rpg400-l@xxxxxxxxxxxx>
> Sent: Friday, September 14, 2012 5:45 AM
> Subject: XML performance issue
>
> We are about to roll out an integration to a remote system where XML is
> the decided way to go. We create messages with all the information for one
> product and send via MQ.
>
> We have the process in place messages are created, syntactically correct
> and sent.
>
> That would seem all right would it not?
>
> Not quite. It is all going pretty slow.
>
> Some metrics:
>
> Each XML message is from 15Kto 30K characters in length. Characters not
> bytes - since the messages are in UTF-16 (CCSID-1200) the message length in
> bytes is double that.
>
> Generating and sending messages for 64K products took just over 6 and half
> hours. This to me seems like a lot.
>
> I have tried using blocked SQL fetch to speed up the reading of all the
> involved files - no  significant change.
> All possible indexes have been applied.
>
> As for the XML message creation this is done by regular string handling,
> building the MQ message step by step. I have a hard time finding anything
> horribly wrong there either.
>
> Question: Is there any high performance tool out there that could
> significantly speed up the generation of XML?
>
>
> Med vänlig hälsning / Best regards
>
> Åke H Olsson
> [Description: cid:image001.png@01CA1FE6.387A03A0]
> Box 433   SE 551 16  Jönköping   Sweden   visit: Brunnsgatan 11
> phone: +46 (0)36 342976   mobile: +46 (0)705 482976 fax: +46 (0)36 34 29
> 29
> ake.olsson@xxxxxx<mailto:ake.olsson@xxxxxx>    www.pdb.se
>
>
> --
> This is the RPG programming on the IBM i / System i (RPG400-L) mailing list
> To post a message email: RPG400-L@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
> or email: RPG400-L-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/rpg400-l.
> --
> This is the RPG programming on the IBM i / System i (RPG400-L) mailing list
> To post a message email: RPG400-L@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
> or email: RPG400-L-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/rpg400-l.