Re: performance in parsing xml with Expat

[James Franz <jfranz46@xxxxxxx>]

We are already planning on processing multiple files at same time - there are 12 files
to process, one for each year - this is a large conversion coming from non-i sys in xml. 
I'm trying to understand performance reading of ifs files.
jim

--- On Mon, 8/27/12, Booth Martin <booth@xxxxxxxxxxxx> wrote:


From: Booth Martin <booth@xxxxxxxxxxxx>
Subject: Re: performance in parsing xml with Expat
To: "RPG programming on the IBM i / System i" <rpg400-l@xxxxxxxxxxxx>
Date: Monday, August 27, 2012, 7:54 PM


Off the wall:

Can you feed the records directly to a dataque and then process the 
records off the dataque?  This would allow you to have several processes 
running.  5 processes would lower run time to something on the order of 
a half hour or less?

It isn't as simple as I suggest I am sure, but it can get your time down 
to levels that you want.

On 8/27/2012 2:49 PM, James Franz wrote:
> Looking for suggestions to speed up parsing xml files with millions of records.
> Using Scott's Expat RPGLE and works great, but taking couple hours in batch per file.
> Jim Franz