Re: Suggestion for improving loop performance

What is the object of this exercise? Are you trying to tokenize a delimited
file and update a table?

By tokenize I mean abc,123,444 becomes
token 1 = agc
token 2 = 123
token 3 = 444

If yes, as part of my standard string functions service program is a set of
procedures that tokenize a string which I suspect would be much, much more
efficient than what you are doing.

I would be happy to send you the source code.

Also, are you reading your delimited records directly from the IFS? If not,
that is going to slow you down. I can send you an example of program that
reads directly from the IFS, parses the records and calls functions to
update database.



On Tue, May 19, 2015 at 11:17 AM, Singh, Ashwani (Lake Mary) <
Ashwani.Singh@xxxxxxxxxx> wrote:

Folks,

We are trying to process a 69 million records file which is taking 5 hours
plus to load into another file. (We have Block *Yes specified for the input
file (with 69M records) We need to bring the processing down for sure..

We are trying for the multithread as well..

There are two crucial loops that run in this single program and causing
trouble.

The first loop takes round about .6 seconds/rec processed the other one
.4 seconds.

Our file is a flat file and is | delimited ..

Loop 1
D ARRAY1 S 5 0 DIM(999)
C '|' SCAN DATA ARRAY1
C Eval X= 1
C Eval A= 0
C Dow ARRAY1(X) > 0
C Eval A+=1
C Eval X+=1
C ENDDO




Loop2
C DOW A < #Pipesreq (Number of pipes actually required)
C Eval Fileds = %subst(fileds:1:%checkr(' ':Fileds)) + '|'
C eval A+=1
C ENDDO


Any suggestion will be highly appreciated..



Thanks,
Ashwani Singh
--
This is the RPG programming on the IBM i (AS/400 and iSeries) (RPG400-L)
mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.