Re: Suggestion for improving loop performance

[Alan Campin <alan0307d@xxxxxxxxx>]

What is the object of this exercise? Are you trying to tokenize a delimited
file and update a table?

By tokenize I mean abc,123,444 becomes
token 1 = agc
token 2 = 123
token 3 = 444

If yes, as part of my standard string functions service program is a set of
procedures that tokenize a string which I suspect would be much, much more
efficient than what you are doing.

I would be happy to send you the source code.

Also, are you reading your delimited records directly from the IFS? If not,
that is going to slow you down. I can send you an example of program that
reads directly from the IFS, parses the records and calls functions to
update database.



On Tue, May 19, 2015 at 11:17 AM, Singh, Ashwani (Lake Mary) <
Ashwani.Singh@xxxxxxxxxx> wrote:

> Folks,
>
> We are trying to process a 69 million records file which is taking 5 hours
> plus to load into another file. (We have Block *Yes specified for the input
> file (with 69M records) We need to bring the processing down for sure..
>
> We are trying for the multithread as well..
>
> There are two crucial loops that run in this single program and causing
> trouble.
>
> The first loop takes round about .6 seconds/rec processed  the other one
> .4 seconds.
>
> Our file is a flat file and is | delimited ..
>
> Loop 1
> D ARRAY1       S           5 0  DIM(999)
> C    '|'          SCAN        DATA            ARRAY1
> C Eval X= 1
> C Eval A= 0
> C Dow ARRAY1(X) > 0
> C  Eval A+=1
> C Eval X+=1
> C ENDDO
>
>
>
>
> Loop2
> C DOW A < #Pipesreq (Number of pipes actually required)
> C Eval  Fileds = %subst(fileds:1:%checkr(' ':Fileds)) + '|'
> C eval A+=1
> C ENDDO
>
>
> Any suggestion will  be highly appreciated..
>
>
>
> Thanks,
> Ashwani Singh
> --
> This is the RPG programming on the IBM i (AS/400 and iSeries) (RPG400-L)
> mailing list
> To post a message email: RPG400-L@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
> or email: RPG400-L-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/rpg400-l.