RE: Suggestion for improving loop performance

Alan,

Much appreciated..

This is what I am trying to do -

We have one control record running into multiple records of flat file i.e.

X:01 A|B|C"
X:02 D|E|F"
X:03 G|H|I

X:01 1|2|3|4|5
X:02 ......


And i know that this record X:01 should contain 5 field's but have 2 missing and rest all are fine.

The output becomes like this

X: A|B|C||D|E|E|G|H|I

This whole process is repeated like this...

Please send me the codes for reading directly form IFS and other suggestion you have..

Thanks,
Ashwani Singh


-----Original Message-----
From: RPG400-L [mailto:rpg400-l-bounces@xxxxxxxxxxxx] On Behalf Of Alan Campin
Sent: Tuesday, May 19, 2015 2:39 PM
To: RPG programming on the IBM i (AS/400 and iSeries)
Subject: Re: Suggestion for improving loop performance

What is the object of this exercise? Are you trying to tokenize a delimited file and update a table?

By tokenize I mean abc,123,444 becomes
token 1 = agc
token 2 = 123
token 3 = 444

If yes, as part of my standard string functions service program is a set of procedures that tokenize a string which I suspect would be much, much more efficient than what you are doing.

I would be happy to send you the source code.

Also, are you reading your delimited records directly from the IFS? If not, that is going to slow you down. I can send you an example of program that reads directly from the IFS, parses the records and calls functions to update database.



On Tue, May 19, 2015 at 11:17 AM, Singh, Ashwani (Lake Mary) < Ashwani.Singh@xxxxxxxxxx> wrote:

Folks,

We are trying to process a 69 million records file which is taking 5
hours plus to load into another file. (We have Block *Yes specified
for the input file (with 69M records) We need to bring the processing down for sure..

We are trying for the multithread as well..

There are two crucial loops that run in this single program and
causing trouble.

The first loop takes round about .6 seconds/rec processed the other
one
.4 seconds.

Our file is a flat file and is | delimited ..

Loop 1
D ARRAY1 S 5 0 DIM(999)
C '|' SCAN DATA ARRAY1
C Eval X= 1
C Eval A= 0
C Dow ARRAY1(X) > 0
C Eval A+=1
C Eval X+=1
C ENDDO




Loop2
C DOW A < #Pipesreq (Number of pipes actually required) C Eval Fileds
= %subst(fileds:1:%checkr(' ':Fileds)) + '|'
C eval A+=1
C ENDDO


Any suggestion will be highly appreciated..



Thanks,
Ashwani Singh
--
This is the RPG programming on the IBM i (AS/400 and iSeries)
(RPG400-L) mailing list To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx Before posting, please take a
moment to review the archives at http://archive.midrange.com/rpg400-l.

--
This is the RPG programming on the IBM i (AS/400 and iSeries) (RPG400-L) mailing list To post a message email: RPG400-L@xxxxxxxxxxxx To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives at http://archive.midrange.com/rpg400-l.