RE: High Performance parallel run programming

["Chevalier, Rick" <Rick.Chevalier@xxxxxxxxxxxxxxx>]

Sas,

I agree with Tracy that trying to save 4 minutes isn't worth the effort.

As far as techniques go, I prefer the use of data queues to splitting a file
based on record ranges.  IMO advantages are that the record ranges don't
have to be updated as the file size changes (this could be done
programmatically), if one of the jobs encounters an error only the record in
error is affected not the range, it can easily be scaled to fit your
situation by adding or removing jobs reading the data queue.

The design would go something like this:

Submit multiple jobs to receive entries from the data queue.  These jobs run
until told to end via an entry on the queue.

Submit the job to populate the data queue.  This jobs sole function is to
place onto the queue only the information the receiving jobs need to perform
their function.  A check should be included to prevent overflowing the data
queue.  When the end of file is reached place shutdown entries onto the
queue for each receiving job.

There are API's for each of the data queue functions.  You can find them at
the Information Center.

HTH,

Rick
 -----Original Message-----
From:   sas [mailto:sas@toto.co.id] 
Sent:   Wednesday, January 15, 2003 4:05 PM
To:     rpg400-l@midrange.com
Subject:        High Performance parallel run programming

Dear all ,
Does anyone on the list has any experience doing parallel run programing ?
background :
suppose we have one million record should be read and it will take ex. 5
minute , so if we want the job to be done in 1 (one ) minute, so we should
run pgm1( to read record 1-200),pgm2 ( to read record 201-400)  and so on
until pgm5( to read 801-1000) and all the programs should be run on the same
time .
Would you be so kind share the experience .
Thank you
Regards,
Sas

**************************************************************
Scanned by  MailScan Content-Security and Anti-Virus Software.
Visit http://www.mwti.net for more info on eScan and MailScan.
**************************************************************

_______________________________________________
This is the RPG programming on the AS400 / iSeries (RPG400-L) mailing list
To post a message email: RPG400-L@midrange.com
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo.cgi/rpg400-l
or email: RPG400-L-request@midrange.com
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.