re: processing a file -Reply -Reply

[Scott Cornell <CORNELLS@xxxxxxxxxxxxxxx>]

Robert Kerr wrote:

>...to gain speed in large file processing you need to
> change the paradyne... Set up a feeder program to load
> records into a data queue...now write your process
> programs to pick records off the queue and do their
> thing...

Hey, that's pretty slick!  I'm curious though - there is a
maximum size for data queue objects (I don't know what it is
off the top of my head) and if you fill up your queue, the
system pukes (I know 'cause we have a data queue driven
app that has exactly that problem sometimes).  Doesn't
your technique run the risk of bombing if your feeder
program gets too far ahead of of the processing
programs?  Of course, you can "tune" your performance
to avoid this by running many instances of the process
program compared to few (or 1 instance) of the feeder
program, but I'd be interested to hear your experiences (if
any) with this problem.

Scott Cornell, Mercy Information Systems
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
* This is the Midrange System Mailing List!  To submit a new message,   *
* send your mail to "MIDRANGE-L@midrange.com".  To unsubscribe from     *
* this list send email to MAJORDOMO@midrange.com and specify            *
* 'unsubscribe MIDRANGE-L' in the body of your message.  Questions      *
* should be directed to the list owner / operator: david@midrange.com   *
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *