re: processing a file -Reply -Reply -Reply

Scott wrote,

Hey, that's pretty slick!  I'm curious though - there is a maximum size for
data queue objects (I don't know what it is off the top of my head) and if
you fill up your queue, the system pukes (I know 'cause we have a data
queue driven app that has exactly that problem sometimes).  Doesn't your
technique run the risk of bombing if your feeder program gets too far
ahead of of the processing programs?  Of course, you can "tune" your
performance to avoid this by running many instances of the process
program compared to few (or 1 instance) of the feeder program, but I'd
be interested to hear your experiences (if any) with this problem.

Data queues are wonderful things, but you do have to acount for
everything... I use a series of data area counters and a monitor program
that I wrote for the operators to use...the data areas are incremented and
decremented as records are added and removed...this also gets me
around data queues not playing well with ALCOBJ... the monitor program
is soft coded so I just add data queue names to a file and presto , my
operators monitor it.... this way the processing programs are dynamic as
well...I can run from 1 to 99 process programs for a given data
queue..the size will get you if you fall asleep....I think the *nomax is
around that magic 2 gig mark... also think about what you are putting in
the queue... in this example of the feeder program it sounds like he's
writing a work file....only load the data that you need in the output...if it's
an update process..you don't need the whole record loaded to the q...
just the data you care about... sometimes wonderful thngs are alot of
work.... I have used this system at two large shops and both love
it....once I had the monitor, viewer, generic loaders and pickers written
with reload capabilities, I don't have to think so much anymore....

* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
* This is the Midrange System Mailing List!  To submit a new message,   *
* send your mail to "MIDRANGE-L@midrange.com".  To unsubscribe from     *
* this list send email to MAJORDOMO@midrange.com and specify            *
* 'unsubscribe MIDRANGE-L' in the body of your message.  Questions      *
* should be directed to the list owner / operator: david@midrange.com   *
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *