re: processing a file -Reply

[Robert Kerr <Robert_Kerr@xxxxxxxxxxxxxxx>]

On Jul 13 1997 boothm@earth.goddard.edu wrote:

>I have figured out that writing out the records selected is what takes the
>time.  Anyone have any good ideas about speeding up the record
writing
>part?

Booth,

Not sure where you're at on the whole process, but here's another
angle...not a lot that you can do about the write... sure you can buffer
and OVRDBF etc..  to gain speed in large file processing you need to
change the paradyne... Set up a feeder program to load records into a
data queue...now write your process programs to pick records off the
queue and do their thing...return without LR on to keep the speed
up...now, run multiple processing programs off the driver data
queue...you can still do all the buffer math, but now you're turbo
charged....  We run 750+ Gig on the floor and large files don't even break
a sweat until you pass several Gig...  Once you get the hang of breaking
the code into pieces you'll get all the speed you need...with this method
you could run as many process programs as you needed to keep up with
the feeder program...


Bob Kerr
Director of Data Center Services
NordicTrack

* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
* This is the Midrange System Mailing List!  To submit a new message,   *
* send your mail to "MIDRANGE-L@midrange.com".  To unsubscribe from     *
* this list send email to MAJORDOMO@midrange.com and specify            *
* 'unsubscribe MIDRANGE-L' in the body of your message.  Questions      *
* should be directed to the list owner / operator: david@midrange.com   *
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *