Re: archiving software was: Product to check out?

["Pete Massiello" <pmassiello@xxxxxxxxxxxxxxxx>]

Archiving records will improve the performance of your system.  While its
not the size of the disk space that you are saving, its everytime you
build an index over the file, run a batch program that reads all the
records in a file, reorganize that file, etc that will have a huge
difference.

Think about running a batch job that reads every record in a sales history
file with 3 million records.  If we could archive that file and remove 1.5
million records, that batch program will likely finish in 1/2 the time. 
That is a big difference.  By the way, we have also reduced disk I/O,
memory Database Page Faults, and overall system utilization.  Another
thing is backups, if we were to backup that sales history file every
night, we are saving 3 million records vs 1.5 million.  If we were using
SAVCHGOBJ, and we added 1 new record to the sales history file, we now
backup all 3,000,001 records.

That is pretty significant.  In the example of removing a few item master
records, you are right its not going to make a big difference.

I have done some detailed timed testing on the above.

Pete Massiello

---------------------------- Original Message ----------------------------
Subject: archiving software was: Product to check out?
From:    rob@xxxxxxxxx
Date:    Tue, November 1, 2005 2:42 pm
To:      "Midrange Systems Technical Discussion" <midrange-l@xxxxxxxxxxxx>
--------------------------------------------------------------------------

> When you lobbied for archiving software did you ever argue with $?
> The purchase of software xyz for $A
> Will make process B run C minutes shorter.
> An alternative to making process B run C minutes shorter is buying
> additional hardware from IBM at a cost of $D?
>
> Most people can't honestly come up with a vaue for C.  They just wing it.
> We had a gent here who used to piss away vast quantities of time clearing
> up item master records to make things run faster and to save disk space.
> Never could say how much faster, nor how much space he would save.
>
> By the way, the size of the item master in question is 2.7MB or .000071%
> of disk space.  Rather reminds me of Barbara Morris example of some
> people's attempts to tune RPG coding can be compared to the fact that
> stepping on a step ladder does put you closer to the moon.
>
> Rob Berendt
> --
> Group Dekko Services, LLC
> Dept 01.073
> PO Box 2000
> Dock 108
> 6928N 400E
> Kendallville, IN 46755
> http://www.dekko.com
>
>
>
>
>
> Al Mac <macwheel99@xxxxxxxxxxx>
> Sent by: midrange-l-bounces@xxxxxxxxxxxx
> 11/01/2005 01:36 PM
> Please respond to
> Midrange Systems Technical Discussion <midrange-l@xxxxxxxxxxxx>
>
>
> To
> Midrange Systems Technical Discussion <midrange-l@xxxxxxxxxxxx>
> cc
>
> Fax to
>
> Subject
> Re: Product to check out?
>
>
>
>
>
>
> Another popular solution, for some packages, is to go with some archiving
> product.
>
> We are on BPCS with many files a million plus records.  The average user
> only needs to see the last few days worth of transactions, at most a
> month,
> but we have a few applications that do need to access stuff that is a year
>
> old.  With archiving, which we do not have, but I have lobbied
> occasionally
> to get, the records that are rarely needed are sitting in another library
> so they not contaminate access efficiency for the 99% normal access needs.
>
> Archiving also provides tools that simplify the task of creating test data
>
> bases.
>
>>Does anyone use this product and can comment on it?
>>
>> > http://www.kisco.com/gofaster/
>> >
>>
>>--
>>This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing
> list
>>To post a message email: MIDRANGE-L@xxxxxxxxxxxx
>>To subscribe, unsubscribe, or change list options,
>>visit: http://lists.midrange.com/mailman/listinfo/midrange-l
>>or email: MIDRANGE-L-request@xxxxxxxxxxxx
>>Before posting, please take a moment to review the archives
>>at http://archive.midrange.com/midrange-l.
>
>
> --
> This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing
> list
> To post a message email: MIDRANGE-L@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/midrange-l
> or email: MIDRANGE-L-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/midrange-l.
>
>
> --
> This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing
> list
> To post a message email: MIDRANGE-L@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/midrange-l
> or email: MIDRANGE-L-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/midrange-l.
>
>