Re: 400 Disk Storage Crisis

[Al Mac <macwheel99@xxxxxxxxxxx>]

Fortunately no one else has been on the system Sunday other than myself, so 
hopefully I can get this resolved before Monday morning mob.  There were a 
few others than me on system on Saturday.

While I was going thru all the reports on spool to see if there were any Ok 
for me to delete (we seem to have thousands) & now there's only a handful 
of reports left that are over 1,000 pages, most of them in the end fiscal area.

I found evidence that there had been a runaway job
We have those occasionally

and after I killed the spool from the runaway job
(which ended abnormally about 10 pm Sat nite)
we down to 89% disk space consumed which is still unacceptable.
The job in question  is related to our factory order modifications, so I 
checking the files associated with that.

Last critical error messages Sunday Nov-6
CPI099B Critical Storage Condition Exists (1.20 pm)
CPI099C Critical Storage Lower Limit reached (1.27 pm)

Last backup was SAVE 21 wee hours of Oct 30, when I was in the building 
that has the AS/400, to run end-month October fiscal stuff.
Last IPL was 9.41 am Sunday after abnormal system end

This mess explains why I was unable to sign onto the 400 Sunday morning ... 
I was thinking the T1 line had gone down in the storm, because I was able 
to connect to VPN, but I got solid time outs on getting a Client Access 
sign on screen.

DSPJOBTBL looks Ok (I am working my way thru things to check) this is the 
area that I tinkered with to solve the last crisis a couple months ago, 
where the 400 was taking 40 winks in mid day, then waking up and not 
knowing it had been asleep.

>                                Display Job 
> Tables                      WIRE 400
>                                                              11/06/05 
> 14:02:09
>  Permanent job structures:                Temporary job 
> structures:
>    Initial  . . . . :   1000                Initial  . . . . 
> :   100
>    Additional . . . :   30                  Additional . . . 
> :   25
>    Available  . . . :   7812                Available  . . . 
> :   15
>    Total  . . . . . 
> :   8755
>    Maximum  . . . . 
> :   163520
>
>
>
>
>
> ---------------------Entries----------------------
>       Table         Size        Total    Available       In-use 
> Other
>           1      8982272         8755         7812          943 
>   0

F11 also Ok
139 in-use active entries
804 in OUTQ

The following is a mystery to me ( % disk space used back down to 61.2400 ) 
... I done almost nothing to locate and fix the problem but standard 
screens seem to be back to normal ... I think now would be a good time to 
do the weekend backup, assuming the system stays stable   I will give it an 
hour or so of nothing else go wrong, since % disk space used has jumped all 
over the 400 map very rapidly in last 24 hours..

>                              Display System 
> Status                     WIRE 400
>                                                              11/06/05 
> 14:06:46
>  % CPU used . . . . . . . :        3.1    Auxiliary 
> storage:
>  % DB capability  . . . . :         .1      System ASP . . . . . . 
> :    29.36 G
>  Elapsed time . . . . . . :   00:44:48      % system ASP used  . . 
> :    61.2400
>  Jobs in system . . . . . :        943      Total  . . . . . . . . 
> :    29.36 G
>  % perm addresses . . . . :       .015      Current unprotect used 
> :      720 M
>  % temp addresses . . . . :       .134      Maximum unprotect  . . 
> :      733 M
>
>
>  System    Pool    Reserved    Max   -----DB-----  ---Non-DB--- 
>
>   Pool   Size (M)  Size 
> (M)  Active  Fault  Pages  Fault  Pages
>     1       73.82     42.37   +++++     .0     .0     .5     .8 
>
>     2       83.42       .38      34     .5     .8    2.4    9.3 
>
>     3      222.91       .00      14     .0     .4    1.5    2.3 
>
>     4        3.83       .00       5     .0     .0     .0     .1 

-
Al Macintyre  http://www.ryze.com/go/Al9Mac
BPCS/400 Computer Janitor ... see
http://radio.weblogs.com/0107846/stories/2002/11/08/bpcsDocSources.html