Re: Memory usage for Domino

Meat at bottom.

Earlier in this thread I had posted
Server.Users = 391
Server.Users.Active15Min = 219
Server.Users.Active1Min = 82
Server.Users.Active30Min = 262
Server.Users.Active3Min = 119
Server.Users.Active5Min = 153
Server.Users.Peak = 392
Server.Users.Peak.Time = 07/25/2011 08:56:45 EDT

With Mexico coming on line now I am showing:
Server.Users.1MinPeak = 99
Server.Users.1MinPeakTime = 07/25/2011 08:58:27 EDT
Server.Users.5MinPeak = 210
Server.Users.5MinPeakTime = 07/25/2011 10:03:59 EDT
Server.Users.Active = 1
Server.Users.Active15Min = 293
Server.Users.Active1Min = 83
Server.Users.Active30Min = 333
Server.Users.Active3Min = 135
Server.Users.Active5Min = 169
Server.Users.Peak = 469
Server.Users.Peak.Time = 07/25/2011 10:07:43 EDT

System Pool Reserved Max -----DB----- ---Non-DB---
Pool Size (M) Size (M) Active Fault Pages Fault Pages
1 8949.41 4663.05 +++++ .0 .0 .8 2.1
2 20182.21 81.73 1918 14.5 824.8 397.6 2081
3 522.23 .29 29 .0 2.8 5.8 36.8
4 17090.37 1.11 1306 45.0 2755 42.2 99.0
5 5479.75 .02 157 10.7 481.7 404.1 3602

1.5MB for ($Inbox) times x 2 times 333Users gets 999MB. Which is really
close to a 1GB per server shot from the hip I dimly recall getting from
somewhere.

On a server that is for databases other than mail I did a show users and
pasted that data into Excel and sorted it. I've got 19 databases with
varying numbers of current user per database. Now I've got to find their
default view and crank out the math. Right?

Rob Berendt
--
Group Dekko
Dept 1600
Mail to: 2505 Dekko Drive
Garrett, IN 46738
Ship to: Dock 108
6928N 400E
Kendallville, IN 46755
http://www.dekko.com





From: Walter Scanlan <wscanlan@xxxxxxxxxx>
To: Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>
Cc: domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx
Date: 07/25/2011 09:54 AM
Subject: Re: Memory usage for Domino
Sent by: domino400-bounces+rob=dekko.com@xxxxxxxxxxxx



1.2 GB sounds right based on what you see, Sorry what do you mean, how
does that play with some of the figures in show stat?

Now that you know the "cost" of an average session 1.5 MB, (which by the
way is about average for a mail server), you could look at REAL workload.

while you have 400 users defined, if you look at Server.Users.Active30Min

that give you a better idea of "real" memory requirements.

Lets assume that with 400 users the Server.Users.Active30Min = 300, then
1.5 times x 2 times 300 gets 900 Mb of memory to support this server.



Walter Scanlan
Senior Software Engineer
Office: 1 720 342 5837
Cell: 507-990-4539




From: rob@xxxxxxxxx
To: Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>,
Date: 07/25/2011 08:48 AM
Subject: Re: Memory usage for Domino
Sent by: domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx



Ok. That helps. That median file was 2.9MB for ($Inbox). I picked 10
files, including that one. The size of that view ranged from 148,864 to
3,754,048 with the average being 1,540,978. Some people are really
religious in moving stuff out of inbox into other views - others aren't.
Me? I have over 1,500 unread messages in my inbox let alone all the stuff


I've read.

So if I take 1.5MB x 2 x 400Users I get 1.2GB. That's easier to swallow
than 10.4GB.

How does that play with some of the figures from show stat, etc?

Rob Berendt
--
Group Dekko
Dept 1600
Mail to: 2505 Dekko Drive
Garrett, IN 46738
Ship to: Dock 108
6928N 400E
Kendallville, IN 46755
http://www.dekko.com





From: Walter Scanlan <wscanlan@xxxxxxxxxx>
To: Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>
Cc: domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx
Date: 07/25/2011 09:16 AM
Subject: Re: Memory usage for Domino
Sent by: domino400-bounces+rob=dekko.com@xxxxxxxxxxxx



Don't Add ALL the views. only the "default" view, for a mail file that is



$INBOX.

Users do NOT open all the views in a mail file at once, and rarely open
views other than $inbox and calendar.

Just track the size of $inbox.



Walter Scanlan
Senior Software Engineer
Office: 1 720 342 5837
Cell: 507-990-4539




From: rob@xxxxxxxxx
To: Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>,
Date: 07/25/2011 08:09 AM
Subject: Re: Memory usage for Domino
Sent by: domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx



Thank you Walter.

In my Admin (we're a daos shop) if I sort by "Logical Size" the largest
mail file is 6.2GB. It's physical size is only 42MB. The view indexes
of this database consume 5 MB of disk space, which is 0% of the entire
space used by this database.
The largest physical file is 624MB and it's logical size is 1.3GB. The
view indexes of this database consume 85 MB of disk space, which is 7% of
the entire space used by this database.
The median physical file is 51MB. The view indexes of this database
consume 13 MB of disk space, which is 4% of the entire space used by this
database.
The median logical size is 240MB. The view indexes of this database
consume 7 MB of disk space, which is 3% of the entire space used by this
database.
13MB x 2 x 400 users = 10.4GB?

We archive mail that is over 6 months old. We put no size or other type
restrictions. We've brought that up to management but their concern was
that a major customer might send us a drawing and we wouldn't want to
reject it (how big do we need to make the check for the disk drives?).

We have 453 mail files. It's 9am here. Which is only 7am in Mexico and
Texas where an additional significant percentage of our users are.
Mem.MaxSharedMemory_MB = 4080
Mem.PhysicalRAM = 54,760,833,024
Mem.PhysicalRAM_MB = 52224
Platform.Memory.FaultsPerSec = 305.3
Platform.Memory.FaultsPerSec.Avg = 374.6
Platform.Memory.FaultsPerSec.Peak = 20,326.6
Platform.Memory.PagesPerSec = 4,779.3
Platform.Memory.PagesPerSec.Avg = 3,223.4
Platform.Memory.PagesPerSec.Peak = 326,166.7
Platform.Memory.RAM.TotalMBytes = 16,789.6
Platform.Memory.WaitToIneligible = 0
Server.Users = 391
Server.Users.Active15Min = 219
Server.Users.Active1Min = 82
Server.Users.Active30Min = 262
Server.Users.Active3Min = 119
Server.Users.Active5Min = 153
Server.Users.Peak = 392
Server.Users.Peak.Time = 07/25/2011 08:56:45 EDT


Rob Berendt
--
Group Dekko
Dept 1600
Mail to: 2505 Dekko Drive
Garrett, IN 46738
Ship to: Dock 108
6928N 400E
Kendallville, IN 46755
http://www.dekko.com





From: Walter Scanlan <wscanlan@xxxxxxxxxx>
To: Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>
Cc: domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx
Date: 07/25/2011 08:25 AM
Subject: Re: Memory usage for Domino
Sent by: domino400-bounces+rob=dekko.com@xxxxxxxxxxxx



I am sure you will not like parts of my answer but I will attempt to
provide an answer to your questions.

For the first part. 512 MB is the MINIMUM Memory requirement

Workload defines Memory requirements beyond the minimum

Some Domino servers require 68 GB of RAM (Yes that is an actual customer
deployment).

The second question, How do I determine the memory requirements for "MY"
workload.

As

http://www-10.lotus.com/ldd/dominowiki.nsf/dx/4.8_Domino_on_IBM_i_Tips#Memory





states, The faulting/paging rates determine how much memory is
over-committed.

Keeping Base pool (assuming default configuration) below 100 faults 300
pages per CPU per second is the goal (the lower the better , but above
these numbers user connections may fail and performance will be poor).

The reason the mention of largest view,
For HUGE mail files and large application deployments the view is
the largest memory cost.
Example. the $INBOX is loaded into memory each time the
user opens his/her mail file, That view is x size, requiring x space in
memory.
As the mail file grows, the $INBOX grows
(in an unmanaged mail file), resulting is MORE memory required to do the
same work as a smaller mail file.

For applications with complex views or large
document counts the views can require a LOT of memory

To see the size of any view (index) from the administration
client, Files tab, right click on any database and select manage views.


Note: in the above the inbox is 18 Mb, if this mail file were on server it





would have a VERY large per user cost.
If this were an "average mail file" on a server with 1000 users,
this server would require 36 GB!!!!!! of memory.

In this case rather than installing 18 GB of memory action would be taken
to manage the mail files to avoid this performance cost.


I don't have a way to Sort the databases by view index size but for a
given type of database (ie. mail file) the largest database has a the
largest indexes.

By comparison The same mail file with a Managed inbox.


Note; if this were the average mail file with 2.8 Mb inbox on a server
with 1000 users the server would require 5.6 GB , still a very large
server but 1/6th the original requirement.



Walter Scanlan
Senior Software Engineer
Office: 1 720 342 5837
Cell: 507-990-4539




From: rob@xxxxxxxxx
To: domino400@xxxxxxxxxxxx,
Date: 07/25/2011 07:03 AM
Subject: Memory usage for Domino
Sent by: domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx



Is the general memory recommendation still 512MB per Domino server?
https://www-304.ibm.com/support/docview.wss?uid=swg27013080

I also noticed this differing recommendation:

http://www-10.lotus.com/ldd/dominowiki.nsf/dx/4.8_Domino_on_IBM_i_Tips#Memory






"2 times the amount of space needed for views in that application
dedicated for the Domino server". I am curious as to how you base your
memory consumption for a server based on the stuff of a database used
(perhaps) by a single user? For example, my NOTES01 server is where my
users mail files are. If I determine that jsmith.nsf view size was xMB so






I give it 2xMB memory? Regardless of the number of users?
Also, how do you determine the size of the views of a database? I don't
suppose there's a way for the Domino Administrator to sort by database
view size?
It's an Amy Hoerle article.


Rob Berendt
--
Group Dekko
Dept 1600
Mail to: 2505 Dekko Drive
Garrett, IN 46738
Ship to: Dock 108
6928N 400E
Kendallville, IN 46755
http://www.dekko.com

_______________________________________________
This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
To post a message email: Domino400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/domino400.


_______________________________________________
This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
To post a message email: Domino400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/domino400.


_______________________________________________
This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
To post a message email: Domino400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/domino400.


_______________________________________________
This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
To post a message email: Domino400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/domino400.


_______________________________________________
This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
To post a message email: Domino400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/domino400.


_______________________________________________
This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
To post a message email: Domino400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/domino400.


_______________________________________________
This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
To post a message email: Domino400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/domino400
or email: Domino400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/domino400.