RE: Unlimited size result sets

We aren't talking about the real world. We are talking about a Java
Programmer wanting to prove her theory that loading the entire database to
an in-memory program and flash sorts is faster than recursive calls. Let her
have her 15 minutes. When it ends up in the drink, we can get back to issues
that really matter. 
I have some code that I acquired somewhere that will allow a remote client
to open a socket connection and make a request. Once the request has been
made, he can shove the 500,000 records at her until she gets them all. The
network will choke, the PC she is running the application on will create a
page file 300 meg wide and her sorting routines will take minutes to
accomplish. We already know what the proof is, because most of us have done
it before. The real proof will be when 15 users all ask for the same data at
the same time. He will have 15 sockets shoving 1.5 gigabytes down the line
at 15 different machines. When the process completes, the real people will
be able to come back from their coffee break and work again.

John Brandt
iStudio400.com

-----Original Message-----
From: Haas, Matt [mailto:Matt.Haas@xxxxxxxxxxx]
Sent: Thursday, December 18, 2003 10:25 AM
To: RPG programming on the AS400 / iSeries
Subject: RE: Unlimited size result sets


This begs the question, who's going to wait around for a quarter million
rows to be loaded from the database for every request? Regardless of this
being a servlet or an applet, it's going to take a long time to push that
much data across a wire (not to mention the amount of memory you'd need just
to store the data from a single request). If this were only a few hundred
rows, it wouldn't be much problem but "in the real world", most developers
are smart enough to let the database do the heavy lifting when it comes to
selecting and sorting large amounts of data.

Matt

-----Original Message-----
From: Buck [mailto:buck.calabro@xxxxxxxxxxxx]
Sent: Thursday, December 18, 2003 10:52 AM
To: rpg400-l@xxxxxxxxxxxx
Subject: Re: Unlimited size result sets


> Get the Java person to make recursive calls to your RPG
> in order to get the dataset(s).

That's the existing situation.  The full scenario is not really an RPG
issue, so I didn't post all the details.  Basically the Java side will be
able to click on a column and sort the dataset in that order.  We RPG folk
want Java to tell us what sort order; we'll return 'one page' of data in
that order.  This means that Java needs to keep track of the last key so she
can ask for page 2, etc.

Her contention is that is is better for us to return the entire dataset to
Java, and let her sort it in whatever order she wants.  Management has
tasked me to find a way to give her the entire quarter of a million record
dataset so she can do a proof of concept.
  --buck





_______________________________________________
This is the RPG programming on the AS400 / iSeries (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.

---
Incoming mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.550 / Virus Database: 342 - Release Date: 12/9/03
 

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.552 / Virus Database: 344 - Release Date: 12/15/03