× The internal search function is temporarily non-functional. The current search engine is no longer viable and we are researching alternatives.
As a stop gap measure, we are using Google's custom search engine service.
If you know of an easy to use, open source, search engine ... please contact support@midrange.com.



Andy,
That would be great. The only problem is that this
data is being sent by an SQL server in a pure stream
format with no End of Record and no End of File markers. 
John

-----Original Message-----
From: Andy Holmer [mailto:aholmer@xxxxxxxxxx]
Sent: Monday, November 03, 2003 2:56 PM
To: RPG programming on the AS400 / iSeries
Subject: RE: User Space or Data Queue or PF or IFS


May I ask why 32767 is such a factor in this discussion?  Maximum
returnable record length?  I have written socket programs that will
embed the length of the next data entry as the first two bytes of the
data.  That approach would let you only send 32 bytes if the record is
only 30 bytes long.  You would do two receives for each record, but that
seems like a small price to pay.  There doesn't have to be a select()
between receives.  I also wonder about an array of pointers that would
let you retrieve the data from whatever userspace(s) you are using.  You
might find that the userspace size of 16MB that could hold only 512 of
the 32k records could hold several thousand of the smaller size.

HTH,
Andy

-----Original Message-----
From: John Brandt Sr. [mailto:pgmr@xxxxxxxxxxxxxxx] 
Sent: Monday, November 03, 2003 3:51 PM
To: 'RPG programming on the AS400 / iSeries'
Subject: RE: User Space or Data Queue or PF or IFS

It was simply due to the ability to fetch
by offset. I was thinking about a PF in QTEMP
with record lengths of 32767.
My only other alternative was multiple user
spaces and just limit the retrieval to 160 meg
or so.
John

-----Original Message-----
From: Peter Dow [mailto:maillist@xxxxxxxxxxxxxxx]
Sent: Monday, November 03, 2003 2:36 PM
To: RPG programming on the AS400 / iSeries
Subject: Re: User Space or Data Queue or PF or IFS


Hi John,

While waiting for your reply to Hans Boldt's question, I thought I just
point out that a physical file accessed by relative record# will perform
better than the IFS, so I'm unclear on why you'd prefer the IFS.

Curious,
Peter Dow
Dow Software Services, Inc.
909 793-9050 voice
909 793-4480 fax
909 522-3214 cell

----- Original Message ----- 
From: "John Brandt Sr." <pgmr@xxxxxxxxxxxxxxx>
To: "'RPG programming on the AS400 / iSeries'" <rpg400-l@xxxxxxxxxxxx>
Sent: Monday, November 03, 2003 12:17 PM
Subject: RE: User Space or Data Queue or PF or IFS


> Peter:
> I am reading off of a socket. I parse the data based on
> the packet size coming off of the socket and
> write it to the user space in 32K increments.
> I am writing to be backwards compatible back to 4.5
> so if they retrieve a multiple gig file,
> I have to be able to handle it.
> I can do the calculations to figure it out in records.
> I was just thinking I didn't want to use the IFS
> because it would take a performance hit.
> John
>
>
> -----Original Message-----
> From: Peter Dow [mailto:maillist@xxxxxxxxxxxxxxx]
> Sent: Monday, November 03, 2003 1:21 PM
> To: RPG programming on the AS400 / iSeries
> Subject: Re: User Space or Data Queue or PF or IFS
>
>
> Hi John,
>
> When you say you're accessing the 32K chunks by address, do you mean
chunk#
> or something?  If you split each chunk into two physical file records,
> calculation of the rrn of the chunks would be pretty simple -- rrn1 =
chunk#
> * 2 - 1, rrn2 = chunk# * 2.  I guess what I'm saying is that
calculating
the
> record you want is not too big a deal.  If speed is an issue, and you
think
> a multiply would take too long, then try rrn1 = chunk# + chunk# - 1.
>
> hth,
> Peter Dow
> Dow Software Services, Inc.
> 909 793-9050 voice
> 909 793-4480 fax
> 909 522-3214 cell
>
> ----- Original Message ----- 
> From: "John Brandt Sr." <pgmr@xxxxxxxxxxxxxxx>
> To: "'RPG programming on the AS400 / iSeries'" <rpg400-l@xxxxxxxxxxxx>
> Sent: Monday, November 03, 2003 10:19 AM
> Subject: User Space or Data Queue or PF or IFS
>
>
> > I have written a utility to retrieve records from an SQL server.
> > I used User Space to store the data returned from the server.
> > The problem is that the user space is restricted to 16MB.
> > In order to break this limitation, I need to move to another storage
> method.
> > I am putting data directly off a socket in 32K chunks and accessing
it
by
> > address.
> > Any method besides the IFS would cause me to have to calculate the
record
> I
> > want every I/O, although a Data Queue would work because I can use
the
32K
> > chunks and just divide my offset by 32767 to get the record that I
want.
> (I
> > will still have some overlap, but I can deal with that)
> >
> > Any suggestions?
> > John Brandt
> > iStudio400.com
> >
> > ---
> > Outgoing mail is certified Virus Free.
> > Checked by AVG anti-virus system (http://www.grisoft.com).
> > Version: 6.0.535 / Virus Database: 330 - Release Date: 11/1/03
> >
> > _______________________________________________
> > This is the RPG programming on the AS400 / iSeries (RPG400-L)
mailing
list
> > To post a message email: RPG400-L@xxxxxxxxxxxx
> > To subscribe, unsubscribe, or change list options,
> > visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
> > or email: RPG400-L-request@xxxxxxxxxxxx
> > Before posting, please take a moment to review the archives
> > at http://archive.midrange.com/rpg400-l.
> >
> >
>
>
> ---
> Outgoing mail is certified Virus Free.
> Checked by AVG anti-virus system (http://www.grisoft.com).
> Version: 6.0.532 / Virus Database: 326 - Release Date: 10/30/2003
>
>
> _______________________________________________
> This is the RPG programming on the AS400 / iSeries (RPG400-L) mailing
list
> To post a message email: RPG400-L@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
> or email: RPG400-L-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/rpg400-l.
>
> ---
> Incoming mail is certified Virus Free.
> Checked by AVG anti-virus system (http://www.grisoft.com).
> Version: 6.0.532 / Virus Database: 326 - Release Date: 10/27/03
>
>
> ---
> Outgoing mail is certified Virus Free.
> Checked by AVG anti-virus system (http://www.grisoft.com).
> Version: 6.0.535 / Virus Database: 330 - Release Date: 11/1/03
>
> _______________________________________________
> This is the RPG programming on the AS400 / iSeries (RPG400-L) mailing
list
> To post a message email: RPG400-L@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
> or email: RPG400-L-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/rpg400-l.
>
>


---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.532 / Virus Database: 326 - Release Date: 10/30/2003


_______________________________________________
This is the RPG programming on the AS400 / iSeries (RPG400-L) mailing
list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.

---
Incoming mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.532 / Virus Database: 326 - Release Date: 10/27/03
 

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.535 / Virus Database: 330 - Release Date: 11/1/03
 
_______________________________________________
This is the RPG programming on the AS400 / iSeries (RPG400-L) mailing
list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.


_______________________________________________
This is the RPG programming on the AS400 / iSeries (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.

---
Incoming mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.532 / Virus Database: 326 - Release Date: 10/27/03
 

---
Outgoing mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.535 / Virus Database: 330 - Release Date: 11/1/03
 

As an Amazon Associate we earn from qualifying purchases.

This thread ...


Follow On AppleNews
Return to Archive home page | Return to MIDRANGE.COM home page

This mailing list archive is Copyright 1997-2024 by midrange.com and David Gibbs as a compilation work. Use of the archive is restricted to research of a business or technical nature. Any other uses are prohibited. Full details are available on our policy page. If you have questions about this, please contact [javascript protected email address].

Operating expenses for this site are earned using the Amazon Associate program and Google Adsense.