Re: Dealing with very large blocks of character data

John,

still the textdata dosn't come from a IFS file so it must come from either
DB2 or the
web and if it is from DB2 fields David will still has to concatinate fields
together in a
trunk of memory.

And if it comes from DB2, the file either has several fields in the record
making it impossible
to copy the data directly it to an IFS file or you are maxed out since your
field length has the
same max as RPGLE V5R4.

So whatever David does he has no way other than first to handle the
concatination of the
text since it can exceed 65535 bytes and here he has the following choises:

- memory the %bifs (alloc/realloc etc.) that support 16MB
- teraspace memory using the C modules that supports 2GB+
- a multi dimentional datastructure that can be 16MB
- User Spaces (16Mb)

In IMHO this is a choise between memory or a User Space and if memory is
the choice why
not go for the solution that supports 2GB.

Whatever is used afterwards to scan depends entirely what has to be
achieved, RPGLE can do
scan/repace in a loop just as regexp, but it can also give you the number
of occourences
and the exact position of each occurence and in RPGLE you only need one
loop for several
scan criterias and in RPGLE complex business logic can be included when a
search criteria
is meet in the string.



On Fri, Dec 2, 2011 at 9:17 AM, John McKay <jmckay@xxxxxxxxxxxxxxxx> wrote:

I agree with the Gary's suggestion.

As regards regular expressions, I have a service program / function
available which makes the regex api's more manageable in an rpg program.

It is at www.rpglanguage.com/regexp and is free to download / use.

Regards,
John McKay mba

On 01/12/2011 21:11, Monnier, Gary wrote:

David,

Can you use the regex APIs to accomplish your string interrogation?

They're available at V5R4.

Gary


-----Original Message-----
From: rpg400-l-bounces@xxxxxxxxxxxx [mailto:

rpg400-l-bounces@xxxxxxxxxxxx] On Behalf Of David Gibbs

Sent: Thursday, December 01, 2011 12:29 PM
To: RPG programming on the IBM i / System i
Subject: Re: Dealing with very large blocks of character data

On 12/1/2011 2:20 PM, CRPence wrote:

How about using some SQL procedures [and\or functions] to perform the
work using CLOB data type, since SQL has similar capability to various
RPG BIFs? For example a scan implemented as a procedure might look
like:

I'm still limited to 64k for the text variable ... since I would need to

pass it to the stored procedure.

PLUS (and this is just a personal preference) I really dislike RPG SQL

... I like the concept, but not the implementation (I dislike code
generators in general).

david

--
IBM i on Power - For when you can't afford to be out of business
--
This is the RPG programming on the IBM i / System i (RPG400-L) mailing

list To post a message email: RPG400-L@xxxxxxxxxxxx To subscribe,
unsubscribe, or change list options,

visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives at

http://archive.midrange.com/rpg400-l.

--
This is the RPG programming on the IBM i / System i (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/rpg400-l.