Re: XML-INTO %HANDLER PATH

Hi Jon

I hope my reply wasn't an automatic "SQL is the answer". I have found that XMLTABLE is easier to use than the data-structure approach with XML-INTO. I admit that I did not pursue further the use of XML-INTO, once XMLTABLE gave me everything I wanted in a fairly simple way.

I do see that the size limit might exist for SQL, especially if it also uses the SAX method - I don't know, one of the Db2 team would need to speak to that.

Defining data structures to be able to flatten XML structures into rows just escapes me, the Xpath stuff lets me be selective - maybe you can verify, do we have to declare data structures to contain every layer of the XML structure, or can we specify only the elements we need, some from a parent level, others from child levels perhaps even child of child, etc.

Cheers
Vern

On 1/20/2025 10:38 AM, Jon Paris wrote:

Not a question of "favorite solution!" Vern - but I do get really tired of "The answer is SQL - now what was the question?"

I also suspect that SQL may also have issues with the size of the document if RPG is barfing at a 2G limit. SAX similarly may also have an issue as I seem to recall that the entire doc is checked for validity before the parser does its thing.

Maybe noXDB can handle it.


Jon P.

I find that XMLTABLE can look a lot like CREATE TABLE, with columns defined with regular SQL data types, plus "path" specs for where each element is located in the XML.

See if that article helps - if you need more, I can probably help, I give a case study presentation about this.

Cheers
Vern

On 1/19/2025 7:12 PM, Charles Wilt wrote:

Actually, that "process in chunks" idea is not quite right...

Even with %handler and path being used, XML-INTO pukes at 1GB; with the
default UCS processing.

You can double that limit to 2GB by telling it to process the file as SBCS.

https://www.ibm.com/docs/en/i/7.5?topic=documents-limitations-xml-parser

There's been an idea out there for a while for IBM to increase the limit.
https://ibm-power-systems.ideas.ibm.com/ideas/IBMI-I-1826

Charles


On Sun, Jan 19, 2025 at 3:50 PM Jon Paris <jon.paris@xxxxxxxxxxxxxx> wrote:

Are you sure Dave?

If you are using %handler you are processing the xml in chunks of the size
you define - surely the size of parts within any given object is not going
to exceed 16mb is it?


Jon Paris
Jon.Paris@xxxxxxxxxxxxxx

--
This is the RPG programming on IBM i (RPG400-L) mailing list
To post a message email: RPG400-L@xxxxxxxxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: https://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxxxxxxxx
Before posting, please take a moment to review the archives
at https://archive.midrange.com/rpg400-l.

Please contact support@xxxxxxxxxxxxxxxxxxxx for any subscription related questions.