RE: Writing lots of records

The table is not journaled.

I got lots of good ideas for future consideration but I ended up using Evan's idea of busting the input data into chunks. It is hard to explain the data but it was impossible to break it into "even" chunks without a 15 minute SQL to figure out how to split it up so I just did logical breaks based on a key field. I have one chunk that is about twice the size of the rest of them but this got me down to a little over 30 minutes and I'm going to say that it is what is it.

-----Original Message-----
From: RPG400-L <rpg400-l-bounces@xxxxxxxxxxxxxxxxxx> On Behalf Of Charles Wilt
Sent: Friday, October 9, 2020 3:45 PM
To: RPG programming on IBM i <rpg400-l@xxxxxxxxxxxxxxxxxx>
Subject: Re: Writing lots of records

Changing to SQL would help if you used a multi-row insert.

Inserting 500,1000 or 1500 records at a time would be considerably quicker than RPG's 1 row at a time.

dcl-ds mydata dim(500);
...
end-ds;

exec sql
insert into my table for :nbrRows values(:mydata);

see also my reply regarding journaling...

Charles


On Thu, Oct 8, 2020 at 4:00 PM <smith5646midrange@xxxxxxxxx> wrote:

I have a conversion program that will end up writing over 300M 72byte
records and I’m getting pressure to figure out if there is a way to
speed it up. Currently the program is using an F-spec. There are no
logicals over the file and even though there is a unique key, there is
no way one could happen during conversion so I'm not checking or monitoring for one.

Would changing to SQL help in any way?
Can I change something related to the blocking? I’ve never messed
with blocking because the system does it automagically and I always
figured it knew more than me.
Are there other options that I might not have thought about…and no,
writing less records is not an option. 😊

--
This is the RPG programming on IBM i (RPG400-L) mailing list To post a
message email: RPG400-L@xxxxxxxxxxxxxxxxxx To subscribe, unsubscribe,
or change list options,
visit: https://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxxxxxxxx
Before posting, please take a moment to review the archives at
https://archive.midrange.com/rpg400-l.

Please contact support@xxxxxxxxxxxxxxxxxxxx for any subscription
related questions.

Help support midrange.com by shopping at amazon.com with our affiliate
link: https://amazon.midrange.com

--
This is the RPG programming on IBM i (RPG400-L) mailing list To post a message email: RPG400-L@xxxxxxxxxxxxxxxxxx To subscribe, unsubscribe, or change list options,
visit: https://lists.midrange.com/mailman/listinfo/rpg400-l
or email: RPG400-L-request@xxxxxxxxxxxxxxxxxx
Before posting, please take a moment to review the archives at https://archive.midrange.com/rpg400-l.

Please contact support@xxxxxxxxxxxxxxxxxxxx for any subscription related questions.

Help support midrange.com by shopping at amazon.com with our affiliate link: https://amazon.midrange.com