Re: Extract new rows only from a table with SQL to SQL server

[Jim Oberholtzer <midrangel@xxxxxxxxxxxxxxxxx>]

Folks:

We had several good suggestions to resolve the issue which we are exploring, further discussion is not needed from my perspective. 

No third party products or paid solutions will be entertained at this time.  If we wish to, we will reach out. 
--
Jim Oberholtzer
Agile Technology Architects




> On Sep 24, 2025, at 10:31 AM, Gavin Inman <midrangelist@xxxxxxxxxxxxxx> wrote:
>
> Jim,
>
> Have you looked at 3rd party solutions?
>
> We use Qlik (formerly Attunity) and replicate about 80% of our databases to SQL server.  Our applications are a mix of our core Iseries application and SQL based add on apps.
>
> Once the database is synced, it keeps it updated (using Journals).
>
> Gavin.
>
> On 9/23/2025 5:54 PM, Jim Oberholtzer wrote:
>
> The current process running has an SQL server using ODBC running a query against a IBM i table with 6 million rows (table scan, no selection criteria) and updating a SQL server table every night.
>
> Right now, the process is a refresh of the 6 million rows on SQL server.  In reality we only need the newest rows since the last run.  Ordinarily I would just use a timestamp  on the table to pull rows since a specific time, but this table does not have a timestamp on it (JDE supplied table so I cannot modify it)
>
> Is there a way we can use SQL to get only the newest rows on the table?  (Triggers are not available for the same reason I can’t modify the table)
>
> My guess is no, without a timestamp we cannot, but hopefully someone will have an enlightened answer.
>
> Might temporal tables play in this scenario?
>
>
> --
> Jim Oberholtzer
> Agile Technology Architects
>
>
>
>
>
> -- 
> This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing list
> To post a message email: MIDRANGE-L@xxxxxxxxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: https://lists.midrange.com/mailman/listinfo/midrange-l
> or email: MIDRANGE-L-request@xxxxxxxxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at https://archive.midrange.com/midrange-l.
>
> Please contact support@xxxxxxxxxxxxxxxxxxxx for any subscription related questions.