Re: File editor for large ifs files

We are currnetly looking at large (1 - 3 gig) .txt files which contain xml
export from a non i system.

We have no control over the export process generating the files. There is some
analysis
to do (why the editor would be great) - each file seems to present a new set of
issues,

mostly in the xml headings and some unusual control characters embedded within
the data.
In a general sense we often get large data files, but this is first to blow up
EDTF. They may be

fixed or variable length text, csv, or xml (within a text file).
We do have the need to sometimes "fix" issues in the file before processing.
The EDTF view (green-screen) or Notepad is what we are used to (some pgmrs, some

business analysts).

Needs:
text view or hex
view w/column positions
search 
update in text or hex

The tools suggested in several posts look good at first glance.

Thanks to all,
Jim Franz
Key Risk Insurance




________________________________
From: Mark S Waterbury <mark.s.waterbury@xxxxxxxxxxxxx>
To: Midrange Systems Technical Discussion <midrange-l@xxxxxxxxxxxx>
Sent: Fri, October 19, 2012 10:42:50 AM
Subject: Re: File editor for large ifs files

Hi, Jim:

Most text editors work by reading the entire file into memory, where you
can then view it, page up and down, and possibly modify (edit)  the
contents..  Then, if you choose to "save" the changes, the editor
rewrites the entire file from the copy in memory.  This is, in effect
also how SEU works, on a source file member basis. (SEU also has
additional logic to handle a "crashed" session and recover changes made
in a previous SEU session, etc.)

Do you really want to be reading an entire file of 1.5 or 2.3 GB into
memory, just to browse it, or perhaps to make a few small changes?

Are you really "editing" the contents of this file?  In what ways?

What kind of data is in this large "text" file? Is it XML?

I just wonder if this is "the best tool for the job"?

There are various Unix commands / tools available in QShell or PASE,
such as "sed" that might also be useful.

HTH,

Mark S. Waterbury

On 10/19/2012 10:06 AM, J Franz wrote:
Is there a file editor (prefer i based) that can open and edit large text

files

in the IFS?

Somewhere between 1.5 and 2.3 gig the EDTF command returns a "Object is too
large to process"

CPFB620 w/Errno 3525
Notepad and Notepad++ fail.
V6R1

Jim Franz