Re: Code for Tokenizer

Check out Scott Klement's website 
http://www.scottklement.com/rpg/ifs.html
for a tutorial on reading text files on the ifs.
 
Using that tutorial, and with some help form the list, I was able to
write my own RPG IV program to do something similar to what you are
asking about.
 
hth, 
 
Dave B

<beppecosta@xxxxxxxxxxx> 01/26/07 4:20 AM >>>

I have to extract fields from a huge text file stored in 
ifs.

The text file contains thousands of records and each 
record has 95 fields.

Each record is CR delimited and can be easily read with 
"fgets".

Each field is delimited with pipe (|).

I've tried with "strtok" but sometimes it fails because 
when some field is missing (and there are two pipes), the 
tokenizer skip to next field.

I've tried to write my own code with %scan but it is very 
slow.

Thank for suggestions.

Giuseppe.