RE: Code for Tokenizer

Beppe,

This thread suggests that strsep() handles contiguous delimiters better than
strtok()
http://www.systeminetwork.com/isnetforums/showthread.php?p=137261

JK

-----Original Message-----
I have to extract fields from a huge text file stored in
ifs.

The text file contains thousands of records and each
record has 95 fields.

Each record is CR delimited and can be easily read with
"fgets".

Each field is delimited with pipe (|).

I've tried with "strtok" but sometimes it fails because
when some field is missing (and there are two pipes), the
tokenizer skip to next field.

I've tried to write my own code with %scan but it is very
slow.

Thank for suggestions.

Giuseppe.