Re: Printing Code from LPEX

No. Source code has no builtin formatting codes, although some have added the 5250 display bytes for display on the green screen.

And a "token" is not something that "...controls background and text colors...". A token, in the most primitive sense, is just a word separated by some delimiter, often a blank, sometimes a semi-colon. The C function strtok just gives you back a "token" out of a string - and uses a delimiter you specify, IIRC.

The "tokenizing" in LPEX is done by LPEX according to certain rules - sometimes found in a syntax file - TextPad has a similar concept - you put in a list of various "tokens" and how they should be displayed.

Tokenizing in LPEX is perhaps better called colorization, IMO.

For printing, that colorizing or other emphasis is done by LPEX - and you can turn it off. Turning it off gives you the plain text. Leaving it on gives you the colorized effect.

I think there's a little confusion on the use of the word "tokenize" = probably the fault of the LPEX usage - there's probably some help text in WDSC that is worth checking on what is going on.

Later
Vern

Bryce Martin wrote:

so it just breaks off the "token" that controls the background and text colors and just send the plain text "token"? I have never dealt with the intricacies of how stream data is formatted, stored, and processed so please pardon my ignorance on this issue.

Thanks
Bryce Martin
Programmer/Analyst I
570-546-4777



Jon Paris <jon.paris@xxxxxxxxxxxxxx> Sent by: wdsci-l-bounces@xxxxxxxxxxxx
02/08/2010 07:16 PM
Please respond to
Rational Developer for IBM i / Websphere Development Studio Client for System i & iSeries <wdsci-l@xxxxxxxxxxxx>


To
wdsci-l@xxxxxxxxxxxx
cc

Subject
Re: [WDSCI-L] Printing Code from LPEX






On Feb 8, 2010, at 4:06 PM, wdsci-l-request@xxxxxxxxxxxx wrote:

Does anyone understand why they named that option Tokenized? I must
really misunderstand something, but seeing that originally didn't make me
think it had to do with this issue.

Because tokenizing is the process of breaking up a line of program script into its "tokens" or component parts. It is one of the processes used by compilers and context sensitive editors - and I suppose word processors etc. too.

GIYF (Google Is Your Friend) http://en.wikipedia.org/wiki/Tokenization


Jon Paris

www.Partner400.com
www.SystemiDeveloper.com