|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
BetterTokenizer class takes an input stream and
* parses it into "tokens", allowing the tokens to be
* read one at a time.low <= c <= high
* are "ordinary" in this tokenizer.
nextToken method of this
* tokenizer to return the current value in the ttype
* field, and not to modify the value in the nval or
* sval field.
ordinaryChar method
* for more information on a character being ordinary.
nextToken method, this field
* contains the type of the token just read.
low <= c <= high
* are white space characters.
low <= c <= high
* are word constituents.
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||