|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
BetterTokenizer
class takes an input stream and
* parses it into "tokens", allowing the tokens to be
* read one at a time.low <= c <= high
* are "ordinary" in this tokenizer.
nextToken
method of this
* tokenizer to return the current value in the ttype
* field, and not to modify the value in the nval
or
* sval
field.
ordinaryChar
method
* for more information on a character being ordinary.
nextToken
method, this field
* contains the type of the token just read.
low <= c <= high
* are white space characters.
low <= c <= high
* are word constituents.
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |