Class TokenClassifier

java.lang.Object

io.github.protasm.jvmud.compiler.token.TokenClassifier

public final class TokenClassifier
extends Object

Re-classifies identifier tokens into language keywords.

The scanner intentionally treats all alpha-numeric sequences as TokenType.T_IDENTIFIER. This classifier runs after scanning to keep lexing free of language semantics while still providing the parser with the token categories it expects.

Method Summary

Modifier and Type	Method	Description
static TokenList	classify(TokenList rawTokens)

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

classify

public static TokenList classify(TokenList rawTokens)