Module tokentypes 

Token and TokenType - the complete vocabulary of the lexer.

Every variant the lexer can produce is defined here. Literal-carrying variants (NumberLiteral, StringLiteral, etc.) embed their parsed value directly so downstream passes never need to re-parse raw text.

Structs

Token

A single token produced by the lexer.

Enums

TokenType

Represents every token type the lexer can produce.