Token

data class Token(val type: Token.Type, val text: String, val span: Span)

Represents a token.

Constructors

Link copied to clipboard
constructor(type: Token.Type, text: String, span: Span)

Types

Link copied to clipboard

Properties

Link copied to clipboard
val span: Span

The Span of the token.

Link copied to clipboard

The text of the token.

Link copied to clipboard

The type of the token.