TokenData

data class TokenData(val text: String, val position: IntRange)

Data of a single, usually small, substring of the source code that stores a chunk of information. For instance, the Markdown code Hello _Quarkdown_ contains the tokens Hello , _, Quarkdown, _.

Parameters

text

the substring extracted from the source code, also known as lexeme

position

location of the token within the source code

See also

Constructors

Link copied to clipboard
constructor(text: String, position: IntRange)

Properties

Link copied to clipboard
Link copied to clipboard