quarkdown-core/com.quarkdown.core.lexer.regex.pattern/WalkedToken

WalkedToken

data class WalkedToken(val token: Token, val charsConsumed: Int)

Result of a walker invocation during tokenization. Produced by patterns that require secondary scanning beyond what regex can capture (e.g., balanced delimiters in function call arguments).

Parameters

token

the token produced by the walker, with walker data embedded

charsConsumed

number of additional characters consumed beyond the regex match

Constructors

WalkedToken

constructor(token: Token, charsConsumed: Int)

Properties

charsConsumed

val charsConsumed: Int

token

val token: Token