quarkdown-core/com.quarkdown.core.lexer.regex/RegexLexer/tokenize

tokenize

open override fun tokenize(): List<Token>

Disassembles some raw string into smaller tokens.

Return

the ordered list of tokens