the token produced by the walker, with walker data embedded
number of additional characters consumed beyond the regex match