TokenizerGenerator.Token

Defines one token together with file and line information. The precedingComment_ is set if there was one comment before the token.

struct TokenizerGenerator(alias tokens, alias reservedTokens)

struct Token {

}

Members

value string value(): Undocumented in source. Be warned that the author may not have intended to support it.

file_ string file_;: Undocumented in source.
line_ size_t line_;: Undocumented in source.
precedingWhitespace_ string precedingWhitespace_;: Undocumented in source.
type_ TokenType2 type_;: Undocumented in source.
value_ string value_;: Undocumented in source.