tooling v0.0.1 (2014-12-07T21:04:21Z)
Dub
Repo
nextToken
tooling
Tokenizer
Helper function, gets next token and updates pc and line.
CppLexer.Token
nextToken
(
ref
string
pc
,
ref
size_t
line
)
Meta
Source
See Implementation
tooling
Tokenizer
aliases
CppLexer
Keywords
NonAlphaTokens
Token
TokenType
tk
functions
nextToken
tokenize
static functions
munchCharLiteral
munchChars
munchComment
munchIdentifier
munchNumber
munchPreprocessorDirective
munchRawString
munchSingleLineComment
munchString
static variables
specialTokens
structs
TokenizerGenerator
Helper function, gets next token and updates pc and line.