Maintain a list of tokens.
Create a new token.
Define more tokens.
Look up a token by its value, rather than name.
Sort our tokens by length, so we know once we match, we‘re done. This helps us avoid the O(n^2) nature of token matching.
[Validate]