Marten::Template::Parser::Lexer
The Marten template lexer.
This class allows to perform a lexical analysis from a raw template: given a text input, the #tokenize method
converts a sequence of characters into an array of tokens that represents the ramifications of the considered
template (tags, variables, comments and raw text).