class

Glimmer::Highlight::Lexer

Inherits Reference < Object

Lexer provides the base class for language-specific tokenizers.

Each language lexer should inherit from this class and implement

the tokenize method.

Instance methods

aliases

Returns a list of aliases for this language (e.g., "js" for "javascript").

language

Returns the name of the language this lexer handles.

tokenize(source : String) : Array(Glimmer::Highlight::Token)

Tokenizes the given source code into an array of tokens.