class

Obelisk::ChainedLexer

Inherits Obelisk::Lexer < Reference < Object

Framework for chaining lexers in sequence

Constructors

new(name : String, chain : Array(Lexer))
Source

Instance methods

analyze(text : String) : Float32

Analyze text to determine if this lexer can handle it Returns a score from 0.0 to 1.0

Source
config
Source
tokenize(text : String) : TokenIterator
Source