class

Obelisk::ComposedLexer

Inherits Obelisk::Lexer < Reference < Object

Framework for composing multiple lexers together

Constructors

new(name : String, lexers : Array(Lexer), strategy : Obelisk::CompositionStrategy = CompositionStrategy::FirstMatch)
Source

Instance methods

analyze(text : String) : Float32

Analyze text to determine if this lexer can handle it Returns a score from 0.0 to 1.0

Source
config
Source
tokenize(text : String) : TokenIterator
Source