class

Cadmium::RegexTokenizer

Inherits Cadmium::Tokenizer < Reference < Object

Constructors

new(pattern : Regex, *, gaps = nil, discard_empty = nil)

Instance methods

tokenize(string : String) : Array(String)