class

Cadmium::RegexTokenizer

Inherits Cadmium::Tokenizer / Reference / Object

Constructors

new(pattern : Regex, *, gaps = nil, discard_empty = nil)

Instance methods

tokenize(string : String) : Array(String)