Cadmium::Tokenizer::Base
Inherits Cadmium::Tokenizer::Diacritics < Cadmium::Tokenizer::StopWords < Reference < Object
Instance methods
tokenize(string : String) : Array(String)
Sourcetrim(arr)
SourceInherits Cadmium::Tokenizer::Diacritics < Cadmium::Tokenizer::StopWords < Reference < Object