Cadmium::Tokenizer::Whitespace
Inherits Cadmium::Tokenizer::Regex < Cadmium::Tokenizer::Base < Cadmium::Tokenizer::Diacritics < Cadmium::Tokenizer::StopWords < Reference < Object
Constants
REGEX_PATTERN = /\s+/
Constructors
new
SourceInherits Cadmium::Tokenizer::Regex < Cadmium::Tokenizer::Base < Cadmium::Tokenizer::Diacritics < Cadmium::Tokenizer::StopWords < Reference < Object