Skip to main content
CrystalDocs
Search documentation
Search
Browse Docs
CrystalShards
About
class
CrystalMoji::Ipadic::Tokenizer
Inherits
CrystalMoji::TokenizerBase
<
Reference
<
Object
Constructors
new
(builder :
Builder
)
Source
new
Source
Instance methods
furigana
(text :
String
) :
String
Source
remove_furigana
(text :
String
) :
String
Source
tokenize
(text :
String
) :
Array
(
Token
)
Source
Nested types
CrystalMoji::Ipadic::Tokenizer::Builder