class

CrystalMoji::Ipadic::Tokenizer::Builder::InternalTokenFactory(Token)

Inherits CrystalMoji::Viterbi::TokenFactory < Reference < Object

Instance methods

create_token(word_id : Int32, surface : String, type : CrystalMoji::Viterbi::ViterbiNode::Type, position : Int32, dictionary : CrystalMoji::Dict::Dictionary) : Token
Source