class

MicroGPT::Embedding

Inherits Reference < Object

Constructors

new(vocab_size : Int32, d_model : Int32, max_seq_len : Int32 = 128)
Source

Instance methods

adam_tok
Source
backward(grad : Mat)
Source
backward_accumulate(grad : Mat)
Source
d_token_emb
Source
forward(ids : Array(Int32)) : Mat
Source
token_emb
Source
update(lr : Float64)
Source