struct

MicroGPT::ModelSpec

Inherits Struct < Value < Object

Parse a model spec like "d64n2", "d4x16n2ff512", or "d1+2+4+8+16+32n2" d64 = one head, dim 64 d4x16 = 4 uniform heads of dim 16 (d_model=64) d1+2+4 = heterogeneous heads (d_model=7)

Constructors

new(d_model : Int32, n_layers : Int32, d_ff : Int32, head_dims : Array(Int32) | Nil)
Source

Instance methods

clone
Source
copy_with(d_model _d_model = @d_model, n_layers _n_layers = @n_layers, d_ff _d_ff = @d_ff, head_dims _head_dims = @head_dims)
Source
d_ff
d_model
head_dims
label
Source
n_layers