class

MicroGPT::FeedForward

Inherits MicroGPT::Layer < Reference < Object

Constructors

new(d_model : Int32, d_ff : Int32)
Source

Instance methods

backward(grad : Mat) : Mat
Source
backward_accumulate(grad : Mat) : Mat
Source
forward(x : Mat) : Mat
Source
update(lr : Float64)
Source