class

ConstructionKit::LayerNormFusedExec

Inherits ConstructionKit::ExecutableNode < Reference < Object

Layer Norm — compound op with internal learnable params (gamma, beta) Uses fused backend for CUDA performance. Inputs: { "in" => Mat } Outputs: { "out" => Mat }

Constructors

new(id : String, dim : Int32 = 64)

Source

Instance methods

adam_beta

Source

adam_gamma

Source

adam_mats

Source

backward(output_grads : Hash(String, MicroGPT::Mat)) : Hash(String, MicroGPT::Mat)

Backward pass: receive gradients for outputs, return gradients for inputs

beta

dbeta

dgamma

forward(inputs : Hash(String, Tensor)) : Hash(String, Tensor)

Forward pass: read named inputs, produce named outputs

Source

gamma

Source

param_count

Source

update(lr : Float64)

Update trainable parameters

Source

weight_mats

Weight access for serialization / checkpoint

Source