class

ConstructionKit::Compiler

Inherits Reference < Object

Constants

COMPOUND_TYPES = Set {"layer_norm", "attention_layer", "loss"}
FORCE_COMPOUND = Set {"layer_norm", "attention_layer", "global_router", "context_router", "gated_router"}

Types that should ALWAYS use compound fallback, never recurse into children. These have unimplemented math primitives in their drill-down.

MATH_TYPES = Set {"weight_param", "bias_param", "scale_param", "embedding_table", "matmul", "add_bias", "relu", "softmax", "lookup", "elem_mul", "layer_norm", "loss", "add", "mean_pool", "broadcast", "reduce_mean", "subtract", "reduce_var", "normalize", "attention_layer"}
SKIP_TYPES = Set {"char_tokenizer", "bpe_tokenizer", "sequential_window", "sliding_window", "random_window", "zero_init", "random_init", "learned_init", "optimizer", "stream_projector"}

Types that are skipped (data pipeline, not model computation)

Constructors

new(vocab_size : Int32, seq_len : Int32 = 128, lr : Float64 = 0.0003)
Source

Instance methods

compile(graph : GraphData) : ExecutableGraph

Compile a pipeline-level graph into an executable graph.

Source
seq_len
Source
vocab_size
Source