MLP block (Feed-Forward Network)
Constructors
new(in_features :
Int32, hidden_features :
Int32 |
Nil = nil, out_features :
Int32 |
Nil = nil, dropout :
Float32 = 0.0_f32, device :
Tensor::Device =
Tensor.default_device)
SourceInstance methods
call(x : Autograd::Variable) : Autograd::Variable
Sourceforward(x : Autograd::Variable) : Autograd::Variable
Forward with GELU activation
Source