class

GS::NN::CrossAttention

Inherits GS::NN::MultiHeadAttention < Reference < Object

Cross-attention (for decoder attending to encoder)

Instance methods

forward_cross(query : Autograd::Variable, memory : Autograd::Variable, attn_mask : Tensor | Nil = nil) : Autograd::Variable

Same as MultiHeadAttention, just a semantic alias

Source