class

ML::NN::CrossAttention

Inherits ML::NN::MultiHeadAttention / Reference / Object

Cross-attention (for decoder attending to encoder)

Instance methods

forward_cross(query : Autograd::Variable, memory : Autograd::Variable, attn_mask : Tensor | Nil = nil) : Autograd::Variable

Same as MultiHeadAttention, just a semantic alias

Source