eAdditivePosMultiheadAttention

class eAdditivePosMultiheadAttention(in_rep, num_heads, *, max_len, dropout=0.0, bias=True, device=None, dtype=None, init_scheme='xavier_normal')

Bases: eModule, PositionalAttentionBase

Equivariant additive positional attention with invariant query/key updates.

Parameters:

• in_rep (Representation)

• num_heads (int)

• max_len (int)

• dropout (float)

• bias (bool)

• init_scheme (str | None)