eAdditiveRelMultiheadAttention

class eAdditiveRelMultiheadAttention(in_rep, num_heads, *, max_distance, dropout=0.0, bias=True, device=None, dtype=None, init_scheme='xavier_normal')

Bases: eModule, PositionalAttentionBase

Equivariant relative-bias attention with an equivariant attention backend.

Parameters:

• in_rep (Representation)

• num_heads (int)

• max_distance (int)

• dropout (float)

• bias (bool)

• init_scheme (str | None)