Self-Attention

An attention mechanism where a sequence attends to itself to capture dependencies.