Term of the Moment

LaserDisc


Look Up Another Term


Definition: self attention mechanism


In machine learning, the self attention mechanism assigns weights to different parts of a sentence to analyze the importance and relationships of the words. Meaning "attending to itself," the self attention mechanism is an important function in the transformer method (see AI transformer).