attention mechanism

A technique allowing models to focus on relevant parts of input

“The attention mechanism helps the model understand context across long sequences.”

Origin: From Latin attendere (to stretch toward, give heed), from ad- (to) + tendere (to stretch)