attention mechanism

A technique allowing models to focus on relevant parts of input

“The attention mechanism helps the model understand context across long sequences.”

Etymology — From Latin `attendere` (to stretch toward, give heed), from `ad-` (to) + `tendere` (to stretch)