Full definition

Technique that allows the model to focus on the most relevant parts of the input when processing information, fundamental in transformer architectures.

Example in a business context

In machine translation, paying more attention to contextually relevant words.