Attention in transformers, step-by-step | Deep Learning Chapter 6

To measure how well each key matches each query, you compute a dot product between each possible key-query pair.

For each column in this diagram, you multiply each of the value vectors by the corresponding weight in that column.