Plate VI. The Loom of Attention, 2017–2022

12 Jun 2017— Research

Attention Is All You Need

Vaswani and colleagues at Google introduce the Transformer, an architecture built entirely on attention, which becomes the basis of modern language models.

Date confidence: high

Sources

• Attention Is All You Need, arXiv primary

See it in the chronicle