ANTI-AI ARCHIVE
ART-HISTORY NODE / 091 · 2017

Attention Is All You Need

Attention Is All You Need

Vaswani et al.

Introduction

The Transformer is initially a sequence-modelling architecture, not a paper on image generation. Later systems including CLIP, DALL·E, DiT, MMDiT and native multimodal models nevertheless draw directly or indirectly on attention and Transformer approaches. Its inclusion documents a cross-domain technical condition rather than an artwork or image model in itself.

ORIGINAL DOCUMENT#091
Page 3 of the linked paper PDF, preserving its original figures and language. The source file identifies the edition; later revision or reprint dates do not replace the node’s historical date.View full image ↗

Page 3 of the linked paper PDF, preserving its original figures and language. The source file identifies the edition; later revision or reprint dates do not replace the node’s historical date.

Vaswani et al. · original paper · Image rights remain with their respective holders; no open licence is asserted

Source · Attention Is All You Need ↗

RESEARCH ACCOUNT

An architecture first presented through language tasks

ANTI-AI ARCHIVE · Revised 2026-10-02

Method and contribution

The Transformer paper replaces recurrent and convolutional sequence architectures with attention and demonstrates machine translation and constituency parsing. Its performance and training-time comparisons concern those tasks. It is not an image-generation paper, and later visual-model capabilities should not be projected back onto 2017.

Section sources: Attention Is All You Need

Art-historical interpretation

Editorial interpretation: its relevance comes through subsequent reuse in generative systems. Movement from language tasks to visual representations requires later evidence. Shared use of attention alone does not establish a direct lineage between artworks or platforms.

Section sources: Attention Is All You Need

Sources for this account

Attention Is All You Need ↗

Author or conference abstract and version record read; full proofs and experiments were not independently reproduced.

This account expands the archive within the cited scope. Historical interpretation is not presented as the original author’s statement or as a proven causal influence. The account and translation are AI-assisted, pending independent human review. Section references identify evidence without claiming independent verification of every historical statement.

Continue with a comparative question

Language Models are Few-Shot Learners ↗

Compare the methods, forms of control or presentation contexts of this entry and Language Models are Few-Shot Learners.

PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis ↗

Compare the methods, forms of control or presentation contexts of this entry and PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis.

Dates & version record

Date displayed for this node: 2017 · Historical date recorded for the source: 2017

These dates refer to the historical event or recorded version, not this page’s publication date. The original date precision and unresolved questions are retained.

Original sources & further reading

These links lead to the cited paper, article, institution or conference page. External texts retain their source languages.

01
Attention Is All You Need ↗

Attention Is All You Need

https://arxiv.org/abs/1706.03762

Current cited URL

Provenance, translation & verification

Timeline entry #091 · Historical node

Research materials & supplement references · 1

AI Art Genealogy Research Master · p. 18 · 056
Date as recorded: 2017
Attention Is All You Need ↗
Attention Is All You Need

Archive account based on the listed research materials, not a full translation of the linked work. AI-assisted translation; independent human review pending.

The master’s research claims and dates await independent verification.

Cite this node

ANTI-AI ARCHIVE. Attention Is All You Need. Art-history node #091. https://salondesrefuses.cn/en/art-history/056

For specific historical claims, also cite the original sources above and include your access date. This account is not a full translation of the linked work.

Adjacent nodes follow chronological order; adjacency does not establish direct influence or causation.