LLMilestonesA milestone timeline of AI and large language models

Act I · Foundations

PaperGoogle

T5: Text-to-text for everything

Recast translation, classification, summarization and every other task as text in, text out.

11Bparameters (largest version)

Why it matters

The unified format influenced later instruction tuning, and the C4 dataset released with it was widely reused.

Built on

BERT

Source: arxiv.org ↗

See it on the 3D timeline →