LLMilestonesA milestone timeline of AI and large language models

Act IV · Multimodal, open source catches up

Closed modelGoogle

Gemini 1.5: a million-token context

Reads about 700,000 words, about an hour of video, or over 30,000 lines of code at once.

1Mtoken context

Why it matters

Stretched context from a few pages to a library, changing how people use models.

Costs and controversy

The 1M window was first available only in a limited preview, with 128K as default. OpenAI announced Sora the same day and stole much of the spotlight.

Built on

Gemini 1.0

Source: blog.google ↗

See it on the 3D timeline →