Chain-of-Thought prompting
Have the model write out its reasoning before answering, and accuracy on math and logic jumps.
Why it matters
Showed the value of letting a model think longer, foreshadowing the reasoning models of two years later.
Costs and controversy
Only works on large enough models; small models often produce wrong reasoning.
Led to
Source: arxiv.org ↗