Test-time training

Plain English. A model that takes a small training step on the prompt it is answering, so its weights change as it works. Distinct from test-time compute (thinking longer with fixed weights): here the model itself is briefly, genuinely learning.

Why it moves money. Three consequences, per the analysis that put it on investor radar. Memory flattens: history folds into fixed-size weights instead of a KV cache that grows with context. Speed can improve — cited research on small models reports up to 2.7x. But serving inverts: once a model updates on your prompt, it is no longer the model that answered anyone else's, so one checkpoint serving millions becomes millions of slightly different models — a per-user cost structure no current inference business is built for.

What to watch. Whether any provider ships it at production scale, and what they charge for it — the per-user serving cost is the tell for whether the economics close.

From the signals. Test-time training would give each user their own model, and its own cost.

Further reading. Sun et al., "Learning to (Learn at Test Time)" (2024).