TechnicalAI glossary
Inference-time computation
Spending compute at inference time rather than at training time. The same model, allowed to produce ten thousand reasoning tokens before concluding, solves problems it misses when answering directly. Nothing was retrained.
In other words
The difference between answering off the cuff and drafting a response. Drafting is billed for.