AI-native development · Glossary term
What is Cost per Successful Task?
Total system cost divided by the number of tasks that satisfy a defined success criterion, including retries, failed runs, tool use, and evaluation overhead.
Why does Cost per Successful Task matter?
A cheap model call can produce an expensive workflow if it fails often or requires repeated human correction.
Cost per Successful Task in practice
Measure provider charges and infrastructure cost across 100 repository tasks, then divide by the number whose patches pass tests and review.
What is the common confusion about Cost per Successful Task?
Cost per token measures usage. Cost per successful task measures useful outcomes.
Learn Cost per Successful Task in the course
No lesson links to this term yet. Search the course catalog for it.
Related terms
- Evaluation (Eval)A defined process for measuring model or system behavior on representative tasks using explicit success criteria, data, scorers, and…
- Retry with BackoffRepeating a failed transient operation after progressively longer delays, usually with randomized jitter and a strict retry limit.
- Model RouterA component that selects a model or provider for a request using requirements such as capability, latency, cost, context size, policy, and…
- Verification GateA control point that blocks progress until defined evidence satisfies a correctness or quality criterion.
- GoodputThe rate of completed requests that satisfy defined service constraints, such as both time-to-first-token and per-token latency…
- Semantic CacheA cache that reuses a previous result when a new request is judged sufficiently similar under a chosen representation and threshold.
- Token BudgetAn explicit allocation of token capacity across instructions, evidence, history, tool results, reasoning or working space, and output.
More terms in AI-native development
This entry comes from glossary/terms.md on GitHub. Browse all 250 glossary terms.