Reliability & operations · Glossary term
What is Graceful Degradation?
Preserving a bounded core service when capacity or dependencies are impaired by reducing optional quality, features, freshness, or workload instead of failing every request.
Why does Graceful Degradation matter?
AI systems often depend on several slow or fallible components, so an explicit reduced mode can protect essential user outcomes during partial failure.
Graceful Degradation in practice
Predefine which capabilities may be disabled, keep the reduced mode visible to operators, protect safety checks, test the fallback under dependency failure, and restore full service deliberately. Tell users when correctness, safety, freshness, or a promised contract materially changes.
What is the common confusion about Graceful Degradation?
Graceful degradation is not silently returning a worse answer as if nothing happened. Operators always need visibility; users need disclosure when the reduced mode materially changes the result or service contract.
Learn Graceful Degradation in the course
Start with
- Building a Production LLM Application
You have built prompts, embeddings, RAG pipelines, function calling, caching layers, and guardrails. Separately. In isolation. Like practicing guitar scales without ever playing a song.
Taught in Phase 11: LLM Engineering.
Related terms
- Circuit BreakerA reliability control that temporarily stops calls to a dependency after failures cross a threshold, then probes whether the dependency…
- Load SheddingDeliberately rejecting, dropping, or cancelling selected work at one or more overload boundaries when demand exceeds the capacity…
- Model RouterA component that selects a model or provider for a request using requirements such as capability, latency, cost, context size, policy, and…
- AvailabilityThe proportion of eligible service interactions or time windows in which users can obtain the defined acceptable service under a stated…
- Readiness ProbeA diagnostic that tells the traffic-routing layer whether a service instance is currently able to accept requests.
Sources
More terms in Reliability & operations
This entry comes from glossary/terms.md on GitHub. Browse all 250 glossary terms.