Reliability & operations · Glossary term
What is Readiness Probe?
A diagnostic that tells the traffic-routing layer whether a service instance is currently able to accept requests.
Why does Readiness Probe matter?
A process can be alive while its model is unloaded, dependencies are unavailable, or warmup is incomplete, so sending traffic too early creates avoidable failures.
Readiness Probe in practice
Check the minimum dependencies required to serve, fail readiness during startup and draining, keep the probe inexpensive, and do not restart the process solely because readiness is false.
What is the common confusion about Readiness Probe?
Readiness controls traffic eligibility. Liveness decides whether the process should be restarted, and neither proves that every model response will be correct.
Learn Readiness Probe in the course
Start with
- Building a Production LLM Application
You have built prompts, embeddings, RAG pipelines, function calling, caching layers, and guardrails. Separately. In isolation. Like practicing guitar scales without ever playing a song.
Taught in Phase 11: LLM Engineering.
Related terms
- AutoscalingA control loop that changes the number or capacity of serving workers from observed demand, resource use, or application metrics within…
- Model ServingThe runtime and API layer that loads versioned model artifacts, accepts inference requests, schedules execution, manages resources, and…
- AvailabilityThe proportion of eligible service interactions or time windows in which users can obtain the defined acceptable service under a stated…
- Graceful DegradationPreserving a bounded core service when capacity or dependencies are impaired by reducing optional quality, features, freshness, or…
Sources
More terms in Reliability & operations
This entry comes from glossary/terms.md on GitHub. Browse all 250 glossary terms.