Reliability & operations · Glossary term
What is Admission Control?
A pre-acceptance gate that decides whether a request may enter a bounded queue or service under the system's current capacity, priority, and policy.
Why does Admission Control matter?
Rejecting excess work at a controlled boundary protects admitted requests from queue growth, timeout cascades, and resource exhaustion.
Admission Control in practice
Estimate the request's cost, check tenant and system capacity, reserve the required budget atomically, and identify the overloaded scope when rejecting. Give retry guidance only when the condition is transient and the caller's retry budget permits another attempt.
What is the common confusion about Admission Control?
Admission control acts before acceptance. Load shedding can reject or remove work at ingress, in queues, at dependencies, or at other overload boundaries.
Learn Admission Control in the course
No lesson links to this term yet. Search the course catalog for it.
Related terms
- Load SheddingDeliberately rejecting, dropping, or cancelling selected work at one or more overload boundaries when demand exceeds the capacity…
- BackpressureA flow-control mechanism that slows or rejects upstream work when a downstream component cannot process it safely at the current rate.
- Rate LimitA policy that caps requests, tokens, concurrent work, or another resource within a defined time or capacity window.
- SaturationThe degree to which a constrained resource or service has exhausted its capacity, including queued work that cannot begin promptly.
- Dynamic BatchingA runtime policy that forms inference batches from queued requests according to compatible shapes, maximum size, priority, and allowed…
- Retry BudgetA bound on retry traffic, usually expressed relative to original requests or over a time window, that prevents retries from consuming…
Sources
More terms in Reliability & operations
This entry comes from glossary/terms.md on GitHub. Browse all 250 glossary terms.