What is Canary Release?

A deployment strategy that exposes a new version to a limited slice of traffic or infrastructure before expanding the rollout.

Why does Canary Release matter?

It limits the impact of defects and gives you production evidence before the new model, prompt, agent, or service reaches everyone.

Route a small eligible cohort to the release, compare quality and operational metrics with the control, and stop or roll back on predefined failures.

A canary release limits exposure; it does not replace pre-deployment tests, approval, or rollback preparation.

No lesson links to this term yet. Search the course catalog for it.

Evaluation (Eval)A defined process for measuring model or system behavior on representative tasks using explicit success criteria, data, scorers, and…
ObservabilityThe ability to understand an AI system's behavior from recorded inputs, outputs, state transitions, tool calls, timings, costs, errors,…
RollbackRestoring a previously known deployment or configuration when the current release violates operational, quality, or safety criteria.
Verification GateA control point that blocks progress until defined evidence satisfies a correctness or quality criterion.
Shadow TrafficA copy of live request traffic sent to a candidate system for observation while the candidate response remains outside the primary user…