Models & inference · Glossary term
What is Stop Sequence?
An application-specified token or text pattern that causes generation to stop when the decoding system encounters it.
Why does Stop Sequence matter?
Stop sequences bound output protocols and multi-part generation without waiting for the model to decide semantically that it is finished.
Stop Sequence in practice
Choose unambiguous delimiters, test tokenization and partial streaming matches, and still enforce output length and schema validation.
What is the common confusion about Stop Sequence?
A stop sequence is a mechanical decoding condition, not proof that the answer is complete or that an agent goal is satisfied.
Learn Stop Sequence in the course
No lesson links to this term yet. Search the course catalog for it.
Related terms
- Decoding StrategyThe algorithm that converts a model's sequence of next-token scores into selected tokens and a completed output.
- Structured OutputModel output constrained or validated against a machine-readable schema so application code can consume fields without parsing free-form…
- TokenAn integer identifier produced by a model-specific tokenizer from text, bytes, images, audio, or another input representation.
- Termination ConditionAn explicit rule that ends or pauses an agent run when it succeeds, fails, exhausts a budget, reaches a safe boundary, or requires…
Sources
More terms in Models & inference
- Attention
- Autoregressive
- CNN (Convolutional Neural Network)
- CUDA
- Decoder
- Decoding Strategy
- Diffusion Model
- Encoder
- GAN (Generative Adversarial Network)
- GPT
- Inductive Bias
- Inference
- KV Cache
- LLM (Large Language Model)
- Logits
- MoE (Mixture of Experts)
- Nucleus Sampling (Top-p)
- Parameter
- Perplexity
- Quantization
- Self-Attention
- Speculative Decoding
- Streaming
- Temperature
- Time to First Token (TTFT)
- Top-k Sampling
- Transformer
- VAE (Variational Autoencoder)
This entry comes from glossary/terms.md on GitHub. Browse all 250 glossary terms.