What is Dataset Split?

A documented partition of examples into separate subsets for fitting, development decisions, and final evaluation.

Why does Dataset Split matter?

Separation prevents the evidence used to choose a system from also serving as independent proof that the chosen system generalizes.

Split by the real deployment unit, such as user, repository, organization, or time, rather than randomly dividing correlated rows.

A random split is not automatically independent. Near duplicates, future observations, or records from the same entity can cross the boundary.

No lesson links to this term yet. Search the course catalog for it.

Eval SetA versioned collection of inputs, expected properties, scoring rules, and metadata used to measure an AI system against a defined…
OverfittingA generalization gap in which performance on training data is substantially better than performance on representative unseen data.
Data LeakageUnintended use of information during training or feature construction that would not be available at the real prediction point or belongs…
Distribution ShiftA difference between the data distribution used to build or evaluate a system and the distribution it encounters after deployment.
Data DeduplicationDetecting and removing exact and near-duplicate examples within or across datasets.
Data ProvenanceTraceable information about where data originated, who or what transformed it, which versions were used, and how derived artifacts relate…
Datasheet for DatasetsStructured documentation of a dataset's motivation, composition, collection process, preprocessing, uses, distribution, maintenance, and…
Model CardA structured report describing a model's intended uses, evaluation conditions, performance characteristics, limitations, and relevant…