Skip to content

evaluation

Data Leakage

When information from outside the training data inadvertently influences model evaluation, leading to overly optimistic performance estimates. Data leakage can occur when test data overlaps with training data or when future information is used in historical predictions.

In practice

If benchmark questions were included in a model's training data, its high benchmark score would reflect data leakage, not genuine ability.