CFA Level I · CFA Level I Exam · Introduction to Financial Data Science
A model achieves very low error on its training dataset but produces much larger errors on a validation dataset. The model is most likely suffering from:
The model most likely suffers from overfitting. It has fitted noise and idiosyncrasies in the training data, so it performs well in-sample but generalizes poorly to new data. Underfitting would show high error on both training and validation sets, not only on validation.
- Aunderfitting, because it is too simple
- Boverfitting, because it has learned noise in the training dataCorrect
- Cdata leakage, because the validation labels were removed
Explanation
Low training error combined with high out-of-sample error is the classic sign of overfitting, where the model captures noise specific to the training sample. Underfitting would produce high error on both datasets. Removing labels from validation data is not leakage and does not explain the pattern.
Did you get it right without looking?
One question tells you little. A timed set on Introduction to Financial Data Science shows your real accuracy, how long you take and where you lose marks.
More Introduction to Financial Data Science questions
- A fund uses a model that classifies firms as likely to default or not, using labeled historical data on past defaults and firm characteristi…
- In a machine learning project, the data are divided into a training set, a validation set, and a test set. The test set is most likely used …
- An analyst computes term frequency-inverse document frequency (TF-IDF) for the word "covenant" in a loan filing. The word appears 6 times in…
- An analyst's dataset of customer incomes contains several extreme values far above the rest, and the analyst wants to reduce the influence o…
- An analyst applies a clustering algorithm to the return histories of 500 stocks to find groups that behave similarly, without predefining an…
- An analyst builds a bag-of-words document term matrix from 2,000 corporate disclosures to predict whether a firm will cut its dividend. Comp…