CFA Level I · CFA Level I Exam · Introduction to Financial Data Science
A data scientist builds a model that fits the training data almost perfectly but produces poor predictions on new data. The problem is most likely:
The problem is most likely overfitting. The model has learned noise specific to the training set, so it performs well in sample but poorly on new data. Techniques such as cross-validation and regularization help reduce it, whereas underfitting would also show poor training results.
- Aunderfitting, which could be reduced by removing features.
- Boverfitting, which could be reduced by using cross-validation and regularization.Correct
- Ca low variance error, which could be reduced by adding noise to the labels.
Explanation
A model that captures noise in the training data and fails out of sample is overfit. Cross-validation and regularization or simpler models help limit it. Underfitting would give poor training performance as well, so the first option is wrong.
Did you get it right without looking?
One question tells you little. A timed set on Introduction to Financial Data Science shows your real accuracy, how long you take and where you lose marks.
More Introduction to Financial Data Science questions
- A team builds a model to forecast bond returns using 200 features and only 150 observations. To reduce overfitting, the team adds a penalty …
- An analyst computes term frequency-inverse document frequency (TF-IDF) for the word "covenant" in a loan filing. The word appears 6 times in…
- To assess how well a model will generalize, an analyst splits the data into a training set, a validation set, and a test set. The test set i…
- An analyst's dataset of customer incomes contains several extreme values far above the rest, and the analyst wants to reduce the influence o…
- An analyst applies a clustering algorithm to the return histories of 500 stocks to find groups that behave similarly, without predefining an…
- An analyst builds a bag-of-words document term matrix from 2,000 corporate disclosures to predict whether a firm will cut its dividend. Comp…