CFA Level I · CFA Level I Exam · Introduction to Financial Data Science
A data scientist builds a model with many features and finds it fits the training set almost perfectly but performs poorly out of sample. Which action is most likely to improve the model's out-of-sample performance?
Applying regularization to penalize model complexity is most likely to help. The model is overfit, so reducing complexity lowers variance and improves generalization. Adding features makes overfitting worse, and using a smaller training set gives less information for learning real patterns.
- AAdd more features to capture remaining training-set variation
- BApply regularization to penalize model complexityCorrect
- CReduce the size of the training set to speed up fitting
Explanation
The symptoms indicate overfitting. Regularization (penalizing complexity, such as with LASSO) or fewer features reduces variance and improves generalization. Adding features increases complexity and worsens overfitting, and shrinking the training set gives the model less information, which also tends to worsen it.
Did you get it right without looking?
One question tells you little. A timed set on Introduction to Financial Data Science shows your real accuracy, how long you take and where you lose marks.
More Introduction to Financial Data Science questions
- An analyst has the following values for a feature: 8, 10, 12, 14, 56. The analyst applies min-max normalization to the value 14. The normali…
- An analyst trains a model to predict whether a borrower will default, using historical loans that are each labeled "default" or "no default.…
- An analyst converts a set of earnings call transcripts into a form suitable for modeling. She removes punctuation, converts all letters to l…
- A data scientist wants to reduce the words "earned", "earning" and "earnings" to a common base form, using a rule-based procedure that strip…
- An analyst preparing unstructured text from analyst reports for natural language processing removes common words such as "the", "is" and "an…
- An analyst collects a dataset containing each firm's credit rating (AAA, AA, A, BBB), where the ratings have a clear ranking but the gaps be…