FRM Part I · FRM Exam Part I · Machine-Learning Methods
A bank compares a neural network with a regularized linear model for predicting corporate defaults using a modest dataset of 800 firms and 15 predictors. Which statement best describes a risk of using a deep neural network here?
A deep neural network is prone to overfitting with a small dataset. Its many parameters let it fit noise in 800 observations, so out-of-sample performance may be poor. Networks do capture nonlinearity and use gradient-based training, and they do not require a normally distributed target.
- AIt is prone to overfitting given limited data relative to its many parametersCorrect
- BIt cannot model any nonlinear relationships between predictors
- CIt requires the target variable to be normally distributed
- DIt cannot be trained using gradient-based methods
Explanation
Deep networks have many parameters, so with a small dataset they can memorize noise and overfit. They do model nonlinearity well, impose no normality requirement on the target, and are trained by gradient-based backpropagation.
Did you get it right without looking?
One question tells you little. A timed set on Machine-Learning Methods shows your real accuracy, how long you take and where you lose marks.
More Machine-Learning Methods questions
- Using the confusion matrix of 30 TP, 10 FP, 20 FN and 140 TN from a default classifier at a 0.5 threshold, the bank lowers the cutoff to 0.3…
- A hidden node in a neural network receives three inputs x1 = 2, x2 = -1 and x3 = 3 with weights 0.5, 2.0 and -0.4 respectively, and a bias o…
- A analyst compares penalized regressions on a data set with many correlated predictors, some of which are believed to be irrelevant. She wan…
- A K-nearest neighbors classifier predicts whether a firm will default using two features: leverage (ratio, range 0 to 5) and market capitali…
- A risk manager lowers the probability threshold at which a logistic model classifies a borrower as a defaulter, from 0.50 to 0.30. Which out…
- An analyst standardizes a feature using the training sample mean of 12 and a training standard deviation of 4. A new observation in the test…