IAI Actuarial Core Principles · Risk Modelling and Survival Analysis · Elementary principles of machine learning
A regression model is evaluated on a test set of 4 observations with actual values 10, 12, 14, 20 and predicted values 11, 10, 14, 16. What are the mean squared error (MSE) and the mean absolute error (MAE)?
The errors are -1, 2, 0 and 4. The squared errors sum to 21, giving MSE = 21/4 = 5.25. The absolute errors sum to 7, giving MAE = 7/4 = 1.75. Hence MSE is 5.25 and MAE is 1.75.
- AMSE = 5.25, MAE = 1.75Correct
- BMSE = 5.25, MAE = 2.25
- CMSE = 21, MAE = 7
- DMSE = 4.25, MAE = 1.75
- MSE = 5.25, MAE = 1.25
Explanation
Errors are -1, 2, 0, 4 (actual minus predicted: -1, 2, 0, 4). Squares are 1, 4, 0, 16, total 21, so MSE = 21/4 = 5.25. Absolute errors are 1, 2, 0, 4, total 7, so MAE = 7/4 = 1.75. Option 3 gives the totals without dividing by 4.
Did you get it right without looking?
One question tells you little. A timed set on Elementary principles of machine learning shows your real accuracy, how long you take and where you lose marks.
More Elementary principles of machine learning questions
- A pricing team fits a claim-severity model and finds that its error on the data used for fitting is very small, but its error on a separate …
- A modeller fits polynomial regressions of increasing degree to the same training data. The training error falls steadily with degree, but th…
- In ridge regression, a penalty equal to a positive constant λ times the sum of squared coefficients is added to the residual sum of squares.…
- A dataset is split into training, validation and test sets to choose the number of neighbours k in a k-nearest-neighbours model. What is the…
- An insurer has a dataset of past motor policies, each labelled with whether a claim was made, and wants a model to predict claims for new po…
- A model is fitted with a penalty on the sum of squared coefficients, with penalty weight λ. Training error is 4.0 at λ=0 and validation erro…