IAI Actuarial Core Principles · Risk Modelling and Survival Analysis · Elementary principles of machine learning
A model predicting whether a policy lapses is tested on 1,000 policies, of which 100 actually lapse. The model predicts lapse for 80 policies, 60 of which really lapse. Which row gives the correct precision and recall for the lapse class?
Precision is 0.75 and recall is 0.60. Precision divides the 60 correct lapse predictions by the 80 predicted lapses, while recall divides the same 60 by the 100 policies that actually lapsed. Swapping the denominators gives the wrong pairing.
- APrecision 0.60, recall 0.75
- BPrecision 0.75, recall 0.60Correct
- CPrecision 0.75, recall 0.80
- DPrecision 0.60, recall 0.60
- Precision 0.94, recall 0.75
Explanation
True positives = 60. Precision = TP / predicted positives = 60/80 = 0.75. Recall = TP / actual positives = 60/100 = 0.60. The option with 0.60 and 0.75 swaps the two measures, and 0.94 is overall accuracy-type reasoning: (60+880)/1000 = 0.94, not precision.
Did you get it right without looking?
One question tells you little. A timed set on Elementary principles of machine learning shows your real accuracy, how long you take and where you lose marks.
More Elementary principles of machine learning questions
- In principal components analysis (PCA) of a standardised data set with 5 variables, the eigenvalues of the correlation matrix are 2.5, 1.3, …
- A pricing team fits a very flexible model to claim data and finds that its error on the training data is very small but its error on a separ…
- A data scientist at an Indian insurer tunes the regularisation parameter of a lasso regression. She tries many values and picks the one with…
- An analyst uses 5-fold cross-validation on 1,000 policy records to choose between candidate models. Which description of the procedure is co…
- Which of the following is an example of a regression task, as opposed to a classification task, in a supervised learning setting?
- A general insurer in India wants to group its motor policyholders into segments using only rating variables such as vehicle age, engine capa…