IAI Actuarial Core Principles · Risk Modelling and Survival Analysis · Elementary principles of machine learning
A classifier is tested on 200 policies, of which 40 are actual fraud cases. It flags 50 policies as fraud, and 30 of these are genuinely fraudulent. What are its precision and recall for fraud?
Precision is 0.60 and recall is 0.75. With 30 true positives, precision divides by the 50 flagged policies and recall divides by the 40 actual fraud cases. Swapping these denominators gives the common wrong answer of 0.75 and 0.60.
- APrecision 0.60, recall 0.75Correct
- BPrecision 0.75, recall 0.60
- CPrecision 0.60, recall 0.15
- DPrecision 0.75, recall 0.15
- Precision 0.80, recall 0.60
Explanation
True positives = 30. Precision = 30/50 = 0.60 (flagged cases that are fraud). Recall = 30/40 = 0.75 (actual frauds caught). Option 1 swaps the two measures; the others use wrong denominators such as 200.
Did you get it right without looking?
One question tells you little. A timed set on Elementary principles of machine learning shows your real accuracy, how long you take and where you lose marks.
More Elementary principles of machine learning questions
- A life insurer in Mumbai has data on 20,000 customers (age, premium paid, number of policies, channel) but no outcome variable. An analyst a…
- An actuary fits a flexible model to 200 motor claims and finds it has a very small error on those 200 records but a much larger error on 100…
- An analyst uses k-fold cross-validation with k = 5 on a dataset of 1,000 observations to compare models. Which description of the procedure …
- A data scientist fits a very flexible model to a claims dataset. It achieves a very low error on the training data but a much higher error o…
- A analyst applies K-means clustering to policyholder data containing annual premium (in rupees, values in the lakhs) and age (in years, valu…
- A binary classifier for insurance claim fraud is tested on 200 claims. It flags 40 as fraud, of which 30 are truly fraud. In total 50 of the…