ACCA Strategic Professional · Advanced Performance Management · Data science and analytics
Orrin Bank has built a model using customer data. The model achieves very high accuracy on the data used to build it but performs poorly when applied to new customers. Which problem does this most likely indicate?
The problem is most likely overfitting. The model has learned random noise and quirks of the training data, so it scores highly there but generalises badly to new customers. Underfitting would instead produce weak results on both the training data and new data.
- AUnderfitting, because the model is too simple to capture patterns
- BOverfitting, because the model has learned noise specific to the training dataCorrect
- CData latency, because the data was captured too slowly
- DSelection of an unsupervised method instead of a supervised method
Explanation
A model that excels on its training data but fails on unseen data has captured noise rather than general patterns, which is overfitting. Underfitting would show poor performance on both training and new data. The scenario gives no evidence of latency or of the method type.
Did you get it right without looking?
One question tells you little. A timed set on Data science and analytics shows your real accuracy, how long you take and where you lose marks.
More Data science and analytics questions
- Zenara Retail's finance team currently reviews monthly sales reports that explain why last month's sales fell below budget in each region. T…
- Wexford Foods has a large set of customer purchase records with no pre-defined labels. It wants an algorithm to discover natural groups of c…
- Orlan Telecom's dashboard is driven by a self-service analytics tool that lets managers filter results by region, product and customer segme…
- Halvik Manufacturing uses an AI model to recommend bonus payouts to plant managers based on sensor-derived output, scrap and downtime data. …
- Castell Pharma appoints a data steward for each major data domain (finance, sales, R&D). The CFO wants to know what this role mainly provide…
- Brindle Airlines has a model that forecasts seat demand per flight. It now adds an optimisation engine that, given forecast demand, fleet co…