ACCA Strategic Professional · Advanced Performance Management · Technology and information systems
Orion Logistics trained a machine learning model on 24 months of delivery data. It achieves very high accuracy on the training data but performs poorly when predicting costs for new routes. Which problem is most likely, and what is the appropriate remedy?
The most likely problem is overfitting: the model has learned noise specific to the training data and so fails on new routes. The remedy is to validate on unseen data and simplify the model or supply more varied data. Underfitting would show weak results on the training data too.
- AOverfitting; validate on unseen data and simplify the model or add more varied dataCorrect
- BUnderfitting; add more complex features and train on the same data only
- CData lake failure; move the data into a data warehouse
- DBlockchain latency; increase the number of network nodes
Explanation
Excellent fit on training data but poor results on new data is the classic sign of overfitting, where the model captures noise rather than general patterns. Remedies include validating on a separate test set, simplifying the model and using more varied data. Underfitting would show poor performance on both training and new data.
Did you get it right without looking?
One question tells you little. A timed set on Technology and information systems shows your real accuracy, how long you take and where you lose marks.
More Technology and information systems questions
- Kestrel Retail plc wants to forecast monthly demand for 2,000 products using five years of sales history, promotions and weather data. The f…
- Nordvik Retail's finance team builds its monthly performance dashboard from sales data held in three separate systems. Managers notice that …
- Brightmoor Bank pays regional managers a bonus based on a customer satisfaction index drawn from an analytics platform. Internal audit finds…
- Brindle Telecom uses a machine-learning model on customer usage and billing data to estimate each customer's probability of cancelling withi…
- Zentra Retail plc wants its finance team to forecast monthly sales for each of its 400 stores using five years of historical sales, local we…
- Marlow Foods' management accountants currently produce monthly variance reports manually from exported spreadsheets, which are issued ten wo…