ACCA Strategic Professional · Strategic Business Leader · Machine learning, AI and robotics
Brevik Logistics introduced a demand forecasting model that performed well for two years. After a major shift in customer buying behaviour following a market disruption, forecast accuracy fell sharply, although the code has not changed. Which issue best explains this?
Model drift explains it. The model was trained on past buying patterns, and when customer behaviour changed the relationships it learned no longer held, so accuracy fell although the code was unchanged. Ongoing monitoring and retraining are needed to manage this.
- AModel drift, because the relationships in current data differ from those in the training dataCorrect
- BInsufficient processing power in the data centre
- COver-reliance on unstructured data
- DLack of a data protection policy
Explanation
Models learn patterns from historical data. When the real-world relationships change, performance degrades without any change in code. This is model (concept) drift, and it requires monitoring and retraining. Processing power would affect speed, not accuracy after a behavioural shift.
Did you get it right without looking?
One question tells you little. A timed set on Machine learning, AI and robotics shows your real accuracy, how long you take and where you lose marks.
More Machine learning, AI and robotics questions
- Elmstead Insurance uses a chatbot to answer routine policy questions at any hour. Which is the most direct business benefit of this applicat…
- Dalmore Health uses a deep learning system to prioritise patients for specialist referral. Clinicians cannot explain why the system ranks pa…
- Brindle Bank trains a model on five years of labelled loan records, each marked 'defaulted' or 'repaid', so it can estimate default probabil…
- Corvane Retail uses an AI system to forecast demand per store and automatically adjust stock orders. The board says the main strategic benef…
- Harbourline Insurance processes thousands of identical claim-registration forms each day. Staff copy data from emails into a legacy claims s…
- Brennan Retail's board is approving a recruitment AI tool bought from a vendor. Directors are concerned that if the tool discriminates again…