ACCA Strategic Professional · Strategic Business Leader · Enabling success: disruptive technologies
Brelton Bank uses a machine-learning model trained on ten years of lending data to approve loans. An internal review shows approval rates are significantly lower for applicants from certain postcodes, although postcode is not a stated criterion. The CEO wants to keep the model because its default prediction is accurate. Which assessment is most appropriate for the board?
The board should treat this as proxy bias carried over from historical data and act: review model inputs, test outcomes across groups and keep human oversight. Predictive accuracy alone does not remove legal, reputational and ethical risk, and confidentiality or wholesale data deletion are not appropriate answers.
- AKeep the model, because accuracy on default prediction is the only relevant test
- BRemove all historical data, since past data is always invalid
- CTreat it as proxy bias inherited from historical data, requiring review of inputs, outcomes testing and human oversight, given legal, reputational and ethical exposureCorrect
- DDisclose nothing, since the model's logic is commercially confidential
Explanation
Postcode can act as a proxy for protected characteristics, and models trained on historical decisions can reproduce past bias. Accuracy alone does not remove discrimination, ethical or regulatory risk. The board should review features, test outcomes across groups and maintain oversight. Discarding all data is excessive and confidentiality does not excuse unfair outcomes.
Did you get it right without looking?
One question tells you little. A timed set on Enabling success: disruptive technologies shows your real accuracy, how long you take and where you lose marks.
More Enabling success: disruptive technologies questions
- Norvik Foods wants to use blockchain to trace produce from farm to supermarket and prove provenance to consumers. Consultants note the ledge…
- Verdane Insurance plans a smart contract that automatically pays crop-insurance claims to farmers when a weather data feed reports rainfall …
- Halden Retail's board has approved a digital transformation. Early pilots of AI-driven pricing succeeded technically, but store managers res…
- Tarvale Hotels installed smart thermostats and door locks in all its rooms, connected to the internet with the manufacturer's default passwo…
- Tessaro Logistics is a family-owned firm with a stable, risk-averse culture. Its board wants to adopt AI route optimisation but staff fear j…
- Brightwell Manufacturing installs sensors on its machines and uses a model trained on past breakdown data to forecast failures so that parts…