ACCA Strategic Professional · Strategic Business Leader · Machine learning, AI and robotics
Orlan Bank's credit-scoring model was trained on ten years of lending decisions, during which loans to applicants from certain postcodes were rarely approved. The model now declines most applicants from those postcodes, though they have strong finances. Which risk has most directly materialised?
The risk is algorithmic bias inherited from biased historical training data. The model learned from past lending decisions that disadvantaged certain postcodes and so reproduces that pattern, even for financially strong applicants. This is a data-quality and fairness problem, not drift or overfitting.
- AOverfitting to random noise caused by too few input variables
- BAlgorithmic bias inherited from biased historical training dataCorrect
- CModel drift caused by a sudden change in market conditions
- DLoss of the black-box property, making the model fully transparent
Explanation
The model has learned patterns embedded in past human decisions, so it reproduces that discrimination. This is bias in the training data carried into the algorithm. Drift concerns changes over time after deployment, not a flaw present in the original data.
Did you get it right without looking?
One question tells you little. A timed set on Machine learning, AI and robotics shows your real accuracy, how long you take and where you lose marks.
More Machine learning, AI and robotics questions
- Marlow Insurance's finance director, a professional accountant, is asked to sign off an AI-generated forecast used in a bond prospectus. She…
- Marlow Retail uses a system that is given thousands of past customer records, each labelled 'churned' or 'stayed', and learns a rule to pred…
- Brevik Logistics introduced a demand forecasting model that performed well for two years. After a major shift in customer buying behaviour f…
- Hartwell Finance uses a software robot that logs into several systems, copies invoice data from emails into the ledger by following fixed ru…
- Elmstead Insurance uses a chatbot to answer routine policy questions at any hour. Which is the most direct business benefit of this applicat…
- Brindle Bank trains a model on five years of labelled loan records, each marked 'defaulted' or 'repaid', so it can estimate default probabil…