ACCA Strategic Professional · Strategic Business Leader · Machine learning, AI and robotics
Kestrel Lending, a bank, uses a machine learning model to approve personal loans. An internal review finds that applicants from certain postcodes are declined far more often, even though postcode is not an input. The model uses a proxy variable highly correlated with postcode. Which ethical and governance issue does this most directly illustrate?
This illustrates algorithmic bias through proxy variables. Even though postcode is excluded, a correlated variable reproduces its effect, leading to unfair outcomes for certain groups. Governance should require bias testing, fairness monitoring and review of input variables, not just removal of the sensitive field.
- AAlgorithmic bias arising from proxy variables in training dataCorrect
- BModel drift caused by changes in interest rates
- CLack of processing capacity in the bank's cloud infrastructure
- DOverfitting caused by too few input variables
Explanation
Removing a protected or sensitive attribute does not remove bias if other variables act as proxies for it. The outcome is discriminatory and creates fairness, reputational and legal risk. Model drift concerns changing data patterns over time, not unfair outcomes linked to a proxy.
Did you get it right without looking?
One question tells you little. A timed set on Machine learning, AI and robotics shows your real accuracy, how long you take and where you lose marks.
More Machine learning, AI and robotics questions
- Tamsin Foods deploys software robots that log into its systems, copy supplier invoice data into the ledger and follow fixed rules, with no a…
- Halden Retail uses a machine learning model to shortlist job applicants. The model was trained on ten years of past hiring decisions, during…
- Orion Logistics develops a deep learning model that predicts delivery delays. It achieves 99% accuracy on the historical data used to build …
- Dalton Insurance feeds its entire customer database, with no outcome labels, into an algorithm that groups customers into segments with simi…
- Orlan Logistics plans to replace 40% of its warehouse workforce with robots and AI scheduling. The CEO argues the decision is purely commerc…
- Calder Bank wants to reduce card fraud losses. Fraud patterns change constantly and are not fully captured by any fixed list of rules. The b…