ACCA Strategic Professional · Strategic Business Leader · Machine learning, AI and robotics
Corvane Bank deploys a deep neural network to approve or decline loans. A declined customer asks why, and the bank's staff cannot explain which factors drove the decision. Regulators require decisions affecting customers to be justifiable. Which limitation of the AI is the most significant issue here?
The key limitation is lack of explainability, the black box problem. Staff cannot show which factors produced a loan decision, so the bank cannot justify outcomes to customers or regulators, which weakens accountability and creates compliance and reputational risk.
- AScalability of the cloud infrastructure
- BLack of transparency or explainability (the black box problem)Correct
- CExcessive human oversight slowing the process
- DObsolescence of the hardware used to run the model
Explanation
Deep neural networks often cannot show the reasoning behind a specific output. This undermines accountability, customer challenge and regulatory compliance. The other options are not described in the case; the problem is inability to explain decisions, not capacity or hardware.
Did you get it right without looking?
One question tells you little. A timed set on Machine learning, AI and robotics shows your real accuracy, how long you take and where you lose marks.
More Machine learning, AI and robotics questions
- Dalton Insurance feeds its entire customer database, with no outcome labels, into an algorithm that groups customers into segments with simi…
- Orlan Logistics plans to replace 40% of its warehouse workforce with robots and AI scheduling. The CEO argues the decision is purely commerc…
- Calder Bank wants to reduce card fraud losses. Fraud patterns change constantly and are not fully captured by any fixed list of rules. The b…
- Velmont Retail's RPA programme has delivered savings in the finance team, and the board now wants to extend it to customer correspondence, w…
- Kestrel Insurance wants a system that learns from 200,000 past claims, each labelled 'fraudulent' or 'genuine', so that it can classify new …
- Tessaly Insurance plans to replace most claims handlers with an AI system. The board is told the technology works, but staff fear job loss, …