ACCA Strategic Professional · Strategic Business Leader · Enabling success: disruptive technologies
Corvane Retail plans to use an AI system to automatically reject or approve staff expense claims with no human review. Internal audit notes that the model's logic is a 'black box' that managers cannot explain to employees who dispute a rejection. Which risk is most directly highlighted?
The most direct risk is lack of transparency and explainability. If managers cannot explain why the AI rejected a claim, accountability and fair treatment of employees are weakened, and disputes cannot be properly resolved. Human oversight or explainable models would mitigate this governance problem.
- ALack of transparency and explainability, which undermines accountability and fair treatmentCorrect
- BTechnological obsolescence, because the model will soon be replaced
- CData latency, because the claims are processed in batches
- DNetwork capacity risk, because the system will overload the servers
Explanation
The inability to explain how decisions are reached is an explainability and transparency problem. It weakens accountability, makes challenge difficult and may breach fairness expectations. The other risks are not indicated by the facts given.
Did you get it right without looking?
One question tells you little. A timed set on Enabling success: disruptive technologies shows your real accuracy, how long you take and where you lose marks.
More Enabling success: disruptive technologies questions
- Karvel Airlines analyses historical booking, weather and maintenance data to estimate which aircraft components are likely to fail in the ne…
- Ostrel Retail plans to launch a digital platform opening its ordering system to third-party sellers. The board is concerned about governance…
- Elmstead Hospitals plans a big data programme combining patient records, wearable-device data and external research. The CEO wants it to del…
- Halden Insurance uses software robots to copy policy data between its legacy claims system and its billing system. The robots follow fixed r…
- Tamsin Foods is considering moving its finance systems to cloud-based SaaS. The finance director argues the main benefit is a shift from cap…
- Halden Insurance deploys a machine learning model that automatically declines claims it scores as likely fraudulent, with no human review. C…