ACCA Strategic Professional · Strategic Business Leader · Machine learning, AI and robotics
Brightpath Recruitment uses an AI tool trained on ten years of its own hiring decisions to shortlist candidates. An internal review finds the tool systematically ranks women lower for senior roles, because past managers hired mostly men. What is the most accurate diagnosis and implication?
The tool has learned historic bias from the training data and so reproduces discrimination. The implication is that the board should require bias testing, better data and human oversight. Greater computing power or changing hosting would not remove bias already embedded in the model.
- AThe training data embeds historic bias, so the model reproduces discrimination and the board should require bias testing and human oversightCorrect
- BThe model is malfunctioning technically, so it should simply be given more processing power
- CThe result is acceptable because the model is objective and has no human involvement
- DThe problem arises only because the tool is cloud-hosted, so moving it in-house would solve it
Explanation
Models learn patterns in historic data, including biased human decisions, so the output reflects past discrimination. The remedy is governance: bias audits, representative data, and human review of outcomes. More power or relocating hosting does not change what the model has learned, and 'objective' is wrong because bias is inherited.
Did you get it right without looking?
One question tells you little. A timed set on Machine learning, AI and robotics shows your real accuracy, how long you take and where you lose marks.
More Machine learning, AI and robotics questions
- Orlan Bank's credit-scoring model was trained on ten years of lending decisions, during which loans to applicants from certain postcodes wer…
- Marlow Insurance's finance director, a professional accountant, is asked to sign off an AI-generated forecast used in a bond prospectus. She…
- Brevik Logistics introduced a demand forecasting model that performed well for two years. After a major shift in customer buying behaviour f…
- Halden Logistics uses a deep neural network to set delivery prices. The board is told the model is highly accurate, but engineers cannot exp…
- Hartwell Finance uses a software robot that logs into several systems, copies invoice data from emails into the ledger by following fixed ru…
- Delmar Telecom wants to use AI to group its customers into segments based on usage patterns, with no predefined categories, to design new ta…