CS Professional · Artificial Intelligence, Data Analytics and Cyber Security - Laws and Practice · Artificial Intelligence - Introduction and Basics
A company uses a deep neural network with many hidden layers to approve credit limits. A customer asks why her limit was reduced, and the company cannot trace the reasoning behind the output. Which feature of deep learning does this most directly illustrate, and why does it matter for compliance and accountability?
This illustrates the black-box problem of deep learning. Multi-layer neural networks produce outputs whose internal reasoning is hard to interpret, so the company cannot explain or audit the decision, which weakens accountability, fairness and the ability to justify automated decisions to customers and regulators.
- AOverfitting; it means the data was encrypted improperly
- BThe black-box problem; lack of explainability makes it hard to justify or audit automated decisionsCorrect
- CSupervised labelling; it guarantees decisions are always lawful
- DClustering; it shows the model has no hidden layers
Explanation
Deep networks with many layers learn complex internal representations that are hard to interpret, called the black-box problem. Without explainability, a company struggles to justify decisions to affected persons, auditors or regulators, which raises accountability and fairness concerns. It is not an encryption or labelling issue.
Did you get it right without looking?
One question tells you little. A timed set on Artificial Intelligence - Introduction and Basics shows your real accuracy, how long you take and where you lose marks.
More Artificial Intelligence - Introduction and Basics questions
- Pune-based FinServe Ltd trains a model to classify customer emails as 'complaint' or 'enquiry' using a dataset in which each email already c…
- A bank deploys software that can only play out a fixed role: it reads cheque images and flags signature mismatches, and it cannot perform an…
- A retailer in Pune feeds thousands of unlabelled customer purchase records into an algorithm that groups customers into segments with simila…
- An Indian lender uses a model that is trained on historical, labelled loan records, each marked 'defaulted' or 'repaid', to predict whether …
- A bank's fraud-detection AI performs well in testing but, after six months, its accuracy drops sharply because customer spending behaviour a…
- A Chennai hospital group builds a diagnostic AI using patient records collected for treatment. A data scientist proposes using the full iden…