ACCA Strategic Professional · Strategic Business Leader · Big data and data analytics
Altair Logistics is building a data lake that will take in unstructured sensor, email and social media data from many sources. The chief data officer is concerned that, without controls, the lake will become a 'data swamp' of unknown quality and provenance. Which action best mitigates this risk?
Maintaining metadata and a data catalogue that records source, owner, quality and permitted use is the best action. It gives context and provenance to stored data, preventing a swamp, while still keeping the lake's flexibility to hold varied unstructured data, unlike restricting formats or allowing uncontrolled editing.
- ARestrict the lake to structured data only and delete other formats
- BMaintain metadata and a data catalogue recording source, owner, quality and permitted use of each datasetCorrect
- CAllow every analyst to add and modify datasets freely to encourage innovation
- DReplace the lake with a single spreadsheet for each department
Explanation
A swamp arises when data is stored without context. Cataloguing with metadata on lineage, ownership, quality and permitted use keeps data findable and trustworthy. Restricting formats defeats the lake's purpose, and unrestricted editing worsens control.
Did you get it right without looking?
One question tells you little. A timed set on Big data and data analytics shows your real accuracy, how long you take and where you lose marks.
More Big data and data analytics questions
- Brightmoor Bank holds transaction data for millions of customers but has no pre-defined categories for them. The marketing director wants an…
- Vexel Manufacturing's analytics team finds that 15% of records in its supplier database have missing or outdated payment terms, causing flaw…
- Marlowe Insurance combines structured policy records with customer emails, call-centre audio recordings, photographs of damaged vehicles and…
- Mirabel Foods, a supermarket chain, combines loyalty-card purchases, in-store sensor footfall data and local weather feeds. Management uses …
- Tavian Bank uses transaction data streams and machine analysis to flag unusual card spending patterns within seconds and block suspected fra…
- Zentra Logistics fits sensors to 40,000 delivery vans. Each van transmits location, engine temperature and fuel use every second, and the co…