risk
Insufficient human oversight and automation complacency
Because consequential AI decisions run under full automation with reviewers who lack the authority, information, or AI literacy to intervene, meaningful human control is absent and automation complacency erodes vigilance, so erroneous or harmful automated decisions reach individuals unchecked.
Record JSON · Open in map · Data retrieval guide
Catalog revision: 24028ffcfc2b295fa1b08ee6caa84b765f0731b321496bf4f548c49ad2177028. A connection does not establish full coverage.
Attributes
- category
- ai_governance
- domain
- AI Governance
- Governance, Policy & Oversight
- taxonomy
- nist-ai-rmf-risk
- iso-23894-ai-risk
- eu-ai-act-risk
- inherent_rating
- high
Details
- risk_id
- ai-insufficient-human-oversight
- category
- ai_governance
- likelihood
- medium
- impact
- high
- inherent_rating
- high
- treatment
- mitigate
- taxonomies
- nist-ai-rmf-risk
- iso-23894-ai-risk
- eu-ai-act-risk
Source
No record-specific source URL is provided.
Connections
- UC-AI-02 — Define AI roles, responsibilities, and competencies mitigates Insufficient human oversight and automation complacency
- strength
- related
- rationale
- Defining required AI-literacy/competencies and authorities equips reviewers to intervene, enabling the oversight operated by UC-16.
- UC-AI-10 — Meet transparency obligations for AI systems mitigates Insufficient human oversight and automation complacency
- strength
- related
- rationale
- Documenting required human-oversight measures for deployers enables the oversight UC-16 operates.
- UC-AI-16 — Ensure human oversight of AI decisions mitigates Insufficient human oversight and automation complacency
- strength
- primary
- rationale
- Assigning competent overseers with authority to interpret, override or halt and automation-bias awareness is the direct inverse of the missing-oversight risk.
- UC-AI-13 — Assign AI value-chain roles and discharge obligations mitigates Insufficient human oversight and automation complacency
- strength
- related
- rationale
- The obligation register assigns the deployer oversight-assignment duty to a specific owner.
- UC-AI-19 — Constrain agent actions and tool use to authorized scope mitigates Insufficient human oversight and automation complacency
- strength
- related
- rationale
- Approval gates and reviewed escalations put a human back in the loop for consequential agent actions.