Benefits of intended system functionality and performance are examined and documented.
About
AI system benefits should counterbalance the inherent risks and implicit and explicit costs. To identify system benefits, organizations should define and document system purpose and utility, along with foreseeable costs, risks, and negative impacts. Credible justification for anticipated benefits beyond the status quo should be clarified and documented.
Actions
Utilize participatory approaches and engage with system end users to evaluate system efficacy and interpretability of AI task output.
Incorporate stakeholder feedback about perceived system benefits beyond the status quo.
Align system requirements with intended purpose and document decisions.
Perform context analysis related to time frame, safety concerns, geographic area, physical environment, ecosystems, social environment, and cultural norms within the intended setting (or conditions that closely approximate the intended setting).
Transparency and Documentation
Organizations can document the following:
Have the benefits of the AI system been communicated to users?
Have the appropriate training material and disclaimers about how to adequately use the AI system been provided to users?
Has your organization implemented a risk management system to address risks involved in deploying the identified AI solution (e.g. personnel risk or changes to commercial objectives)?
