ICTlogy

Abstract:

Procuring AI systems is different. It starts with defining acceptable (and unacceptable) uses of the system and traverses a path that specifies expectations toward data quality, data rights, system quality, transparency, explainability, system monitoring, ongoing risk management, and highly-specialized technical audits and inspections.

Evaluating and controlling these factors are essential in the AI procurement and contracting processes. This is particularly important for systems designed to address needs attached to human rights, human dignity, and civil liberties.

Our responsibility, as procuring officials of such high-risk systems, is to instantiate the values and expectations that our fellow humans deserve. This is no small task, and the playbooks are not well formed.

This playbook, based largely on the work conducted by the City of Amsterdam, provides the procurement community with a helpful set of contracting considerations when evaluating and procuring any high-risk AI system. We hope you will share this widely with colleagues...to achieve a world in which all high-risk AI systems are held to reasonably high standards of responsible design, development, and deployment.