Enabling the Department of Defense's Future to Test and Evaluate Artificial Intelligence Enabled Systems

While of great potential benefit, Artificial Intelligence (AI) presents new challenges and exacerbates some existing ones for the Department of Defense (DoD) Test and Evaluation (T&E) community. T&E professionals will need to work to ensure that AI-enabled systems' (AIES) complex and variable nature can be sufficiently characterized by the boundaries of acceptable performance. To help the DoD understand and prepare for the challenges of T&E of AIES, we convened a group of AI adoption, AI development, and policy experts to develop a future vision of T&E with respect to AI. The result is a vision of T&E that incorporates the unique requirements for AIES, encompassing policy changes, user engagement approaches, measures and metrics, data, infrastructure, and cybersecurity. This future vision is accomplishable by identifying focus for efforts across DoD, academia, Federally Funded Research and Development Centers (FFRDCs) and industry to provide processes, policy/standards, tools, data, and infrastructure. Thus, we can assure a more feasible future for the T&E of AIES.