Measures and Metrics of ML Data and Models to Assure Reliable and Safe Systems

The US Army solicited partners through a Broad Agency Announcement to propose solutions under a Small Business Technology Transfer contract mechanism for the program “Metrics and Methods for Verification, Validation, Assurance and Trust of Machine Learning Models & Data for Safety-Critical Applications in Armaments Systems.” OptTek Systems, Inc. and University of Alabama in Huntsville (UAH) were one of the selected proposals for Phase I. Under this contract agreement OptTek and UAH set the goal to research & develop (R&D) fundamental metrics & measures for the certification & qualification of ML training data sets & models. Of particular note, the use of a safety score calculated from the accuracy as well as a dedicated look at data quality have been demonstrated as reasonable approaches to the proposed topic. As the Technical Point of Contact for this effort, the US Army Combat Capabilities Development Command Armaments Center (DEVCOM AC) authored the topic and provided guidance on the effort to align with mission objectives. This paper is an exploration of the research and development conducted by OptTek and UAH within the framework of how it may be applied to the assurance of systems to be developed by the US Army and augment practices in reliability and safety.