Co-operative game for certification and continued conformance check of AI enabled CPS*

One of the biggest challenges in widespread acceptance and deployment of cyber physical systems (CPS) such as medical devices or autonomous cars is generating trust in users about their safety, security and effectiveness. As such the certification process is of utmost importance. However, the process of certification for a CPS is potentially an intractable problem and can never be optimally solved to obtain a CPS that is regulatory compliant in an absolute sense. Introduction of data driven learning introduces non-determinism that further exacerbates the problem. Moreover, the certification process involves collaboration between certifier and manufacturer who are potentially restricted by the law of the land to communicate with full transparency. In this paper, we navigate the certification space in the medical device domain and provide a framework through co-operative gaming to certify a CPS under a limited operational environment in an agile iterative process with assurance guarantees.