Modeling Operational Profile for AI Systems: A Case Study on UAV Systems

Operational profile (OP) and reliability testing is vital to ensure the reliability of artificial intelligence (AI) systems. This paper presents the AIOP (AI-oriented Operational Profile) method, which enhances reliability testing for AI systems, by incorporating environmental and data profiles to comprehensively represent their internal functioning and interaction with the external environment. Through the implementation of the AIOP framework and the introduction of feature-oriented profile modeling for environmental and data profiles, this study offers valuable insights for improving system reliability and reducing potential risks in the development and testing of AI systems across various domains. A case study on the UAV system, DroneResponse, demonstrates the effectiveness of the AIOP method.