Requirements Elicitation and Stakeholder Communications for Explainable Machine Learning Systems: State of the Art

Machine Learning (ML) systems are currently used widely. While the requirements elicitation and management processes are well understood and standardized for software systems, they have not been adopted for ML systems. These processes pose additional complexity due to the multitude of stakeholders, their understanding of ML concepts, and their varied requirement orientations. Communication among the stakeholders is a must to generate an appropriate requirements document to guide the development of the system. Another aspect of ML systems is their black box mode of operation. It is essential to know the reasoning behind the predictions of these systems, especially for critical applications. These explainability requirements also must be taken into consideration. This paper reviews state of the art in these two areas to form a basis for developing a framework for stakeholder interaction to facilitate the requirement management of ML systems.