Responding to emerging situation by developing the Ranking Capability Score (RCS)

The data fusion community have introduced multiple procedures of situational assessments to facilitate timely responses to emerging situations. Process Refinement (level 4) of the Joint Directors of Laboratories (JDL) is a meta-process used to assess and improve the data fusion task during a real-time operation. The User Refinement (level 5) of the JDL is intended to address knowledge representation for the decision-making resources. In this regard, we have proposed a performance metric to direct the analysts' attention about any ranking capability issues that may occur during a real-time operation. This paper discusses the interaction between machine projection and user perception. In particular, it is conducting a reliability-based evaluation to examine the proposed scoring scheme against the operators comprehension. The Ranking Capability Score (RCS) has successfully quantified different ranking instances appropriately. However, it provides incomprehensible scores for the analysis team, specifically, under a situational assessment where the number of prioritized events is dynamically shifted in a multi-projection environment.