User-Centric Design: Adjective Rating Scale for Conversational Agent Interaction

Measuring the user experience (UX) of Conversational Agents (CA) is crucial for ensuring user satisfaction and optimizing performance, which can be more effectively communicated with adjective ratings. Through the employment of a CA measurement tool, the study captures the UX through experiments and structured procedures. Moreover, it underscores the significance of adjective ratings in providing descriptive and qualitative insights into user perceptions and clarification of scale numeric scores. The results revealed a positive correlation between the adjective ratings and the scale numeric scores, indicating their reliability in delineating the UX score of CA. Furthermore, the study further explore the relationship between user demographics and UX with the use of adjective ratings.