Evaluation task in Interactive Topic Detection and Tracking

Interactive Topic Detection and Tracking (iTDT) is a branch of TDT research focusing on the aspects of user interface and user interaction. Thus, user tasks are the main focus in iTDT. This paper described the methodology used to design and to evaluate the Tracking and the Detection task. The tasks were designed to support the journalists to perform it in a way that it is in line with their task. Interactive Event Tracking System (iEvent) was used in the user experiment and the procedure of performing the TDT tasks using iEvent was explained.