Assessment of expert panels

Expert panels are groups of people who work together to perform a given task, make diagnostics, or reach a decision. A good example of an expert panel is a software development team. The Condorcet-List theorem states that under certain conditions the proposals of a group may be more reliable than those taken by a single expert. In order to estimate the probability of an individual arriving at the correct choice, the authors of the present work use the Rasch model, as is usual in assessments. Besides evaluating individuals, the present paper uses the Rasch model to assess software development teams. To evaluate a team, it is proposed that each member of the group is able to give educated advice in each subtask of the problem. This is necessary, since the Condorcet-List theorem requires that decisions be taken by a majority vote, and that each voter has a probability greater than 0.5 of giving a correct feedback to his/her co-workers.