The IEEE GRSS data and algorithm standard evaluation (DASE) website: Incrementally building a standardized assessment for algorithm performance

In order to ensure homogeneity in performance assessment of proposed algorithms for information extraction in the Earth Observation (EO) domain, standardized remotely sensed datasets are particularly useful and welcome. Fully aware of this principle, the IEEE Geoscience and Remote Sensing Society (GRSS) and especially its Image Analysis and Data Fusion Technical Committee (IADF), has been organizing for some years now the Data Fusion Contest (DFC). In the DFC, one specific dataset is made available to the scientific community, which can download it and use it to test its newly developed algorithms. The consistence of the starting dataset across participating groups ensures the significance of assessing and ranking results, to finally proclaim the winner who scored the highest. More recently, the IEEE GRSS has provided one more contribution to the standardization effort by building the Data and Algorithm Standard Evaluation (DASE) website. DASE can distribute to registered users a limited set of possible “standard” open datasets, together with some ground truth info, and automatically assess the processing results provided by the users. In this paper we report on the birth of this initiative and present some recently introduced features.