Badly-posed classification of remotely sensed images-an experimental comparison of existing data labelling systems

Abstract—Although underestimated in practice, the small/unrepresentative sample problem is likely to affect a large segment of real-world remotely sensed (RS) image mapping applications where ground truth knowledge is typically expensive, tedious, or difficult to gather. Starting from this realistic assumption, subjective (weak) but ample evidence of the relative effectiveness of existing unsupervised and supervised data labeling systems is collected in two RS image classification problems. To provide a fair assessment of competing techniques, first the two selected image datasets feature different degrees of image fragmentation and range from poorly to ill-posed. Second, different initialization strategies are tested to pass on to the mapping system at hand the maximally informative representation of prior (ground truth) knowledge. For estimating and comparing the competing systems in terms of learning ability, generalization capability, and computational efficiency when little prior knowledge is available, the recently published data-driven map quality assessment (DAMA) strategy, which is capable of capturing genuine, but small, image details in multiple reference cluster maps, is adopted in combination with a traditional resubstitution method. Collected quantitative results yield conclusions about the potential utility of the alternative techniques that appear to be realistic and useful in practice, in line with theoretical expectations and the qualitative assessment of mapping results by expert photointerpreters.