Changing Software in a Changing World: How to Test in Presence of Variability, Adaptation and Evolution?

Modern software-intensive and pervasive systems need to be able to manage dierent requirements of variability, adaptation and evolution. The latter are surely related properties, all bringing uncertainty, but covering dierent aspects and requiring dierent approaches. Testing of such systems introduces many challenges: variability would require the test of too many congurations and variants well beyond feasibility; adaptation should be based on context-aware testing over many predictable or even unpredictable scenarios; evolution would entail testing a system for which the reference model has become out-of-date. It is evident how current testing approaches are not adequate for such types of systems. We make a brief overview of testing challenges for changing software in a changing world, and hint at some promising approaches, arguing how these would need to be part of a holistic validation approach that can handle uncertainty.