Making better sense of the mosaic of environmental measurement networks: a system-of-systems approach and quantitative assessment

There are numerous networks and initiatives concerned with the non-satellite-observing segment of Earth observation. These are owned and operated by various entities and organisations often with different practices, norms, data policies, etc. The Horizon 2020 project GAIA-CLIM is working to improve our collective ability to use an appropriate subset of these observations to rigorously characterise satellite observations. The first fundamental question is which observations from the mosaic of non-satellite observational capabilities are appropriate for such an application. This requires an assessment of the relevant, quantifiable aspects of the measurement series which are available. While fundamentally poor or incorrect measurements can be relatively easily identified, it is metrologically impossible to be sure that a measurement series is "correct". Certain assessable aspects of the measurement series can, however, build confidence in their scientific maturity and appropriateness for given applications. These are aspects such as that it is well documented, well understood, representative, updated, publicly available and maintains rich metadata. Entities such as the Global Climate Observing System have suggested a hierarchy of networks whereby different subsets of the observational capabilities are assigned to different layers based on such assessable aspects. Herein, we make a first attempt to formalise both such a system-of-systems networks concept and a means by which to, as objectively as possible, assess where in this framework different networks may reside. In this study, we concentrate on networks measuring primarily a subset of the atmospheric Essential Climate Variables of interest to GAIA-CLIM activities. We show assessment results from our application of the guidance and how we plan to use this in downstream example applications of the GAIA-CLIM project. However, the approach laid out should be more widely applicable across a broad range of application areas. If broadly adopted, the system-of-systems approach will have potential benefits in guiding users to the most appropriate set of observations for their needs and in highlighting to network owners and operators areas for potential improvement.