Sustainable system for climate data record generation

2014-02-05T17:04:29Z (GMT) by Christopher J Merchant
<p>Overview of a system for sustained provision of a climate data record from space data (Earth observations), as part of a climate service. It is designed to support: routine, reliable provision of climate-quality observations via robust implementation of excellent scientific methods; and the agile scientific work-flow that delivers upgraded CDRs that react to changing constellations of EO satellites. </p> <p>Continuous R&D is essential in parallel to operations because: experiences of users of the data will always uncover new problems in these huge, complex data sets; inputs (level 1 radiance data, also known as the fundamental climate data record, FCDR) will periodically be reprocessed and improved by space agencies; new sensors will require seamless integration into the CDR, while preserving stability and other quality aspects; scientists continually learn how better to reduce uncertainties and improve stability of CDRs; new user requirements will emerge, demanding new, value-added or better quality CDRs.</p> <p>Sustained CDR operations must include continuous availability of a full, consistently reprocessed CDR. This is the purpose of having overlapping pre-operational and operational CDRs. Pre-operational provision gives users time to move across to the next version CDR.</p> <p>The improvement cycle (loop from problem identification to reprocessing) requires agile implementation of scientific innovations (e.g., new algorithms) within a robust and traceable system environment. The full effect of changes on the CDR is apparent only on reprocessing the full archive. The system must therefore be capable of maintaining routine delivery of ‘new’ data while simultaneously undertaking rapid (perhaps multiple) reprocessing as part of this improvement cycle.</p>