Summary of UK CSDS Data Processing

The processing of UK CSDS products (i.e. Prime and Summary Parameters for FGM, PEACE, and DWP) is described in the document `Process Control for the Routine Production of the UK CSDS Data Products', CU-QMW-TN-0005.

The schematic processing chain is reproduced here in the interests of providing a self contained interface description.

1. RDM received and logged at DRAL.
2. PI data reduction software (using/incorporating DRAL RDM reading software) generates the Prime Parameter Interface Files (PPIF) (one per spacecraft) and the Summary Parameter Interface File (SPIF). These are ASCII files, collectively referred to as .iff files, and are defined below. They will be referred to as `files' throughout this document, but in practice the output from the PI provided data reduction software may be a stream to `standard out' in the prescribed ASCII format, details are specified for each instrument in the Process Control definition, CU-QMW-TN-0004. Since the CDF writing software must make two passes over the interface files it will not be possible to pipe the output from the PI provided software directly into the CDF writing software, and a physical intermediate file must always be constructed. This file will be a concatenation of the output from the data reduction software and information from the controlling script and RDA software.
3. QMW software generates version ``00'' CDF files conforming to CSDS standards from these .iff files and the corresponding CSDS skeleton files.
4. PIs (or designate) validate the data contained within the CDF files. This requires changing various attributes and the version number to ``01'' (or higher), and will be accomplished using CSDS-UI supplied validation software (produced under contract by DRAL).
5. DRAL ingestion software incorporates this CDF into the CSDS database. Note that this ingestion software must check for the existence of a prior version (``n'' say), rename the new version as ``n+1''.
6. This CDF file is now ready for delivery to (or pick up by) other CSDS national data centres, and for access by the Cluster community.

The top level process control is described elswhere, CU-QMW-TN-0005.