A single ascii format data file syntax was recommended by the CSDS Archive Task Group for the exchange of science data between instrument teams. This format was intended as an exchange format to allow translation between the several native data formats used by science tools and data bases within the Cluster community. Adopting a single common format, that can be written and read by all teams, allows exchange of data between any of the other formats and storage systems.
This format was adopted by the Cluster Active Archive design team as the basis for the format to be used for delivery of science data to the CAA, and as a possible format for delivery to science users. As a consequence configuration control of this document has been transferred to the data Formats working group of the CAA, and the specification has been made more rigorous.
The file syntax and minimum header content is specified to describe the products sufficiently for science use. The open format also allows for inclusion of any extra metadata deemed desirable by the generating team.
This format serves to facilitate the storage of commonly used science products in a robust and easily accessible form. It is not intended to replace the normal data exchange channels used by each instrument group - such as ISDAT and IDFS. It is intended to facilitate delivery of data products to workers outside of the instrument team with different science and database software. It will also facilitate delivery of science products to future scientists without access to specific software in use at the time of data archival.
Software that can translate between the CSDS standard CDF files and CEF files is maintained by Imperial College London, Space and Atmospheric Physics group. The utility, called Qtran, can be obtained from
http://www.sp.ph.ic.ac.uk/csc-web/Qtran/qtran_welcome.html
The same utility is able to read other record oriented ascii data and may help with translation from ascii data dumps into the recommended exchange format.
This document provides the syntax for these ``Cluster Exchange Format'' (CEF) files. The syntax specified in version 2.0 and above of this document is not completely backwardly compatible with earlier versions used for Cluster data exchange. Earlier versions of this syntax will be referred to as cef 1, and the syntax specified for the active archive will be designated cef 2.