Cal-Mex 2010 Data Policy and Management

The Cal-Mex team is committed to full sharing of data between all participants during all phases of the field experiment and subsequent research and analysis activities. This document is intended to provide a framework through which this sharing might be efficient and inclusive. The ultimate goal is not only to have unfettered access to data, but to foster collaborations across the various components of Cal-Mex that will fully exploit the scientific value of the Cal-Mex observations. Given the size and diversity of the Cal-Mex effort, it is imperative that scientific courtesy be observed and that investigators be consulted and appropriately acknowledged whenever their data is used.

Data Timeline

The status of data sets can be thought of as going through three phases: FieldResearch, and Public. Each phase will have its own Data Repository (described below). For Cal-Mex, the dates corresponding to these phases are:

  1. Field Phase: May 15-June 30, 2010
  2. Research Phase: up to June 30, 2012
    Preliminary data due October 1, 2010
    Final data due March 1, 2011
  3. Public Phase: July 1, 2012 onward

During the Field Phase, it is requested, if possible, for investigators to submit their data to the Field Repository within 24 hours of the measurement. These Field Data (raw data, QA/QC level 0) will be used only during the Field Study to assess that the science goals of the mission are being met and to evaluate the forecast models. 
To facilitate scientific analysis of all the data, it is requested that Preliminary Data (QA/QC level 1) be submitted to the Research Repository byOctober 1, 2010.  Final Data must be submitted by March 1, 2011
During the Research Phase, data are only available to Cal-Mex participants and the Research Repository will be protected by password. Each data file should include in its header (metadata) a clear indication of whether the data is Preliminary or Final. 
All data will be made publicly available on July 1, 2012 by removing the password control on the Research Repository.

Data Policy

In order to be sure that data is used and acknowledged fairly and properly, all Cal-Mex participants are requested to accept the following responsibilities:

  1. Submit data according to the specified schedule, in one of the specified formats
  2. Provide adequate metadata in data files
  3. Consult with PIs when using their data
  4. Invite PIs of any data used to be co-author (particularly during research phase)
  5. PIs should be available to answer questions about their data after submission (need to provide contact information in file headers)

During the Research Phase, all Cal-Mex participants will have access to all data. 
All data will become public on July 1, 2012. This is consistent with NSF data policies to make data public 1-2 years after an experiment. Individual Cal-Mex teams may choose to release their data to the public sooner. Such elections to accelerate public release will not affect the protected status of the larger Cal-Mex data holdings. Component groups may also elect to share data or collaborate with groups outside the Cal-Mex community. Such data sharing with third parties will be arbitrated by leadership within the relevant component group and will respect the protected status of data from the other component groups.

Acknowledgement Statements

When any of the Cal-Mex data are used in a publication, an acknowledgement statement should be included, recognizing the efforts and funding from the large number of people and agencies involved.

Data Formats

To allow consistency with previous measurement campaigns, NARSTO data formats will be used during Cal-Mex.

  1. Please see NARSTO website for the NARSTO DES format description.
  1. Instructions for the NARSTO Atmospheric Measurements Template.


Data Repository

The Molina Center will serve as the field data repository. Contact Jared Morante (jmorante AT mce2.org) for further assistance.