Climate and Forecast Metadata Conventions

The Climate and Forecast (CF) metadata conventions are conventions for the description of Earth sciences data, intended to promote the processing and sharing of data files. The metadata defined by the CF conventions are generally included in the same file as the data, thus making the file "self-describing". The conventions provide a definitive description of what the data values found in each netCDF variable represent, and of the spatial and temporal properties of the data, including information about grids, such as grid cell bounds and cell averaging methods. This enables users of files from different sources to decide which variables are comparable, and is a basis for building software applications with powerful data extraction, grid remapping, data analysis, and data visualization capabilities.

History and Evolution

The CF conventions were introduced in 2003, after several years of development by a collaboration that included staff from U.S. and European climate and weather laboratories ^[1]. The conventions contained generalizations and extensions to the earlier Cooperative Ocean/Atmosphere Research Data Service (COARDS) conventions ^[2] and the Gregory/Drach/Tett (GDT) conventions ^[3]. As the scope of the CF conventions grew along with its user base, the CF community adopted an open governance model ^[4]. In December 2008 the trio of standards, netCDF+CF+OPeNDAP, was adopted by IOOS as a recommended standard (number 08-012) for the representation and transport of gridded data. The CF conventions are being considered by the NASA Standards Process Group (SPG) and others as more broadly applicable standards ^{[5] [6]}.

Applications and User Base

The CF conventions have been adopted by a wide variety of national and international programs and activities in the Earth sciences ^[7]. For example, they were required for the climate model output data collected for Coupled model intercomparison projects, which are the basis of Intergovernmental Panel on Climate Change assessment reports ^[8]. They are promoted as an important element of scientific community coordination by the World Climate Research Programme ^[9][10]. They are also used as a technical foundation for a number of software packages and data systems, including the Climate Model Output Rewriter (CMOR), which is post processing software for climate model data, and the Earth System Grid, which distributes climate and other data ^[11][12][13]. The CF conventions have also been used to describe the physical fields transferred between individual Earth system model software components, such as atmosphere and ocean components, as the model runs ^[14].

Supported Data Types

CF is intended for use with state estimation and forecasting data, in the atmosphere, ocean, and other physical domains. It was designed primarily to address gridded data types such as numerical weather prediction model outputs and climatology data in which data binning is used to impose a regular structure ^{[15] [13]}. However, the CF conventions are also applicable to many classes of observational data and have been adopted by a number of groups for such applications.

Supported Data Formats

CF originated as a standard for data written in netCDF, but its structure is general and it has been adapted for use with other data formats. For example, using the CF conventions with Hierarchical Data Format data has been explored ^[16].

Design Principles

Several principles guide the development of CF conventions:

• Data should be self-describing, without external tables needed for interpretation.
• Conventions should be developed only as needed, rather than anticipating possible needs.
• Conventions should not be onerous to use for either data-writers or data-readers.
• Metadata should be readable by humans as well as interpretable by programs.
• Redundancy should be avoided to prevent inconsistencies when writing data.

Specific CF metadata descriptors use values of attributes to represent

• Data provenance: title, institution, contact, source (e.g. model), history (audit trail of operations), references, comment
• Description of associated activity: project, experiment
• Description of data: units, standard_name, long_name, auxiliary_variables, missing_value, valid_range, flag_values, flag_meanings
• Description of coordinates: coordinates, bounds, grid_mapping (with formula_terms); time specified with reference_time ("time since T0") and calendar attributes.
• Meaning of grid cells: cell_methods, cell_measures, and climatological statistics.

A central element of the CF Conventions is the CF Standard Name Table. The CF Standard Name Table uniquely associates a standard name with each geophysical parameter in a data set, where each name provides a precise description of physical quantities being represented. Note that this is the string value of the standard_name attribute, not the name of the parameter. The CF standard name table identifies over 1,000 physical quantities, each with a precise description and associated canonical units. Guidelines for construction of CF standard names are documented on the conventions web site.

As an example of the information provided by CF standard names, the entry for sea-level atmospheric pressure includes:

• standard name: air_pressure_at_sea_level
• description: sea_level means mean sea level, which is close to the geoid in sea areas. Air pressure at sea level is the quantity often abbreviated as MSLP or PMSL.
• canonical units: Pa

References

1. ^ Gregory, Jonathan (2003). "The CF metadata standard". http://cf-pcmdi.llnl.gov/documents/other/cf_overview_article.pdf. 
2. ^ "Conventions for the Standardization of NetCDF files". May, 1995. http://ferret.wrc.noaa.gov/noaa_coop/coop_cdf_profile.html. 
3. ^ "GDT netCDF conventions for climate data, version 1.3". March 14, 1999. http://www-pcmdi.llnl.gov/drach/GDT_convention.html. 
4. ^ Lawrence, B.N. (2003). "Maintaining and Advancing the CF Standard for Earth System Science Community Data". http://cf-pcmdi.llnl.gov/documents/white-papers/cf2_whitepaper_final.html. 
5. ^ Rew, Russ (2010). "CF Metadata Conventions". http://www.esdswg.org/spg/rfc/esds-rfc-021/ESDS-RFC-021-v0.01.pdf. 
6. ^ Domenico, Ben (2009). "Web Coverage Service (WCS) 1.1 extension for CF-netCDF 3.0 encoding". http://xml.coverpages.org/OGC-09-018-WCS11-ExtensionCF-netCDF.pdf. 
7. ^ Projects and Groups Adopting or Encouraging the CF-Conventions as a Standard
8. ^ "Report of the 12th Session of the JSC/CLIVAR Working Group on Coupled Modelling (WGCM)". 2009. http://wcrp.ipsl.jussieu.fr/Documents/WMP/136_WGCM12.pdf. 
9. ^ Kinter, James L. III (2005). "Data Issues for WCRP Weather and Climate Modeling". http://wcrp.ipsl.jussieu.fr/Documents/WMP/WMP1_KinterTaylor.pdf. 
10. ^ Taylor, Karl (2005). "Issues Related to the Dissemination of Climate Model Output". http://wcrp.ipsl.jussieu.fr/Documents/WMP/Presentations/WMP1_2-7Taylor.pdf. 
11. ^ Doutriaux, Charles (2010). "Climate Model Output Rewriter". http://esg-repo.llnl.gov/gitweb/?p=cmor.git;a=blob;f=Doc/cmor_users_guide.pdf. 
12. ^ Drach, Bob (2002). "Metadata Standards for Gridded Climate Data in the Earth System Grid". http://archive.niees.ac.uk/talks/metadata/Bob_Drach_talk.ppt. 
13. ^ ^{a b} "NetCDF in ArcGIS 9.2". 2006. http://www.crwr.utexas.edu/gis/gishydro06/Introduction/Presentations/netCDF.ppt. 
14. ^ Dunlap, R. L. Mark, S. Rugaber, V. Balaji, J. Chastang, L. Cinquini, C. DeLuca, D. Middleton, and S. Murphy (2008). "Earth system curator: metadata infrastructure for climate modeling". Earth Science Informatics 1 (3–4): 131–149. doi:10.1007/s12145-008-0016-1. http://www.springerlink.com/content/t781174802510364/fulltext.pdf. 
15. ^ V. Balaji (2008). "Metadata Standards for Gridded Climate Data in the Earth System Grid". http://esdswg.eosdis.nasa.gov/WG/SPG/pdf/esdswg-cf-balaji.pdf. 
16. ^ Yang, M., R. Duerr, C. Lee (2009). "Investigation of using HDF5 archival information packages (AIP) to store NASA ECS data". 25th Conference on International Interactive Information and Processing Systems (IIPS) for Meteorology, Oceanography, and Hydrology, 89th American Meteorological Society Meeting. http://ams.confex.com/ams/89annual/techprogram/paper_148062.htm. 

External links

• CF Metadata Home Page
• The CF Metadata Convention (BADC page)
• NASA Standards Process Group
• Standard for the CF Metadata Conventions (Marine Metadata Interoperabilty Project page)
• Ocean Data Standards on Metadata