www.igaco-o3.fi | Programme status | IGACO activities | Cluster D

17 Dec 2017

Activity Cluster D: Services

Activity D1: Better data access and archiving

The goal for this task is to develop a plan on how to work towards one-stop facilities for both data submission and retrieval. Despite attempts to integrate data sets of different types and from different sources at an accessible data centre (e.g. WOUDC), currently each scientist typically needs to contact all data sources and archives individually (and sign a multitude of agreements and protocols) in order to obtain data for a study.

Originally planned tasks:

  • organize workshop to discuss the process, including user requirements
  • develop tools for improving access to data that are routinely needed for Antarctic Ozone Bulletins
  • develop tools for Scientist assigned to work on the forthcoming Ozone Assessments
  • follow implementation
Coordinator: TBD

Status: Closed. Under the responsibility of WIS.
Meeting arranged in Duebendorf 2007. On-going activity under the responsibility of WIS.

Activity D2: Make more total ozone, Umkehr profiles and sondes available in near real-time

For many applications, such as Antarctic Ozone Bulletins, prediction of chemical weather, and satellite validation campaigns, near real-time (NRT) access to data is crucial. The GAW/IGACO goal for improving predictive capability and increased use of assimilation schemes will increase the need of NRT data in the future. Many stations already provide fast data access but more stations should be capable of providing data in near real-time. A possible solution is to use the WMO GTS/WIS data network, developed for worldwide distribution of meteorological data.

Originally planned tasks:

  • train station personnel on how to make data available in GTW/WIS
  • discuss with World Weather Watch and National Meteorological Services how scientists worldwide would obtain easy access to GTS/WIS
Coordinator: WGOS/WMO

Status: On-going. Brewer NRT supported by EUBREWNET. This activity is also part of WGOS pilot project. EU MACC project (CAMS) is also pushing for this. WMO has published 'Guidelines for reporting total ozone data in near real time' in 2011, WMO GAW report No 193: http://www.wmo.int/pages/prog/arep/gaw/documents/FINAL_GAW_193.pdf

Activity D3: Improve access to meteorological data

This task is linked to the previous one. Central repositories such as the European Centre for Medium-Range Weather Forecasts (ECMWF) retrieve and store meteorological data globally in near real-time. For assimilation and modelling purposes, access to those data would be valuable. A contact with ECMWF will be established to discuss how those data could be used for non-meteorological applications and users not working at National Meteorological Services.

Originally planned task:

  • discuss with ECMWF how meteorological data could be made available for non-meteorological applications and users not working at National Meteorological Services
Coordinator: ECMWF

Status: Closed. Not seen as a critical topic anymore.

Activity D4: Streamlining accessibility of UV data in WOUDC and EUVDB

UV data from within GAW is submitted to the World Ozone and Ultraviolet Data Centre (WOUDC) in Toronto, operated by Environment Canada. At present, the WOUDC archive contains both broadband and multi-band data: spectral UV observations from 45 sites mostly located in North America and Asia; multi-band UV data from 35 sites, mostly from the US; and broadband UV data from 4 sites. Archives of the European UV Data Base (EUVDB) and NSF UV network contain measurements from European and the NSF network respectively. Most of these data are not currently available from the WOUDC, or vice versa.

Originally planned tasks:

  • harmonization of WOUDC and EUVDB databases
  • generate pre-calculated products (at the database) from spectral data for users (various dose rates, daily and monthly doses etc.)
  • include of overpass satellite UV data to facilitate validation against ground-based data (one-stop service)
  • in the next phase (follow-on activity), work also on NSF and NDACC data
Coordinators: WOUDC & EUVDB

Status: On-going. Collaboration with EUVDB and WOUDC on-going.

Activity D5: Increase UV data in the WOUDC

Even if no formal requirements from the UV-SAG exist for those data, both WOUDC and EUVDB initially concentrated on populating the database with spectral data. There is a need to extend the database(s) to include more multifilter and broadband data, and possibly also underwater measurements in the future. For some data types the submission (and retrieval) process might be simplified. The UV-SAG has already begun to address this issue.

Originally planned tasks:

  • invite more existing stations to become GAW associated as regional or contributing stations (already under discussion in UV-SAG)
  • discuss simplified data submission procedures to database(s), particularly for the underrepresented broadband and multifilter instruments (see below)
  • results of activity B1 may lead to increased spectral monitoring at new sites, or replacing current broadband sites
  • there are 3 USDA decommissioned UV spectroradiometers that are available for reassignment to other sites within GAW. Suitable sites with sufficient support will be selected by UV-SAG
Coordinator: UV-SAG

Status: On-going. Collaboration with EUVDB and WOUDC on-going.

Activity D6: Mapping the current situation for data providers

The purpose of this activity is to have a quantitative understanding of how many different databases/formats the individual data providers need to support, in order to estimate the usefulness and feasibility of a "one-stop portal" for data submission (see activity D1 above).

Originally planned tasks:

  • approach data providers and ask which databases they are asked to support / supporting, with specific questions on data centres, frequency of submission, data types submitted
  • check those databases for products: data formats, commonalities/differences, redundancies
  • Not checking consistency of data
Coordinator: O3-SAG

Status: Closed. This activity is now under the responsibility of WIS.

Activity D7: Multiple versions of same data

The purpose of this activity to avoid the situation when apparently same data appears in different databases, but has different content (example: NDACC O3 profile may have different content than WOUDC). There would be a need for a "main database" for any given dataset. This is a long-term goal, not immediate implementation for a wider system.

Originally planned tasks:

  • pilot project could be started between NDACC & WOUDC, and possibly SHADOZ
  • follow-on activity / pilot project: consider the possibility of switching to "pick up" system at specific sites (i.e., data centre "pulling" data from provider instead of provider "pushing" data to data centre)
Coordinators: NDACC & WOUDC

Status: On-going. This work is critical for data centers. Collaboration between NDACC and WOUDC on-going. This activity is under the responsibility of World Data Center Expert Team.

Activity D8: Review existing services and tools

A review on ozone, UV, greenhouse gases and air quality was performed within the GSE PROMOTE project (2005). ESA agrees to provide this documentation, precising the different segments and the corresponding needs.

Originally planned task:

  • obtain review results from ESA and make available on IGACO website. (Note: focus is on Europe, so this is a starting point. Needed as background information for developing services)
Coordinator: TBD

Status: Closed. Combined with activity D9.

Activity D9: Overview of existing data services - follow-on

Originally planned tasks:
  • send out a questionnaire on behalf of IGACO requesting for concise information on existing ozone data services (web link; 2-3 sentences description; contact person; information on main users; original / main data source)
  • feedback from service providers
  • a review phase to test the links, assess usefulness, lacks
  • WMO coordinates a report
Coordinator: IGACO-O3/UV

Status: On-going. WOUDC is working on this.

Activity D10: Guidelines for tools to be included

Several databases offer web-based tools (either images or on-line graphical package); however those tools do not necessarily meet the needs of all users, who would want to, e.g., compare data and make their own tailor-made plots.

A recommendation is that, in a system for instance like WIS, a dataset that is requested will come with its metadata, data protocol, and also an interface package . At minimum, this interface package would include reading routines in FORTRAN and/or C. There could be supplement, such as graphical scripts as long as they are based on free software and that they are open-source. For graphics these scripts could rely on software like GMT, Grads, and Vis5d.

Originally planned task:

  • define guidelines for "mandatory" tools, based on description above. Read/write routines and data catalogue are probably the most useful tools.
Coordinator: TBD

Status: Closed. Data center and WIS related topic.

Activity D11: Identifying historical data

There exist quite a lot of data that have been discontinued, and the originator does not (any more) support calibration/validation history. Specific campaign data can be included in this category. WOUDC (other data centres to be confirmed) will tag those data so that users clearly understand the difference with those data and currently supported data.

Originally planned task:

  • not defined
Coordinator: O3-SAG

Status: Closed. On-going normal activity at data centers.

Activity D12: Development of WIS

Follow the definition and development of the WMO Information System (WIS) pro-actively, so that the needs of IGACO are taken into account as much as possible. At the same time, IGACO-O3/UV and WMO will keep the O3/UV community informed of development status. WMO will work (on a best effort basis) to obtain a commitment from WIS for supporting non-WMO (science) communities.

Task:

  • not defined
Coordinator: WMO?

Status: Closed. This activity is on-going activity at WMO