CEDA Repository
Not a member yet
1250 research outputs found
Sort by
Minutes of the 43rd Natural Environment Research Council (NERC) Mesosphere-Stratosphere-Troposphere (MST) Radar Facility Experimenters' Meeting
No full textMeeting date: Thursday 25th June 2009;
Meeting location: The Cosener's House, Abingdon, UK;
Meeting agenda:
1) Minutes of the previous meeting
2) Matters arising
3) Facility Report
4) NERC Instrument Report
5) Guest Instrument Report
6) Science and Technical Presentations
7) Any Other Busines
HPFELD : Hosted Processing Facility for the Exploitation of Large Datasets
No full textThe era of 'big data' means that data centres are under increasing pressure to hold and support datasets which are
much larger than before. The sheer volume of such datasets means that it is becoming impractical for users to be expected to download and store them on their local systems. Even if they could do this, they are then faced with the problem of finding enough local computing resource to process the data in a timely fashion. This is particularly true for Earth Observation (EO)data from satellites. Consequently, these data are effectively unusable by a significant proportion of the user community.
A more efficient approach would be to allow the data centre archive themselves to be coupled to processing capability, and made available to users over the internet. In this way, remote users could select a pre-configured algorithm (or upload their own) to run on the dataset. The actual processing would be run on a host system which was 'close' to the data archive, and the results of the processing, would be made available to view on-line or download to their local systems. In this system, other complementary datasets for the data centre could be easily incorporated into the processing, such as comparison with different 42 model datasets. The host system would also be able to leverage the power of 'cloud' technologies, with the HPFELD system itself providing the environment in which the processing is performed.
The HPFELD project was an attempt to see if existing technologies (such as G-POD, OPeNDAP and OpenID) could be combined to rapidly produce a demonstration system It was part funded by the TSB, and was a collaboration between STFC (CEDA), and the commercial companies Magellium and Terradue. The demonstrator system was set up to process METOP IASI L1C and ECMWF data to derive methane, with the aim of making the processing as flexible and easy to use as possible. Both of these datasets are held in the BADC archive (http://badc.nerc.ac.uk). This system has been used to show the benefits of using this approach when processing very large datasets
Growing a community analysis platform with JASMIN and the Community Inter-comparison Suite
No full textCEDA is developing a the JASMIN Analysis Platform, a set of software which enables researchers to use a constent set of tools whether running their analyses at local reasearch institutions or on JASMIN hardware. A central component of the JASMIN Analysis Platform is the Community Inter-comparisson Suite (CIS): a high-level analysis tool enabling inter-comparison of diverse admospheric and EO datasets through the command-line and a Python interface
Facilitating Effective Collaboration under the JWCRP using the JASMIN Platform
No full textThe JASMIN computing platform at NCAS BADC provides access to high-performance disk, a virtualisation platform, compute cluster and high-speed networking. One key aspect from the NCAS perspective is that resources are equally accessible to researchers in UK universities and the UK Met Office. This makes JASMIN an excellent candidate for hosting services to support collaborations under the Joint Weather and Climate Research Programme (JWCRP)
Running the Met Office NAME dispersion model on the JASMIN computing platform: A new community tool and trajectory service
No full textThe Met Office has traditionally distributed the NAME atmospheric dispersion model and supporting meteorological data to a number of external organisations. CEDA’s new JASMIN platform enables consolidation of resources by providing a centralised and supported NAME community service. Wider exploitation of the model is planned along with a web-tool for running historic forward and backward trajectories and a dataset of NAME outputs including trajectory plots. NCAS scientists can exploit this service for large scale batch runs supporting field campaigns as well as individual research applications
QUICK START GUIDE TO ESA SST CCI PRODUCTS
No full textQUICK START GUIDE TO ESA SST CCI PRODUCTS
This document gives a short introduction to the data products produced in the ESA Climate Change Initiative Sea Surface Temperature project. It explains what products and tools are available, how to download the data and tools, and how to read the data. Links to further information, and contact details are also provided
ESA Globsnow: Algorithm Theoretical Basis Document - SWE-algorithm
No full textSnow Water Equivalent (SWE) Algorithm Theoretical Basis Document; deliverable 06 for the European Space Agency Global Snow Monitoring for Climate Research (GlobSnow) project.
The purpose of the document is to give a detailed description of the algorithms used for generating the GlobSnow Snow Water Equivalent (SWE) product. This document presents the algorithm used for producing the diagnostic data set (DDS) of SWE for the GlobSnow-2 project
Data publication: policies and procedures from the PREPARDE project
No full textData are widely acknowledged as a first class scientific output. Increases in researchers’ abilities to create data need to be matched by corresponding infrastructures for them to manage and share their data. At the same time, the quality and persistence of the datasets need to be ensured, providing the dataset creators with the recognition they deserve for their efforts.
Formal publication of data takes advantage of the processes and procedures already in place to publish academic articles about scientific results, enabling data to be reviewed and more broadly disseminated. Data are vastly more varied in format than papers, and so the policies required to manage and publish data must take into account the complexities associated with different data types, scientific fields, licensing rules etc.
The Peer REview for Publication & Accreditation of Research Data in the Earth sciences (PREPARDE) project is JISC- and NERC-funded, and aims to investigate the policies and procedures required for the formal publication of research data. The project is investigating the whole workflow of data publication, from ingestion into a data repository, through to formal publication in a data journal. To limit the scope of the project, the focus is primarily on the policies required for the Royal Meteorological Society and Wiley’s Geoscience Data Journal, though members of the project team include representatives from the life sciences (F1000Research), and will generalise the policies to other disciplines.
PREPARDE addresses key issues arising in the data publication paradigm, such as: what criteria are needed for a repository to be considered objectively trustworthy; how does one peer-review a dataset; and how can datasets and journal publications be effectively cross-linked for the benefit of the wider research community and the completeness of the scientific record? To answer these questions, the project is hosting workshops addressing these issues, with interactions from key stakeholders, including data and repository managers, researchers, funders and publishers. The results of these workshops will be presented and further comment and interaction sought from interested parties
Minutes of the 41st Natural Environment Research Council (NERC) Mesosphere-Stratosphere-Troposphere (MST) Radar Facility Experimenters' Meeting
No full textMeeting date: Thursday 10th July 2008
Meeting location: The Cosener's House, Abingdon, UK
Meeting agenda:
1) Minutes of the previous meeting
2) Matters arising
3) Funding Renewal
4) Site Report
5) NERC Instrument Report
6) Guest Instrument Report
7) Science and Technical Presentations
8) Any Other Busines
Minutes of the 44th Natural Environment Research Council (NERC) Mesosphere-Stratosphere-Troposphere (MST) Radar Facility Experimenters' Meeting
No full textMeeting date: Thursday 21st January 2010;
Meeting location: The Cosener's House, Abingdon, UK;
Meeting agenda:
1) Minutes of the previous meeting
2) Matters arising
3) Facility Report
4) NERC Instrument Report
5) Guest Instrument Report
6) Science and Technical Presentations
7) Any Other Busines