CEDA Repository
Not a member yet
1250 research outputs found
Sort by
CEMS: Building a Cloud-Based Infrastructure to Support Climate and Environmental Data Services
No full textCEMS, the facility for Climate and Environmental Monitoring from Space, is a new joint collaboration between academia and industry to bring together their collective expertise to support research into climate change and provide a catalyst for growth in related Earth Observation (EO) technologies and services in the commercial sector.
A recent major investment by the UK Space Agency has made possible the development of a dedicated fa- cility at ISIC, the International Space Innovation Centre at Harwell in the UK. CEMS has a number of key elements: the provision of access to large-volume EO and climate datasets co-located with high performance computing facilities; a flexible infrastructure to support the needs of research projects in the academic community and new business opportunities for commercial companies. Expertise and tools for scientific data quality and in- tegrity are another essential component, giving users confidence and transparency in its data, services and products.
Central to the development of this infrastructure is the utilisation of cloud-based technology: multi-tenancy and the dynamic provision of resources are key characteristics to exploit in order to support the range of organisations using the facilities and the varied use cases. The hosting of processing services and applications next to the data within the CEMS facility is another important capability. With the expected exponential increase in data volumes within the climate science and EO domains it is becoming increasingly impracticable for organisations to retrieve this data over networks and provide the necessary storage. Consider for example, the factor of o20 increase in data volumes expected for the ESA Sentinel missions over the equivalent Envisat instruments.
We explore the options for the provision of a hybrid community/private cloud looking at offerings from the commercial sector and developments in the Open Source community. Building on this virtualisation layer, a further core services tier will support and serve applications as part of a service oriented architecture. We consider the constituent services in this layer to support access to the data, data processing and the orchestration of workflows
IPython parallel Project Work Summer 2008 Presentation
No full textThe IPython parallel project work undertaken in Summer 2008 by Joseph Landsdowne was part of the STFC Rutherford Appleton Laboratory summer placement scheme undertaken with the Centre for Environmental Data Archival. The project looked to set up a prototype system for parallelising processing of large volumes of environmental data held within CEDA's parallel access and storage system with associated parallel processing system: JASMIN.
This presentation discussed the work undertaken and demostrates the impact of the prototype on data processing. It also details the use of webbased tools to act as a front end to the IPython system
Kruger National Park Rivers LiDAR Project Survey Report
No full textThis document contains project information regarding the Kruger National Park Rivers LiDAR Project
Institute of Physics, Environmental Physics Group newsletter (47), April 2012
No full textThis file contains the newsletters of the Environmental Physics Group at the Institute of Physics. The fundamental aim of the Group is to promote physics within the context of the environmental sciences. In achieving this aim we provide a forum for the discussion of physics as it applies to the environment and encourage the development and application of physical methods to environmental research. The Group also encourages the education and training of physicists in the environmental sciences through meetings and contacts with educationalists at all levels. Because of the broad nature of environmental physics the Group is involved in co-operative meetings with other professional organisations with interests in the environment. These newsletters are an archive of our activities since the formation of the Group. For more information about the Environmental Physics Group, see http://www.iop.org/activity/groups/subject/env/index.htm
Summer Placement Tasks: Updating Metadata in MOLES2 on the BADC website.
No full textOverview of tasks discussed in presentation:
Examining and ammending BADC Data Entities to bring in line with the requirements of the NERC Science Information Strategy Information (SIS) project.
Reviewing BADC Data Entities in more depth and modifying associated data (i.e. Deployments, Data Production Tools, Observation Stations, and Activities.)
Writing and recording a webguide to explain MOLES2 elements.
A comparison of the similarities between MOLES2 and MOLES3 is included in these presentation slides.
Presentation took place on the 27th of September 2012, at RAL Space, Oxfordshire
Infrastructure Strategy for the European Earth System Modelling Community 2012-2022
No full textThis document explores the infrastructure needed during the next decade to support European climate research for seasonal to centennial climate predictions. This research will be integral to providing the scientific basis for climate services. It is highly relevant to the objectives of the Joint Programming Initiative on Climate “Connecting Climate Knowledge for Europe”.
The scientific community working on climate modelling is organized within the European Network for Earth System modelling (ENES). It has outlined major scientific issues both related to the reliability of climate change predictions and to the scientific understanding of climate natural variability. The document presents a vision of what could be available in 10 years time. It is envisaged that by the end of the decade, convective scales will be fully featured in climate models. Initialization and ensemble techniques will be well developed. Uncertainty will be well characterised ensuring appropriate diversity in both regional predictions and longer paleoclimatic simulations. It will be possible to initialise models from real data using full data assimilation techniques. It will be easier to evaluate models and their shorter range projections using hindcasts applied to real data, and such evaluation will be harnessed in a cycle of continuous model improvement.
The implications of this vision for infrastructure are set out. The most demanding goal is to ensure by the end of the decade convective scales are resolved in European climate models of the Earth system with the objective to obtain regional climate predictions for next few decades which are more reliable. This in turn will require intensive and adapted access to exascale computing (1018 operations per second), co-located to an unusually large data archive, which needs to be connected to national archives by networks transferring data at rates faster than Tera bits/second. European models will benefit from being more modern in terms of flexibility and usability, and having a designed diversity, with the number of model «families» possibly reduced and commensurate with the resources available for their development and use.They should scale very well on high performance computers, but also allow usage across the whole computing pyramid. This will mandate a better connected and organized European community, agreeing and working together on common goals.
The requirements to ensure the availability of appropriately skilled experts is outlined, and possible funding and governance are discussed.
ENES recommends the following action items for the climate modelling research infrastructure:
1. Provide a blend of high-performance computing facilities ranging from national machines to a worldclass computing facility suitable for climate applications, which, given the workload anticipated, may well
have to be dedicated to climate simulations.
2. Accelerate the preparation for exascale computing, e.g. by establishing closer links to PRACE and by developing new algorithms for massively parallel many-core computing.
3. Ensure data from climate simulations are easily available and well documented, especially for the climate impacts community.
4. Build a physical network connecting national archives with transfer capacities exceeding Tbits/sec.
5. Strengthen the European expertise in climate science and computing to enable the long term vision to be realized.
Strengthening the European climate modelling infrastructure will provide Europe with the necessary evidence
and expertise for its mitigation and adaptation policies
CEDA Summer placement 2012 presentation on : Digitising Royal Greenwich Observatory Photo-Heliographic Reports (1887-1976)
No full textDuring Summer 2012 the UK Solar System Data Centre (UKSSDC) partook in the Science and Technology Facility Council's summer placement scheme with a project to assess the resources needed to make digital images of the Photo Heliographic reports held by UKSSDC.
This presentation describes the photo heliographic reports from 1874 – 1976 held in UKSSDC's physical archive, including pre 1925 books which are are very delicate. In addition, work concerning addressing the errata needing to be applied is presented
Integrating PIMMS into the Simulation Workflow
No full textThe workflow of running simulations, converting from model data format to a common data format and then making model data available to the community contain many different actions. At some point along the way we expect the scientist to pause and document what they did.
In an ideal world model documentation should happen early in this workflow however in practice models and simulations are very often documented only when the data is used in research publications. The PIMMS project (Portable Infrastructure for the Metafor Metadata System) hopes to revolutionise the documentation of models and simulations by creating an infrastructure that makes model documentation easy to do very early in the workflow.
This is an interactive poster where we invite participants to indicate where the act of documenting simulations occurs in their typical workflow. And also where the act of documentation should occur in their ideal workflow. In this way the PIMMS team hope to find out those places where PIMMS would be of most benefit to the community. An established PIMMS infrastructure should fit seamlessly into the simulation workflow and significantly reduce the effort required to fully document simulations
CEMS: Building a cloud-based infrastructure to support climate and environmental data services
No full textA poster to show CEMS: Building a cloud-based infrastructure to support climate and environmental data service
Vaisala CL31 LCBR documentation
No full textThe Vaisala Ceilometer CL31 is a
compact and lightweight instrument
for cloud base height and vertical
visibility measurements. It detects
three cloud layers simultaneously.
The CL31 employs a pulsed diode
laser LIDAR (light detection and
ranging) technology. The CL31 is
ideal for aviation and meteorological
applications