CEDA Repository
Not a member yet
1250 research outputs found
Sort by
L2 ARG Edition 1 Validation report (including G2 SWupdate)
No full textThis a validation report for L2 ARG Edition 1
PROCESSING and ACCURACY summary: GERB L2 Edition 1
No full textThis document contains information about the processing and accuracy of the GERB L2 dataset
FIDUCEO Project: File format Specification for CDRs and FCDRs V2.0
No full textFIDUCEO Project: File format Specification for CDRs and FCDRs V2.
Semantic Storage of climate data on object stores
No full textNew methods for storing large volumes of data, such as cloud systems and object storage present opportunities:
Improved access and user management over POSIX
Parallel reads / writes
Read / write from anywhere (no need to mount disks)
and challenges:
Interface and access methods for users are changed
Exploit parallel and remote access nature of stores with S3 HTTP API
While maintaining a familiar and consistent API for the user
S3-netCDF-python:
Library to read/write netCDF 3 and netCDF 4 via a S3 HTTP API
Files can be streamed directly to memory or cached to disk
Files can be split into smaller objects
Multiple objects can be streamed in paralle
Fixity checking a large climate data archive
No full textIt is important not to rely on internal checking mechanisms in hardware systems as these are fallible like everything else. Corruption is rare on the current JASMIN storage system. Future systems needs to be monitored closely if we are to have confidence in their fixity
CEDA and JASMIN Services
No full textThe Centre for Environmental Data Analysis (CEDA) is based at the STFC Rutherford Appleton Laboratory. CEDA operates 4 environmental data centres, offers data analysis environments (JASMIN), and professional data management services for the UK academic community to ensure the availability of stored data for the future
Bringing the Global Climate Projections Archive to UK Researchers
No full textLooking at the CMIP5 archive, the contribution from CEDA and looking at the next stage of CMIP6
NCAS Computing skills training
No full textThe introduction to scientific computing course covers the skills needed for managing and analysing data using Linux and Python
WGISS - Working Group for Information Systems and Services
No full textWGISS (The Working Group on Information Systems and Services) is a subsidiary body supporting CEO
The Environmental Data Service
No full textLast year NERC commissioned all the data centres as a single service. It’s been business as usual, but we are now planning for things we can do together