Changes between Version 45 and Version 46 of CDB


Ignore:
Timestamp:
13/04/12 18:41:13 (8 years ago)
Author:
lalibert
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • CDB

    v45 v46  
    1313* Help in the timely delivery of model intercomparisons 
    1414 
    15 The first releases of the CDB are intended for use by climate researchers that have ssh access to an ESG node. In its simplest formulation, the CDB can be used remotely to create a subset of the ESG archive. This subset can then be transferred to a local compute node for further treatment. Because the CDB is portable, it can then be used locally for the processing of the ESG archive subset. 
     15The CDB facilitates the processing of large datasets with the underlying principle that "''a dataset is useful only as long as it is used''". Doing science with datasets in peta- and exabytes archives requires new tools and the prototype CDB provided here is intended as one possible solution to this challenge. 
     16 
     17The first release of the CDB requires climate researchers to have an ssh access to an ESG archive node. In its simplest formulation, the CDB can be used remotely to create a subset of the ESG archive. This subset can then be transferred to a local compute node for further treatment. Because the CDB is portable, it can then be used locally for further processing of the ESG archive subset. 
    1618 
    1719With its more advanced features, the CDB can be used remotely from the beginning to the end. For example, it can generate PBS submit scripts to simplify the distributed processing of ESG data on a cluster with a direct connection to an ESG node, as on the CICLAD server at IPSL.