Changes between Version 2 and Version 3 of CDB_Bench


Ignore:
Timestamp:
11/04/12 22:06:34 (8 years ago)
Author:
lalibert
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • CDB_Bench

    v2 v3  
    3838  
    3939---- 
    40 == [badc.nerc.ac.uk BADC] ''The British Atmospheric Data Centre'' login node  == 
     40== [http://badc.nerc.ac.uk BADC] ''The British Atmospheric Data Centre'' login node  == 
    4141 Location:: 
    4242   STFC Rutherford Appleton Laboratory (RAL), Oxfordshire, UK 
     
    4545  Intel(R) Xeon(R) CPU E5620 at 2.40GHz w/ 2 CPU cores, 8GB shared memory 
    4646 Performance Tests:: 
    47   A simple server-side processing test has been conducted. The daily psl for one model (NOAA-GFDL/GFDL-ESM2M, historical, rcp45) was retrieved from the archive, compressed (using netcdf4 capabilities) and transferred on CICLAD (total ~1.5GB, less than 5 minutes transfer). On CICLAD, the daily psl was not available for this model. The cyclone_mask diagnostic was then applied on the transferred data and the compressed results were transferred back to BADC. The cyclone_mask output is at the daily frequency but it is boolean and it thus take only ~28MB when compressed. The transfer back to BADC was thus instantaneous. The combine_cyclone_mask diagnostic was then launched on the transferred cyclone_mask data taking about 45 minutes to multiply the mask with the daily surface temperature and the daily three dimensional air temperature (pressure levels 1000,850,700,500,250,100,50,10 hPa), or ~15GB of data. After the multiplication, a monthly mean was performed, greatly reducing the output to ~500MB. This suggest the following analysis: 
     47  A simple server-side processing test has been conducted. The daily psl for one model (NOAA-GFDL/GFDL-ESM2M, historical, rcp45) was retrieved from the archive, compressed (using netcdf4 capabilities) and transferred to CICLAD (total ~1.5GB, less than 5 minutes transfer). On CICLAD, the daily psl was not available for this model. The cyclone_mask diagnostic was then applied on the transferred data and the compressed results were transferred back to BADC. The cyclone_mask output is at the daily frequency but it is boolean and it thus take only ~28MB when compressed. The transfer back to BADC was thus instantaneous. The combine_cyclone_mask diagnostic was then launched on the transferred cyclone_mask data taking about 45 minutes to multiply the mask with the daily surface temperature and the daily three dimensional air temperature (pressure levels 1000,850,700,500,250,100,50,10 hPa), or ~15GB of data. After the multiplication, a monthly mean was performed, greatly reducing the output to ~500MB. This suggest the following analysis: 
    4848{{{ 
    4949let N be the number of three dimensional fields to be composited with the cyclone_mask