wiki:PackageCedaccInstall/ExampleInstalls

Version 5 (modified by astephen, 5 years ago) (diff)

--

Example Installations of the CEDA-CC package

Introduction

The purpose of this page is to capture any installation issues outside the normal instructions. It is split by Institute so that users from each Institute can refer to instructions generated by their colleagues who have installed the tool.

1. JASMIN installation

The current ceda-cc version running on JASMIN is installed in the /apps/contrib/ceda/ceda-cc directory. This directory is visible across the following:

  • jasmin-sci[12].ceda.ac.uk
  • cems-sci1.cems.rl.ac.uk
  • All LOTUS nodes

The following dependencies are already available on the above servers:

  • Python2.7
  • Using python-netcdf4 (i.e. import netCDF4) to interface to files.
  • Installation tools: virtualenv and pip
  • Location of installation: Any directory (within a virtual environment created by running: virtualenv-2.7).
# Create, and enter, a directory in which to install the package
$ cd /apps/contrib/ceda/
$ mkdir cedacc
$ cd cedacc/

# Set up a virtualenv (to install the python libraries) called "venv"
# The argument "--system-site-packages" will pick up the installations of libraries such as "netCDF4" from the main python installation.
$ virtualenv-2.7 --system-site-packages venv

# Activate the virtualenv: This means that the PATH and PYTHONPATH will point to the appropriate commands/libraries under the "venv" directory.
$ . venv/bin/activate

# Check that your $http_proxy and $https_proxy environment variables are set to:
$ export http_proxy=http://wwwcache.rl.ac.uk:8080
$ export https_proxy=https://wwwcache.rl.ac.uk:8080

# Install the CEDA-CC package using pip
$ pip install ceda-cc

CEDA-CC relies on a configuration directory that contains specifications and vocabularies for each project. If you want a copy of this directory locally, e.g. in config_dir you can run:

$ ceda-cc --copy-config config_dir
Configuration directory copied to config_dir.  Set CC_CONFIG_DIR to use this configuration.

You should set the environment variable to make sure that this directory is used.

$ export CC_CONFIG_DIR=$PWD/config_dir

You can then test a file with...

$ ceda-cc -p CMIP5 --ld cmip5_logs -f /badc/cmip5/data/cmip5/output1/MOHC/HadGEM2-ES/rcp45/mon/land/Lmon/r1i1p1/v20111128/mrso/mrso_Lmon_HadGEM2-ES_rcp45_r1i1p1_224912-227411.nc
1 files, ['Lmon']
Error count 0

2. Met Office Installation

These instructions should get you started with running ceda-cc on the Linux environment at the Met Office:

  • Python2.7
  • Using python-netcdf4 (i.e. import netCDF4) to interface to files.
  • Installation tools: virtualenv and pip
  • Location of installation: Any directory (within a virtual environment created by running: virtualenv-2.7).
# Create, and enter, a directory in which to install the package
$ mkdir cedacc
$ cd cedacc/

# Set up a virtualenv (to install the python libraries) called "venv"
# The argument "--system-site-packages" will pick up the installations of libraries such as "netCDF4" from the main python installation.
$ virtualenv-2.7 --system-site-packages venv

# Activate the virtualenv: This means that the PATH and PYTHONPATH will point to the appropriate commands/libraries under the "venv" directory.
$ . venv/bin/activate

# Check that your $http_proxy and $https_proxy environment variables are set to:
$ export http_proxy=http://webproxy.metoffice.gov.uk:8080
$ export https_proxy=http://webproxy.metoffice.gov.uk:8080

# Install the CEDA-CC package using pip
$ pip install ceda-cc

CEDA-CC relies on a configuration directory that contains specifications and vocabularies for each project. If you want a copy of this directory locally, e.g. in config_dir you can run:

$ ceda-cc --copy-config config_dir
Configuration directory copied to config_dir.  Set CC_CONFIG_DIR to use this configuration.

You should set the environment variable to make sure that this directory is used.

$ export CC_CONFIG_DIR=$PWD/config_dir

You can then test a file with...

$ ceda-cc -p CMIP5 --ld cmip5_logs -f /project/champ/data/cmip5/output1/MOHC/HadCM3/rcp45/mon/land/Lmon/r1i1p1/v20110905/mrso/mrso_Lmon_HadCM3_rcp45_r1i1p1_203101-203512.nc 
1 files, ['Lmon']
Error count 0

3. Installation on ingest1 CEDA VM

For information about the CEDA "ingest1" VM see:

 http://team.ceda.ac.uk/trac/ceda/wiki/opman/ingest/ESGFIngestAndPublication/ComplianceChecking#NoteaboutinstallationofCEDA-CConingest1server (RESTRICTION ACCESS)