Changes between Version 7 and Version 8 of Software/MSI/ConfigurationTriton


Ignore:
Timestamp:
20/11/09 09:53:49 (10 years ago)
Author:
sdonegan
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • Software/MSI/ConfigurationTriton

    v7 v8  
    1212 
    1313|| '''Developer''' || '''Service''' || '''Deployment status''' || '''Documentation''' || '''Version''' || '''Notes''' || '''Tested?''' 
    14 || Steve D || NDG Redirection Service || Installed 18/11/09 || n/a || n/a || Installed /usr/local/ndg-redirect Awaiting proper configuration || n/a || 
     14|| Steve D || NDG Redirection Service || Installed 18/11/09 || n/a || n/a || Installed /usr/local/ndg-redirect || Tested OK 20/11/09 - updates triton db fine. || 
    1515|| Steve D || Discovery Postgres Database || installed 13/10/09 || n/a || n/a || Clone of Neptune (AJH) || n/a || 
    1616|| Steve D || Discovery Service ingestion stack || Installed 18/11/09 || n/a || n/a || Installed /usr/local/ndg-discovery-ingest (needs to be connected to triton cronjob) || standard ingest NO/ ceda feed YES || 
     
    153153== Discovery Service Portal (MILK) Configuration & Notes == 
    154154 
     155== NDG URL redirection service == 
     156 
     157The redirection service allows tracking of all modified urls (altered in the ingest service) - this allows NDG to follow the "through" traffic and work out whats most popular in terms of links and services.  The service is comprised of three parts: 
     158 * '''Discovery Service Ingest URL changer''' (in `utilities.py` of the oai_document_ingester egg collection.  This has hard coded the base url of the actual web redirection service (in `abstractDocumentIngester.py`.  The rest of the ingest will then generate a redirection url to replace the original url in the ingested xml document.  The ingest code will also encapsulate information within the redirect url: the datasetID, datasetName and the original url.  This information is creamed off in the redirection service and updated to the url tracking database. 
     159 
     160 * '''NDG Redirection web service''': This is a true web service within its own mod_wsgi buildout and running on triton.  When a url is clicked on within the discovery service portal this will go via the redirect service which uses the encapsulated information to update the url tracking database and then actually redirects to the true url, giving the user the affect of being taken to the desired url 
     161 
     162 * '''URL tracking database''': This is a separate table (`urlTracking`) within the `searchLog` database on triton.  Everytime a redirection url is clicked, information on the url, dataset id and name are recorded.  Code within the redirection service on triton increments a counter for the number of access attempts and only starts a new line for a new url associated with a dataset. 
     163 
     164The baseURl for the triton redirection service is `http://triton.badc.rl.ac.uk/NDGredirection/ndgURLredirect/redirect?url=` (NOTE this really needs to be part of a config file in ingesT!) 
     165 
     166For example, this url: `http://badc.nerc.ac.uk/data/rapid/` 
     167 
     168results in this redirect url: 
     169http://triton.badc.rl.ac.uk/NDGredirection/ndgURLredirect/redirect?url=http%3A//badc.nerc.ac.uk/data/rapid&docID=badc.nerc.ac.uk%3ADIF%3Adataent_rapid_SERVICE_TEST&docTitle=NERC%20Rapid%20Climate%20Change%20%28RAPID%29%20programme 
     170 
     171The redirection web service buildout is located on triton under `/usr/local/ndg-redirection` with the generated wsgi script placed in `/usr/local/apache2/wsgi_scripts_public`. 
     172 
     173The buildout.cfg for the triton redirection service (as of 20/11/09 09:53) is: 
     174{{{ 
     175# 
     176# zc.buildout config for the NDG Discovery Service 
     177# 
     178# P J Kershaw 02/06/09 
     179# 
     180[buildout] 
     181parts = ndgRedirect 
     182#develop = passwords 
     183 
     184# Configuration mirroring eggs as currently deployed on proglue 
     185[ndgRedirect] 
     186recipe = collective.recipe.modwsgi 
     187extra-paths = ${buildout:directory}/config/redirect.config 
     188 
     189# Versioning: 
     190# 
     191# 1) Explicit Pylons and WebHelpers versions required otherwise code 
     192# breaks with WebHelpers 0.6.4 with: 
     193# 
     194# File "/usr/local/ndg-discovery/eggs/ows_server-0.0.0dev_r5354-py2.5.egg/ows_server/config/environment.py", line 22, in load_environment 
     195# tmpl_options['myghty.escapes'] = dict(l=webhelpers.auto_link, s=webhelpers.simple_format) 
     196# AttributeError: 'module' object has no attribute 'auto_link' 
     197# 
     198# 2) cdat_lite should be fixed at 4.1.2 to imitate the proglue settings 
     199# but this build fails.  Using >=, cdat_lite 5 is installed but there 
     200# are then issues with the code not able to find cdms because of the 
     201# change to cdms2. e.g. 
     202# 
     203# http://ndg3beta.badc.rl.ac.uk/services/view/grid.bodc.nerc.ac.uk__DIF__grid.bodc.nerc.ac.uk-DIF-EDMED1048001 
     204# 
     205# Left as an open issue because discovery service is likely to be upgraded to 
     206# the latest version anyway 
     207eggs = 
     208        ows_common==0.1dev_r2969 
     209        ndgCommon==0.1.1.dev_r5997 
     210        Pylons==0.9.6.2 # changed from 0.9.6.1 to get oai editor going 
     211        PyGreSQL==3.8.1 
     212        PasteScript 
     213        WebHelpers==0.3.2 
     214        Routes==1.7.3 
     215        ndgRedirect==1.0.0dev_r5460 
     216config-file = ${buildout:directory}/development.ini 
     217find-links = http://ndg.nerc.ac.uk/dist 
     218        http://ndg.nerc.ac.uk/dist/archivedcsml 
     219}}} 
     220 
     221.. and the Makefile: 
     222 
     223{{{ 
     224# 
     225# Makefile to customise WSGI script generated by zc.buildout and add in logging 
     226# capability.  It also installs the script in the correct area for Apache to pick up 
     227# Alteration of the script is done with a series of ugly sed calls.  This could be 
     228# replaced by a customised Pylons buildout recipe to add the logging calls in 
     229# 
     230# P J Kershaw 04/06/09 
     231WSGI_DIR=/usr/local/apache2/wsgi_scripts_public 
     232WSGI_SCRIPT_NAME=ndgRedirect.wsgi 
     233WSGI_SCRIPT_IN_FILE=./parts/ndgRedirect/wsgi 
     234#TMP_FILE=${WSGI_SCRIPT_IN_FILE}.tmp 
     235TMP_FILE=${WSGI_SCRIPT_IN_FILE} 
     236 
     237install_wsgi: 
     238        @echo installing WSGI script ... 
     239        cp ${TMP_FILE} ${WSGI_DIR}/${WSGI_SCRIPT_NAME} 
     240        @echo Done. 
     241 
     242http_proxy=http://wwwcache.rl.ac.uk:8080 
     243 
     244buildout: 
     245        export http_proxy=${http_proxy}; /usr/local/bin/buildout 
     246}}} 
     247