Changeset 3021


Ignore:
Timestamp:
16/11/07 17:06:37 (12 years ago)
Author:
selatham
Message:

Another new DP. Tidied ingest.

Location:
TI01-discovery/trunk/ingestAutomation/OAIBatch
Files:
2 edited

Legend:

Unmodified
Added
Removed
  • TI01-discovery/trunk/ingestAutomation/OAIBatch/ncar_config.properties

    r721 r3021  
    1 # Define host_OAI as the string that OAI adds to the filenames after harvesting 
    2  
    3 # BODC = oai%3Agrid.bodc.nerc.ac.uk%3A 
    4 # SOC = oai%3Aoai.noc.soton.ac.uk%3A 
    5 # NCAR = oai%3Aucar.ncar.scd.cdp%3A 
    6 # PML = oai%3Apml.nerc.ac.uk%3A 
    7 # TPAC = oai%3Atpac.org.au%3A 
    8  
    9 host_OAI=oai%3Aucar.ncar.scd.cdp%3A 
     1#Note - don't have any blank lines in this config file 
     2#host_OAI=oai%3Aucar.ncar.scd.cdp%3A 
     3# 
     4#Define host_path as the full directory name where this data centre's records will be harvested into. 
     5host_path /usr/local/jakarta-tomcat/webapps/oai/WEB-INF/harvested_records/oai-cdp-ucar-edu-dif 
     6# 
     7#Define groups - portal groups for limiting searches by 'group of datacentres'. 
     8#groups 
     9# 
     10#Define which format is harvested from the data centre (one only) 
     11format DIF 
     12# 
     13#Define the data providers namespace 
     14namespace cdp.ucar.edu 
     15# 
     16#Say whether this is a full NDG data Provider who uses NDG identifiers etc. 
  • TI01-discovery/trunk/ingestAutomation/OAIBatch/oai_ingest.py

    r3020 r3021  
    322322    sys.exit("Failed at copying to backup directory %s" %this_backupdir) 
    323323 
    324 #Clear out the original harvest records area and DIF2MOLES 
     324#Clear out the original harvest records area and FINALMOLES 
     325commandline = "ls -1 ./FINALMOLES | xargs -i rm ./FINALMOLES/{\}" 
     326print "Executing : " + commandline 
     327status = os.system(commandline) 
     328if status !=0: 
     329    sys.exit("Failed at clearing out FINALMOLES area %s" %harvest_home) 
     330 
    325331commandline = "ls -1 " + harvest_home + " | xargs -i rm " + harvest_home + "/{\}" 
    326332print "Executing : " + commandline 
     
    329335    sys.exit("Failed at clearing out original harvest records area %s" %harvest_home) 
    330336 
    331 commandline = "ls -1 ./FINALMOLES | xargs -i rm ./FINALMOLES/{\}" 
    332 print "Executing : " + commandline 
    333 status = os.system(commandline) 
    334 if status !=0: 
    335     sys.exit("Failed at clearing out FINALMOLES area %s" %harvest_home) 
     337 
    336338 
    337339#remove the DIF2MOLES directory 
Note: See TracChangeset for help on using the changeset viewer.