Changeset 3020 for TI01-discovery


Ignore:
Timestamp:
16/11/07 16:32:51 (12 years ago)
Author:
selatham
Message:

New DP configs. Deal with colons in IDs

Location:
TI01-discovery/trunk/ingestAutomation/OAIBatch
Files:
1 added
3 edited

Legend:

Unmodified
Added
Removed
  • TI01-discovery/trunk/ingestAutomation/OAIBatch/oai_ingest.py

    r2508 r3020  
    188188                else: 
    189189                    new_filename = outdir + "/" +datacentre_namespace+ "__"+datacentre_format+ "__"+ ident +".xml" 
     190                    new_filename=new_filename.replace(":","-") 
    190191                print "original file = %s, newfile = %s" %(original_filename, new_filename) 
    191192                commandline = "cp "+original_filename+ " " +new_filename 
     
    231232 
    232233# Then run the minimum moles creator for each discovery record 
    233 # Put records in ./DIF2MOLES with original filename 
     234# Put records in ./DIF2MOLES with same filename 
    234235filenames = os.listdir(outdir) 
    235236for filename in filenames: 
  • TI01-discovery/trunk/ingestAutomation/OAIBatch/tpac_config.properties

    r721 r3020  
    1 # Define host_OAI as the string that OAI adds to the filenames after harvesting 
    2  
    3 # BODC = oai%3Agrid.bodc.nerc.ac.uk%3A 
    4 # SOC = oai%3Aoai.noc.soton.ac.uk%3A 
    5 # NCAR = oai%3Aucar.ncar.scd.cdp%3A 
    6 # PML = oai%3Apml.nerc.ac.uk%3A 
    7 # TPAC = oai%3Atpac.org.au%3A 
    8  
     1#Note - don't have any blank lines in this config file 
     2# Define host_OAI as the string that OAI adds to the filenames after harvesting (not neccessary anymore?) 
     3# 
    94host_OAI=oai%3Atpac.org.au%3A 
     5# 
     6#Define host_path as the full directory name where this data centre's records will be harvested into. 
     7host_path /usr/local/jakarta-tomcat/webapps/oai/WEB-INF/harvested_records/ngportal-sf-utas-edu-au-dif 
     8# 
     9#Define groups - portal groups for limiting searches by 'group of datacentres'. 
     10#groups 
     11# 
     12#Define which format is harvested from the data centre (one only) 
     13format DIF 
     14# 
     15#Define the data providers namespace 
     16namespace tpac.edu.au 
     17# 
     18#Say whether this is a full NDG data Provider who uses NDG identifiers etc. 
  • TI01-discovery/trunk/ingestAutomation/OAIBatch/wdcc_config.properties

    r1046 r3020  
    11#Note - don't have any blank lines in this config file 
    2 # Define host_OAI as the string that OAI adds to the filenames after harvesting 
    3 # BODC = oai%3Agrid.bodc.nerc.ac.uk%3A 
    4 # SOC = oai%3Aoai.noc.soton.ac.uk%3A 
    5 # NCAR = oai%3Aucar.ncar.scd.cdp%3A 
    6 # PML = oai%3Apml.nerc.ac.uk%3A 
    7 # TPAC = oai%3Atpac.org.au%3A 
    8 # WDCC = ? 
    9 host_OAI = oai%3Agrid.wdcc.nerc.ac.uk%3A 
     2#host_OAI = 
    103# 
    114#Define host_path as the full directory name where this data centre's records will be harvested into. 
    12 host_path /home/tomcat/oai/WEB-INF/harvested_records/uranus.dkrz.de/8080/oai/provider/dif 
     5host_path /usr/local/jakarta-tomcat/webapps/oai/WEB-INF/harvested_records/uranus-dkrz-de-8080-dif 
     6# 
     7#Define groups - portal groups for limiting searches by 'group of datacentres'. 
     8#groups 
     9# 
     10#Define which format is harvested from the data centre (one only) 
     11format DIF 
     12# 
     13#Define the data providers namespace 
     14namespace wdcc.dkrz.de 
     15# 
     16#Say whether this is a full NDG data Provider who uses NDG identifiers etc. 
Note: See TracChangeset for help on using the changeset viewer.