source: TI01-discovery-Ingest @ 7864

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @7864   8 years sdonegan Updated so when ndgRedirection set to false will put complete original xml …
(edit) @7857   8 years sdonegan Updated to take data centre configuration settings from dpws db when a …
(edit) @7856   8 years mnagni provider - added the last fields required by Steve (see DPWS rev.7773) …
(edit) @7764   9 years sdonegan Updates including copy original metadata to CSW pickup point if successful …
(edit) @7763   9 years sdonegan Added in configuration terms for publishing to MEDIN geonetworks CSW
(edit) @7760   9 years sdonegan extra config lines to handle CSW publiction - or not. Note also defines …
(edit) @7759   9 years sdonegan Copys original metadata file into holding area so geonetworks can ingest …
(edit) @7725   9 years sdonegan Updates to allow proper handling of NERC DMS format and uprated dif2iso …
(edit) @7692   9 years sdonegan Bug fix to deal with handling of records with no bounding dates
(edit) @7658   9 years mnagni now the foreign key to common_provider generate ON DELETE CASCADE
(edit) @7655   9 years mnagni Insert the tables for the Timer service and the trigger to handle how …
(edit) @7471   9 years sdonegan Put in bugfix to deal with neoddas records with no dif creation date (this …
(edit) @7470   9 years mnagni new field in HiProcess? to log the process progression status. Add two new …
(edit) @7467   9 years sdonegan updates to progress reporting in logging db and other bug fixes
(edit) @7457   9 years sdonegan simple bug fixes
(edit) @7456   9 years sdonegan various updates and tweaks so can support other DC difs
(edit) @7455   9 years sdonegan Copy of medin profile model to start work on nerc standard support
(edit) @7409   9 years mnagni Update of the tables underlying the DPWS's BETA-0.0.1 version
(edit) @7392   9 years sdonegan added ingest start and end times to relevant tables
(edit) @7391   9 years sdonegan Records ingest start and end time now
(edit) @7363   9 years sdonegan adjusted types to match similar elsewhere in db
(edit) @7362   9 years sdonegan debug problem file reporting and adjusted data types in reporting
(edit) @7352   9 years sdonegan changed function to match updated db structure
(edit) @7300   9 years sdonegan various updates to ingest (note change of name of main class) - can be …
(edit) @7297   9 years sdonegan updated tables and sql functions for ingester interaction with DPWS db
(edit) @7286   9 years sdonegan Updates for NERC v4.3.0 MEDIN style ingest with new arg for process id for …
(edit) @7277   9 years sdonegan removed superfluous files
(edit) @7252   9 years sdonegan updates to allow creation of ingest tracking table and use of function for …
(edit) @7249   9 years sdonegan Fixed bug for multiple update of spatial tables and handling of comment …
(edit) @7245   9 years sdonegan fixed some sql typo
(edit) @7241   9 years mnagni New tables for the service
(edit) @7239   9 years sdonegan Initial commit of ingest & logging database create scripts
(edit) @7238   9 years sdonegan Create folder to hold scripts for generating tables for new DPWS framework
(edit) @7192   9 years sdonegan got rid of bug with new column names
(edit) @7191   9 years sdonegan added 3 more columns for NERC version
(edit) @7190   9 years sdonegan
(edit) @7189   9 years sdonegan
(edit) @7188   9 years sdonegan Adding files from v4.2.0 tag to form basis for v4.3.0 version
(edit) @7187   9 years sdonegan
(edit) @7186   9 years sdonegan Adding files from v4.2.0 tag to form basis for v4.3.0 version
(edit) @7185   9 years sdonegan Adding files from v4.2.0 tag to form basis for v4.3.0 version
(edit) @7184   9 years sdonegan
(edit) @7183   9 years sdonegan Adding files from v4.2.0 tag to form basis for v4.3.0 version
(edit) @7182   9 years sdonegan Adding files from v4.2.0 tag to form basis for v4.3.0 version
(edit) @7181   9 years sdonegan Removed file/folder
(edit) @7180   9 years sdonegan made a copy
(edit) @7179   9 years sdonegan Removed file/folder
(edit) @7178   9 years sdonegan made a copy
(edit) @7177   9 years sdonegan Removed file/folder
(edit) @7176   9 years sdonegan
(edit) @7175   9 years sdonegan Removed file/folder
(edit) @7174   9 years sdonegan Removed file/folder
(edit) @7173   9 years sdonegan made a copy
(edit) @7172   9 years sdonegan made a copy
(edit) @7171   9 years sdonegan Removed file/folder
(edit) @7170   9 years sdonegan made a copy
(edit) @7169   9 years sdonegan Created folder to hold development trunk code for updated MEDIN 4.2 code …
(edit) @7167   9 years sdonegan Create tagged version for latest operational MEDIN ingest code
(edit) @7166   9 years sdonegan Renamed remotely
(edit) @7096   9 years sdonegan Updated handling of TopicCategory? to fix bug
(edit) @7053   9 years sdonegan Added extra columns for dataFormats
(edit) @7052   9 years sdonegan Added code to support requirement to extract DataFormats? from ISO
(edit) @7012   9 years sdonegan fixed small bug regarding error line printing
(edit) @6956   9 years sdonegan fixed bug in originator handling and error reporting
(edit) @6946   9 years sdonegan Added validation checking for dataOriginator and ability to handle …
(edit) @6944   9 years sdonegan got dataOriginator xpath right this time..
(edit) @6941   9 years sdonegan adjusted xpath value for dataOriginator so now just pulls value where …
(edit) @6904   9 years sdonegan further debug updates to check dates
(edit) @6891   9 years sdonegan further bug fixes and reporting updates and update to run_all_ingest for …
(edit) @6875   9 years sdonegan Fixed some content bugs and handling of keywords/parameters as well as …
(edit) @6865   9 years sdonegan Upgrade a set of bug fixes to deal with authors, upgrade stats, reporting …
(edit) @6852   9 years sdonegan Incorporates updated xpath to handle different definitions of data centre …
(edit) @6851   9 years sdonegan Updated to handled checking changes to xml - looks in transformed_doc now …
(edit) @6849   9 years sdonegan Put in workaround to deal with datacentres that insist on using 'gcmd' as …
(edit) @6848   9 years sdonegan Put in workaround to deal with datacentres that insist on using 'gcmd' as …
(edit) @6846   9 years sdonegan Put in some code to deal with multiple definitions of datacentre name …
(edit) @6836   9 years sdonegan Fixed bug with mismatch of records between original_document table and …
(edit) @6709   9 years sdonegan Updated handling of some elements where no data present
(edit) @6685   9 years sdonegan roundup updates - ingestion working well
(edit) @6662   9 years sdonegan Latest version of config file for running medin style ingester - much more …
(edit) @6661   9 years sdonegan Updated so no original_document text field in original_document table
(edit) @6660   9 years sdonegan Update includes latest changes to allow full MEDIN xml and DIF xml ingest …
(edit) @6639   9 years sdonegan Latest code that updates either NDG3 style or MEDIn style DB with all …
(edit) @6631   9 years sdonegan Use these database scripts to generate a database compatible with the …
(edit) @6619   9 years sdonegan added extra fields etc for medin
(edit) @6618   9 years sdonegan Commit of code that updates successfully MEDIN ISO as well as GCMD DIF …
(edit) @6616   9 years sdonegan Updated to work with latest PostgresDAO
(edit) @6614   9 years sdonegan Added latest updates to extract all requested info from MEDIN iso
(edit) @6613   9 years sdonegan Added latest updates to extract all requested info from MEDIN iso
(edit) @6569   9 years sdonegan updated with correct xpaths and methods needed to support ingest of medin …
(edit) @6568   9 years sdonegan updated with correct xpaths and methods needed to support ingest of medin …
(edit) @6545   9 years sdonegan python xpath class to be used with ExtractISO.py to extract and generate …
(edit) @6544   9 years sdonegan Updated version of MEDIN ingest - will ingest NEODC DIFs, convert to ISO …
(edit) @6486   9 years sdonegan fixed bug in passing passwords.txt file location to existdb connector - …
(edit) @6451   9 years sdonegan Updated ExtractISO.py to rewrite URLs with ndgredirect if required. Also …
(edit) @6444   9 years sdonegan Re-updated to include 5 generic MEDIN fields plus abstract column to …
(edit) @6421   9 years sdonegan updated so can work with new config file arrangement
(edit) @6377   9 years sdonegan debugged -let a pdb in there
(edit) @6376   9 years sdonegan further updates so processDatacentre can recieve the config file location …
(edit) @6368   9 years sdonegan ..and synching this as well
Note: See TracRevisionLog for help on using the revision log.