source: TI01-discovery-Ingest @ 7052

Revision Log Mode:


Legend:

Added
Modified
Copied or renamed
Diff Rev Age Author Log Message
(edit) @7052   9 years sdonegan Added code to support requirement to extract DataFormats? from ISO
(edit) @7012   9 years sdonegan fixed small bug regarding error line printing
(edit) @6956   9 years sdonegan fixed bug in originator handling and error reporting
(edit) @6946   9 years sdonegan Added validation checking for dataOriginator and ability to handle …
(edit) @6944   9 years sdonegan got dataOriginator xpath right this time..
(edit) @6941   9 years sdonegan adjusted xpath value for dataOriginator so now just pulls value where …
(edit) @6904   9 years sdonegan further debug updates to check dates
(edit) @6891   9 years sdonegan further bug fixes and reporting updates and update to run_all_ingest for …
(edit) @6875   9 years sdonegan Fixed some content bugs and handling of keywords/parameters as well as …
(edit) @6865   9 years sdonegan Upgrade a set of bug fixes to deal with authors, upgrade stats, reporting …
(edit) @6852   9 years sdonegan Incorporates updated xpath to handle different definitions of data centre …
(edit) @6851   9 years sdonegan Updated to handled checking changes to xml - looks in transformed_doc now …
(edit) @6849   9 years sdonegan Put in workaround to deal with datacentres that insist on using 'gcmd' as …
(edit) @6848   9 years sdonegan Put in workaround to deal with datacentres that insist on using 'gcmd' as …
(edit) @6846   9 years sdonegan Put in some code to deal with multiple definitions of datacentre name …
(edit) @6836   9 years sdonegan Fixed bug with mismatch of records between original_document table and …
(edit) @6709   9 years sdonegan Updated handling of some elements where no data present
(edit) @6685   9 years sdonegan roundup updates - ingestion working well
(edit) @6662   9 years sdonegan Latest version of config file for running medin style ingester - much more …
(edit) @6661   9 years sdonegan Updated so no original_document text field in original_document table
(edit) @6660   9 years sdonegan Update includes latest changes to allow full MEDIN xml and DIF xml ingest …
(edit) @6639   9 years sdonegan Latest code that updates either NDG3 style or MEDIn style DB with all …
(edit) @6631   9 years sdonegan Use these database scripts to generate a database compatible with the …
(edit) @6619   9 years sdonegan added extra fields etc for medin
(edit) @6618   9 years sdonegan Commit of code that updates successfully MEDIN ISO as well as GCMD DIF …
(edit) @6616   9 years sdonegan Updated to work with latest PostgresDAO
(edit) @6614   9 years sdonegan Added latest updates to extract all requested info from MEDIN iso
(edit) @6613   9 years sdonegan Added latest updates to extract all requested info from MEDIN iso
(edit) @6569   9 years sdonegan updated with correct xpaths and methods needed to support ingest of medin …
(edit) @6568   9 years sdonegan updated with correct xpaths and methods needed to support ingest of medin …
(edit) @6545   9 years sdonegan python xpath class to be used with ExtractISO.py to extract and generate …
(edit) @6544   9 years sdonegan Updated version of MEDIN ingest - will ingest NEODC DIFs, convert to ISO …
(edit) @6486   9 years sdonegan fixed bug in passing passwords.txt file location to existdb connector - …
(edit) @6451   9 years sdonegan Updated ExtractISO.py to rewrite URLs with ndgredirect if required. Also …
(edit) @6444   9 years sdonegan Re-updated to include 5 generic MEDIN fields plus abstract column to …
(edit) @6421   9 years sdonegan updated so can work with new config file arrangement
(edit) @6377   9 years sdonegan debugged -let a pdb in there
(edit) @6376   9 years sdonegan further updates so processDatacentre can recieve the config file location …
(edit) @6368   9 years sdonegan ..and synching this as well
(edit) @6367   9 years sdonegan completion of synchronising…
(edit) @6366   9 years sdonegan Synching dirs.. this should be it now..
(edit) @6365   9 years sdonegan Manually synching files..
(edit) @6361   9 years sdonegan Updated to take configuration file location as a mandatory arguement. …
(edit) @6336   10 years sdonegan switching to new structure!
(edit) @6275   10 years sdonegan switch to official tagged version
(edit) @6274   10 years sdonegan Updated to NDG3 official release - to be set up in tagged release
(edit) @6206   10 years sdonegan Updated feed ingester with latest config
(edit) @6205   10 years sdonegan template for configuration file for running the ingester - all dirs and …
(edit) @6204   10 years sdonegan Added extra configuration control to file and debugged redirect url …
(edit) @6201   10 years sdonegan updated config
(edit) @6199   10 years sdonegan Removed file/folder
(edit) @6198   10 years sdonegan Removed file/folder
(edit) @6197   10 years sdonegan debug - hardwired full config file path
(edit) @6196   10 years sdonegan Moving main ndg3 ingest development branch to here to be consistent with …
(edit) @6183   10 years sdonegan Copied remotely
(edit) @6181   10 years sdonegan Copied remotely
(edit) @6180   10 years sdonegan Copied remotely
(edit) @6179   10 years sdonegan Removed file/folder
(copy) @6178   10 years sdonegan Renamed remotely
copied from TI-discovery-Ingest:
(edit) @6167   10 years sdonegan Created folder remotely
Note: See TracRevisionLog for help on using the revision log.