Ticket #282 (closed issue: invalid)

Opened 13 years ago

Last modified 11 years ago

[M] Automate Z39.50 bespoke harvesting & ingest

Reported by: selatham Owned by: selatham
Priority: discussion Milestone: Reporting
Component: discovery Version:
Keywords: Metadata_Gateway Project_Board_June07 Cc:

Description

Automate the harvesting from NERC Designated data centres. There are bespoke transformations of the records available via Z39.50 queries to bodc, bgs,ceh (bas do not run a zserver). We can automate the ingest of these records into the NDG discovery portal.

Change History

comment:1 Changed 13 years ago by selatham

However, the formats of the metadata retreived is completely non-standard mixture of html and text and subject to change at any un-notified time. So the automation is likely to break at any time. Doing this work does not mean we can harvest from any other zserver easily as you don't know what they will supply. Is this worth doing or should we be encouraging providing by OAI?

comment:2 Changed 13 years ago by rkl

My preference for BODC in the long run would be to dynamically post metadata records on OAI as our EDMED repository is updated. However, this requires ability to export EDMED in DIF or ISO19115 profile (which we don't yet have, largely due to vocabulary issues) or an extension to our MOLES repository to include Data Entities in addition to the Data Granules we are producing and calling 'Data Entities' at the moment. I would strongly discourage any updating of the content of the BODC Z-Server. If a short-term fix is required then I would counsel manual production of DIFs to be posted in our OAI repository.

comment:3 Changed 13 years ago by selatham

  • Keywords Metadata_Gateway added
  • Status changed from new to assigned
  • Milestone changed from Replace Metadata Gateway to ReFactored Discovery WebServices

comment:4 Changed 12 years ago by selatham

BODC have got their EDMED ecords in DIF on OAI now. We need to encourage other Data Providers to do likewise. Seeing BGS 28th March 2007. Contact BAS,CEH. Can we decide that we won't do bespoke harvesting and ingest from Z39.50?

comment:5 Changed 12 years ago by selatham

  • Milestone changed from ReFactored_Discovery_WebServices to Replace Metadata Gateway

comment:6 Changed 12 years ago by selatham

  • Keywords Project_Board_June07 added
  • Type changed from task to issue

Raise at next Project Board for a decision.

comment:7 Changed 11 years ago by lawrence

  • Status changed from assigned to closed
  • Resolution set to invalid

reckon this is obsolete

Note: See TracTickets for help on using tickets.