wiki:T13_DataProvider

Version 17 (modified by pmiller, 13 years ago) (diff)

added bit about versioning from ticket 388

T13_DataProvider

Software and documentation to deploy NDG services at a data provider. If possible (depending on other projects) this package may include OGC web service software and other data services packaged in with the NDG software.

T13 Product purpose

To allow project partners (and others) to deploy NDG services to allow users to find and securely access detailed metadata and data held within a data provider.

Project components:

  1. Database backend and associated web services and documentation.
  2. OAI repository software and associated documentation.
  3. NDG interfaces package and associated documentation.
  4. NDG security services package and documentation on how to link to existing user databases or to create one.

Documents

(Relevant working documents, including specs etc)

Some Component Documentation already exists in BSCW NDG1 work packages folders. Most will need updating or are currently incomplete.

  1. NDG_Data_Provider_Guide (v0.4, Aug. 2005, Architecture Process)
  2. NDG_MOLES_Instructions_for_Creation (v0.20, Aug. 2005, Models/Metadata?)
  3. NDG Metadata Schema (v0.1, Mar. 2003, Models/Metadata?)
  4. Metadata_Creation_process_for_the_BADC (v0.1, Dec. 2004, Internal Documents/NDG Workpackages/BADC Metadata)
  5. BODC NDG B Metadata Population (v0.3, Feb. 2005, Models/Metadata?)
  6. OAI_Guidelines (v0.3, Oct. 2005, Internal Documents/NDG Workpackages/Discovery? Service)
  7. CSML_Users_Manual (v0.1, Jan 2005, Models/Data? model/CMSL)

Key Integration Milestones

  1. Update/Create? Documentation of Components (NDG Alpha Jul 2006) -> Doc Pre-Beta
  2. Documentation of Install procedures (NDG Alpha Jul 2006) -> Pre-Beta
  3. Documentation of DataProvider Guidelines (NDG Alpha Jul 2006) -> Doc Pre-Beta
  4. Possible additions to Components (NDG Beta Jan 2007)
  5. All components received and loaded into one /usr/local directory (NDG Beta Jan 2007)
  6. Install/build script(s) written (NDG Beta Jan 2007)
  7. Integration testing (ensure smooth installation/operation) (NDG Beta Jan 2007)
  8. Update Documentation of Components (NDG Implementation Jun 2007)
  9. Update Documentation of Install procedures (NDG Implementation Jun 2007)
  10. Update Documentation of DataProvider Guidelines (NDG Implementation Jun 2007)

Integration Dependencies

  1. Database package (Discovery)
  2. Vocabulary Services for Metadata Creation (Vocabulary)
  3. OAI repository (Discovery)
  4. Session Manager (Security)
  5. Attribute Authority (Security)
  6. FTP Server (Delivery)
  7. Data Extractor/Geosplat? ()
  8. MOLES Schema with documentation (MOLES)
  9. XSLT MOLES to Discovery (MOLES)
  10. CSML Schema with documentation (CSML)

Requirements of Data Provider Package

Software components provided by other NDG Workpackages

  • Data extractor
  • Delivery system
  • Database backend and web services
  • Bulk stub-b and DIF creation utilities ( including #32)
  • NDG interfaces
  • Security system

Software components unique to Data Provider Package:

  • Database: eXist
  • OAI provider
  • Just checking: assuming DP Package doesn’t develop any software?
  • More?

Versioning of components

Sue, Dom and Andrew suggested that sub-components should be versioned independently (to allow for separate development), but that versions grouped together under a tagged release should be mutually compatible and documented as such. In addition, when a product is tagged, one should document in the change comment which versions of other products it's compatible with. Possible relevance to ticket:376 and ticket:201. (Copied from ticket:388)


Due by milestone: PreAlpha (01 June 2006)

No results

Due by milestone: Alpha (19 June 2006)

This is the initial NDG2 release. Major components should be present.

  1. Nothing.

#142
Incorporate bulk Stub-B runner in DP Package

Due by milestone: Post-Alpha Review (12 July 2006)

Reviewing how well alpha products were delivered and implemented.

  1. Any changes in requirements from review?

#201
[WG] Tag what has been used for alpha in subversion

Due by milestone: External Product Definition (31 Oct. 2006)

Mostly a checkpoint to see if there are any problems before PreBeta and make sure information is available and disseminated.

No results

Due by milestone: Documentation Pre-Beta (30 Nov. 2006)

All key documentation requirements should be identified, and at least skeleton documents should exist.

No results

Due by milestone: Pre-Beta (21 Dec. 2006)

This stage is intended to try and pull together the back-end services that make Beta possible.

No results

Due by milestone: Beta (30 Jan. 2007)

This milestone should include all the components that will appear in the production version of NDG.

#466
[DS] Granule Summary Tool

Due by milestone: Post-Beta Review (?)

This stage is a review of how we did for beta, what needs doing, and making a public release.

No results

Due by milestone: Production (30 Jun. 2007)

No results


Notes for discussion