wiki:PMLUseCase

Version 3 (modified by pmiller, 13 years ago) (diff)

--

Complete NDG Use Case for PML

What PML wants from NDG2

  • Increase discovery and usage of RSDAS data, logged per user.
  • Allow visualisation and analysis of RSDAS data using generic tools.
  • Expand NDG-enabled datasets to include long time-series and near-real time data.

Use case of interaction with RSDAS data

  • User discovers RSDAS data on NDG portal, says wow I want to analyse that.
  • User logs in to another DP to get NDG credentials for accessing RSDAS data.
  • User browses around metadata DIF, MOLES, CSML.
  • User visualises time-series of satellite data using GeoSPLAT; compares with other datsets
  • Scientist user writes program using Client Package (Python/Java?/IDL) to analyse RSDAS data.
  • User may contact PML for additional access permissions, via RSDAS application form.

Data provider procedure - PML perspective

Describe dataset metadata

  • Decide on scope of each discoverable dataset.
  • Assume we are generating MOLES first then CSML... (discuss).
  • Decide on granularity of DataGranule objects, ie how many CSML per MOLE record?
  • Write/adapt software for automating output of MOLES from DB.
  • Write software to semi-automate DB population for new datasets.
  • Ensure all related metadata are represented, e.g. sensors, units, vocabulary keywords, activities, etc.
  • Populate DB to allow dynamic generation of MOLES records for new datasets.
  • Automatically/dynamically generate DIF records.
  • Harvest DIF records, test DIF/MOLES accuracy and iterate.

Describe dataset data

  • Write CSML scanner/templates for new datasets.
  • Consider original data formats, ideally can be converted to suitable format on-the-fly, e.g. netCDF.
  • Generate CSML records dynamically from database.
  • Test CSML accuracy using NDG portal data browser.

Security and logging

  • Install NDG security software.
  • Generate role mappings with other NDG DP's.
  • Assign RSDAS users into external NDG roles.
  • Assign datasets to appropriate access role, e.g. any NDG user.
  • Interface NDG security with RSDAS data browser and authentication system.
  • Ensure NDG access to RSDAS data is logged: e.g. name, date, data granule id or filename.
  • Install NDG data delivery services and DX?
  • Test access to RSDAS data.

Visualisation

  • Install local GeoSPLAT?
  • Test delivery of netCDF files from RSDAS data.
  • Test visualisation of RSDAS data in GeoSPLAT.