wiki:Software

Version 9 (modified by lawrence, 11 years ago) (diff)

--

Software

Or more precisely, data and information access software ...

Three Main Components

  • NDGutils: standalone python egg with useful metadata and xml handling tools, including xqueries.
  • COWS: CEDA OGC Web Services, server stack.
  • MILK: Metadata, Information, Leads to Knowledge client stack for the COWS.

Meetings

October 1, 2008

Need to split old NDG stack into two clear stacks: a server stack, and a client stack. The former will be COWS, the latter needs a new name. What should we call it?

Both clients and servers need securing.

Proposed Resources and Timeline

Stephen: 40 days. From the new year. Dom: 40 days. Mainly from the new year, although Dom could move the WCS as described below, before Christmas.

Server Activities (COWS)

Issues and Actions

  • Observe that the parameter names exposed by WMS for HiGEM are meaningless.
    • This is in part because they stack currently uses gml:id rather than the parameter name.
      • This is a csml issue for Dom to fix.
    • It is also in part because the original NetCDF files have rather obscure parameter names in them, and since what we *already* have is not CF compliant, we need to deal with it. The NCML solution is to allow NCML to provide alternative names for actual attribute names within files.
      • This could be fixed by modifying the storage descripter to allow an actual netcdf attribute name and a CSML understood name, this would need to be supported by all the code stacks. Dom Issue. Andrew to understand and approve.
      • Dom's note: Actually it's simpler than that - the storage descriptor doesn't need to change. All that is necessary is that the gml id,description and name values in the csml documents change. The links between csml features and storage descriptors are managed by xlinks with gml:ids that aren't exposed - they aren't linked by variable name.

  • The existing WCS server stuff in the NDG stack needs to move to the COWS stack. Dom.
  • Does the WMS stack needs to support reprojections? Stephen. See polar stereographic below.
  • Configuration needs to be significantly improved so WMS and WCS can be more easily deployed starting from a global configuration file and CSML files.
    • Action: Stephen and Dom.
  • Need to add unit tests for the WMS and WCS servers using OWSlib.
    • Support for levels and duration should be deployed and tested in both WCS and WMS. Dom and Stephen.
  • WFS support in general. We now the existing geoserver work which is designed for providing CSML access to databases. The current work was limited in terms of what could be exposed (temporal duration, parameter picking, midas snaphot, scaling issues). It is unlikely that we can make significant progress on this work during this phase of the project, but future work should be properly scoped and identified and relation to C-SEKT clarified.
    • Action: Stephen and Dom to produce a paper describing what was achieved and what needs doing, and what resources it would take.

Client Stack (MILK)

Current state is that we have the work that Calum did running on a server not much plumbed in anywhere. We need to improve this and the client stack needs to be refactored to be standalone. It should include the WMS client, WCS client, the old browse client, the new browse client and a discovery client, and it should be deployed at BADC and existing NDG sites.

A key requirement for the visualisation is to support polar stereographic as well as standard map projections. A future requirement would be to include an interface to DCIP-type WPS methods to provide more complicated plots.

Presumably the polar stereographic reprojection would be done in the server stack not in openlayers per se? Need some clarity.

Specific obvious actions:

  • Evaluate and potentially improve what Calum has done. Make sure it's understood. Stephen.

Download button for maps on the WMS page, which encode a precanned WCS call. Return NetCDF. Dom.

  • Build a standalone pylons WCS client (which could be deployable via easy_install and localhost). Ideally get someone from outside the exsting team to do this. PersonX.

Generic CEDA issues:

  • The last brings us to a point to consider CEDA wide: we don't have a web design expert with javascript and layout skills. We need to work out who that might be.
  • Do we want to consider building a webhelpers equivalent for the Yahoo Javascript library (YUI?).

Current Tickets

COWS

#389
[DS][M] Exposing vars to user via CSML and CDML - name plus cell_methods plus coordinate?
#877
[D] WCS 1.0.0+
#987
Support for reprojections in COWS stack (WMS)
#988
Improve configuration of COWS
#989
Create CEDA tests for OWSLib
#992
Review and scope out MIDAS WFS work
#994
Automatic Generation of KML from CSML WMS
#996
Client (and visualisation) stack needs to be standalone
#998
WCS support for rotated grids
#1000
Make WMS interface pluggable through egg entrypoints
#1002
COWS test suite
#1070
Cowsclient - legends still visible even when not top layer
#1071
COWS -threads/processes etc
#1112
COWS Visualisation needs a logout button
#1113
COWS Visualisation browser compatibility and login
#1114
COWS paster template is broken

MILK

#415
[m] browse should link to the parameter definitions from the vocab server
#692
[M] Tooltips in Discovery
#806
[M] Browse not consistent in displaying Data Curator URI
#842
[M] Pick up logo info for Browse from correct place
#866
[WG] Need to consider a retrieve function for the granule part of a ndg-b record
#915
[WG][M] Number of bounding boxes reported is wrong in browse
#937
Caching in discovery/browse is too permanent
#961
[D] Browse display shows the browse link itself
#995
Build standalone python WCS client
#997
Scope NDG COWS service deliverables
#1009
Deploy WMS background map for MILK

ndgutils

Error: Macro TicketQuery(componet=ndgutils&status=new|assigned|reopened) failed
column t.componet does not exist
LINE 1: ...riority,t.time AS time,t.changetime AS changetime,t.componet...
                                                             ^
HINT:  Perhaps you meant to reference the column "t.component".


NDG3: Capability, Discovery, Vocab, Software, MOLES, Security, Community, Roadmap