NDG Progress, as of October 2006 (mhen)

NDG/MOLES

• The PML MOLES Database has been redesigned. Triggers and postgres-specific extensions (such as arrays) have been removed and relationships have been made explicit. This should make it (slightly) easier to understand, and also more portable. A graphical representation of the new database structure is attached.

• extensive modifications to b_serve.php, in line with the database modifications.  An example data_entity generated by b_serve

• The database can now be fully populated with data entities, by using a few perl scripts and unix tools.

mhen@pmpc828 ndg_moles # ./scanner.pl modis meris avhrr seawifs | sort | uniq | ./group_by_year.pl | ./ndg_moles_insert.pl

Currently, the database has one MOLES record for each year of data for a particular sensor and area:

Sensor	No. Records
MERIS	32
MODIS	81
AVHRR	617
SeaWiFS	260
(total 1054)

• DIFs can now be generated using sed in combination with a  slightly modified XQuery. An example DIF is available here:  DIF500

NDG/CSML

• CSML records can now be generated, by using a combination of perl and python scripts:

mhen@pmpc828 ndg_csml_gen # ./ndg_csml_granule meris200607zx | metatrans.pl --format NDG_CSML | ./ndg_csml_dataset_gen.py

The CSML record generated by the above scripts can be seen here:  meris200607zx