source: mauRepo/MolesManager/trunk/src/libs/migration/processor/migrationProcess.py @ 8358

Subversion URL: http://proj.badc.rl.ac.uk/svn/ndg/mauRepo/MolesManager/trunk/src/libs/migration/processor/migrationProcess.py@8358
Revision 8358, 3.1 KB checked in by mnagni, 7 years ago (diff)

Major refactoring about migration (now handles better create/update, even if the single updates have to be quite fully implemented)
Added the connection pool from SQLAlchemy

Line 
1'''
2BSD Licence
3Copyright (c) 2012, Science & Technology Facilities Council (STFC)
4All rights reserved.
5
6Redistribution and use in source and binary forms, with or without modification,
7are permitted provided that the following conditions are met:
8
9    * Redistributions of source code must retain the above copyright notice,
10        this list of conditions and the following disclaimer.
11    * Redistributions in binary form must reproduce the above copyright notice,
12        this list of conditions and the following disclaimer in the documentation
13        and/or other materials provided with the distribution.
14    * Neither the name of the Science & Technology Facilities Council (STFC)
15        nor the names of its contributors may be used to endorse or promote
16        products derived from this software without specific prior written permission.
17
18THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
19AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO,
20THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
21PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS
22BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY,
23OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
24SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
25HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
26OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
27OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
28
29Created on 10 Jan 2012
30
31@author: Maurizio Nagni
32'''
33from libs.migration.processor.dataEntity import DataEntityProcessor
34import logging
35from logging import StreamHandler
36
37class MigrationProcess():
38    log = logging.getLogger('MigrationProcess')
39    log.addHandler(StreamHandler())
40    log.setLevel(logging.DEBUG)
41   
42    """
43        Manages the migration process from Moles2 to Moles3.
44    """
45    def __init__(self, epbRepo):
46        '''
47            @param epbRepo: an instance of EPBRepo
48        '''
49        self.epbRepo = epbRepo
50   
51    def process(self, dataEntityObject = None):
52        """
53            Starts the migration. If no DataEntityMigration instance is given then all the DataEntityMigration objects in the
54            data_entity_migration table are processed
55            1) each DataEntityMigration is associated to a "dataent_xxxx" file, called "data entity" in Moles2
56            2) each "data entity" is associated with a CEDA_ObservationCollection
57            @param dataEntityObject: a DataEntityMigration instance to process.
58            @return: a list of collected exceptions
59        """
60        exs = []
61        data_ents = self.epbRepo.migrationEPB.getDataEntityMigrationbyPath(dataEntityObject)
62           
63        #loops over the data entities
64        for dataEntityMigration in data_ents:                         
65            dep = DataEntityProcessor(dataEntityMigration, self.epbRepo)           
66            exs.extend(dep.process())
67            MigrationProcess.log.info("Done")           
68        return exs
Note: See TracBrowser for help on using the repository browser.