MetaDataProvider: MetaData.py annotate

annotate MetaData.py @ 6:00147a1ab4ac

division between MetaDataFolder and Metadata looks good now (to me :-)

author	casties
date	Wed, 27 Jul 2011 21:08:01 +0200
parents	c1dbf78cc036
children	e959bc6bf2a7

rev	line source
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	1 from OFS.Folder import Folder
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	2 from Products.PageTemplates.PageTemplateFile import PageTemplateFile
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	3 from Globals import package_home
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	4 from AccessControl import ClassSecurityInfo
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	5 import os.path
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	6 import urllib
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	7 import logging
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	8 import urlparse
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	9
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	10 # TODO: which xml toolkit?
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	11 import amara
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	12 import xml.sax.saxutils
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	13 import xml.dom.minidom
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	14 import xml.etree.ElementTree as ET
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	15
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	16
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	17 # TODO: do we need this?
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	18 #from Products.OSA_system2 import OSAS_helpers
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	19 #from Products.OSA_system2.OSAS_metadata import OSAS_Metadata,OSAS_MetadataMapping
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	20
2 ac8e119b25ec trying to make import from xml work casties parents: 1 diff changeset	21 from MetaDataMapping import MetaDataMapping
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	22 from OSAS_metadata import OSAS_Metadata, OSAS_MetadataMapping
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	23
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	24
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	25 from SrvTxtUtils import getHttpData, getText
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	26
6 00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	27 def normalizeFieldName(bt, underscore=True):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	28 """returns normalised field type for looking up mappings"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	29 bt = bt.strip().replace(' ', '-').lower()
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	30 if underscore:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	31 bt = bt.replace('_', '-')
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	32
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	33 return bt
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	34
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	35
6 00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	36 class MetaData(Folder):
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	37 """provides basic methods for managing metadata structures"""
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	38 meta_type='MetaData'
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	39 security=ClassSecurityInfo()
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	40 manage_options = Folder.manage_options+(
5 c1dbf78cc036 more MetaDataFolder casties parents: 4 diff changeset	41 {'label':'Main Config','action':'changeMetaDataForm'},
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	42 {'label':'Import XML Schema','action':'importMetaDataExportXML'},
3 3dadf0d89261 more renovation casties parents: 2 diff changeset	43 #{'label':'Select Fields for Display','action':'indicateDisplayFieldsForm'},
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	44 )
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	45
6 00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	46 mappingSelectAttribute = 'type'
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	47 """the name of the attribute that can be used to select a mapping (if applicable)"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	48
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	49 def __init__(self,id,shortDescription='',description='',fields=''):
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	50 """initialize a new instance"""
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	51 self.id = id
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	52 self.shortDescription =shortDescription #label fuer link auf add page
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	53 self.description=description #description of the method for link page
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	54 self.fieldList=fields.split(",")[0:]
6 00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	55 #self.metaDataServerUrl="" # muss mit change metadata gesetzt werden
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	56
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	57
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	58 def getFieldList(self):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	59 """returns fieldList"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	60 return ','.join(self.fieldList)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	61
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	62 def getTagName(self):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	63 """returns the tag name of this element"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	64 return self.shortDescription
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	65
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	66 def getXmlPath(self, omitRoot=False):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	67 """returns the xpath to this element"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	68 path = '/%s'%self.getTagName()
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	69 parent = self.aq_parent
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	70 if parent.meta_type == self.meta_type:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	71 # add parent
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	72 path = parent.getXmlPath(omitRoot=omitRoot) + path
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	73 elif omitRoot:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	74 return ''
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	75
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	76 return path
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	77
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	78 def getMapping(self, type):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	79 """returns MetaDataMapping for type"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	80 # try type as id
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	81 mapping = getattr(self, type, None)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	82 if mapping is None:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	83 # try manually
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	84 mapFolder = self
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	85 for obj in mapFolder.objectValues():
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	86 if obj.meta_type == "MetadataMapping":
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	87 # real type is in title
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	88 mapType = obj.title
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	89 if mapType == type:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	90 # try type as is
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	91 return obj
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	92
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	93 if normalizeFieldName(mapType, underscore=True) == normalizeFieldName(type, underscore=True):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	94 # try normalized type without underscore
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	95 return obj
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	96
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	97 return mapping
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	98
6 00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	99 def getMapFields(self, data):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	100 """returns dict with metadata description for data"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	101 fields = {}
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	102 type = data['@type']
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	103 # get mapping from main/meta/bib
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	104 mapping = self.getMapping(type)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	105 if mapping is None:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	106 logging.error("getMapFields: no mapping for type: %s"%type)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	107 return fields
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	108
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	109 # get field descriptions (copy so we can change it)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	110 fields = mapping.getFields().copy()
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	111 # add field list
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	112 fields['@fieldList'] = mapping.getFieldList()
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	113
6 00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	114 return fields
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	115
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	116 def getMappedData(self, data, allFields=False):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	117 """returns dict with metadata descriptions and data for data"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	118 fields = self.getMapFields(data)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	119 fieldList = fields['@fieldList']
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	120 mappedData = {}
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	121 mappedList = []
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	122 for bk in fieldList:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	123 # ignore descriptions without data
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	124 if not data.get(bk, None):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	125 continue
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	126
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	127 # field description (copy so we can change it)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	128 bf = fields[bk].copy()
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	129 # add value
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	130 bf['value'] = data[bk]
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	131 mappedData[bk] = bf
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	132 mappedList.append(bk)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	133
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	134 if allFields and len(mappedData) < len(data):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	135 # add fields that were not in fields
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	136 for bk in data.keys():
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	137 if bk in mappedData or not data[bk]:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	138 continue
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	139
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	140 mappedData[bk] = {'tag':bk, 'label':bk, 'value':data[bk]}
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	141 mappedList.append(bk)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	142
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	143 mappedData['@fieldList'] = mappedList
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	144 return mappedData
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	145
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	146 def getDCMappedData(self, data, allFields=False):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	147 """returns dict with DC keys and data form data"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	148 fields = self.getMapFields(data)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	149 dcData = {}
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	150 for bk in fields.keys():
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	151 # ignore descriptions without data
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	152 if not data.get(bk, None):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	153 continue
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	154
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	155 # field description
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	156 dc = fields[bk].get('dcmap', None)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	157 if dc:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	158 # add value
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	159 if dcData.get('dc',None):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	160 # key exists - append
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	161 dcData[dc] += '/' + data[bk]
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	162 else:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	163 dcData[dc] = data[bk]
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	164
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	165 return dcData
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	166
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	167 def getFormatted(self, template, path=None, dom=None, data=None, allFields=False):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	168 """returns string with document data formatted according to template.
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	169 gets data from server or dom or pre-parsed data."""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	170 logging.debug("getFormatted(template=%s)"%(template))
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	171
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	172 if dom is None and data is None:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	173 # get from server
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	174 md = self.getMDFromPathOrUrl(path.replace("/mpiwg/online",""))
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	175 dom = ET.fromstring(md)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	176
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	177 # get contents of bib tag
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	178 if data is None:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	179 data = getDataFromDom(dom)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	180
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	181 type = data.get('@type', '')
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	182
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	183 # get template
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	184 tp=getattr(self,"%s_%s"%(template, normalizeFieldName(type)), None)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	185 if tp is None:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	186 logging.warning("getFormatted: no template for: %s_%s"%(template, type))
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	187 # try generic
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	188 tp=getattr(self,"%s_generic"%(template), None)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	189 if tp is None:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	190 logging.error("getFormatted: no generic template either: %s"%(template))
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	191 return ""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	192
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	193 # put field descriptions in mdHash
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	194 fields = self.getMappedData(data, allFields=allFields)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	195
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	196 return tp(mdmap=fields, md=data)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	197
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	198
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	199 def getDataFromDom(self, dom):
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	200 """returns dict with all elements from corresponding tag"""
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	201 info = {}
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	202 # ElementTree doesn't like absolute paths
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	203 # lets assume dom is rooted in the first element
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	204 xpath = '.' + self.getXmlPath(omitRoot=True)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	205 logging.debug("getDataFromDom looking for %s in %s"%(xpath, dom))
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	206 elem = dom.find(xpath)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	207 if elem is not None:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	208 # put type in @type
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	209 type = elem.get(self.mappingSelectAttribute, None)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	210 if type is not None:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	211 info['@type'] = normalizeFieldName(type)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	212
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	213 # put all subelements in dict
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	214 for e in elem:
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	215 info[normalizeFieldName(e.tag)] = getText(e)
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	216
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	217 return info
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	218
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	219
00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	220
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	221 def correctPath(self,path,remove=None,prefix=None,cut=0):
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	222 """convinience method um einen pfad zu veraendern"""
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	223 if remove is not None:
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	224 path=path.replace(remove,'')
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	225 if prefix is not None:
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	226 path=os.path.join(prefix,path)
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	227
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	228 if cut>0:
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	229 splitted=path.split("/")
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	230 path="/".join(splitted[0:len(splitted)-cut])
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	231 return path
6 00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	232
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	233
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	234 def importMetaDataExportXML(self,importFile=None,RESPONSE=None):
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	235 """imports metadata from the metadataexportxml file"""
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	236
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	237 if importFile is None:
3 3dadf0d89261 more renovation casties parents: 2 diff changeset	238 pt=PageTemplateFile('zpt/importMetaDataExportXML', globals()).__of__(self)
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	239 return pt()
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	240
3 3dadf0d89261 more renovation casties parents: 2 diff changeset	241 dom=ET.parse(importFile)
3dadf0d89261 more renovation casties parents: 2 diff changeset	242 node = dom.getroot()
3dadf0d89261 more renovation casties parents: 2 diff changeset	243 if node.tag != 'metadataExport':
3dadf0d89261 more renovation casties parents: 2 diff changeset	244 node = dom.find("metadataExport")
3dadf0d89261 more renovation casties parents: 2 diff changeset	245
3dadf0d89261 more renovation casties parents: 2 diff changeset	246 self.createMappingFromDom(node)
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	247
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	248 if RESPONSE is not None:
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	249 RESPONSE.redirect('manage_main')
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	250
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	251
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	252 def createMappingFromDom(self,metadatanode,metadata=None):
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	253 """erzeuge ein Mapping aus dem der metadatanode des xmlformats, metadata ist ein metadataobject"""
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	254
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	255 if metadata is None:
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	256 metadata=self
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	257
3 3dadf0d89261 more renovation casties parents: 2 diff changeset	258 nodes=metadatanode
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	259
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	260 for node in nodes:
2 ac8e119b25ec trying to make import from xml work casties parents: 1 diff changeset	261 logging.debug("node: %s"%repr(node))
3 3dadf0d89261 more renovation casties parents: 2 diff changeset	262 if node.tag=="set":
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	263 set=node
3 3dadf0d89261 more renovation casties parents: 2 diff changeset	264 id=set.get('name')
3dadf0d89261 more renovation casties parents: 2 diff changeset	265 list=[]
3dadf0d89261 more renovation casties parents: 2 diff changeset	266 argList={}
3dadf0d89261 more renovation casties parents: 2 diff changeset	267 for entry in set:
3dadf0d89261 more renovation casties parents: 2 diff changeset	268 genericName=entry.get('genericName')
3dadf0d89261 more renovation casties parents: 2 diff changeset	269 if set.get('name')=='generic':
3dadf0d89261 more renovation casties parents: 2 diff changeset	270 # generic mapping doesn't have labels
3dadf0d89261 more renovation casties parents: 2 diff changeset	271 tag = genericName
3dadf0d89261 more renovation casties parents: 2 diff changeset	272 label = genericName
3dadf0d89261 more renovation casties parents: 2 diff changeset	273 else:
3dadf0d89261 more renovation casties parents: 2 diff changeset	274 tag=entry.get('tag')
3dadf0d89261 more renovation casties parents: 2 diff changeset	275 label=entry.get('label')
3dadf0d89261 more renovation casties parents: 2 diff changeset	276
3dadf0d89261 more renovation casties parents: 2 diff changeset	277 if not tag:
3dadf0d89261 more renovation casties parents: 2 diff changeset	278 # ignore empty tags
3dadf0d89261 more renovation casties parents: 2 diff changeset	279 continue
3dadf0d89261 more renovation casties parents: 2 diff changeset	280
3dadf0d89261 more renovation casties parents: 2 diff changeset	281 description=getText(entry)
3dadf0d89261 more renovation casties parents: 2 diff changeset	282 argList[tag]={'tag':tag,'label':label,'explanation':description,'status':'optional'}
3dadf0d89261 more renovation casties parents: 2 diff changeset	283
3dadf0d89261 more renovation casties parents: 2 diff changeset	284 logging.debug("createMappingFromDom: new mapping=%s"%repr(argList))
3dadf0d89261 more renovation casties parents: 2 diff changeset	285 metadata._setObject(id,MetaDataMapping(id,id,argList))
3dadf0d89261 more renovation casties parents: 2 diff changeset	286
3dadf0d89261 more renovation casties parents: 2 diff changeset	287 elif node.tag=="metadata":
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	288 mn=node
3 3dadf0d89261 more renovation casties parents: 2 diff changeset	289 name=mn.get('name')
3dadf0d89261 more renovation casties parents: 2 diff changeset	290 logging.debug("createMappingFromDom: new metadata=%s"%repr(name))
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	291 metadata._setObject(name,MetaData(name,name))
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	292 mdObj=getattr(metadata,name)
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	293 mdObj.createMappingFromDom(mn)
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	294
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	295
5 c1dbf78cc036 more MetaDataFolder casties parents: 4 diff changeset	296 security.declarePublic('changeMetaDataForm')
c1dbf78cc036 more MetaDataFolder casties parents: 4 diff changeset	297 def changeMetaDataForm(self):
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	298 """Main configuration"""
6 00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	299 pt=PageTemplateFile(os.path.join(package_home(globals()),'zpt','changeMetadata.zpt')).__of__(self)
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	300 return pt()
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	301
5 c1dbf78cc036 more MetaDataFolder casties parents: 4 diff changeset	302 security.declarePublic('changeMetaData')
c1dbf78cc036 more MetaDataFolder casties parents: 4 diff changeset	303 def changeMetaData(self,shortDescription,description,fields,metaDataServerUrl,RESPONSE=None):
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	304 """Change Metadata"""
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	305 self.shortDescription=shortDescription
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	306 self.description=description
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	307 self.fieldList=fields.split(",")[0:]
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	308 self.metaDataServerUrl=metaDataServerUrl
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	309 if RESPONSE is not None:
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	310 RESPONSE.redirect('manage_main')
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	311
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	312
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	313 def manage_addMetaDataForm(self):
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	314 """interface for adding the OSAS_add_Metadata"""
6 00147a1ab4ac division between MetaDataFolder and Metadata looks good now (to me :-) casties parents: 5 diff changeset	315 pt=PageTemplateFile(os.path.join(package_home(globals()),'zpt','addMetadataForm.zpt')).__of__(self)
0 9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	316 return pt()
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	317
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	318 def manage_addMetaData(self,id,shortDescription,description,fields,RESPONSE=None):
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	319 """a metadata objekt"""
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	320 newObj=MetaData(id,shortDescription,description,fields)
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	321 self.Destination()._setObject(id,newObj)
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	322 if RESPONSE is not None:
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	323 RESPONSE.redirect('manage_main')
9f9d9be26e53 first checkin in Mercurial (see history in SVN) casties parents: diff changeset	324

Mercurial > hg > MetaDataProvider

annotate MetaData.py @ 6:00147a1ab4ac