MPIWGWeb: SrvTxtUtils.py annotate

annotate SrvTxtUtils.py @ 28:dd765003647b

compatibility band-aid.

author	casties
date	Tue, 23 Apr 2013 10:25:21 +0200
parents	54f135c1ed65
children	e40ff9829108

rev	line source
0 bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	1 """Utility methods for handling XML, reading HTTP, etc"""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	2
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	3 from App.ImageFile import ImageFile
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	4 from App.Common import rfc1123_date
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	5
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	6 import sys
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	7 import os
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	8 import stat
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	9 import urllib
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	10 import urllib2
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	11 import logging
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	12
16 54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	13 srvTxtUtilsVersion = "1.6"
0 bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	14
16 54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	15 map_months = {'en': [u"",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	16 u"January",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	17 u"February",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	18 u"March",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	19 u"April",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	20 u"May",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	21 u"June",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	22 u"July",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	23 u"August",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	24 u"September",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	25 u"October",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	26 u"November",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	27 u"December"],
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	28 'de': [u"",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	29 u"Januar",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	30 u"Februar",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	31 u"M\u00e4rz",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	32 u"April",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	33 u"Mai",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	34 u"Juni",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	35 u"Juli",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	36 u"August",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	37 u"September",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	38 u"Oktober",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	39 u"November",
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	40 u"Dezember"]}
0 bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	41
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	42 def getInt(number, default=0):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	43 """returns always an int (0 in case of problems)"""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	44 try:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	45 return int(number)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	46 except:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	47 return int(default)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	48
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	49 def getAt(array, idx, default=None):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	50 """returns element idx from array or default (in case of problems)"""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	51 try:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	52 return array[idx]
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	53 except:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	54 return default
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	55
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	56 def unicodify(s):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	57 """decode str (utf-8 or latin-1 representation) into unicode object"""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	58 if not s:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	59 return u""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	60 if isinstance(s, str):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	61 try:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	62 return s.decode('utf-8')
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	63 except:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	64 return s.decode('latin-1')
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	65 else:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	66 return s
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	67
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	68 def utf8ify(s):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	69 """encode unicode object or string into byte string in utf-8 representation.
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	70 assumes string objects to be utf-8"""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	71 if not s:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	72 return ""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	73 if isinstance(s, str):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	74 return s
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	75 else:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	76 return s.encode('utf-8')
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	77
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	78 def getText(node, recursive=0):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	79 """returns all text content of a node and its subnodes"""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	80 if node is None:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	81 return ''
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	82
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	83 # ElementTree:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	84 text = node.text or ''
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	85 for e in node:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	86 if recursive:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	87 text += getText(e)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	88 else:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	89 text += e.text or ''
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	90 if e.tail:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	91 text += e.tail
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	92
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	93 # 4Suite:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	94 #nodelist=node.childNodes
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	95 #text = ""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	96 #for n in nodelist:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	97 # if n.nodeType == node.TEXT_NODE:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	98 # text = text + n.data
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	99
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	100 return text
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	101
16 54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	102 def getMonthName(mon, lang):
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	103 """returns the name of the month mon in the language lang"""
54f135c1ed65 updated MPIWGFeature. casties parents: 0 diff changeset	104 return map_months[lang][mon]
0 bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	105
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	106 def getHttpData(url, data=None, num_tries=3, timeout=10, noExceptions=False):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	107 """returns result from url+data HTTP request"""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	108 # we do GET (by appending data to url)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	109 if isinstance(data, str) or isinstance(data, unicode):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	110 # if data is string then append
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	111 url = "%s?%s"%(url,data)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	112 elif isinstance(data, dict) or isinstance(data, list) or isinstance(data, tuple):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	113 # urlencode
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	114 url = "%s?%s"%(url,urllib.urlencode(data))
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	115
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	116 response = None
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	117 errmsg = None
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	118 for cnt in range(num_tries):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	119 try:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	120 logging.debug("getHttpData(#%s %ss) url=%s"%(cnt+1,timeout,url))
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	121 if sys.version_info < (2, 6):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	122 # set timeout on socket -- ugly :-(
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	123 import socket
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	124 socket.setdefaulttimeout(float(timeout))
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	125 response = urllib2.urlopen(url)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	126 else:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	127 # timeout as parameter
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	128 response = urllib2.urlopen(url,timeout=float(timeout))
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	129 # check result?
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	130 break
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	131 except urllib2.HTTPError, e:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	132 logging.error("getHttpData: HTTP error(%s): %s"%(e.code,e))
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	133 errmsg = str(e)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	134 # stop trying
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	135 break
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	136 except urllib2.URLError, e:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	137 logging.error("getHttpData: URLLIB error(%s): %s"%(e.reason,e))
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	138 errmsg = str(e)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	139 # stop trying
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	140 #break
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	141
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	142 if response is not None:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	143 data = response.read()
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	144 response.close()
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	145 return data
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	146
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	147 if noExceptions:
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	148 return None
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	149
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	150 raise IOError("ERROR fetching HTTP data from %s: %s"%(url,errmsg))
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	151 #return None
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	152
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	153
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	154 def refreshingImageFileIndexHtml(self, REQUEST, RESPONSE):
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	155 """index_html method for App.ImageFile that updates the file info for each request."""
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	156 stat_info = os.stat(self.path)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	157 self.size = stat_info[stat.ST_SIZE]
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	158 self.lmt = float(stat_info[stat.ST_MTIME]) or time.time()
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	159 self.lmh = rfc1123_date(self.lmt)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	160 # call original method
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	161 return ImageFile.index_html(self, REQUEST, RESPONSE)
bca61e893fcc first checkin of MPIWGWeb r2 branch from CVS into mercurial casties parents: diff changeset	162

Mercurial > hg > MPIWGWeb

annotate SrvTxtUtils.py @ 28:dd765003647b