LGDataverses: scripts/migration/files_source

annotate scripts/migration/files_source_ @ 10:a50cf11e5178

Rewrite LGDataverse completely upgrading to dataverse4.0

author	Zoe Hong <zhong@mpiwg-berlin.mpg.de>
date	Tue, 08 Sep 2015 17:00:21 +0200
parents
children

rev	line source
10 a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	1 #!/usr/bin/perl
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	2
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	3 my $dvobjectoffset = shift @ARGV;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	4
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	5 unless ($dvobjectoffset > 0)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	6 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	7 print STDERR "Usage: ./files_source_ <DVOBJECT DB ID OFFSET>\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	8 exit 1;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	9 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	10
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	11 my $filecatid = 0; # file categories (this is a new object in 4.0, so there are no 3.6 IDs to reuse)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	12 # (offset this if adding content content to an already populated db)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	13
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	14 use DBI;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	15
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	16 my $host = "localhost";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	17 my $username = "xxxxx";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	18 my $database = "xxxxx";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	19 my $password = "xxxxx";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	20
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	21 my $dbh = DBI->connect("DBI:Pg:dbname=$database;host=$host",$username,$password);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	22
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	23 open PL, ">packlist.txt";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	24
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	25 %STUDYMAP = {};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	26 %STUDYFILEMAP = {};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	27
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	28 while ( <> )
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	29 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	30 chop;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	31 my ($globalid, $dsid, $dsvid, $dsvnum) = split("\t", $_);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	32
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	33 %FILECATEGORIES = {}; # file categories for this dataset.
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	34
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	35 if ($globalid =~/^([a-z]):(.)\/([^\/]*)$/)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	36 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	37 $protocol = $1;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	38 $authority = $2;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	39 $identifier = $3;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	40
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	41 # print $protocol . " " . $authority . " " . $identifier . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	42 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	43 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	44 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	45 print STDERR "WARNING! illegal global id: " . $globalid . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	46 next;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	47 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	48
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	49 my $sth;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	50
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	51 #$sth = $dbh->prepare(qq {SELECT s.id, v.id FROM study s, studyversion v WHERE v.study_id = s.id AND s.protocol = '$protocol' AND s.authority='$authority' AND s.studyid = '$identifier' AND v.versionstate = 'RELEASED'});
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	52 $sth = $dbh->prepare(qq {SELECT s.id, v.id FROM study s, studyversion v WHERE v.study_id = s.id AND s.protocol = '$protocol' AND s.authority='$authority' AND s.studyid = '$identifier' AND v.versionnumber = $dsvnum});
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	53 $sth->execute();
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	54
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	55 my $vercount = 0;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	56
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	57 my $sid;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	58 my $svid;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	59
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	60 while ( @foo = $sth->fetchrow() )
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	61 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	62 $sid = $foo[0];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	63 $svid = $foo[1];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	64
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	65 # print $sid . "\t" . $svid . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	66 $vercount++;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	67 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	68
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	69 $sth->finish;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	70
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	71 unless ($vercount == 1)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	72 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	73 print STDERR "WARNING: invalid number of versions for study " . $globalid . ", with version number " . $dsvnum . " (" . $vercount . ")!\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	74 next;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	75 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	76
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	77 $sth = $dbh->prepare(qq {SELECT fm.label, fm.category, fm.description, sf.filetype, sf.filesystemlocation, sf.md5, sf.restricted, sf.subsettable, sf.originalfiletype, sf.unf, sf.id, sf.fileclass, fm.id FROM filemetadata fm, studyfile sf WHERE fm.studyfile_id = sf.id AND fm.studyversion_id = $svid});
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	78
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	79 # print qq {SELECT fm.label, fm.category, fm.description, sf.filetype, sf.filesystemlocation, sf.md5, sf.restricted, sf.subsettable, sf.originalfiletype, sf.unf FROM filemetadata fm, studyfile sf WHERE fm.studyfile_id = sf.id AND fm.studyversion_id = $svid} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	80
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	81 $sth->execute();
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	82
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	83 my $newfile = 0;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	84
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	85 while ( @foo = $sth->fetchrow() )
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	86 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	87 # new filemetadata fields:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	88 $label = $foo[0];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	89 $description = $foo[2];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	90 $description =~s/\n/ /g;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	91 $description = $dbh->quote($description);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	92 # category:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	93 $category = $foo[1];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	94 # new datafile fields:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	95 $type = $foo[3];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	96 unless ($type =~m:/:)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	97 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	98 $type = "application/octet-stream";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	99 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	100 $md5 = $foo[5];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	101 $restricted = $foo[6];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	102 # location of the file, on the old filesystem:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	103 $fslocation = $foo[4];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	104 # additional info for subsettable files:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	105 # (will go into the new datatable)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	106 $subsettable = $foo[7];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	107 $originalfiletype = $foo[8];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	108 $unf = $foo[9];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	109 # id of the existing studyfile:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	110 $sfid = $foo[10];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	111 # "class" of the existing studyfile:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	112 # (tabular, "other", etc.)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	113 $fileclass = $foo[11];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	114 $fmid = $foo[12];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	115 #print join ("\t", @_) . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	116
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	117 if ($label =~/[\\\/:\*\?\"\<\>\\|;\#]/)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	118 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	119 $preservedlabel = $label;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	120 $label=~s/[\\\/:\*\?\"\<\>\\|;\#]//g;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	121
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	122 print STDERR "LABEL REPLACED: (FILEMETA: " . $fmid . ", FILE: " . $sfid . ", STUDY: " . $sid . ", VERSION: " . $svid . ", GLOBALID: " . $globalid . ") OLD: \"" . $preservedlabel . "\", NEW: \"" . $label . "\"\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	123 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	124
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	125 if ($label eq '')
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	126 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	127 $label = "UNKNOWN";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	128 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	129
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	130 $label = $dbh->quote($label);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	131
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	132
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	133 unless ($STUDYFILEMAP{$sfid})
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	134 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	135 $newfile = 1;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	136 # Certain things only need to be done once per file -
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	137 # namely, each file needs one dvobject and datafile each;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	138 # same for the datatables and variables.
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	139 # Other things, like filemetadatas, need to be created one
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	140 # per version.
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	141
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	142 $newdatafileid = ($dvobjectoffset+$sfid);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	143 $STUDYFILEMAP{$sfid} = $newdatafileid;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	144 ##$dvobjectoffset++;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	145
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	146 $fsname = $fslocation;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	147
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	148 if ($fslocation =~/^http/ )
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	149 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	150 $fsize = 0;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	151 $fmtime = &formatTimeStamp(time);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	152 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	153 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	154 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	155 if ( -f $fslocation )
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	156 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	157 @fstats = stat($fslocation);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	158 $fsize = $fstats[7];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	159 $mtime = $fstats[9];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	160
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	161 $fmtime = &formatTimeStamp($mtime);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	162 $packlistentry = $fslocation;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	163 $packlistentry =~s/.*\/DVN\/data\///;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	164 print PL $packlistentry . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	165 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	166 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	167 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	168 print STDERR "WARNING: file " . $fslocation . " not found!\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	169 $fsize = 0;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	170 $fmtime = &formatTimeStamp(time);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	171 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	172
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	173 $fsname =~s/^.*\///g;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	174 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	175
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	176 # dvobject:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	177
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	178 print qq {INSERT INTO dvobject (id, dtype, owner_id, createdate, modificationtime) VALUES ($newdatafileid, 'DataFile', $dsid, '$fmtime', '$fmtime');} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	179
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	180 # datafile object:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	181
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	182 print qq {INSERT INTO datafile (id, contenttype, filesystemname, filesize, md5, restricted) VALUES ($newdatafileid, '$type', '$fsname', $fsize, '$md5', TRUE);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	183 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	184 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	185 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	186 $newdatafileid = $STUDYFILEMAP{$sfid};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	187 $newfile = 0;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	188 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	189
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	190 # file metadata object:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	191 print qq {INSERT INTO filemetadata (id, description, label, restricted, version, datasetversion_id, datafile_id) VALUES ($fmid, $description, $label, TRUE, 1, $dsvid, $newdatafileid);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	192 ##print qq {INSERT INTO filemetadata (id, description, label, restricted, version, datasetversion_id, datafile_id) VALUES ($fmid, $description, $label, TRUE, 1, $dsvid, $dvobjectoffset);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	193
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	194 # and the category, if exists:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	195
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	196 if ($category && $category ne "")
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	197 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	198 $category = $dbh->quote($category);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	199 unless ($FILECATEGORIES{$category})
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	200 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	201 # this is a new category (for this dataset),
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	202 # so it needs to be created:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	203
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	204 $filecatid++;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	205
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	206 print qq{INSERT INTO datafilecategory (id, name, dataset_id) VALUES ($filecatid, $category, $newdatafileid);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	207 #print qq{INSERT INTO datafilecategory (id, name, dataset_id) VALUES ($filecatid, $category, $dvobjectoffset);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	208
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	209 $FILECATEGORIES{$category} = $filecatid;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	210 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	211
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	212 my $fcid = $FILECATEGORIES{$category};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	213 print qq{INSERT INTO filemetadata_datafilecategory (filecategories_id, filemetadatas_id) VALUES ($fcid, $fmid);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	214
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	215 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	216
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	217
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	218 # subsettable files:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	219 # (again, this only needs to be done once per file!)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	220
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	221
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	222 if ($newfile && ($fileclass eq "TabularDataFile"))
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	223 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	224 #print STDERR "this is a subsettable file.\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	225
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	226 # NOTE:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	227 # there's only one datatable per file - make sure to only run this once!
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	228 # (i.e., not for every version!)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	229
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	230 $sth1 = $dbh->prepare(qq {SELECT id, varquantity, casequantity, unf, recordspercase FROM datatable WHERE studyfile_id = $sfid});
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	231
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	232 $sth1->execute();
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	233
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	234 $count = 0;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	235
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	236 while ( @dt = $sth1->fetchrow() )
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	237 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	238 $dtid = $dt[0];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	239 $varquantity = $dt[1];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	240 $casequantity = $dt[2];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	241 $dtunf = $dt[3];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	242 $recordspercase = $dt[4];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	243
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	244 $count++;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	245
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	246 unless ($unf eq $dtunf)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	247 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	248 print STDERR "WARNING: unf mismatch, between studyfile and datatable: " + $unf + ":" + $dtunf + "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	249 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	250
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	251 # datatable object:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	252
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	253
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	254 if ($recordspercase)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	255 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	256 print qq {INSERT INTO datatable (id, varquantity, casequantity, unf, originalfileformat, recordspercase, datafile_id) VALUES ($dtid, $varquantity, $casequantity, '$unf', '$originalfiletype', $recordspercase, $newdatafileid);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	257 #print qq {INSERT INTO datatable (id, varquantity, casequantity, unf, originalfileformat, recordspercase, datafile_id) VALUES ($dtid, $varquantity, $casequantity, '$unf', '$originalfiletype', $recordspercase, $dvobjectoffset);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	258 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	259 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	260 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	261 print qq {INSERT INTO datatable (id, varquantity, casequantity, unf, originalfileformat, datafile_id) VALUES ($dtid, $varquantity, $casequantity, '$unf', '$originalfiletype', $newdatafileid);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	262 #print qq {INSERT INTO datatable (id, varquantity, casequantity, unf, originalfileformat, datafile_id) VALUES ($dtid, $varquantity, $casequantity, '$unf', '$originalfiletype', $dvobjectoffset);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	263 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	264 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	265
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	266 $sth1->finish;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	267
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	268 unless ($count == 1)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	269 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	270 print STDERR "WARNING: invalid numbe of datatables: " + $count +".\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	271 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	272 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	273 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	274 # variables:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	275 $sth1 = $dbh->prepare(qq {SELECT name, label, variableformattype_id, variableintervaltype_id, formatcategory, formatschema, formatschemaname, unf, fileorder, weighted, orderedfactor, numberofdecimalpoints, universe, filestartposition, fileendposition, recordsegmentnumber, id FROM datavariable WHERE datatable_id = $dtid});
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	276
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	277
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	278 $sth1->execute();
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	279
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	280 while ( @dv = $sth1->fetchrow() )
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	281 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	282 $varname = $dv[0];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	283 $varname = $dbh->quote($varname);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	284 $varlabel = $dv[1];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	285 $varlabel = $dbh->quote($varlabel);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	286 $variableformattype_id = $dv[2];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	287 # the old school formattype_id and
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	288 # intervaltype_id need to be adjusted by 1,
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	289 # to match the new enum values used in the
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	290 # 4.0 datavariables:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	291 $variableformattype_id--;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	292 $variableintervaltype_id = $dv[3];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	293 $variableintervaltype_id--;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	294 $varformatcategory = $dv[4];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	295 $varformatschema = $dv[5];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	296 $varformatschemaname = $dv[6];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	297 $varunf = $dv[7];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	298 $varfileorder = $dv[8];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	299 $varweighted = $dv[9];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	300 if ($varweighted)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	301 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	302 $varweighted = "TRUE";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	303 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	304 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	305 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	306 $varweighted = "FALSE";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	307 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	308 $varorderedfactor = $dv[10];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	309 if ($varorderedfactor)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	310 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	311 $varorderedfactor = "TRUE";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	312 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	313 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	314 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	315 $varorderedfactor = "FALSE";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	316 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	317
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	318 $varnumberofdecimalpoints = $dv[11];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	319 $varuniverse = $dv[12];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	320 $varfilestartposition = $dv[13];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	321 $varfileendposition = $dv[14];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	322 $varrecordsegmentnumber = $dv[15];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	323 $varid = $dv[16];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	324
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	325
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	326
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	327 # new datavariable object:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	328
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	329 $newdvfields = "id, name, label, interval, type, unf, fileorder, orderedfactor, weighted, datatable_id";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	330 $newdvvalues = qq {$varid, $varname, $varlabel, $variableintervaltype_id, $variableformattype_id, '$varunf', $varfileorder, $varorderedfactor, $varweighted, $dtid};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	331
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	332 if ($varformatschemaname)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	333 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	334 # becomes "format":
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	335 $newdvfields = $newdvfields . ", format";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	336 $newdvvalues = qq{$newdvvalues, '$varformatschemaname'};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	337 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	338
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	339 if ($varformatcategory)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	340 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	341 $newdvfields = $newdvfields . ", formatcategory";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	342 $newdvvalues = qq{$newdvvalues, '$varformatcategory'};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	343 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	344
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	345 if ($varfilestartposition)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	346 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	347 $newdvfields = $newdvfields . ", filestartposition";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	348 $newdvvalues = qq{$newdvvalues, $varfilestartposition};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	349 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	350
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	351 if ($varfileendposition)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	352 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	353 $newdvfields = $newdvfields . ", fileendposition";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	354 $newdvvalues = qq{$newdvvalues, $varfileendposition};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	355 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	356
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	357 if ($varrecordsegmentnumber)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	358 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	359 $newdvfields = $newdvfields . ", recordsegmentnumber";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	360 $newdvvalues = qq{$newdvvalues, $varrecordsegmentnumber};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	361 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	362
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	363 if ($varuniverse)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	364 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	365 $newdvfields = $newdvfields . ", universe";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	366 $newdvvalues = qq{$newdvvalues, '$varuniverse'};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	367 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	368
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	369 if ($varnumberofdecimalpoints)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	370 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	371 $newdvfields = $newdvfields . ", numberofdecimalpoints";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	372 $newdvvalues = qq{$newdvvalues, $numberofdecimalpoints};
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	373 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	374
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	375
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	376 print qq {INSERT INTO datavariable ($newdvfields) VALUES ($newdvvalues);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	377
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	378 # variable categories:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	379 $sth2 = $dbh->prepare(qq {SELECT id, label, value, missing, catorder, frequency FROM variablecategory WHERE datavariable_id = $varid});
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	380 $sth2->execute();
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	381
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	382 while ( @vc = $sth2->fetchrow() )
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	383 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	384 $varcatid = $vc[0];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	385 $varcatlabel = $vc[1];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	386 $varcatvalue = $vc[2];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	387 $varcatmissing = $vc[3];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	388 if ($varcatmissing)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	389 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	390 $varcatmissing = "true";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	391 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	392 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	393 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	394 $varcatmissing = "false";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	395 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	396 $varcatorder = $vc[4];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	397 unless ($varcatorder)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	398 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	399 if ($varcatorder eq "" \|\| $varcatorder != 0)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	400 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	401 $varcatorder = "null";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	402 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	403 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	404 $varcatfreq = $vc[5];
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	405 unless ($varcatfreq)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	406 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	407 if ($varcatfreq eq "" \|\| $varcatfreq != 0)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	408 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	409 $varcatfreq = "null";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	410 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	411 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	412
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	413
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	414 # only migrate the real categories:
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	415 if ($varcatlabel)
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	416 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	417 $varcatlabel = $dbh->quote($varcatlabel);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	418 unless ($varcatvalue \|\| ($varcatvalue eq "") \|\| ($varcatvalue == 0))
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	419 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	420 #print STDERR "WARNING: empty var cat value (" . $varcatlabel . ")\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	421 print STDERR qq {INSERT INTO variablecategory (id, label, value, missing, catorder, frequency, datavariable_id) VALUES ($varcatid, $varcatlabel, $varcatvalue, $varcatmissing, $varcatorder, $varcatfreq, $varid);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	422 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	423 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	424 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	425 $varcatvalue = $dbh->quote($varcatvalue);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	426 print qq {INSERT INTO variablecategory (id, label, value, missing, catorder, frequency, datavariable_id) VALUES ($varcatid, $varcatlabel, $varcatvalue, $varcatmissing, $varcatorder, $varcatfreq, $varid);} . "\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	427 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	428 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	429 else
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	430 {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	431 #print STDERR "empty var cat label.\n";
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	432 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	433 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	434
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	435 $sth2->finish;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	436 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	437
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	438 $sth1->finish;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	439 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	440
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	441
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	442
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	443 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	444 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	445
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	446 $sth->finish;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	447
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	448 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	449
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	450 $dbh->disconnect;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	451
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	452 close PL;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	453
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	454 exit 0;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	455
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	456 sub formatTimeStamp () {
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	457 my ($mtime) = (@_);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	458 my ($sec,$min,$hour,$mday,$mon,$year,$wday,$yday,$isdst) = localtime($mtime);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	459
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	460 $year+=1900;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	461 $mon++;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	462
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	463 $fmt = $year . "-" . sprintf("%02d",$mon) . "-" . sprintf("%02d",$mday) . " " .
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	464 sprintf("%02d", $hour) . ":" . sprintf("%02d",$min) . ":" . sprintf("%02d",$sec);
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	465
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	466 return $fmt;
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	467 }
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	468
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	469
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	470
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	471
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	472
a50cf11e5178 Rewrite LGDataverse completely upgrading to dataverse4.0 Zoe Hong <zhong@mpiwg-berlin.mpg.de> parents: diff changeset	473

Mercurial > hg > LGDataverses

annotate scripts/migration/files_source_ @ 10:a50cf11e5178