Changes between Initial Version and Version 1 of dataIntegration

Timestamp:

Dec 6, 2013, 12:43:45 PM (10 years ago)

Author:

dwinter

Comment:

--

dataIntegration

@@ +1 @@
+= Data Integration =
+
+
+== Integration of Cologne Data ==
+
+=== general ===
+
+'''convertFaust''' converts faust-xml output into FMPXMLRESULT.
+
+''' match_faust_arb''' contains the methods for matching the different object with the ARB data.
+
+=== texts ===
+First step is matching the texts.
+
+   * convert text objects from faust to filemaker format.
+   * import the texts into filemaker database faust-texte.
+   * export relevant field for matching in this case only the number part of '''signatur''' is comparted with the numbers in '''Title''' in N_source_codex
+   * match with '''match_faust_arb.doMatchTexts'''
+   * import results into C_faust_arb_texte
+   * manually check (layout -> C_faust_arb_texte)
+
+
+Relating the matched texts:
+
+   * Layout N_source_codex_faust displayes links to the matched texts.
+   
+Importing the new texts/ all non matching texts:
+   
+   * Import all faust-ids into N_source_codex, for each is a new empty data set created, original ID is saved in __import_from_faust
+   * Script import_from_faust_text, imports selected fields from the faust-db into ARB
+   * Script import_all_from_faust_text, loops through all selected datasets and does the import, if possible.
+  
+Matching:
+
+   * [ticket:25 Contents / Remarks of the matching docs have to be integrated?]
+      * [ticket:26 needs an layout to do so]
+
+
+
+
+=== recipes ===
+
+   * [ticket:21 Matching of recipies has to be done]
+   * [ticket:18 Import non matching recipes ] (Import all recipies which can't be in ARB because the texts are not in ARB. (Seems to be only one ID:4229)
+   * [ticket:22 Import remaining recipes]
+      * first: import von faust-recepte: kommentar -> remark, key --> {{{__import_key__from_cologne}}}, Material --> material
+      * second : import now : Folio_Seite --> location, c_faust_arb_texte:correct_arb --> ID_target, N_recipies:ID --> ID_source
+      * Now export the now generated datasets (fields: ID_source, ID)
+      * Now import the exported data into N_recipes, with ID_soruce matching ID und ID -> ID_recipes_sources
+       * Now import transcription and translation:
+       * Export transcription and Übersetzung mit ID_recep_
+       * Import in N_representation transkription --> transcription, Übersetzung --> translation, C:recipes_soruces:ID --> _tmp
+       * Export the new datasets from there _tmp,ID
+       * Import this into C_recipes_source, witch matching _tmp -> ID_source, ID -> ID_representation
+       * Export from faust-lexikon.fp7 N_ingredient, N_recipes and key
+       * Generate from the export file with splitExport mapping for C_recipes_ingredient.
+       * Import this into C_recipes_ingredient
+       * Import in N_appellation from faust-lexikon, key -> __import_from_cologne, name -> appelation
+       * Export from N_appellation {{{ __import__from_cologne_ID }}} and ID
+       * Import into C_recipes_ingredient matching {{{ __import__from_cologne_ID}}} ID --> ID_appellation
+       * Import in N_lemma from faust-lexikon, key -> __import_from_cologne, lemma -> name
+       * Export from N_Lemma {{{ __import__from_cologne_ID }}} and ID
+       * Import into C_recipes_ingredient matching {{{ __import__from_cologne_ID}}} ID --> ID_lemma
+       * Results need checking [ticket:28 Lemmas] and [ticket:29 Appellation]
+
+
+
+=== lexikon ===
+   
+   * [ticket:24 General: solves problem material vs. ingredient.]
+   * First step: matching DB_glossary and ingredients. (inported all missing, and comments), [ticket:23 should be checked by Sylvie]
+   * Import all Moderne Namen ";" separated into to entries in N_ingredient (datei: moderneNamen_id.csv), new field lexikon_id_cologne, this ID was created by a script (modernNameMatch) and is not in the FAUST db.
+
+   
+
+