Mercurial > hg > extraction-interface
comparison interface/insert_new_columns_into_books/readme.txt @ 0:b12c99b7c3f0
commit for previous development
| author | Zoe Hong <zhong@mpiwg-berlin.mpg.de> |
|---|---|
| date | Mon, 19 Jan 2015 17:13:49 +0100 |
| parents | |
| children |
comparison
equal
deleted
inserted
replaced
| -1:000000000000 | 0:b12c99b7c3f0 |
|---|---|
| 1 insert_new_columns_into_books.php parse the book information from localmonographs.xml and insert the result into database | |
| 2 insert_176_rows_into_books.php insert and update the information for 176 books in the database | |
| 3 | |
| 4 localmonographs.xml additional book information | |
| 5 localmonographs.txt the txt version of additional book information | |
| 6 local_monographs_176.txt the list of 176 books and their information | |
| 7 | |
| 8 get_data_from_sinica.php parse the book information from the website of sinica and write to files stored under data_from_sinica/ | |
| 9 parse_data_from_sinica.php Group the duplicated books of source 1 and write the results to data_from_sinica/merged_books.csv | |
| 10 analyze_data_from_sinica.php Count the # of books of each source, and concatenate all the csv from 01-71.csv | |
| 11 data_from_sinica/ csv files storing book information, encoding in utf8 and big5 (originally encoded format) | |
| 12 *column_name.csv contains the mapping between column name and source | |
| 13 all_data.csv contains all the data concatenated from 01-71.csv | |
| 14 merged_books.csv contains the grouped list of duplicated books | |
| 15 list_of_local_monographs_from_sinica.xlsx contains the grouping of the duplicated books which are assumed to be the same one, the excel version of merged_books.csv | |
| 16 |