From SQL Server to MongoDB - Aleks Drozdov, Enterprise Architect, The National Archives

Transcript

1. None

2. Aleks Drozdov Enterprise Architect 19 September 2011 From SQL Server

   to MongoDB

3. Outline   •  About  The  Na-onal  Archives   •  TNA

    datasets   •  Informa-on  architecture  and  Discovery  service   •  Integra-on  and  data  migra-on   •  MongoDB  implementa-on   3

4. About The National Archives •  The  Na-onal  Archives  is  a

    department  of  the  U.K.  government  and  an   execu-ve  agency  of  the  Ministry  of  Jus-ce.  It’s  the  official  archives  of  the   United  Kingdom  and  cares  for,  makes  available  and  ‘brings  alive’  a  vast   collec-on  of  more  than  1,000  years  of  historical  records,  including  the   treasured  Domesday  Book.   •  The  Na-onal  Archives  is  one  of  the  world’s  largest  records  repositories,   holding  more  than  11  million  records,  spanning  the  Magna  Carta  to  modern   government  papers.  The  organiza-on  not  only  keeps  its  collec-on  secure  and   available  to  the  public,  it  also  conducts  significant  research  ensuring   government  records  remain  accessible  for  decades  to  come.   •  The  Na-onal  Archives  safeguards  historical  informa-on  and  manages  current   digital  informa-on,  devising  new  technological  solu-ons  for  keeping   government  records  readable  now  and  in  the  future.  As  a  leading  advocate  for   the  archive  sector,  The  Na-onal  Archives  provides  world  class  research   facili-es  and  expert  advice.  It  also  publishes  all  U.K.  legisla-on  and  official   publica-ons.

5. THE  CATALOGUE   The  Na-onal  Archives  launched  an  online  catalogue

    of  its  collec-on  in  1998.  Since   then,  the  catalogue  has  more  than  doubled  in  size  and  the  organiza-on  has   designed  and  implemented  a  number  of  home-­‐grown  systems  to  improve  the   accessibility  and  maintenance  of  its  growing  collec-on.     •  The Catalogue •  Cabinet Papers •  DocumentsOnline •  ERO •  Library Catalogue •  Taxation Records •  Trafalgar Ancestors database •  UK Government Web Archive •  Census records •  Merchant seamen registers •  More…

6. DISCOVERY   HTTP://DISCOVERY.NATIONALARCHIVES.GOV.UK   6

7. DISCOVERY   HTTP://DISCOVERY.NATIONALARCHIVES.GOV. UK   7

8. DISCOVERY:  BROWSE  HIERARCHY   8

9. The  CMS  Data  AggregaQon  System   9

10. RELATIONAL  MODEL   10 TNA LDM-Level 2 (Part 1) -

    A detailed Logical Model used to identify CURRENT and CORE Meta-Data for the TNA OFC Project. [ V0.12 Created August 2009, by Bill McLennan, TNA Infomation Architect ] W.I.P. PROCAT PDM - Analysis - Prospective OFC Content V0.7 shows PROCAT tables selected by Bill McLennan for inclusion in OFC 'As-Is' LDM. This set of tables is up for challenge but it should be noted that the following principles have been applied to selection criteria:- (1) Replicated 'core' tables used in the Editorial Function have been excluded on the basis that a target COTS product will inevitably deal with this in its own way. The 'editorial requirement' will still be required! (2) It is expected that Audit Trail tables will also be dealt with by COTS product. Audit requirements will still need to be defined and met for OFC. (3) Several 'transient' tables associated with business and IT procedures have been excluded. THE ABOVE LDM INCLUDES CONTENT SOURCED FROM THE FOLLOWING PDM ANALYSIS SUBJECT AREAS:- GMMS (DAS) 'Live Core' Subject Area (PDM Extract) Reverse Engineered by Bill McLennan (TNA Information Architect), May 2009 using ERWin V7.2 toolest from concatenated Production 'zipped' schemaas dated 11/05/2009 with inferred relationships based on indexes. V0.8 includes GMMS content updated July 2009 during 'Analysis' phase of OFC project to (1) exclude redundant tables (2) exclude tables already covered by 'PROCAT-GMMS' overlap subject-area (3) show 'OFC IA' ontological 'colour' coding of tables/entities. V0.9 includes selected ERO-3 content overlayed on some 'core' GMMS tables. v0.10 includes DOL 'Composite' - Tables selected for 'AS-IS' LDM, August 2009 v0.11 includes HMC 'Composite' - Tables selected for 'AS-IS' LDM, August 2009 v0.12 includes YourArchives v1.13 'Composite' - Tables selected for 'AS-IS' LDM, August 2009 Catalogue_Element_Matrix Property_ID Property_Name Available_In_Lettercode Available_In_Division Available_In_Class Available_In_Header Available_In_Subheader Available_In_Piece Available_In_Item Bulk_Updateable Corporate_Body_Link_Type Corporate_Body_Link_Type_Id Corporate_Body_Link_Type_Descr Language language_id language_desc Currency_Indicator ISO_Code Leaflet Leaflet_Reference_ID Leaflet_order Leaflet_Title_Text Note_Text Info_Leaflet_URL Leaflet_filename Created_on access_condition access_condition_id access_condition_text Currency_Indicator authority_status Authority_Status Authority_Status_Description Currency_Indicator collection_context collection_context_id description covering_date_expressions expression start_day start_month start_year end_day end_month end_year description edit_set_stage stage_id Edit_Set_Stage_Description edit_set_type Edit_Set_Type Edit_Set_Type_Description legal_status legal_status_code Legal_Status_Description Currency_Indicator person_link_type Person_Link_Type_Id Person_Link_Type_Description physical_form physical_form_code physical_form_text currency_indicator place_link_type Place_Link_Type_Id Place_Link_Type_Description popular_search search_name search_string description is_reader_search reader_user reader_user_id doris_user_id user_fullname user_surname user_status user_ticket user_type staff_ntname time_last_used role role_id role_description role_level max_roles_per_edit_set subject_Link_Type Subject_Link_Type_Id Subject_Link_Type_Description tbl_closurestatus closure_status clstatus_desc tbl_closuretype closure_type cltype_desc tbl_desctype desc_type_id desc_type_desc tbl_flags flag_id flag_name flag_desc flag_value tbl_levels level_no level_desc tbl_reftype ref_type_id ref_type_desc users User_ID user_NT_logon user_name User_Initials verity_collection verity_collection_id collection_path PC_Leaflet Catalogue_ID Leaflet_Reference_ID (FK) level_no Property_ID (FK) Description PC_Link_Data_Element Catalogue_ID level_no Property_ID (FK) Description PC_link Catalogue_ID1 (FK) level_no1 (FK) Catalogue_ID2 (FK) level_no2 (FK) Property_ID (FK) Description level_no (FK) bookmark bookmark_id reader_user_id (FK) catalogue_id date_created level_no (FK) catalogue_reference title covering_dates deleted corporate_body Corporate_Body_Reference_Id Authority_Status (FK) Corporate_Body_Name_Text Corporate_Body_Date_End Remit_And_Function Corporate_Body_Date_Start uncertain_date_code_start Variant_Text Validation_Text uncertain_date_code_end jurisdiction_text is_place_of_deposit national_place_of_deposit_code Created_on Created_by (FK) edit_set Edit_Set_ID Edit_Set_Type (FK) name Description edit_set_stage_transition Edit_Set_Stage (FK) Edit_Set_Stage1 Forward_Transition person Person_Reference_Id Surname_Text Authority_Status (FK) Gender_Indicator Person_Title additional_elements_of_name Pretitle_Text Forename_Text Alternative_Status_Text Birth_Date Uncertain_Birth_Date_Code Biog_History_Text Validation_text Death_Date Uncertain_Death_Date_Code Created_on Created_by (FK) place Place_Reference_Id Authority_Status (FK) Place_Name_Text parish_text town_text county_text place_date_end Grid_References_Text uncertain_date_code_start uncertain_date_code_end validation_text Country_Text place_date_start Place_History_Text Created_on Created_by (FK) reader_session session_id reader_user_id (FK) time_last_hit saved_search Saved_search_id Description reader_user_id (FK) search_string date_created deleted stage_role_involved_in role_id (FK) stage_id (FK) subject Subject_Reference_Id Subject_Term_Text Subject_Definition Authority_Status (FK) Validation_Text Created_on Created_by (FK) tbl_lettercode lettercode_id letter_code lettercode_title closure_status (FK) user_role role_id (FK) User_ID (FK) Corporate_Body_Link Corporate_Body_Reference_Id1 (FK) Corporate_Body_Link_Type_Id (FK) Corporate_Body_Reference_Id2 Leaflet_corporate_body Leaflet_Reference_ID (FK) Corporate_Body_Reference_Id (FK) Leaflet_person Leaflet_Reference_ID (FK) Person_Reference_Id (FK) Leaflet_place Leaflet_Reference_ID (FK) Place_Reference_Id (FK) Leaflet_subject Subject_Reference_Id (FK) Leaflet_Reference_ID (FK) Lettercode_SortedTitle lettercode_id (FK) SortTitle LockedCatalogues Catalogue_ID level_no TabToLock Edit_Set_ID (FK) User_ID (FK) Session_ID DateTimeOfLocking PC_Corp_Body Catalogue_ID Corporate_Body_Reference_Id (FK) level_no Property_ID (FK) Description PC_Person Catalogue_ID Person_Reference_Id (FK) level_no Property_ID (FK) Description PC_Place Catalogue_ID Place_Reference_Id (FK) level_no Property_ID (FK) Description PC_Subject Catalogue_ID Subject_Reference_Id (FK) level_no Property_ID (FK) Description edit_set_history Edit_Set_Stage (FK) Edit_Set_ID (FK) Edit_Set_To_Stage (FK) Transtition_Date User_ID Comment lcode_verity_collection lcode_verity_collection_id verity_collection_id (FK) lettercode_id (FK) collection_context_id (FK) is_depth_restricted lettercode_accruals lettercode_id (FK) accruals_text lettercode_admin_biog_hist lettercode_id (FK) admin_biog_hist_text lettercode_app_dest_info lettercode_id (FK) app_dest_info_text lettercode_arrangement lettercode_id (FK) arrangement_text lettercode_custodial_hist lettercode_id (FK) custodial_hist_text lettercode_extension lettercode_id (FK) access_condition_id (FK) physical_form_code (FK) language_id (FK) legal_status_code (FK) accumulation_date_text covering_date_text covering_from_date covering_to_date map_designation physical_record_quantity dimensions restrictions_on_use scale_number Former_Reference_Department Former_Reference_PRO Record_Opening_Date Physical_condition Live_Flag closure_type (FK) Closure_Code batch_id lettercode_note lettercode_id (FK) note_text lettercode_scope_content lettercode_id (FK) scope_content_text lettercode_title lettercode_id (FK) title_text person_link Person_Link_Type_Id (FK) Person_Reference_Id1 (FK) Person_Reference_Id2 (FK) place_link Place_Link_Type_Id (FK) Place_Reference_Id1 (FK) Place_Reference_Id2 (FK) reader_transient_store id sessionid (FK) Data Order_ID created_on saved_search_overspill Saved_search_id (FK) order_no search_string subject_Link Subject_Link_Type_Id (FK) Subject_Reference_Id1 (FK) Subject_Reference_Id2 (FK) tbl_Division Division_ID Division_Title lettercode_id (FK) closure_status (FK) division_no batch_id tbl_class class_id lettercode_id (FK) Division_ID (FK) class_no subclass_no class_title intro_note date_text batch_id closure_status (FK) first_date last_date p_deposit user_role_on_editset Edit_Set_ID (FK) User_ID (FK) role_id (FK) complete Currency_Indicator date_created date_removed class_accruals class_id (FK) accruals_text class_admin_biog_hist class_id (FK) admin_biog_hist_text class_app_dest_info class_id (FK) app_dest_info_text class_arrangement class_id (FK) arrangement_text class_custodial_hist class_id (FK) custodial_hist_text class_extension class_id (FK) access_condition_id (FK) legal_status_code (FK) language_id (FK) accumulation_date_text physical_form_code (FK) map_designation physical_record_quantity dimensions restrictions_on_use scale_number Former_Reference_Department Former_Reference_PRO Record_Opening_Date Physical_condition Live_Flag closure_type (FK) Closure_Code class_note class_id (FK) note_text class_scope_content class_id (FK) scope_content_text class_title class_id (FK) title_text division_accruals Division_ID (FK) accruals_text division_admin_biog_hist Division_ID (FK) admin_biog_hist_text division_app_dest_info Division_ID (FK) app_dest_info_text division_arrangement Division_ID (FK) arrangement_text division_custodial_hist Division_ID (FK) custodial_hist_text division_extension Division_ID (FK) access_condition_id (FK) legal_status_code (FK) language_id (FK) physical_form_code (FK) accumulation_date_text covering_date_text covering_from_date covering_to_date map_designation physical_record_quantity dimensions restrictions_on_use scale_number Former_Reference_Department Former_Reference_PRO Record_Opening_Date Physical_condition Live_Flag closure_type (FK) Closure_Code division_note Division_ID (FK) note_text division_scope_content Division_ID (FK) scope_content_text division_title Division_ID (FK) title_text tbl_description desc_id desc_text level_no list_ref_id desc_type_id (FK) class_id (FK) tbl_header header_id class_id (FK) class_hdr_no header_title header_scope date_text batch_id tbl_reference ref_id ref_char ref_text level_no list_ref_id ref_type_id (FK) class_id (FK) header_accruals header_id (FK) accruals_text header_admin_biog_hist header_id (FK) admin_biog_hist_text header_app_dest_info header_id (FK) app_dest_info_text header_arrangement header_id (FK) arrangement_text header_custodial_hist header_id (FK) custodial_hist_text header_extension header_id (FK) access_condition_id (FK) closure_status (FK) physical_form_code (FK) language_id (FK) accumulation_date_text legal_status_code (FK) covering_from_date covering_to_date map_designation physical_record_quantity dimensions restrictions_on_use scale_number Former_Reference_Department Former_Reference_PRO Record_Opening_Date Physical_condition Live_Flag closure_type (FK) Closure_Code header_note header_id (FK) note_text header_scope_content header_id (FK) scope_content_text header_title header_id (FK) title_text tbl_subheader subheader_id header_id (FK) subheader_no subheader_title subheader_scope date_text batch_id subheader_accruals subheader_id (FK) accruals_text subheader_admin_biog_hist subheader_id (FK) admin_biog_hist_text subheader_app_dest_info subheader_id (FK) app_dest_info_text subheader_arrangement subheader_id (FK) arrangement_text subheader_custodial_hist subheader_id (FK) custodial_hist_text subheader_extension subheader_id (FK) access_condition_id (FK) closure_status (FK) language_id (FK) physical_form_code (FK) legal_status_code (FK) accumulation_date_text covering_from_date covering_to_date map_designation physical_record_quantity dimensions restrictions_on_use scale_number Former_Reference_Department Former_Reference_PRO Record_Opening_Date Physical_condition Live_Flag closure_type (FK) Closure_Code subheader_note subheader_id (FK) note_text subheader_scope_content subheader_id (FK) scope_content_text subheader_title subheader_id (FK) title_text tbl_piece piece_id piece_key_order class_id (FK) header_id (FK) subheader_id (FK) piece_ref piece_title piece_scope date_text closure_status (FK) closure_type (FK) closure_code open_date batch_id record_status first_date last_date physcond_id language_id piece_accruals piece_id (FK) accruals_text piece_admin_biog_hist piece_id (FK) admin_biog_hist_text piece_app_dest_info piece_id (FK) app_dest_info_text piece_arrangement piece_id (FK) arrangement_text piece_custodial_hist piece_id (FK) custodial_hist_text piece_extension piece_id (FK) accumulation_date_text physical_form_code (FK) legal_status_code (FK) access_condition_id (FK) map_designation physical_record_quantity dimensions restrictions_on_use scale_number Former_Reference_Department Former_Reference_PRO Live_Flag Physical_condition piece_note piece_id (FK) note_text piece_scope_content piece_id (FK) scope_content_text piece_title piece_id (FK) title_text tbl_item item_id item_key_order piece_id (FK) item_ref item_title item_scope date_text closure_status (FK) closure_type (FK) closure_code open_date batch_id record_status first_date last_date physcond_id language_id item_accruals item_id (FK) accruals_text item_admin_biog_hist item_id (FK) admin_biog_hist_text item_app_dest_info item_id (FK) app_dest_info_text item_arrangement item_id (FK) arrangement_text item_custodial_hist item_id (FK) custodial_hist_text item_extension item_id (FK) accumulation_date_text physical_form_code (FK) legal_status_code (FK) access_condition_id (FK) map_designation physical_record_quantity dimensions restrictions_on_use scale_number Former_Reference_Department Former_Reference_PRO Live_Flag Physical_condition item_note item_id (FK) note_text item_scope_content item_id (FK) scope_content_text item_title item_id (FK) title_text o_unit site floor wing bay application_user user_id username_text last_logon_date created_date user_guid application_role application_role_id description_text application_role_guid sort_order is_accession_role version_history version_history_id major_version minor_version build applied_by_text applied_date menu_option menu_option_id menu_option_text url_text parent_menu_option_id (FK) level_sort_order application_role_menu_option application_role_id (FK) menu_option_id (FK) task task_id description_text exit_state exit_state_id description_text task_exit_state task_id (FK) exit_state_id (FK) exit_value requires_record_validation sort_order page page_id url_text help_url_text is_restricted forbidden_url_text application_role_restricted_page restricted_page_id (FK) application_role_id (FK) process_template process_template_id description_text activity process_template_id (FK) unique_identifier_text application_role_id (FK) deliverable_unit_type deliverable_unit_type_id description_text is_container edit_status edit_status_id description_text workflow_status workflow_status_id description_text protective_marking protective_marking_id description_text custody_status custody_status_id description_text access_status access_status_id description_text sar_closure_status sar_closure_status_text access_status_id (FK) exemption_status_id (FK) sar_code_mapping sar_code_mapping_id sar_closure_type_text custody_status_id (FK) sar_closure_status_text (FK) extension extension_id description_text deliverable_unit_type_extension deliverable_unit_type_id (FK) extension_id (FK) deliverable_unit_link_type deliverable_unit_link_type_id description_text event_type event_type_id description_text description_format_text audit_event_type audit_event_type_id description_text audit_event audit_event_id audit_event_type_id (FK) created_date created_by (FK) accumulation accumulation_id series_id (FK) name_text metadata_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date version accession accession_id accumulation_id (FK) sequence is_transfer_complete metadata_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date version accession_user accession_user_id accession_id (FK) application_role_id (FK) user_id (FK) created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date version transformation_mapping transformation_mapping_id department_id description_text file_name_text file_path_text build_structure_using_unique_key active preprocessing_script_path_text created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date version transformation_mapping_parameter transformation_mapping_parameter_id transformation_mapping_id (FK) description_text is_core_file created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by deleted_date transformation transformation_id accession_id (FK) sequence transformation_mapping_id (FK) created_by (FK) created_date last_changed_by (FK) last_changed_date version transformation_file transformation_file_id transformation_id (FK) transformation_mapping_parameter_id (FK) name_text last_modified_date created_by (FK) created_date deliverable_unit deliverable_unit_id accumulation_id (FK) retained_accession_id (FK) retained_accession_is_inherited delivered_accession_id (FK) digital_surrogate tna_reference_text deliverable_unit_type_id (FK) home_location_id home_location_is_inherited legal_status_id language_id restrictions_on_use_text rights_restrictions_text edit_status_id (FK) workflow_status_id (FK) exemption_applied_for exemption_status_id (FK) is_redacted redaction_sequence_number immediate_source_of_acquisition_corp_body_id immediate_source_of_acquisition_person_id series_id (FK) ingest_protective_marking_id (FK) legal_responsibility_id is_accession_default custody_status_id (FK) retained_until_date anticipated_opening_date closed_until_date exemption_export_performed is_valid children_are_valid hide_metadata sar_closure_code sar_closure_status_text sar_closure_type_text created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date audit_event_id (FK) version aggregation_type_id (FK) Corporate_Body_Reference_Id Person_Reference_Id Corporate_Body_Reference_Id__17472 Corporate_Body_Reference_Id__17484 user_id (FK) deliverable_unit_corporate_body deliverable_unit_link_type_id (FK) corporate_body_id Corporate_Body_Reference_Id (FK) deliverable_unit_id (FK) audit_event_id (FK) created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date deliverable_unit_person deliverable_unit_link_type_id (FK) person_id Person_Reference_Id (FK) deliverable_unit_id (FK) audit_event_id (FK) created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date deliverable_unit_place place_id Place_Reference_Id (FK) deliverable_unit_id (FK) audit_event_id (FK) created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date deliverable_unit_subject subject_id Subject_Reference_Id deliverable_unit_id (FK) audit_event_id (FK) created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date deliverable_unit_description deliverable_unit_id (FK) description_text title_text former_internal_reference_text former_external_reference_text created_date created_date_text declared_date declared_date_text ogd_file_path_text ogd_file_name_text ogd_reference_text derive_ogd_extracted_file_path ogd_extracted_file_path_text ogd_unique_key_text ogd_parent_unique_key_text original_arrangement_text related_material_text metadata_xml last_changed_by (FK) last_changed_date audit_event_id (FK) version acquired_date opened_date closed_date cut_off_date record_type_id (FK) creator_text addressee_text bcc_addressee_text cc_addressee_text correspondence_data_xml dataset_xml disposal_xml rights_xml relation_xml deliverable_unit_redacted_description deliverable_unit_id (FK) description_text title_text last_changed_by (FK) last_changed_date audit_event_id (FK) version accession_comment accession_comment_id accession_id (FK) comment_text active created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date version deliverable_unit_comment deliverable_unit_comment_id comment_text active created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date version deliverable_unit_id (FK) deliverable_unit_extension deliverable_unit_extension_id extension_id (FK) value_text audit_event_id (FK) created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date deliverable_unit_id (FK) deliverable_unit_lock deliverable_unit_id (FK) locked_by (FK) locked_date deliverable_unit_reference series_id next_reference event event_id event_type_id (FK) created_by (FK) created_date agent_text process_text outcome_text version_text component_text accumulation_event accumulation_id (FK) event_id (FK) accession_event accession_id (FK) event_id (FK) deliverable_unit_event event_id (FK) deliverable_unit_id (FK) search_criteria search_criteria_text created_by (FK) search_criteria_id created_date deleted_by (FK) deleted_date search_field search_field_id description_text where_clause_text is_text_field is_date_field search_replace search_replace_id search_text replace_text search_by search_date search_replace_deliverable_unit deliverable_unit_id (FK) search_replace_id (FK) title_text description_text deliverable_unit_scope created_by (FK) deliverable_unit_scope_id created_date deliverable_unit_scope_deliverable_unit deliverable_unit_id (FK) aggregation_type aggregation_type_id description_text record_type record_type_id description_text edit_list edit_list_id edit_list_ref edit_list_type sequence_no accession_id created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date completed_date version edit_list_deliverable_unit edit_list_deliverable_unit_id edit_list_id created_by (FK) created_date deleted_by (FK) deleted_date can_be_deleted deliverable_unit_id (FK) edit_list_users edit_list_user_id edit_list_id (FK) application_role_id (FK) user_id (FK) created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date version edit_list_comment edit_list_comment_id edit_list_id (FK) comment_text active created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date version application_role_workflow application_role_id (FK) workflow_id (FK) workflow workflow_id description_text deliverable_unit_manifestation_type deliverable_unit_manifestation_type_id description_text deliverable_unit_manifestation deliverable_unit_manifestation_id (FK) deliverable_unit_manifestation_type_id (FK) transformation_unit_id sequence originality active technical_environment_id technical_environment_text metadata_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date version deliverable_unit_id (FK) deliverable_unit_component deliverable_unit_id (FK) deliverable_unit_component_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date component_manifestation deliverable_unit_manifestation_id component_manifestation_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date user_id (FK) transformation_unit transformation_unit_id ingested_file_set_id (FK) transformation_unit_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date ingested_file_set ingested_file_set_id ingested_file_set_type_id accession_id (FK) created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date ingested_file_set_event ingested_file_set_id (FK) event_id (FK) digital_file digital_file_id ingested_file_set_id (FK) sequence name_text working_path_text valid well_formed file_size last_modified_date extant directory identification_status_text metadata_xml format_discrepancies_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date digital_file_event digital_file_id (FK) event_id (FK) digital_file_fixity digital_file_id (FK) fixity_algorithm_id value_text created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date digital_file_format digital_file_format_id digital_file_id (FK) format_puid_text format_name_text format_version_text valid created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date digital_file_format_warning digital_file_format_warning_id digital_file_format_id (FK) warning_text digital_file_property digital_file_property_id digital_file_id (FK) event_id (FK) name_text value_text metadata_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date manifestation_file deliverable_unit_manifestation_id (FK) digital_file_id (FK) file_path_text created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date embedded_bitstream embedded_bitstream_id digital_file_id (FK) sequence parent_sequence type_text valid well_formed file_size last_modified_date identification_status_text metadata_xml format_discrepancies_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date filename embedded_bitstream_event embedded_bitstream_id (FK) event_id (FK) embedded_bitstream_fixity embedded_bitstream_id (FK) fixity_algorithm_id value_text created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date embedded_bitstream_format embedded_bitstream_format_id embedded_bitstream_id (FK) format_puid_text format_name_text format_version_text valid created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date embedded_bitstream_format_warning embedded_bitstream_format_warning_id embedded_bitstream_format_id (FK) warning_text embedded_bitstream_property embedded_bitstream_property_id embedded_bitstream_id (FK) event_id (FK) name_text value_text metadata_xml created_by (FK) created_date last_changed_by (FK) last_changed_date deleted_by (FK) deleted_date exemption_status exemption_status_id description_text vw_security_closure_ra_cache vw_security_visibility_ra_cache tbl_security_digital_file tbl_security_deliverable_unit deliverable_unit_manifestation_view deliverable_unit_manifestation_content_type deliverable_unit_manifestation_content_type_id description_text deliverable_unit_external_url deliverable_unit_external_url_id deliverable_unit_id external_url tlkp_EROCategory category_id cat_name_Text tlkp_EROSubCategory subcat_id category_id subcat_name_Text prefix subcat_map ApplicationSettings Setting_Id Setting_key_text Setting_Group_text Available_To_Web_text Description_text Collection_Specific_text cabjisc edocument_id (FK) collection_id (FK) cat_id (FK) Level_no (FK) Covering_date Edoc_ref first_date last_date Type FormerReference Attendees Agenda Title Author Catalogue_Ref Doc_Categories First_Image Last_image FirstDeliverablePDF part_no Transbatch_id DateStamp AutonomyString AutonomyStringTrunc ApplicationSettingsValues Setting_Id (FK) Collection_Id Setting_Value_text collection_id (FK) AthensOrganisation organisation_id organisation_name_text AthensSession customer_id login_date AthensUsage customer_id (FK) persistent_uid_text organisation_id (FK) username_text location_type location_type_text location_name_text location_description_text OrderProcessing order_process_id transaction_id (FK) process_type_text create_date process_date source_filepath_text destination_filepath_text order_delivery_id session_id_text payment_type payment_type_text payment_name_text payment_description_text SodDeliveryFiles od_id (FK) file_path_text FIPO organisation_Id IP_Address_text Organisation_text FreeAccess tbl_accounting_periods period_number month_number tbl_anomaly_type anomaly_type description tbl_Category Category_ID (FK) Category_Name Browsable Parent_ID MetaCategory BitMask Category_Description Order_Number UniqueStyleFile tbl_CatrefData catref_id cat_id whole_doc_flag level_no file_counter url_display_text URL_Display_Text (FK) tbl_edocument_replicated edocument_id collection_id Available cat_id (FK) Level_no (FK) Covering_date Edoc_ref catref_id del_medium_id (FK) whole_doc_text first_date last_date Physical_Description_ID (FK) scope_content_text Doc_Categories Release_ID (FK) tbl_edoc_verity_batch Change_ID edocument_id (FK) Process_Type Create_Date Process_Date being_indexed tbl_collection_replicated collection_id coll_brief_desc available coll_description contextual_data1 contextual_data2 contextual_data3 External_flag Charge_type_id (FK) Search_type ScopeData1 ScopeData2 ScopeData3 ScopeData4 ScopeData5 ScopeData6 ScopeData7 ScopeData8 ScopeData9 ScopeData10 ScopeData11 Scopeprefix1 Scopeprefix2 Scopeprefix3 Scopeprefix4 Scopeprefix5 Scopeprefix6 Scopeprefix7 Scopeprefix8 Scopeprefix9 Scopeprefix10 Scopeprefix11 Scope_example whole_doc_flag whole_doc_text Default_Doc_Categories Default_Physical_Description_ID (FK) CoverText required_filename_length CollectionTags Display_Annotation_text tbl_ApplicationSettings Setting_Key Setting_Value Setting_Group Description tbl_cust_header Cust_id Cust_Type Title First_Names Family_Name Date_Created Telephone Fax_No Comments tbl_deliverable Deliverable_id edocument_id (FK) First_Image Last_image Dfile_ref Charge_type_id (FK) part_no Transbatch_id Dfile_size No_of_pages del_format_version load_date modified_date tbl_deliveryMedium del_medium_id Server_name Intranet_Server Directory_Name tbl_cust_address Address_id Cust_id (FK) Address_Type Address_Usage Address PostCode Country_Code Marketing tbl_card_type card_type_ID card_name card_code tbl_financial_rbos batch_ID merchant_ID RBS_date merchant_session_ID shopping_transaction_number currency_code amount authorization_ID authorized_amount captured_amount refunded_amount outstanding_authorized_amount outstanding_captured_amount capture_complete card_type_code recurring_transaction subsequent_recurring_transaction recurring_reference_transaction_number commodity_code ticket_number customer_reference_number merchant_order_number type_code type_description response_code acquirer_response_code financial_transaction_number payment_server_session_ID settlement_batch_number acquirer_batch_number STAN RRN username transaction_source additional_data terminal_ID acquirer_batch_number2 acquirer_merchant_ID tbl_application application_code name owner start_project start_live merchant_status merchant_ID registered email_on_order email_on_payment email_on_despatch email_on_completion PRO_email account_number account_name accounts_description accounts_reference accounts_transaction_reference1 accounts_transaction_reference2 RBOSDOWN_user RBOSDOWN_password IMA_user IMA_password application_database_name return_URL_application (FK) return_URL_RoyNet (FK) return_URL_administration (FK) pass_URL_payment (FK) IMA_sender_name IMA_sender_address tbl_New_Release Release_ID Release_Name Release_Date Release_Description Order_Number tbl_Physical_Description Physical_Description_ID Physical_Description_Type Physical_Description_Desc Document_Count tbl_Linked_URL URL_Display_Text Linked_URL_id URL_key URL_Option tbl_orderDelivery od_id Trans_id (FK) Order_id (FK) No_of_pages Dfile_size Dfile_ref price tbl_order_header Order_header_id Trans_id (FK) Cust_id (FK) Address_id (FK) Session_id Date_Created Amount Response_Code_id VAT_Total Delivery_Code email_sent_date tbl_order order_id collection_id edocument_id Trans_id (FK) order_sequence Dfile_count cat_ref cat_id level_no tbl_financial_transaction financial_transaction_ID merchant_ID shopping_transaction_number transaction_type_ID (FK) amount NT_user_name PRO_date RBS_date response_code_id financial_transaction_number export_status ima_comments Supervisor_name Authorised_date tbl_job job_code job_ID tbl_message_status message_status_ID description tbl_job_log job_log_ID job_code (FK) category started completed record_count status remarks status_code (FK) tbl_message_queue message_queue_id transaction_date transaction_type_id session_id transaction_amount recipient_name recipient_address message_date message_status_id (FK) sender_name sender_address session_ID (FK) tbl_message_template application_code (FK) transaction_type_id (FK) message_template_id message_subject message_body tbl_function function_id Application_code (FK) function_name function_directory function_URL Menu_name tbl_price Charge_type_id Price VAT_percentage Description tbl_response_code Response_Code_id response_code_id Description description tbl_RDWN_status status_code description tbl_roynet_receipt roynet_receipt_ID session_ID (FK) digital_receipt_ID acquirer_response_code summary_response_code authorization_code shopping_transaction_number batch_ID RoyNet_authorized_pence merchant_ID locale tbl_transaction Trans_id Trans_date Last_modified_date RC_Ref trans_value vat_rate customer_id (FK) payment_type_text (FK) location_type_text (FK) user_type_text (FK) tbl_shopping_rbos batch_ID merchant_ID RBS_date merchant_session_ID shopping_transaction_number currency_code amount authorization_ID authorized_amount captured_amount refunded_amount outstanding_authorized_amount outstanding_captured_amount capture_complete card_type_code recurring_transaction subsequent_recurring_transaction recurring_reference_transaction_number commodity_code ticket_number customer_reference_number merchant_order_number tbl_transaction_type transaction_type_ID transaction_type transaction_type_code description tbl_user_group User_group_id USer_Group_name tbl_user_group_membership Ugm_id User_group_id (FK) Function_id (FK) tbl_shopping_transaction session_ID merchant_ID amount PRO_date RBS_date shopping_transaction_number response_code_id (FK) transaction_type_ID (FK) currency_code transfer_date authorized_amount captured_amount refunded_amount outstanding_authorized_amount outstanding_captured_amount capture_complete card_type_ID (FK) recurring_transaction subsequent_recurring_transaction recurring_reference_transaction_number commodity_code ticket_number customer_reference_number merchant_order_number Response_Code_id (FK) tbl_transaction_anomaly anomaly_ID job_log_ID (FK) anomaly_type (FK) session_ID (FK) merchant_ID shopping_transaction_number description tbl_Verity_Category Category_ID Category_Name Browsable Parent_ID MetaCategory BitMask Category_Description Order_Number Document_Count UniqueStyleFile tbl_Verity_Collection Verity_Collection_ID (FK) Collection_Path tbl_Verity_Field Verity_Field_ID Verity_Field_Name tbl_VerityBrowseField Field_ID Field_Name Category_ID (FK) Order_Number Verity_Field_ID tbl_verity_quick_search_dates date_range_id date_desc order_number tbl_verity_category_date_count Category_ID (FK) date_range_id (FK) date_type document_count order_number tbl_verity_log search_id search_type_code start_date number_of_results ip_address session_id (FK) is_pro_user search_keywords search_verity_query search_date_range search_duration_ms search_keywords_start user_type user_type_text user_name_text user_description_text Procat-DOL-Resolver-Link cat_id Level_no ArchiveRecord ArchiveRecordID SubjectType RecordDescription RepositoryID IsPublic Dates DateNote FirstDate LastDate NRAID ROCollectionRef OtherRef NRADetails ISADGRef MDKeyword MDCollection AddInfo LevelOfDescription Extent CreatedBy LastUpdateDate LastUpdatedBy CreateDate rowversion Catalogue CatalogueID AuctioneerID (FK) CatalogueName Currency AuctionDate DateRead WorkSheetRead CuratorContactID CreatedBy LastUpdateDate LastUpdatedBy CreateDate AccessionDigest AccessionDigestID AccessionID (FK) DigestID (FK) CreatedBy LastUpdateDate LastUpdatedBy CreateDate Auctioneer AuctioneerID AuctioneerName Address Town County Postcode Telephone Fax CreatedBy LastUpdateDate LastUpdatedBy CreateDate Email URL Category CategoryID CategoryDescription SubjectType CreatedBy LastUpdateDate LastUpdatedBy CreateDate Accession AccessionID RepositoryID (FK) AccessionYear (FK) AccessionOrder AccessionDescription AccessionDate ROReference ArchiveRecordID CreatedBy LastUpdateDate LastUpdatedBy CreateDate ArchiveRecordBook ArchiveRecordBookID ArchiveRecordID (FK) BookID (FK) CreatedBy CreateDate LastUpdatedBy LastUpdateDate CorporationCategory CorporationCategoryID SubjectID (FK) CategoryID (FK) SubCategoryID (FK) CreatedBy LastUpdateDate LastUpdatedBy CreateDate Contact ContactID RepositoryID (FK) OrganisationID Title FirstName LastName JobTitle Email URL ContactAddress Telephone Fax RepOrder CreateDate CreatedBy LastUpdateDate LastUpdatedBy IsPublicContact IsNotificationContact Label LabelID Name Addressee Address ListName CreateDate CreatedBy LastUpdateDate LastUpdatedBy Location LocationID LocationName DisplayName LocationType QualifiedLocationName CreateDate CreatedBy LastUpdateDate LastUpdatedBy DiaryKeyword DiaryKeywordID SubjectID (FK) DiaryKeyword CreatedBy LastUpdateDate LastUpdatedBy CreateDate Lib_Book BookID Title AuthorNames EditorNames VNS VolumeNo PublisherID (FK) Series Edition PublicationDate Suffix Notes ProjectPublicationOnly Class (FK) ISBN CreateDate CreatedBy LastUpdateDate LastUpdatedBy Journal JournalID Title JournalType EditorNames Notes Address Town County Postcode CreateDate CreatedBy LastUpdateDate LastUpdatedBy JournalDigest JournalDigestID JournalID (FK) DigestID (FK) CreatedBy LastUpdateDate LastUpdatedBy CreateDate Lib_Article ArticleID BookID (FK) Title AuthorNames IssueNumber PublicationDate CreatedBy CreateDate LastUpdatedBy LastUpdateDate Lib_Class Class LocationID (FK) ClassName CreatedBy CreateDate LastUpdatedBy LastUpdateDate Lib_Publisher PublisherID PublisherName Abbreviation PreviousName Suffix CreateDate CreatedBy LastUpdateDate LastUpdatedBy Lib_BookItem BookItemID BookID (FK) PublicationCost Type AlternativeLocationID (FK) AccessionDate CreatedBy CreateDate LastUpdatedBy LastUpdateDate Digest DigestID DigestName HTMLDigestName CreatedBy LastUpdateDate LastUpdatedBy CreateDate HMCUser HMCUserID FirstName LastName FileRegUser Signature CreatedBy CreateDate LastUpdatedBy LastUpdateDate ISADG ISADGRef RepositoryID (FK) CatalogueURL Scope Dates LevelDescription Extent Name History Mon Edit Source Title AdminBiogHistory DescriptionDate CreatedBy LastUpdateDate LastUpdatedBy CreateDate product productid supplierID (FK) subjectID product SubjectID (FK) ndnb ndnbid SubjectID (FK) ndnb_url Project ProjectID Title Acronym URL Status StartDate ArchiveDomain LibraryDomain MuseumDomain OtherDomain Description CreateDate CreatedBy LastUpdateDate LastUpdatedBy LocationRelationship LocationRelationshipID LocationID (FK) RelatedLocationID (FK) Relationship (FK) CreatedBy CreateDate LastUpdatedBy LastUpdateDate ProjectKeyword ProjectKeywordID ProjectID (FK) Keyword CreateDate CreatedBy LastUpdateDate LastUpdatedBy Lot LotID CatalogueID (FK) NRAID FirstDate LastDate LotDescription TermIndex LowerValue UpperValue HammerPrice TotalCost PurchaserOption PurchaserInfo Comment LotOrder LotNumber CreatedBy LastUpdateDate LastUpdatedBy CreateDate POD_Record_classes RepositoryID (FK) ClassName ClassID (FK) CreatedBy LastUpdatedBy LastUpdateDate CreateDate Lookup ShortValue LookupType LongValue CreateDate CreatedBy LastUpdateDate LastUpdatedBy NameForm NameFormID SubjectID (FK) NameForm NameFormType CreatedBy CreateDate LastUpdatedBy LastUpdateDate rowversion Notification NotificationID LotID (FK) RepositoryID (FK) Bid Purchased Notes DateReturned CreatedBy LastUpdateDate LastUpdatedBy CreateDate ProjectPublication ProjectPublicationID ProjectID (FK) BookID (FK) CreateDate CreatedBy LastUpdateDate LastUpdatedBy ProjectOrganisation ProjectOrganisationID ProjectID (FK) OrganisationID (FK) Currency GrantAmount CreateDate CreatedBy LastUpdateDate LastUpdatedBy ProjectContact ProjectContactID ProjectOrganisationID (FK) ContactID (FK) CreateDate CreatedBy LastUpdateDate LastUpdatedBy Network NetworkID RepositoryID (FK) NetworkName NetworkURL NetworkRepositoryID Date CreateDate CreatedBy LastUpdateDate LastUpdatedBy Organisation OrganisationID OrganisationName URL RepositoryID (FK) OrganisationAddress CreateDate CreatedBy LastUpdateDate LastUpdatedBy Reg_Class ClassID ClassDescription ClassType rhsLinks ODNB article DOI article_id type target_id target_url descrip ArticleID (FK) Resource ResourceID ResourceTitle ResourceType ResourceDescription ResourceLink CreatedBy CreateDate LastUpdatedBy LastUpdateDate LinkType ExternalReference ResourceSection LinkLookupType Relationship Relationship LocationType RelatedLocationType CreatedBy CreateDate LastUpdatedBy LastUpdateDate Returns ReturnID RepositoryID (FK) ReturnYear (FK) ReturnDate Medium ReturningNothing Notes CreatedBy LastUpdateDate LastUpdatedBy CreateDate Reg_File FileID ClassID (FK) Title EstNumber1 EstNumber2 EstNumber3 Part BoxID (FK) PRORef DateCreated DateReviewed DateClosed DateDestroyed Notes CreateDate CreatedBy LastUpdateDate LastUpdatedBy Registry NRAID ManorialIndicator BusinessIndicator OrganisationIndicator PersonIndicator DiaryIndicator FamilyIndicator CreatedBy LastUpdateDate LastUpdatedBy CreateDate ProjectRegion ProjectRegionID ProjectID (FK) RegionID (FK) CreateDate CreatedBy LastUpdateDate LastUpdatedBy RegistryRecord RegistryRecordID NRAID (FK) AdditionalRef RecordTitle RecordShortTitle RecordSortTitle NetworkCollectionRef ISADGRef (FK) CheckWord Pages Dates ROCollectionRef SeriesIndicator Comments SortClass SortWord NewCountyID RepOrderNo ROAccessionNo SurveyRef URL Extent CreatedBy LastUpdateDate LastUpdatedBy CreateDate RepositoryAuctioneer RepositoryAuctioneerID RepositoryID (FK) AuctioneerID (FK) CreatedBy LastUpdateDate LastUpdatedBy CreateDate RegistryRepository RegistryRepositoryID RegistryRecordID (FK) NRAID RepositoryID (FK) CreatedBy LastUpdateDate LastUpdatedBy CreateDate Repository RepositoryID RepositoryName Type AddressLine1 AddressTown AddressCounty AddressCountry Postcode LocationID (FK) CorrespondenceAddress Telephone Fax Email PitchID OldRef InUK URL MapURL CatalogueURL OpeningHours Holidays Introduction Appointment Ticket CARN Fee DisabledAccess Comments Photographs Microfilm Repair RepairOthers RecordRepositories ResearchService IDRequired SalesColPol PurchasingBudget Accessions AccessionsActive Subscription TNAApproval TNAProvisionalApproval Approved LastVisited Diocesan PROApproval PODAddress PODRespAuth FormalInspection GoverningBody ActivePurchaser RepeatPurchaseNotification CreateDate CreatedBy LastUpdateDate LastUpdatedBy scanFiles pdfFilename filename extension fileIsadgref fileIsadgref2 isadgrefalt ISADGRef (FK) xmlFileName sequence processed scanned_lists scanned_lists_id sequence ISADGRef (FK) URL indexPath indexFile ISADGRefAlt refType ISADGRefExists SubjectRelationship SubjectRelationshipID SubjectID (FK) ChildID RelationshipCategory RelationshipDescription RelationshipDates CreatedBy CreateDate LastUpdatedBy LastUpdateDate SubjectLocation SubjectLocationID SubjectID (FK) LocationID (FK) SortOrder RelationshipType CreatedBy LastUpdateDate LastUpdatedBy CreateDate SubjectResource SubjectResourceID SubjectID (FK) ResourceID (FK) RelationshipNature RelationshipDates CreatedBy CreateDate LastUpdatedBy LastUpdateDate SubCategory SubCategoryID CategoryID (FK) SubCategoryDescription CreatedBy LastUpdateDate LastUpdatedBy CreateDate SubjectArchiveRecord SubjectArchiveRecordID ArchiveRecordID (FK) SubjectID (FK) RelationshipNature RelationshipDates SortOrder Accession CreatedBy CreateDate LastUpdatedBy LastUpdateDate SubjectLanguages SubjectLanguageId SubjectID (FK) LanguageCode CreateDate CreatedBy LastUpdatedBy LastUpdateDate SubjectFunctions SubjectFunctionId SubjectID (FK) FunctionText CreateDate CreatedBy LastUpdatedBy LastUpdateDate SubjectHistoryResource SubjectHistoryResourceID SubjectID (FK) ResourceID (FK) CreateDate CreatedBy LastUpdatedBy LastUpdateDate Subject SubjectID SubjectType TypeSpecificID PreTitle Forenames Name _FullName SortName AlternativeStatus Title SortTitle Epithet Gender IsAuthorityRecord IsAnonymous Dates FirstDate LastDate RecordStatus Notes AuthorityName IsHeader HonourLocationID StandardisedName History GeographicalArea LegalStatus Mandate InternalStructure GeneralContext OtherSignificantInfo DescriptionArea AuthorityRecordStatus AuthorityDetailLevel ControlAreaNotes CreatedBy LastUpdateDate LastUpdatedBy CreateDate rowversion FormerISAARReference Sources CorporateCharityNumber CorporateBusinessNumber ISAARReference InstitutionIdentifier IsPublic SubjectRule SubjectRuleID SubjectID (FK) CreatedBy CreateDate LastUpdatedBy LastUpdateDate SubjectRule supplier supplierID supplier SubjectScripts SubjectScriptId SubjectID (FK) ScriptCode CreateDate CreatedBy LastUpdatedBy LastUpdateDate YearAccessionEditor AccessionYear AccessionEditorID (FK) CreatedBy LastUpdateDate LastUpdatedBy CreateDate active categorylinks page_id (FK) cl_to cl_sortkey cl_timestamp category cat_id cat_title cat_pages cat_subcats cat_files cat_hidden imagelinks page_id (FK) img_name (FK) externallinks page_id (FK) el_to el_index ipblocks ipb_id ipb_address ipb_user user_id (FK) ipb_by_text ipb_reason ipb_timestamp ipb_auto ipb_anon_only ipb_create_account ipb_enable_autoblock ipb_expiry ipb_range_start ipb_range_end ipb_deleted ipb_block_email image img_name img_size img_width img_height img_metadata img_bits img_media_type img_major_mime img_minor_mime img_description img_user (FK) img_user_text img_timestamp img_sha1 interwiki iw_prefix iw_url iw_local iw_trans page page_id page_namespace page_title page_restrictions page_counter page_is_redirect page_is_new page_random page_touched page_latest page_len revision rev_id page_id (FK) old_id (FK) rev_comment user_id (FK) rev_user_text rev_timestamp rev_minor_edit rev_deleted rev_len rev_parent_id pagelinks page_id (FK) pl_namespace pl_title langlinks page_id (FK) ll_lang ll_title oldimage img_name (FK) oi_archive_name oi_size oi_width oi_height oi_bits oi_description user_id (FK) oi_user_text oi_timestamp oi_metadata oi_media_type oi_major_mime oi_minor_mime oi_deleted oi_sha1 recentchanges rc_id rc_timestamp rc_cur_time rc_user rc_user_text rc_namespace rc_title rc_comment rc_minor rc_bot rc_new rc_cur_id (FK) old_id (FK) rc_last_oldid rc_type rc_moved_to_ns rc_moved_to_title rc_patrolled rc_ip rc_old_len rc_new_len rc_deleted rc_logid rc_log_type rc_log_action rc_params rc_this_oldid (FK) querycache qc_type qc_value qc_namespace qc_title redirect page_id (FK) rd_namespace rd_title querycachetwo qcc_type qcc_value qcc_namespace qcc_title qcc_namespacetwo qcc_titletwo page_restrictions pr_type page_id (FK) pr_level pr_cascade pr_user pr_expiry pr_id protected_titles pt_namespace pt_title pt_user pt_reason pt_timestamp pt_expiry pt_create_perm page_props pp_page pp_propname pp_value searchindex page_id (FK) si_title si_text text old_id old_text old_flags templatelinks page_id (FK) tl_namespace tl_title USER user_id user_name user_real_name user_password user_newpassword user_newpass_time user_email user_options user_touched user_token user_email_authenticated user_email_token user_email_token_expires user_registration user_editcount user_groups ug_group user_id (FK) user_newtalk user_id (FK) user_ip user_last_timestamp watchlist user_id (FK) wl_namespace wl_title wl_notificationtimestamp

11. SOA  FRAMEWORK:  SERVICES  AND   OBJECTS   In  2010,  The

     Na-onal  Archives  decided  to   move  to  a  standardized  Service  Oriented   Architecture  framework  to  reduce   maintenance  costs  and  provide  the  flexibility   to  add  new  services  in  the  future.     11

12. SQL  SERVER  DATABASES   12

13. CREATING  INFORMATION  ASSET:  EAV   13 Entity-attribute-value model (EAV) is

    a data model to describe entities where the number of attributes (properties, parameters) that can be used to describe them is potentially vast, but the number that will actually apply to a given entity is relatively modest.

14. POPULATING  INFORMATION  ASSETS  IN   MONGODB   14

15. CREATING  INFORMATION  ASSET:   MONGODB   15

16. CREATING  INFORMATION  ASSET:   MONGODB   16

17. CREATING  INFORMATION  ASSET:   MONGODB   17

18. DISCOVERY  ARCHITECTURE  

19. USING  MONGODB:  ARCHITECTURE   (REPLICA  SET)   19 NetApp FAS3140

    HA FILER2 FILER1 mongo_db1 (250GB) mongo_logs1 (75GB) mongo_db2 (250GB) mongo_logs2 (75GB) MONGO_SRV1 MONGO_SRV2 ARBITER

20. DISCOVERY:  SEARCH  INFORMATION   ASSET   20

21. DISCOVERY:  BROWSE  INFORMATION   ASSETS  HIERARCHY   21

22. BROWSE  FROM  INFORMATION  ASSET   DETAILS   22

23. DISCOVERY:  USING  THE  SYSTEM  -­‐  API   23 [email protected]

24. Thank you! http://discovery.nationalarchives.gov.uk http://discovery.nationalarchives.gov.uk/api.htm [email protected]