$30 off During Our Annual Pro Sale. View Details »

From SQL Server to MongoDB - Aleks Drozdov, Enterprise Architect, The National Archives

mongodb
October 12, 2011

From SQL Server to MongoDB - Aleks Drozdov, Enterprise Architect, The National Archives

MongoUK 2011

How The National Archives migrated its data store from SQL Server to Mongo DB and built Service-Oriented Platform to make available over 11m of historical... records.
http://discovery.nationalarchives.gov.uk

mongodb

October 12, 2011
Tweet

More Decks by mongodb

Other Decks in Technology

Transcript

  1. View Slide

  2. Aleks Drozdov
    Enterprise Architect
    19 September 2011
    From SQL Server to MongoDB

    View Slide

  3. Outline
     
    •  About  The  Na-onal  Archives  
    •  TNA  datasets  
    •  Informa-on  architecture  and  Discovery  service  
    •  Integra-on  and  data  migra-on  
    •  MongoDB  implementa-on  
    3

    View Slide

  4. About The National Archives
    •  The  Na-onal  Archives  is  a  department  of  the  U.K.  government  and  an  
    execu-ve  agency  of  the  Ministry  of  Jus-ce.  It’s  the  official  archives  of  the  
    United  Kingdom  and  cares  for,  makes  available  and  ‘brings  alive’  a  vast  
    collec-on  of  more  than  1,000  years  of  historical  records,  including  the  
    treasured  Domesday  Book.  
    •  The  Na-onal  Archives  is  one  of  the  world’s  largest  records  repositories,  
    holding  more  than  11  million  records,  spanning  the  Magna  Carta  to  modern  
    government  papers.  The  organiza-on  not  only  keeps  its  collec-on  secure  and  
    available  to  the  public,  it  also  conducts  significant  research  ensuring  
    government  records  remain  accessible  for  decades  to  come.  
    •  The  Na-onal  Archives  safeguards  historical  informa-on  and  manages  current  
    digital  informa-on,  devising  new  technological  solu-ons  for  keeping  
    government  records  readable  now  and  in  the  future.  As  a  leading  advocate  for  
    the  archive  sector,  The  Na-onal  Archives  provides  world  class  research  
    facili-es  and  expert  advice.  It  also  publishes  all  U.K.  legisla-on  and  official  
    publica-ons.

    View Slide

  5. THE  CATALOGUE  
    The  Na-onal  Archives  launched  an  online  catalogue  of  its  collec-on  in  1998.  Since  
    then,  the  catalogue  has  more  than  doubled  in  size  and  the  organiza-on  has  
    designed  and  implemented  a  number  of  home-­‐grown  systems  to  improve  the  
    accessibility  and  maintenance  of  its  growing  collec-on.  
     
    •  The Catalogue
    •  Cabinet Papers
    •  DocumentsOnline
    •  ERO
    •  Library Catalogue
    •  Taxation Records
    •  Trafalgar Ancestors database
    •  UK Government Web Archive
    •  Census records
    •  Merchant seamen registers
    •  More…

    View Slide

  6. DISCOVERY  
    HTTP://DISCOVERY.NATIONALARCHIVES.GOV.UK
     
    6

    View Slide

  7. DISCOVERY  
    HTTP://DISCOVERY.NATIONALARCHIVES.GOV.
    UK
     
    7

    View Slide

  8. DISCOVERY:  BROWSE  HIERARCHY  
    8

    View Slide

  9. The  CMS  Data  AggregaQon  System
     
    9

    View Slide

  10. RELATIONAL  MODEL
     
    10
    TNA LDM-Level 2 (Part 1) - A detailed Logical Model used to identify
    CURRENT and CORE Meta-Data for the TNA OFC Project.
    [ V0.12 Created August 2009, by Bill McLennan, TNA Infomation Architect ]
    W.I.P.
    PROCAT PDM - Analysis - Prospective OFC Content
    V0.7 shows PROCAT tables selected by Bill McLennan for inclusion in OFC 'As-Is' LDM.
    This set of tables is up for challenge but it should be noted that the following principles have been applied to selection criteria:-
    (1) Replicated 'core' tables used in the Editorial Function have been excluded on the basis that a target COTS product will inevitably
    deal with this in its own way.
    The 'editorial requirement' will still be required!
    (2) It is expected that Audit Trail tables will also be dealt with by COTS product. Audit requirements will still need to be defined and met
    for OFC.
    (3) Several 'transient' tables associated with business and IT procedures have been excluded.
    THE ABOVE LDM INCLUDES CONTENT SOURCED FROM THE FOLLOWING PDM ANALYSIS SUBJECT AREAS:-
    GMMS (DAS) 'Live Core' Subject Area (PDM Extract)
    Reverse Engineered by Bill McLennan (TNA Information Architect), May 2009
    using ERWin V7.2 toolest from concatenated Production 'zipped' schemaas dated 11/05/2009
    with inferred relationships based on indexes.
    V0.8 includes GMMS content updated July 2009 during 'Analysis' phase of OFC project to
    (1) exclude redundant tables
    (2) exclude tables already covered by 'PROCAT-GMMS' overlap subject-area
    (3) show 'OFC IA' ontological 'colour' coding of tables/entities.
    V0.9 includes selected ERO-3 content overlayed on some 'core' GMMS tables.
    v0.10 includes DOL 'Composite' - Tables selected for 'AS-IS' LDM, August 2009
    v0.11 includes HMC 'Composite' - Tables selected for 'AS-IS' LDM, August 2009
    v0.12 includes YourArchives v1.13 'Composite' - Tables selected for 'AS-IS' LDM,
    August 2009
    Catalogue_Element_Matrix
    Property_ID
    Property_Name
    Available_In_Lettercode
    Available_In_Division
    Available_In_Class
    Available_In_Header
    Available_In_Subheader
    Available_In_Piece
    Available_In_Item
    Bulk_Updateable
    Corporate_Body_Link_Type
    Corporate_Body_Link_Type_Id
    Corporate_Body_Link_Type_Descr
    Language
    language_id
    language_desc
    Currency_Indicator
    ISO_Code
    Leaflet
    Leaflet_Reference_ID
    Leaflet_order
    Leaflet_Title_Text
    Note_Text
    Info_Leaflet_URL
    Leaflet_filename
    Created_on
    access_condition
    access_condition_id
    access_condition_text
    Currency_Indicator
    authority_status
    Authority_Status
    Authority_Status_Description
    Currency_Indicator
    collection_context
    collection_context_id
    description
    covering_date_expressions
    expression
    start_day
    start_month
    start_year
    end_day
    end_month
    end_year
    description
    edit_set_stage
    stage_id
    Edit_Set_Stage_Description
    edit_set_type
    Edit_Set_Type
    Edit_Set_Type_Description
    legal_status
    legal_status_code
    Legal_Status_Description
    Currency_Indicator
    person_link_type
    Person_Link_Type_Id
    Person_Link_Type_Description
    physical_form
    physical_form_code
    physical_form_text
    currency_indicator
    place_link_type
    Place_Link_Type_Id
    Place_Link_Type_Description
    popular_search
    search_name
    search_string
    description
    is_reader_search
    reader_user
    reader_user_id
    doris_user_id
    user_fullname
    user_surname
    user_status
    user_ticket
    user_type
    staff_ntname
    time_last_used
    role
    role_id
    role_description
    role_level
    max_roles_per_edit_set
    subject_Link_Type
    Subject_Link_Type_Id
    Subject_Link_Type_Description
    tbl_closurestatus
    closure_status
    clstatus_desc
    tbl_closuretype
    closure_type
    cltype_desc
    tbl_desctype
    desc_type_id
    desc_type_desc
    tbl_flags
    flag_id
    flag_name
    flag_desc
    flag_value
    tbl_levels
    level_no
    level_desc
    tbl_reftype
    ref_type_id
    ref_type_desc
    users
    User_ID
    user_NT_logon
    user_name
    User_Initials
    verity_collection
    verity_collection_id
    collection_path
    PC_Leaflet
    Catalogue_ID
    Leaflet_Reference_ID (FK)
    level_no
    Property_ID (FK)
    Description
    PC_Link_Data_Element
    Catalogue_ID
    level_no
    Property_ID (FK)
    Description
    PC_link
    Catalogue_ID1 (FK)
    level_no1 (FK)
    Catalogue_ID2 (FK)
    level_no2 (FK)
    Property_ID (FK)
    Description
    level_no (FK)
    bookmark
    bookmark_id
    reader_user_id (FK)
    catalogue_id
    date_created
    level_no (FK)
    catalogue_reference
    title
    covering_dates
    deleted
    corporate_body
    Corporate_Body_Reference_Id
    Authority_Status (FK)
    Corporate_Body_Name_Text
    Corporate_Body_Date_End
    Remit_And_Function
    Corporate_Body_Date_Start
    uncertain_date_code_start
    Variant_Text
    Validation_Text
    uncertain_date_code_end
    jurisdiction_text
    is_place_of_deposit
    national_place_of_deposit_code
    Created_on
    Created_by (FK)
    edit_set
    Edit_Set_ID
    Edit_Set_Type (FK)
    name
    Description
    edit_set_stage_transition
    Edit_Set_Stage (FK)
    Edit_Set_Stage1
    Forward_Transition
    person
    Person_Reference_Id
    Surname_Text
    Authority_Status (FK)
    Gender_Indicator
    Person_Title
    additional_elements_of_name
    Pretitle_Text
    Forename_Text
    Alternative_Status_Text
    Birth_Date
    Uncertain_Birth_Date_Code
    Biog_History_Text
    Validation_text
    Death_Date
    Uncertain_Death_Date_Code
    Created_on
    Created_by (FK)
    place
    Place_Reference_Id
    Authority_Status (FK)
    Place_Name_Text
    parish_text
    town_text
    county_text
    place_date_end
    Grid_References_Text
    uncertain_date_code_start
    uncertain_date_code_end
    validation_text
    Country_Text
    place_date_start
    Place_History_Text
    Created_on
    Created_by (FK)
    reader_session
    session_id
    reader_user_id (FK)
    time_last_hit
    saved_search
    Saved_search_id
    Description
    reader_user_id (FK)
    search_string
    date_created
    deleted
    stage_role_involved_in
    role_id (FK)
    stage_id (FK)
    subject
    Subject_Reference_Id
    Subject_Term_Text
    Subject_Definition
    Authority_Status (FK)
    Validation_Text
    Created_on
    Created_by (FK)
    tbl_lettercode
    lettercode_id
    letter_code
    lettercode_title
    closure_status (FK)
    user_role
    role_id (FK)
    User_ID (FK)
    Corporate_Body_Link
    Corporate_Body_Reference_Id1 (FK)
    Corporate_Body_Link_Type_Id (FK)
    Corporate_Body_Reference_Id2
    Leaflet_corporate_body
    Leaflet_Reference_ID (FK)
    Corporate_Body_Reference_Id (FK)
    Leaflet_person
    Leaflet_Reference_ID (FK)
    Person_Reference_Id (FK)
    Leaflet_place
    Leaflet_Reference_ID (FK)
    Place_Reference_Id (FK)
    Leaflet_subject
    Subject_Reference_Id (FK)
    Leaflet_Reference_ID (FK)
    Lettercode_SortedTitle
    lettercode_id (FK)
    SortTitle
    LockedCatalogues
    Catalogue_ID
    level_no
    TabToLock
    Edit_Set_ID (FK)
    User_ID (FK)
    Session_ID
    DateTimeOfLocking
    PC_Corp_Body
    Catalogue_ID
    Corporate_Body_Reference_Id (FK)
    level_no
    Property_ID (FK)
    Description
    PC_Person
    Catalogue_ID
    Person_Reference_Id (FK)
    level_no
    Property_ID (FK)
    Description
    PC_Place
    Catalogue_ID
    Place_Reference_Id (FK)
    level_no
    Property_ID (FK)
    Description
    PC_Subject
    Catalogue_ID
    Subject_Reference_Id (FK)
    level_no
    Property_ID (FK)
    Description
    edit_set_history
    Edit_Set_Stage (FK)
    Edit_Set_ID (FK)
    Edit_Set_To_Stage (FK)
    Transtition_Date
    User_ID
    Comment
    lcode_verity_collection
    lcode_verity_collection_id
    verity_collection_id (FK)
    lettercode_id (FK)
    collection_context_id (FK)
    is_depth_restricted
    lettercode_accruals
    lettercode_id (FK)
    accruals_text
    lettercode_admin_biog_hist
    lettercode_id (FK)
    admin_biog_hist_text
    lettercode_app_dest_info
    lettercode_id (FK)
    app_dest_info_text
    lettercode_arrangement
    lettercode_id (FK)
    arrangement_text
    lettercode_custodial_hist
    lettercode_id (FK)
    custodial_hist_text
    lettercode_extension
    lettercode_id (FK)
    access_condition_id (FK)
    physical_form_code (FK)
    language_id (FK)
    legal_status_code (FK)
    accumulation_date_text
    covering_date_text
    covering_from_date
    covering_to_date
    map_designation
    physical_record_quantity
    dimensions
    restrictions_on_use
    scale_number
    Former_Reference_Department
    Former_Reference_PRO
    Record_Opening_Date
    Physical_condition
    Live_Flag
    closure_type (FK)
    Closure_Code
    batch_id
    lettercode_note
    lettercode_id (FK)
    note_text
    lettercode_scope_content
    lettercode_id (FK)
    scope_content_text
    lettercode_title
    lettercode_id (FK)
    title_text
    person_link
    Person_Link_Type_Id (FK)
    Person_Reference_Id1 (FK)
    Person_Reference_Id2 (FK)
    place_link
    Place_Link_Type_Id (FK)
    Place_Reference_Id1 (FK)
    Place_Reference_Id2 (FK)
    reader_transient_store
    id
    sessionid (FK)
    Data
    Order_ID
    created_on
    saved_search_overspill
    Saved_search_id (FK)
    order_no
    search_string
    subject_Link
    Subject_Link_Type_Id (FK)
    Subject_Reference_Id1 (FK)
    Subject_Reference_Id2 (FK)
    tbl_Division
    Division_ID
    Division_Title
    lettercode_id (FK)
    closure_status (FK)
    division_no
    batch_id
    tbl_class
    class_id
    lettercode_id (FK)
    Division_ID (FK)
    class_no
    subclass_no
    class_title
    intro_note
    date_text
    batch_id
    closure_status (FK)
    first_date
    last_date
    p_deposit
    user_role_on_editset
    Edit_Set_ID (FK)
    User_ID (FK)
    role_id (FK)
    complete
    Currency_Indicator
    date_created
    date_removed
    class_accruals
    class_id (FK)
    accruals_text
    class_admin_biog_hist
    class_id (FK)
    admin_biog_hist_text
    class_app_dest_info
    class_id (FK)
    app_dest_info_text
    class_arrangement
    class_id (FK)
    arrangement_text
    class_custodial_hist
    class_id (FK)
    custodial_hist_text
    class_extension
    class_id (FK)
    access_condition_id (FK)
    legal_status_code (FK)
    language_id (FK)
    accumulation_date_text
    physical_form_code (FK)
    map_designation
    physical_record_quantity
    dimensions
    restrictions_on_use
    scale_number
    Former_Reference_Department
    Former_Reference_PRO
    Record_Opening_Date
    Physical_condition
    Live_Flag
    closure_type (FK)
    Closure_Code
    class_note
    class_id (FK)
    note_text
    class_scope_content
    class_id (FK)
    scope_content_text
    class_title
    class_id (FK)
    title_text
    division_accruals
    Division_ID (FK)
    accruals_text
    division_admin_biog_hist
    Division_ID (FK)
    admin_biog_hist_text
    division_app_dest_info
    Division_ID (FK)
    app_dest_info_text
    division_arrangement
    Division_ID (FK)
    arrangement_text
    division_custodial_hist
    Division_ID (FK)
    custodial_hist_text
    division_extension
    Division_ID (FK)
    access_condition_id (FK)
    legal_status_code (FK)
    language_id (FK)
    physical_form_code (FK)
    accumulation_date_text
    covering_date_text
    covering_from_date
    covering_to_date
    map_designation
    physical_record_quantity
    dimensions
    restrictions_on_use
    scale_number
    Former_Reference_Department
    Former_Reference_PRO
    Record_Opening_Date
    Physical_condition
    Live_Flag
    closure_type (FK)
    Closure_Code
    division_note
    Division_ID (FK)
    note_text
    division_scope_content
    Division_ID (FK)
    scope_content_text
    division_title
    Division_ID (FK)
    title_text
    tbl_description
    desc_id
    desc_text
    level_no
    list_ref_id
    desc_type_id (FK)
    class_id (FK)
    tbl_header
    header_id
    class_id (FK)
    class_hdr_no
    header_title
    header_scope
    date_text
    batch_id
    tbl_reference
    ref_id
    ref_char
    ref_text
    level_no
    list_ref_id
    ref_type_id (FK)
    class_id (FK)
    header_accruals
    header_id (FK)
    accruals_text
    header_admin_biog_hist
    header_id (FK)
    admin_biog_hist_text
    header_app_dest_info
    header_id (FK)
    app_dest_info_text
    header_arrangement
    header_id (FK)
    arrangement_text
    header_custodial_hist
    header_id (FK)
    custodial_hist_text
    header_extension
    header_id (FK)
    access_condition_id (FK)
    closure_status (FK)
    physical_form_code (FK)
    language_id (FK)
    accumulation_date_text
    legal_status_code (FK)
    covering_from_date
    covering_to_date
    map_designation
    physical_record_quantity
    dimensions
    restrictions_on_use
    scale_number
    Former_Reference_Department
    Former_Reference_PRO
    Record_Opening_Date
    Physical_condition
    Live_Flag
    closure_type (FK)
    Closure_Code
    header_note
    header_id (FK)
    note_text
    header_scope_content
    header_id (FK)
    scope_content_text
    header_title
    header_id (FK)
    title_text
    tbl_subheader
    subheader_id
    header_id (FK)
    subheader_no
    subheader_title
    subheader_scope
    date_text
    batch_id
    subheader_accruals
    subheader_id (FK)
    accruals_text
    subheader_admin_biog_hist
    subheader_id (FK)
    admin_biog_hist_text
    subheader_app_dest_info
    subheader_id (FK)
    app_dest_info_text
    subheader_arrangement
    subheader_id (FK)
    arrangement_text
    subheader_custodial_hist
    subheader_id (FK)
    custodial_hist_text
    subheader_extension
    subheader_id (FK)
    access_condition_id (FK)
    closure_status (FK)
    language_id (FK)
    physical_form_code (FK)
    legal_status_code (FK)
    accumulation_date_text
    covering_from_date
    covering_to_date
    map_designation
    physical_record_quantity
    dimensions
    restrictions_on_use
    scale_number
    Former_Reference_Department
    Former_Reference_PRO
    Record_Opening_Date
    Physical_condition
    Live_Flag
    closure_type (FK)
    Closure_Code
    subheader_note
    subheader_id (FK)
    note_text
    subheader_scope_content
    subheader_id (FK)
    scope_content_text
    subheader_title
    subheader_id (FK)
    title_text
    tbl_piece
    piece_id
    piece_key_order
    class_id (FK)
    header_id (FK)
    subheader_id (FK)
    piece_ref
    piece_title
    piece_scope
    date_text
    closure_status (FK)
    closure_type (FK)
    closure_code
    open_date
    batch_id
    record_status
    first_date
    last_date
    physcond_id
    language_id
    piece_accruals
    piece_id (FK)
    accruals_text
    piece_admin_biog_hist
    piece_id (FK)
    admin_biog_hist_text
    piece_app_dest_info
    piece_id (FK)
    app_dest_info_text
    piece_arrangement
    piece_id (FK)
    arrangement_text
    piece_custodial_hist
    piece_id (FK)
    custodial_hist_text
    piece_extension
    piece_id (FK)
    accumulation_date_text
    physical_form_code (FK)
    legal_status_code (FK)
    access_condition_id (FK)
    map_designation
    physical_record_quantity
    dimensions
    restrictions_on_use
    scale_number
    Former_Reference_Department
    Former_Reference_PRO
    Live_Flag
    Physical_condition
    piece_note
    piece_id (FK)
    note_text
    piece_scope_content
    piece_id (FK)
    scope_content_text
    piece_title
    piece_id (FK)
    title_text
    tbl_item
    item_id
    item_key_order
    piece_id (FK)
    item_ref
    item_title
    item_scope
    date_text
    closure_status (FK)
    closure_type (FK)
    closure_code
    open_date
    batch_id
    record_status
    first_date
    last_date
    physcond_id
    language_id
    item_accruals
    item_id (FK)
    accruals_text
    item_admin_biog_hist
    item_id (FK)
    admin_biog_hist_text
    item_app_dest_info
    item_id (FK)
    app_dest_info_text
    item_arrangement
    item_id (FK)
    arrangement_text
    item_custodial_hist
    item_id (FK)
    custodial_hist_text
    item_extension
    item_id (FK)
    accumulation_date_text
    physical_form_code (FK)
    legal_status_code (FK)
    access_condition_id (FK)
    map_designation
    physical_record_quantity
    dimensions
    restrictions_on_use
    scale_number
    Former_Reference_Department
    Former_Reference_PRO
    Live_Flag
    Physical_condition
    item_note
    item_id (FK)
    note_text
    item_scope_content
    item_id (FK)
    scope_content_text
    item_title
    item_id (FK)
    title_text
    o_unit site floor wing
    bay
    application_user
    user_id
    username_text
    last_logon_date
    created_date
    user_guid
    application_role
    application_role_id
    description_text
    application_role_guid
    sort_order
    is_accession_role
    version_history
    version_history_id
    major_version
    minor_version
    build
    applied_by_text
    applied_date
    menu_option
    menu_option_id
    menu_option_text
    url_text
    parent_menu_option_id (FK)
    level_sort_order
    application_role_menu_option
    application_role_id (FK)
    menu_option_id (FK)
    task
    task_id
    description_text
    exit_state
    exit_state_id
    description_text
    task_exit_state
    task_id (FK)
    exit_state_id (FK)
    exit_value
    requires_record_validation
    sort_order
    page
    page_id
    url_text
    help_url_text
    is_restricted
    forbidden_url_text
    application_role_restricted_page
    restricted_page_id (FK)
    application_role_id (FK)
    process_template
    process_template_id
    description_text
    activity
    process_template_id (FK)
    unique_identifier_text
    application_role_id (FK)
    deliverable_unit_type
    deliverable_unit_type_id
    description_text
    is_container
    edit_status
    edit_status_id
    description_text
    workflow_status
    workflow_status_id
    description_text
    protective_marking
    protective_marking_id
    description_text
    custody_status
    custody_status_id
    description_text
    access_status
    access_status_id
    description_text
    sar_closure_status
    sar_closure_status_text
    access_status_id (FK)
    exemption_status_id (FK)
    sar_code_mapping
    sar_code_mapping_id
    sar_closure_type_text
    custody_status_id (FK)
    sar_closure_status_text (FK)
    extension
    extension_id
    description_text
    deliverable_unit_type_extension
    deliverable_unit_type_id (FK)
    extension_id (FK)
    deliverable_unit_link_type
    deliverable_unit_link_type_id
    description_text
    event_type
    event_type_id
    description_text
    description_format_text
    audit_event_type
    audit_event_type_id
    description_text
    audit_event
    audit_event_id
    audit_event_type_id (FK)
    created_date
    created_by (FK)
    accumulation
    accumulation_id
    series_id (FK)
    name_text
    metadata_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    version
    accession
    accession_id
    accumulation_id (FK)
    sequence
    is_transfer_complete
    metadata_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    version
    accession_user
    accession_user_id
    accession_id (FK)
    application_role_id (FK)
    user_id (FK)
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    version
    transformation_mapping
    transformation_mapping_id
    department_id
    description_text
    file_name_text
    file_path_text
    build_structure_using_unique_key
    active
    preprocessing_script_path_text
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    version
    transformation_mapping_parameter
    transformation_mapping_parameter_id
    transformation_mapping_id (FK)
    description_text
    is_core_file
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by
    deleted_date
    transformation
    transformation_id
    accession_id (FK)
    sequence
    transformation_mapping_id (FK)
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    version
    transformation_file
    transformation_file_id
    transformation_id (FK)
    transformation_mapping_parameter_id (FK)
    name_text
    last_modified_date
    created_by (FK)
    created_date
    deliverable_unit
    deliverable_unit_id
    accumulation_id (FK)
    retained_accession_id (FK)
    retained_accession_is_inherited
    delivered_accession_id (FK)
    digital_surrogate
    tna_reference_text
    deliverable_unit_type_id (FK)
    home_location_id
    home_location_is_inherited
    legal_status_id
    language_id
    restrictions_on_use_text
    rights_restrictions_text
    edit_status_id (FK)
    workflow_status_id (FK)
    exemption_applied_for
    exemption_status_id (FK)
    is_redacted
    redaction_sequence_number
    immediate_source_of_acquisition_corp_body_id
    immediate_source_of_acquisition_person_id
    series_id (FK)
    ingest_protective_marking_id (FK)
    legal_responsibility_id
    is_accession_default
    custody_status_id (FK)
    retained_until_date
    anticipated_opening_date
    closed_until_date
    exemption_export_performed
    is_valid
    children_are_valid
    hide_metadata
    sar_closure_code
    sar_closure_status_text
    sar_closure_type_text
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    audit_event_id (FK)
    version
    aggregation_type_id (FK)
    Corporate_Body_Reference_Id
    Person_Reference_Id
    Corporate_Body_Reference_Id__17472
    Corporate_Body_Reference_Id__17484
    user_id (FK)
    deliverable_unit_corporate_body
    deliverable_unit_link_type_id (FK)
    corporate_body_id
    Corporate_Body_Reference_Id (FK)
    deliverable_unit_id (FK)
    audit_event_id (FK)
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    deliverable_unit_person
    deliverable_unit_link_type_id (FK)
    person_id
    Person_Reference_Id (FK)
    deliverable_unit_id (FK)
    audit_event_id (FK)
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    deliverable_unit_place
    place_id
    Place_Reference_Id (FK)
    deliverable_unit_id (FK)
    audit_event_id (FK)
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    deliverable_unit_subject
    subject_id
    Subject_Reference_Id
    deliverable_unit_id (FK)
    audit_event_id (FK)
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    deliverable_unit_description
    deliverable_unit_id (FK)
    description_text
    title_text
    former_internal_reference_text
    former_external_reference_text
    created_date
    created_date_text
    declared_date
    declared_date_text
    ogd_file_path_text
    ogd_file_name_text
    ogd_reference_text
    derive_ogd_extracted_file_path
    ogd_extracted_file_path_text
    ogd_unique_key_text
    ogd_parent_unique_key_text
    original_arrangement_text
    related_material_text
    metadata_xml
    last_changed_by (FK)
    last_changed_date
    audit_event_id (FK)
    version
    acquired_date
    opened_date
    closed_date
    cut_off_date
    record_type_id (FK)
    creator_text
    addressee_text
    bcc_addressee_text
    cc_addressee_text
    correspondence_data_xml
    dataset_xml
    disposal_xml
    rights_xml
    relation_xml
    deliverable_unit_redacted_description
    deliverable_unit_id (FK)
    description_text
    title_text
    last_changed_by (FK)
    last_changed_date
    audit_event_id (FK)
    version
    accession_comment
    accession_comment_id
    accession_id (FK)
    comment_text
    active
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    version
    deliverable_unit_comment
    deliverable_unit_comment_id
    comment_text
    active
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    version
    deliverable_unit_id (FK)
    deliverable_unit_extension
    deliverable_unit_extension_id
    extension_id (FK)
    value_text
    audit_event_id (FK)
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    deliverable_unit_id (FK)
    deliverable_unit_lock
    deliverable_unit_id (FK)
    locked_by (FK)
    locked_date
    deliverable_unit_reference
    series_id
    next_reference
    event
    event_id
    event_type_id (FK)
    created_by (FK)
    created_date
    agent_text
    process_text
    outcome_text
    version_text
    component_text
    accumulation_event
    accumulation_id (FK)
    event_id (FK)
    accession_event
    accession_id (FK)
    event_id (FK)
    deliverable_unit_event
    event_id (FK)
    deliverable_unit_id (FK)
    search_criteria
    search_criteria_text
    created_by (FK)
    search_criteria_id
    created_date
    deleted_by (FK)
    deleted_date
    search_field
    search_field_id
    description_text
    where_clause_text
    is_text_field
    is_date_field
    search_replace
    search_replace_id
    search_text
    replace_text
    search_by
    search_date
    search_replace_deliverable_unit
    deliverable_unit_id (FK)
    search_replace_id (FK)
    title_text
    description_text
    deliverable_unit_scope
    created_by (FK)
    deliverable_unit_scope_id
    created_date
    deliverable_unit_scope_deliverable_unit
    deliverable_unit_id (FK)
    aggregation_type
    aggregation_type_id
    description_text
    record_type
    record_type_id
    description_text
    edit_list
    edit_list_id
    edit_list_ref
    edit_list_type
    sequence_no
    accession_id
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    completed_date
    version
    edit_list_deliverable_unit
    edit_list_deliverable_unit_id
    edit_list_id
    created_by (FK)
    created_date
    deleted_by (FK)
    deleted_date
    can_be_deleted
    deliverable_unit_id (FK)
    edit_list_users
    edit_list_user_id
    edit_list_id (FK)
    application_role_id (FK)
    user_id (FK)
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    version
    edit_list_comment
    edit_list_comment_id
    edit_list_id (FK)
    comment_text
    active
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    version
    application_role_workflow
    application_role_id (FK)
    workflow_id (FK)
    workflow
    workflow_id
    description_text
    deliverable_unit_manifestation_type
    deliverable_unit_manifestation_type_id
    description_text
    deliverable_unit_manifestation
    deliverable_unit_manifestation_id (FK)
    deliverable_unit_manifestation_type_id (FK)
    transformation_unit_id
    sequence
    originality
    active
    technical_environment_id
    technical_environment_text
    metadata_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    version
    deliverable_unit_id (FK)
    deliverable_unit_component
    deliverable_unit_id (FK)
    deliverable_unit_component_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    component_manifestation
    deliverable_unit_manifestation_id
    component_manifestation_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    user_id (FK)
    transformation_unit
    transformation_unit_id
    ingested_file_set_id (FK)
    transformation_unit_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    ingested_file_set
    ingested_file_set_id
    ingested_file_set_type_id
    accession_id (FK)
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    ingested_file_set_event
    ingested_file_set_id (FK)
    event_id (FK)
    digital_file
    digital_file_id
    ingested_file_set_id (FK)
    sequence
    name_text
    working_path_text
    valid
    well_formed
    file_size
    last_modified_date
    extant
    directory
    identification_status_text
    metadata_xml
    format_discrepancies_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    digital_file_event
    digital_file_id (FK)
    event_id (FK)
    digital_file_fixity
    digital_file_id (FK)
    fixity_algorithm_id
    value_text
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    digital_file_format
    digital_file_format_id
    digital_file_id (FK)
    format_puid_text
    format_name_text
    format_version_text
    valid
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    digital_file_format_warning
    digital_file_format_warning_id
    digital_file_format_id (FK)
    warning_text
    digital_file_property
    digital_file_property_id
    digital_file_id (FK)
    event_id (FK)
    name_text
    value_text
    metadata_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    manifestation_file
    deliverable_unit_manifestation_id (FK)
    digital_file_id (FK)
    file_path_text
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    embedded_bitstream
    embedded_bitstream_id
    digital_file_id (FK)
    sequence
    parent_sequence
    type_text
    valid
    well_formed
    file_size
    last_modified_date
    identification_status_text
    metadata_xml
    format_discrepancies_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    filename
    embedded_bitstream_event
    embedded_bitstream_id (FK)
    event_id (FK)
    embedded_bitstream_fixity
    embedded_bitstream_id (FK)
    fixity_algorithm_id
    value_text
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    embedded_bitstream_format
    embedded_bitstream_format_id
    embedded_bitstream_id (FK)
    format_puid_text
    format_name_text
    format_version_text
    valid
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    embedded_bitstream_format_warning
    embedded_bitstream_format_warning_id
    embedded_bitstream_format_id (FK)
    warning_text
    embedded_bitstream_property
    embedded_bitstream_property_id
    embedded_bitstream_id (FK)
    event_id (FK)
    name_text
    value_text
    metadata_xml
    created_by (FK)
    created_date
    last_changed_by (FK)
    last_changed_date
    deleted_by (FK)
    deleted_date
    exemption_status
    exemption_status_id
    description_text
    vw_security_closure_ra_cache
    vw_security_visibility_ra_cache
    tbl_security_digital_file tbl_security_deliverable_unit deliverable_unit_manifestation_view
    deliverable_unit_manifestation_content_type
    deliverable_unit_manifestation_content_type_id
    description_text
    deliverable_unit_external_url
    deliverable_unit_external_url_id
    deliverable_unit_id
    external_url
    tlkp_EROCategory
    category_id
    cat_name_Text
    tlkp_EROSubCategory
    subcat_id
    category_id
    subcat_name_Text
    prefix
    subcat_map
    ApplicationSettings
    Setting_Id
    Setting_key_text
    Setting_Group_text
    Available_To_Web_text
    Description_text
    Collection_Specific_text
    cabjisc
    edocument_id (FK)
    collection_id (FK)
    cat_id (FK)
    Level_no (FK)
    Covering_date
    Edoc_ref
    first_date
    last_date
    Type
    FormerReference
    Attendees
    Agenda
    Title
    Author
    Catalogue_Ref
    Doc_Categories
    First_Image
    Last_image
    FirstDeliverablePDF
    part_no
    Transbatch_id
    DateStamp
    AutonomyString
    AutonomyStringTrunc
    ApplicationSettingsValues
    Setting_Id (FK)
    Collection_Id
    Setting_Value_text
    collection_id (FK)
    AthensOrganisation
    organisation_id
    organisation_name_text
    AthensSession
    customer_id
    login_date
    AthensUsage
    customer_id (FK)
    persistent_uid_text
    organisation_id (FK)
    username_text
    location_type
    location_type_text
    location_name_text
    location_description_text
    OrderProcessing
    order_process_id
    transaction_id (FK)
    process_type_text
    create_date
    process_date
    source_filepath_text
    destination_filepath_text
    order_delivery_id
    session_id_text
    payment_type
    payment_type_text
    payment_name_text
    payment_description_text
    SodDeliveryFiles
    od_id (FK)
    file_path_text
    FIPO
    organisation_Id
    IP_Address_text
    Organisation_text
    FreeAccess
    tbl_accounting_periods
    period_number
    month_number
    tbl_anomaly_type
    anomaly_type
    description
    tbl_Category
    Category_ID (FK)
    Category_Name
    Browsable
    Parent_ID
    MetaCategory
    BitMask
    Category_Description
    Order_Number
    UniqueStyleFile
    tbl_CatrefData
    catref_id
    cat_id
    whole_doc_flag
    level_no
    file_counter
    url_display_text
    URL_Display_Text (FK)
    tbl_edocument_replicated
    edocument_id
    collection_id
    Available
    cat_id (FK)
    Level_no (FK)
    Covering_date
    Edoc_ref
    catref_id
    del_medium_id (FK)
    whole_doc_text
    first_date
    last_date
    Physical_Description_ID (FK)
    scope_content_text
    Doc_Categories
    Release_ID (FK)
    tbl_edoc_verity_batch
    Change_ID
    edocument_id (FK)
    Process_Type
    Create_Date
    Process_Date
    being_indexed
    tbl_collection_replicated
    collection_id
    coll_brief_desc
    available
    coll_description
    contextual_data1
    contextual_data2
    contextual_data3
    External_flag
    Charge_type_id (FK)
    Search_type
    ScopeData1
    ScopeData2
    ScopeData3
    ScopeData4
    ScopeData5
    ScopeData6
    ScopeData7
    ScopeData8
    ScopeData9
    ScopeData10
    ScopeData11
    Scopeprefix1
    Scopeprefix2
    Scopeprefix3
    Scopeprefix4
    Scopeprefix5
    Scopeprefix6
    Scopeprefix7
    Scopeprefix8
    Scopeprefix9
    Scopeprefix10
    Scopeprefix11
    Scope_example
    whole_doc_flag
    whole_doc_text
    Default_Doc_Categories
    Default_Physical_Description_ID (FK)
    CoverText
    required_filename_length
    CollectionTags
    Display_Annotation_text
    tbl_ApplicationSettings
    Setting_Key
    Setting_Value
    Setting_Group
    Description
    tbl_cust_header
    Cust_id
    Cust_Type
    Title
    First_Names
    Family_Name
    Date_Created
    Telephone
    Fax_No
    Comments
    tbl_deliverable
    Deliverable_id
    edocument_id (FK)
    First_Image
    Last_image
    Dfile_ref
    Charge_type_id (FK)
    part_no
    Transbatch_id
    Dfile_size
    No_of_pages
    del_format_version
    load_date
    modified_date
    tbl_deliveryMedium
    del_medium_id
    Server_name
    Intranet_Server
    Directory_Name
    tbl_cust_address
    Address_id
    Cust_id (FK)
    Address_Type
    Address_Usage
    Address
    PostCode
    Country_Code
    Marketing
    tbl_card_type
    card_type_ID
    card_name
    card_code
    tbl_financial_rbos
    batch_ID
    merchant_ID
    RBS_date
    merchant_session_ID
    shopping_transaction_number
    currency_code
    amount
    authorization_ID
    authorized_amount
    captured_amount
    refunded_amount
    outstanding_authorized_amount
    outstanding_captured_amount
    capture_complete
    card_type_code
    recurring_transaction
    subsequent_recurring_transaction
    recurring_reference_transaction_number
    commodity_code
    ticket_number
    customer_reference_number
    merchant_order_number
    type_code
    type_description
    response_code
    acquirer_response_code
    financial_transaction_number
    payment_server_session_ID
    settlement_batch_number
    acquirer_batch_number
    STAN
    RRN
    username
    transaction_source
    additional_data
    terminal_ID
    acquirer_batch_number2
    acquirer_merchant_ID
    tbl_application
    application_code
    name
    owner
    start_project
    start_live
    merchant_status
    merchant_ID
    registered
    email_on_order
    email_on_payment
    email_on_despatch
    email_on_completion
    PRO_email
    account_number
    account_name
    accounts_description
    accounts_reference
    accounts_transaction_reference1
    accounts_transaction_reference2
    RBOSDOWN_user
    RBOSDOWN_password
    IMA_user
    IMA_password
    application_database_name
    return_URL_application (FK)
    return_URL_RoyNet (FK)
    return_URL_administration (FK)
    pass_URL_payment (FK)
    IMA_sender_name
    IMA_sender_address
    tbl_New_Release
    Release_ID
    Release_Name
    Release_Date
    Release_Description
    Order_Number
    tbl_Physical_Description
    Physical_Description_ID
    Physical_Description_Type
    Physical_Description_Desc
    Document_Count
    tbl_Linked_URL
    URL_Display_Text
    Linked_URL_id
    URL_key
    URL_Option
    tbl_orderDelivery
    od_id
    Trans_id (FK)
    Order_id (FK)
    No_of_pages
    Dfile_size
    Dfile_ref
    price
    tbl_order_header
    Order_header_id
    Trans_id (FK)
    Cust_id (FK)
    Address_id (FK)
    Session_id
    Date_Created
    Amount
    Response_Code_id
    VAT_Total
    Delivery_Code
    email_sent_date
    tbl_order
    order_id
    collection_id
    edocument_id
    Trans_id (FK)
    order_sequence
    Dfile_count
    cat_ref
    cat_id
    level_no
    tbl_financial_transaction
    financial_transaction_ID
    merchant_ID
    shopping_transaction_number
    transaction_type_ID (FK)
    amount
    NT_user_name
    PRO_date
    RBS_date
    response_code_id
    financial_transaction_number
    export_status
    ima_comments
    Supervisor_name
    Authorised_date
    tbl_job
    job_code
    job_ID
    tbl_message_status
    message_status_ID
    description
    tbl_job_log
    job_log_ID
    job_code (FK)
    category
    started
    completed
    record_count
    status
    remarks
    status_code (FK)
    tbl_message_queue
    message_queue_id
    transaction_date
    transaction_type_id
    session_id
    transaction_amount
    recipient_name
    recipient_address
    message_date
    message_status_id (FK)
    sender_name
    sender_address
    session_ID (FK)
    tbl_message_template
    application_code (FK)
    transaction_type_id (FK)
    message_template_id
    message_subject
    message_body
    tbl_function
    function_id
    Application_code (FK)
    function_name
    function_directory
    function_URL
    Menu_name
    tbl_price
    Charge_type_id
    Price
    VAT_percentage
    Description
    tbl_response_code
    Response_Code_id
    response_code_id
    Description
    description
    tbl_RDWN_status
    status_code
    description
    tbl_roynet_receipt
    roynet_receipt_ID
    session_ID (FK)
    digital_receipt_ID
    acquirer_response_code
    summary_response_code
    authorization_code
    shopping_transaction_number
    batch_ID
    RoyNet_authorized_pence
    merchant_ID
    locale
    tbl_transaction
    Trans_id
    Trans_date
    Last_modified_date
    RC_Ref
    trans_value
    vat_rate
    customer_id (FK)
    payment_type_text (FK)
    location_type_text (FK)
    user_type_text (FK)
    tbl_shopping_rbos
    batch_ID
    merchant_ID
    RBS_date
    merchant_session_ID
    shopping_transaction_number
    currency_code
    amount
    authorization_ID
    authorized_amount
    captured_amount
    refunded_amount
    outstanding_authorized_amount
    outstanding_captured_amount
    capture_complete
    card_type_code
    recurring_transaction
    subsequent_recurring_transaction
    recurring_reference_transaction_number
    commodity_code
    ticket_number
    customer_reference_number
    merchant_order_number
    tbl_transaction_type
    transaction_type_ID
    transaction_type
    transaction_type_code
    description
    tbl_user_group
    User_group_id
    USer_Group_name
    tbl_user_group_membership
    Ugm_id
    User_group_id (FK)
    Function_id (FK)
    tbl_shopping_transaction
    session_ID
    merchant_ID
    amount
    PRO_date
    RBS_date
    shopping_transaction_number
    response_code_id (FK)
    transaction_type_ID (FK)
    currency_code
    transfer_date
    authorized_amount
    captured_amount
    refunded_amount
    outstanding_authorized_amount
    outstanding_captured_amount
    capture_complete
    card_type_ID (FK)
    recurring_transaction
    subsequent_recurring_transaction
    recurring_reference_transaction_number
    commodity_code
    ticket_number
    customer_reference_number
    merchant_order_number
    Response_Code_id (FK)
    tbl_transaction_anomaly
    anomaly_ID
    job_log_ID (FK)
    anomaly_type (FK)
    session_ID (FK)
    merchant_ID
    shopping_transaction_number
    description
    tbl_Verity_Category
    Category_ID
    Category_Name
    Browsable
    Parent_ID
    MetaCategory
    BitMask
    Category_Description
    Order_Number
    Document_Count
    UniqueStyleFile
    tbl_Verity_Collection
    Verity_Collection_ID (FK)
    Collection_Path
    tbl_Verity_Field
    Verity_Field_ID
    Verity_Field_Name
    tbl_VerityBrowseField
    Field_ID
    Field_Name
    Category_ID (FK)
    Order_Number
    Verity_Field_ID
    tbl_verity_quick_search_dates
    date_range_id
    date_desc
    order_number
    tbl_verity_category_date_count
    Category_ID (FK)
    date_range_id (FK)
    date_type
    document_count
    order_number
    tbl_verity_log
    search_id
    search_type_code
    start_date
    number_of_results
    ip_address
    session_id (FK)
    is_pro_user
    search_keywords
    search_verity_query
    search_date_range
    search_duration_ms
    search_keywords_start
    user_type
    user_type_text
    user_name_text
    user_description_text
    Procat-DOL-Resolver-Link
    cat_id
    Level_no
    ArchiveRecord
    ArchiveRecordID
    SubjectType
    RecordDescription
    RepositoryID
    IsPublic
    Dates
    DateNote
    FirstDate
    LastDate
    NRAID
    ROCollectionRef
    OtherRef
    NRADetails
    ISADGRef
    MDKeyword
    MDCollection
    AddInfo
    LevelOfDescription
    Extent
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    rowversion
    Catalogue
    CatalogueID
    AuctioneerID (FK)
    CatalogueName
    Currency
    AuctionDate
    DateRead
    WorkSheetRead
    CuratorContactID
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    AccessionDigest
    AccessionDigestID
    AccessionID (FK)
    DigestID (FK)
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    Auctioneer
    AuctioneerID
    AuctioneerName
    Address
    Town
    County
    Postcode
    Telephone
    Fax
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    Email
    URL
    Category
    CategoryID
    CategoryDescription
    SubjectType
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    Accession
    AccessionID
    RepositoryID (FK)
    AccessionYear (FK)
    AccessionOrder
    AccessionDescription
    AccessionDate
    ROReference
    ArchiveRecordID
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    ArchiveRecordBook
    ArchiveRecordBookID
    ArchiveRecordID (FK)
    BookID (FK)
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    CorporationCategory
    CorporationCategoryID
    SubjectID (FK)
    CategoryID (FK)
    SubCategoryID (FK)
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    Contact
    ContactID
    RepositoryID (FK)
    OrganisationID
    Title
    FirstName
    LastName
    JobTitle
    Email
    URL
    ContactAddress
    Telephone
    Fax
    RepOrder
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    IsPublicContact
    IsNotificationContact
    Label
    LabelID
    Name
    Addressee
    Address
    ListName
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    Location
    LocationID
    LocationName
    DisplayName
    LocationType
    QualifiedLocationName
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    DiaryKeyword
    DiaryKeywordID
    SubjectID (FK)
    DiaryKeyword
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    Lib_Book
    BookID
    Title
    AuthorNames
    EditorNames
    VNS
    VolumeNo
    PublisherID (FK)
    Series
    Edition
    PublicationDate
    Suffix
    Notes
    ProjectPublicationOnly
    Class (FK)
    ISBN
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    Journal
    JournalID
    Title
    JournalType
    EditorNames
    Notes
    Address
    Town
    County
    Postcode
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    JournalDigest
    JournalDigestID
    JournalID (FK)
    DigestID (FK)
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    Lib_Article
    ArticleID
    BookID (FK)
    Title
    AuthorNames
    IssueNumber
    PublicationDate
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    Lib_Class
    Class
    LocationID (FK)
    ClassName
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    Lib_Publisher
    PublisherID
    PublisherName
    Abbreviation
    PreviousName
    Suffix
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    Lib_BookItem
    BookItemID
    BookID (FK)
    PublicationCost
    Type
    AlternativeLocationID (FK)
    AccessionDate
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    Digest
    DigestID
    DigestName
    HTMLDigestName
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    HMCUser
    HMCUserID
    FirstName
    LastName
    FileRegUser
    Signature
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    ISADG
    ISADGRef
    RepositoryID (FK)
    CatalogueURL
    Scope
    Dates
    LevelDescription
    Extent
    Name
    History
    Mon
    Edit
    Source
    Title
    AdminBiogHistory
    DescriptionDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    product
    productid
    supplierID (FK)
    subjectID
    product
    SubjectID (FK)
    ndnb
    ndnbid
    SubjectID (FK)
    ndnb_url
    Project
    ProjectID
    Title
    Acronym
    URL
    Status
    StartDate
    ArchiveDomain
    LibraryDomain
    MuseumDomain
    OtherDomain
    Description
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    LocationRelationship
    LocationRelationshipID
    LocationID (FK)
    RelatedLocationID (FK)
    Relationship (FK)
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    ProjectKeyword
    ProjectKeywordID
    ProjectID (FK)
    Keyword
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    Lot
    LotID
    CatalogueID (FK)
    NRAID
    FirstDate
    LastDate
    LotDescription
    TermIndex
    LowerValue
    UpperValue
    HammerPrice
    TotalCost
    PurchaserOption
    PurchaserInfo
    Comment
    LotOrder
    LotNumber
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    POD_Record_classes
    RepositoryID (FK)
    ClassName
    ClassID (FK)
    CreatedBy
    LastUpdatedBy
    LastUpdateDate
    CreateDate
    Lookup
    ShortValue
    LookupType
    LongValue
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    NameForm
    NameFormID
    SubjectID (FK)
    NameForm
    NameFormType
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    rowversion
    Notification
    NotificationID
    LotID (FK)
    RepositoryID (FK)
    Bid
    Purchased
    Notes
    DateReturned
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    ProjectPublication
    ProjectPublicationID
    ProjectID (FK)
    BookID (FK)
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    ProjectOrganisation
    ProjectOrganisationID
    ProjectID (FK)
    OrganisationID (FK)
    Currency
    GrantAmount
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    ProjectContact
    ProjectContactID
    ProjectOrganisationID (FK)
    ContactID (FK)
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    Network
    NetworkID
    RepositoryID (FK)
    NetworkName
    NetworkURL
    NetworkRepositoryID
    Date
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    Organisation
    OrganisationID
    OrganisationName
    URL
    RepositoryID (FK)
    OrganisationAddress
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    Reg_Class
    ClassID
    ClassDescription
    ClassType
    rhsLinks
    ODNB article DOI
    article_id
    type
    target_id
    target_url
    descrip
    ArticleID (FK)
    Resource
    ResourceID
    ResourceTitle
    ResourceType
    ResourceDescription
    ResourceLink
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    LinkType
    ExternalReference
    ResourceSection
    LinkLookupType
    Relationship
    Relationship
    LocationType
    RelatedLocationType
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    Returns
    ReturnID
    RepositoryID (FK)
    ReturnYear (FK)
    ReturnDate
    Medium
    ReturningNothing
    Notes
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    Reg_File
    FileID
    ClassID (FK)
    Title
    EstNumber1
    EstNumber2
    EstNumber3
    Part
    BoxID (FK)
    PRORef
    DateCreated
    DateReviewed
    DateClosed
    DateDestroyed
    Notes
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    Registry
    NRAID
    ManorialIndicator
    BusinessIndicator
    OrganisationIndicator
    PersonIndicator
    DiaryIndicator
    FamilyIndicator
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    ProjectRegion
    ProjectRegionID
    ProjectID (FK)
    RegionID (FK)
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    RegistryRecord
    RegistryRecordID
    NRAID (FK)
    AdditionalRef
    RecordTitle
    RecordShortTitle
    RecordSortTitle
    NetworkCollectionRef
    ISADGRef (FK)
    CheckWord
    Pages
    Dates
    ROCollectionRef
    SeriesIndicator
    Comments
    SortClass
    SortWord
    NewCountyID
    RepOrderNo
    ROAccessionNo
    SurveyRef
    URL
    Extent
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    RepositoryAuctioneer
    RepositoryAuctioneerID
    RepositoryID (FK)
    AuctioneerID (FK)
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    RegistryRepository
    RegistryRepositoryID
    RegistryRecordID (FK)
    NRAID
    RepositoryID (FK)
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    Repository
    RepositoryID
    RepositoryName
    Type
    AddressLine1
    AddressTown
    AddressCounty
    AddressCountry
    Postcode
    LocationID (FK)
    CorrespondenceAddress
    Telephone
    Fax
    Email
    PitchID
    OldRef
    InUK
    URL
    MapURL
    CatalogueURL
    OpeningHours
    Holidays
    Introduction
    Appointment
    Ticket
    CARN
    Fee
    DisabledAccess
    Comments
    Photographs
    Microfilm
    Repair
    RepairOthers
    RecordRepositories
    ResearchService
    IDRequired
    SalesColPol
    PurchasingBudget
    Accessions
    AccessionsActive
    Subscription
    TNAApproval
    TNAProvisionalApproval
    Approved
    LastVisited
    Diocesan
    PROApproval
    PODAddress
    PODRespAuth
    FormalInspection
    GoverningBody
    ActivePurchaser
    RepeatPurchaseNotification
    CreateDate
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    scanFiles
    pdfFilename
    filename
    extension
    fileIsadgref
    fileIsadgref2
    isadgrefalt
    ISADGRef (FK)
    xmlFileName
    sequence
    processed
    scanned_lists
    scanned_lists_id
    sequence
    ISADGRef (FK)
    URL
    indexPath
    indexFile
    ISADGRefAlt
    refType
    ISADGRefExists
    SubjectRelationship
    SubjectRelationshipID
    SubjectID (FK)
    ChildID
    RelationshipCategory
    RelationshipDescription
    RelationshipDates
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    SubjectLocation
    SubjectLocationID
    SubjectID (FK)
    LocationID (FK)
    SortOrder
    RelationshipType
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    SubjectResource
    SubjectResourceID
    SubjectID (FK)
    ResourceID (FK)
    RelationshipNature
    RelationshipDates
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    SubCategory
    SubCategoryID
    CategoryID (FK)
    SubCategoryDescription
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    SubjectArchiveRecord
    SubjectArchiveRecordID
    ArchiveRecordID (FK)
    SubjectID (FK)
    RelationshipNature
    RelationshipDates
    SortOrder
    Accession
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    SubjectLanguages
    SubjectLanguageId
    SubjectID (FK)
    LanguageCode
    CreateDate
    CreatedBy
    LastUpdatedBy
    LastUpdateDate
    SubjectFunctions
    SubjectFunctionId
    SubjectID (FK)
    FunctionText
    CreateDate
    CreatedBy
    LastUpdatedBy
    LastUpdateDate
    SubjectHistoryResource
    SubjectHistoryResourceID
    SubjectID (FK)
    ResourceID (FK)
    CreateDate
    CreatedBy
    LastUpdatedBy
    LastUpdateDate
    Subject
    SubjectID
    SubjectType
    TypeSpecificID
    PreTitle
    Forenames
    Name
    _FullName
    SortName
    AlternativeStatus
    Title
    SortTitle
    Epithet
    Gender
    IsAuthorityRecord
    IsAnonymous
    Dates
    FirstDate
    LastDate
    RecordStatus
    Notes
    AuthorityName
    IsHeader
    HonourLocationID
    StandardisedName
    History
    GeographicalArea
    LegalStatus
    Mandate
    InternalStructure
    GeneralContext
    OtherSignificantInfo
    DescriptionArea
    AuthorityRecordStatus
    AuthorityDetailLevel
    ControlAreaNotes
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    rowversion
    FormerISAARReference
    Sources
    CorporateCharityNumber
    CorporateBusinessNumber
    ISAARReference
    InstitutionIdentifier
    IsPublic
    SubjectRule
    SubjectRuleID
    SubjectID (FK)
    CreatedBy
    CreateDate
    LastUpdatedBy
    LastUpdateDate
    SubjectRule
    supplier
    supplierID
    supplier
    SubjectScripts
    SubjectScriptId
    SubjectID (FK)
    ScriptCode
    CreateDate
    CreatedBy
    LastUpdatedBy
    LastUpdateDate
    YearAccessionEditor
    AccessionYear
    AccessionEditorID (FK)
    CreatedBy
    LastUpdateDate
    LastUpdatedBy
    CreateDate
    active
    categorylinks
    page_id (FK)
    cl_to
    cl_sortkey
    cl_timestamp
    category
    cat_id
    cat_title
    cat_pages
    cat_subcats
    cat_files
    cat_hidden
    imagelinks
    page_id (FK)
    img_name (FK)
    externallinks
    page_id (FK)
    el_to
    el_index
    ipblocks
    ipb_id
    ipb_address
    ipb_user
    user_id (FK)
    ipb_by_text
    ipb_reason
    ipb_timestamp
    ipb_auto
    ipb_anon_only
    ipb_create_account
    ipb_enable_autoblock
    ipb_expiry
    ipb_range_start
    ipb_range_end
    ipb_deleted
    ipb_block_email
    image
    img_name
    img_size
    img_width
    img_height
    img_metadata
    img_bits
    img_media_type
    img_major_mime
    img_minor_mime
    img_description
    img_user (FK)
    img_user_text
    img_timestamp
    img_sha1
    interwiki
    iw_prefix
    iw_url
    iw_local
    iw_trans
    page
    page_id
    page_namespace
    page_title
    page_restrictions
    page_counter
    page_is_redirect
    page_is_new
    page_random
    page_touched
    page_latest
    page_len
    revision
    rev_id
    page_id (FK)
    old_id (FK)
    rev_comment
    user_id (FK)
    rev_user_text
    rev_timestamp
    rev_minor_edit
    rev_deleted
    rev_len
    rev_parent_id
    pagelinks
    page_id (FK)
    pl_namespace
    pl_title
    langlinks
    page_id (FK)
    ll_lang
    ll_title
    oldimage
    img_name (FK)
    oi_archive_name
    oi_size
    oi_width
    oi_height
    oi_bits
    oi_description
    user_id (FK)
    oi_user_text
    oi_timestamp
    oi_metadata
    oi_media_type
    oi_major_mime
    oi_minor_mime
    oi_deleted
    oi_sha1
    recentchanges
    rc_id
    rc_timestamp
    rc_cur_time
    rc_user
    rc_user_text
    rc_namespace
    rc_title
    rc_comment
    rc_minor
    rc_bot
    rc_new
    rc_cur_id (FK)
    old_id (FK)
    rc_last_oldid
    rc_type
    rc_moved_to_ns
    rc_moved_to_title
    rc_patrolled
    rc_ip
    rc_old_len
    rc_new_len
    rc_deleted
    rc_logid
    rc_log_type
    rc_log_action
    rc_params
    rc_this_oldid (FK)
    querycache
    qc_type
    qc_value
    qc_namespace
    qc_title
    redirect
    page_id (FK)
    rd_namespace
    rd_title
    querycachetwo
    qcc_type
    qcc_value
    qcc_namespace
    qcc_title
    qcc_namespacetwo
    qcc_titletwo
    page_restrictions
    pr_type
    page_id (FK)
    pr_level
    pr_cascade
    pr_user
    pr_expiry
    pr_id
    protected_titles
    pt_namespace
    pt_title
    pt_user
    pt_reason
    pt_timestamp
    pt_expiry
    pt_create_perm
    page_props
    pp_page
    pp_propname
    pp_value
    searchindex
    page_id (FK)
    si_title
    si_text
    text
    old_id
    old_text
    old_flags
    templatelinks
    page_id (FK)
    tl_namespace
    tl_title
    USER
    user_id
    user_name
    user_real_name
    user_password
    user_newpassword
    user_newpass_time
    user_email
    user_options
    user_touched
    user_token
    user_email_authenticated
    user_email_token
    user_email_token_expires
    user_registration
    user_editcount
    user_groups
    ug_group
    user_id (FK)
    user_newtalk
    user_id (FK)
    user_ip
    user_last_timestamp
    watchlist
    user_id (FK)
    wl_namespace
    wl_title
    wl_notificationtimestamp

    View Slide

  11. SOA  FRAMEWORK:  SERVICES  AND  
    OBJECTS  
    In  2010,  The  Na-onal  Archives  decided  to  
    move  to  a  standardized  Service  Oriented  
    Architecture  framework  to  reduce  
    maintenance  costs  and  provide  the  flexibility  
    to  add  new  services  in  the  future.  
     
    11

    View Slide

  12. SQL  SERVER  DATABASES  
    12

    View Slide

  13. CREATING  INFORMATION  ASSET:  EAV  
    13
    Entity-attribute-value model (EAV) is a data model to describe entities where the number of attributes
    (properties, parameters) that can be used to describe them is potentially vast, but the number that will
    actually apply to a given entity is relatively modest.

    View Slide

  14. POPULATING  INFORMATION  ASSETS  IN  
    MONGODB
     
    14

    View Slide

  15. CREATING  INFORMATION  ASSET:  
    MONGODB  
    15

    View Slide

  16. CREATING  INFORMATION  ASSET:  
    MONGODB  
    16

    View Slide

  17. CREATING  INFORMATION  ASSET:  
    MONGODB  
    17

    View Slide

  18. DISCOVERY  ARCHITECTURE  

    View Slide

  19. USING  MONGODB:  ARCHITECTURE  
    (REPLICA  SET)  
    19
    NetApp FAS3140 HA
    FILER2
    FILER1 mongo_db1 (250GB)
    mongo_logs1 (75GB)
    mongo_db2 (250GB)
    mongo_logs2 (75GB)
    MONGO_SRV1 MONGO_SRV2
    ARBITER

    View Slide

  20. DISCOVERY:  SEARCH  INFORMATION  
    ASSET  
    20

    View Slide

  21. DISCOVERY:  BROWSE  INFORMATION  
    ASSETS  HIERARCHY  
    21

    View Slide

  22. BROWSE  FROM  INFORMATION  ASSET  
    DETAILS
     
    22

    View Slide

  23. DISCOVERY:  USING  THE  SYSTEM  -­‐  API  
    23
    [email protected]

    View Slide

  24. Thank you!
    http://discovery.nationalarchives.gov.uk
    http://discovery.nationalarchives.gov.uk/api.htm
    [email protected]

    View Slide