Implementing Automatic Digital Preservation for a Mass Digitization Workflow - The Challanges

#SLUB #Dresden #iPres2016

Transcript

1. Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de CC BY 4.0 The Challenges Henrike Berthold, Jörg Sachse, Andreas Romeyke, Sabine Krug, Stefan Fritzsche Saxon State and University Library Dresden (SLUB) 5. Oktober 2016 Implementing Automatic Digital Preservation for a Mass Digitization Workflow mailto: langzeitarchiv@slub-dresden.de
2. Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de CC BY 4.0 Agenda 5. Oktober 2016 | Seite 2 Jörg Sachse | Department IT 2.3 1.Overview 2.Mass Digitization Workflow 3.Challenges & Solutions 1. File format specification with constraints 2. Updates of archival information packages 3. Checking the bit-stream of a large archive
3. Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de CC BY 4.0 Overview 5. Oktober 2016 | Seite 3 Jörg Sachse | Department IT 2.3 • in-house mass retrodigitisation workflow (Kitodo.Production) • more material from external producers, federal digitisation program etc. • digital preservation system „SLUBArchiv“ 2012 – 2014 (in production since Jan. 2015) • ca. 60,000 IEs, 3,000,000 Files, 43 TB
4. Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de CC BY 4.0 Mass Digitization Workflow How do we create digital material? Create Kitodo MD record scan documents create checksums add descriptive & structural MD from catalog export master data process via Submission Application ingestprocessing in SLUBArchiv preservation & curation 5. Oktober 2016 | Seite 4 Jörg Sachse | Department IT 2.3
5. Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de CC BY 4.0 Challenges & Solutions File format specification with constraints • additional requirements regarding digitized data => compliance with … • …guidelines as specified by DFG • …policy as specified in-house • technical parameters as well as content parameters • free TIFF validator checkit_tiff, tag rule configuration • => improved quality, policies enforced 5. Oktober 2016 | Seite 5 Jörg Sachse | Department IT 2.3
6. Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de CC BY 4.0 Challenges & Solutions Updates of Archival Information Packages • multiple update scenarios • MD changed/extended • new representation added • file replacement • Rosetta supports AIP updates • old versions are kept • Submission Application distinguishes ingest from update 5. Oktober 2016 | Seite 6 Jörg Sachse | Department IT 2.3
7. Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de CC BY 4.0 Challenges & Solutions Checking the bit-stream of a large archive • integrity checks on all copies unfeasible • sample method • check subsample of files instead of full check • pattern method • write predefined bit pattern to disk/tape • 0010.1010|1010.1010|1111.1111|0000.0000|… • check regularly • no integrity breaches found 5. Oktober 2016 | Seite 7 Jörg Sachse | Department IT 2.3
8. Sächsische Landesbibliothek – Staats- und Universitätsbibliothek Dresden slub-dresden.de CC BY 4.0 The Challenges Henrike Berthold, Jörg Sachse, Andreas Romeyke, Sabine Krug, Stefan Fritzsche Saxon State and University Library Dresden (SLUB) 5. Oktober 2016 Implementing Automatic Digital Preservation for a Mass Digitization Workflow mailto: langzeitarchiv@slub-dresden.de