Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Kurt - An archiving tool

Kurt - An archiving tool

I gave this lightning talk at the PyUGRM meetup on August, 20th 2013.

Avatar for Zoran Zaric

Zoran Zaric

August 26, 2013
Tweet

More Decks by Zoran Zaric

Other Decks in Programming

Transcript

  1. Motivation ✤ Archive huge ammounts of RAW Images (~25MB/Image ~1000

    Images/Shooting) ✤ Don‘t trust anybody ✤ Don‘t download everything to get one image ✤ 1. Start a FOSS project in a language you love 2. Give it an awkward name 3. ? 4. Profit! Dienstag, 20. August 13
  2. Implementation ✤ Images are clustered in „Packfiles“ (<1000 Files &&

    <1GB) ✤ Metadata stored in a SQLite database ✤ Which file is in which packfile? ✤ Filesize ✤ EXIF ✤ Previews stored with metadata Dienstag, 20. August 13
  3. Implementation (cont.) ✤ ENCRYPT ALL THE THINGS!!!! (with GPG) ✤

    Packfiles are stored in Amazon Glacier Dienstag, 20. August 13
  4. TODO ✤ encryption in a sane way ✤ Amazon Glacier

    up- and download ✤ Versioning ✤ File search ✤ Metadata search ✤ Other storage backends Dienstag, 20. August 13