Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Kurt - An archiving tool

Kurt - An archiving tool

I gave this lightning talk at the PyUGRM meetup on August, 20th 2013.

Zoran Zaric

August 26, 2013
Tweet

More Decks by Zoran Zaric

Other Decks in Programming

Transcript

  1. Motivation ✤ Archive huge ammounts of RAW Images (~25MB/Image ~1000

    Images/Shooting) ✤ Don‘t trust anybody ✤ Don‘t download everything to get one image ✤ 1. Start a FOSS project in a language you love 2. Give it an awkward name 3. ? 4. Profit! Dienstag, 20. August 13
  2. Implementation ✤ Images are clustered in „Packfiles“ (<1000 Files &&

    <1GB) ✤ Metadata stored in a SQLite database ✤ Which file is in which packfile? ✤ Filesize ✤ EXIF ✤ Previews stored with metadata Dienstag, 20. August 13
  3. Implementation (cont.) ✤ ENCRYPT ALL THE THINGS!!!! (with GPG) ✤

    Packfiles are stored in Amazon Glacier Dienstag, 20. August 13
  4. TODO ✤ encryption in a sane way ✤ Amazon Glacier

    up- and download ✤ Versioning ✤ File search ✤ Metadata search ✤ Other storage backends Dienstag, 20. August 13