Hate organising your photos? Try it with 5 terabytes

Transcript

1. HATE ORGANIZING YOUR PHOTOS?
2. Hi, I’m Arto
3. Hi, I’m Eija
4. image: Freepik.com Hi, I’m generic customer / co-worker
5. ...also Arto
6. WHEN WAS THE LAST TIME YOU WENT THROUGH YOUR PHOTOS?
16. ARTO LIUKKONEN Full-stack developer Serverless (AWS) + ReactJS for ~5 years Live in Jyväskylä, Finland Work at Nordcloud (recruiting in 10 countries) “
17. Cheap & scaling backup solution? Consider it done! “
18. BUSINESS REQUIREMENTS • Easy to use • Cheap ◦ 10-20€/month • Durable storage • Photo browser “
19. Copy files to home NAS CLOUD BACKUP Cloud backup
20. Let’s just use Google Drive!
22. ... Dropbox!
24. ... S3 Bucket!
25. 0.023$/Gb/month Total ~115e/month AWS S3
26. No thumbnails from RAWs Galleries are hard to browse Not magical enough 🦄 ...but first, that 5TB RAW backup “
27. 0.00099$/Gb/month Total ~5$/month AWS S3 GLACIER DEEP ARCHIVE
28. AWS S3 Glacier Deep Archive + Cheap + Unlimited storage - Retrieval price 0.02€/Gb - Retrieval time +12 hours “
29. Two ways to Glacier - Glacier Vault • aws glacier create-vault • Usage through Glacier API • Vault lock can prevent object delete even from root user “
30. Two ways to Glacier - S3 API • aws s3 cp --storage-class=GLACIER ... • Usage through S3 API • Can also move using Lifecycle rules • ...more of this later “
31. Magic Copy files to home NAS CLOUD BACKUP 2.0 Raw files in S3 Magic Photo browser ✅
33. Upload RAW to S3 Standard IA EXTRACTING JPG FROM RAW Extract PreviewImage with exiftool Copy EXIF with exiftool Resize to 2000px with ImageMagick Lifecycle move RAW to Glacier after ~2 days
34. Previews from RAW require native binaries Lambda layers could do the job ImageMagick layer is available ...anyone got exiftool working? “
35. Raspberry Pi to the rescue! “
38. 0.023$/Gb/month Total ~1$/month AWS S3 (2000px previews)
39. Raspberry Pi resize & sync Raw files in S3 Copy files to home NAS CLOUD BACKUP 2.0 Magic Photo browser ✅✅
41. AWS Rekognition • Face recognition ◦ Find same person from different photoshoots • Object & scene recognition ◦ Browse photos by occasion ◦ Weddings, cooking, animals, etc “
47. FUN FACT: Rekognition ops per sec quotas! “
49. 1$/1000 images & run two times per image ...quite a lot, but luckily only once AWS REKOGNITION (free tier 5000 per month)
50. Copy files to home NAS SO HOW DOES THE SOLUTION LOOK? Raspberry Pi resize & sync AWS Rekognition AWS Lambda AWS DynamoDB Photo browser (Amplify, ReactJS)
51. RPi with HDD Rekognition & storage Gallery browser
52. DEMO TIME!
53. AND THAT’S NOT ALL!
54. Finished & tagged photos to S3 PORTFOLIO WEBSITE S3 trigger Lambda Object metadata stored to DynamoDB www.eijahelena.com
55. Finished & tagged photos to S3 NEXT STEP: WEBSHOP S3 trigger Lambda Watermark images? Password protected galleries? Stripe?
56. 5Tb of raws: 5$/month Rekognition: 0-5$/month 2000px previews: 1$/month DynamoDB, traffic, Lambda: ~0.5$/month Time spent: priceless TOTAL COST
57. THANKS! @artoliukkonen www.arto.dev