Storing User Files with Express, Stormpath, and Amazon S3

Sign up for Stormpath: https://api.stormpath.com/register
Watch the presentation: https://youtu.be/dxKbcBDvvrI
Read the blog post: https://stormpath.com/blog/securely-storing-files-node-s3

Join Stormpath Developer Evangelist, Randall Degges, to learn how to store user files using Amazon S3. He’ll cover everything you need to know to properly handle user files in your web applications.

Randall will cover:
- What is the problem we're trying to solve?
- How files are typically stored
- What you need to know about Amazon S3
- How to build a basic Express application with user authentication
- How to securely store files in S3 using express-stormpath-s3
- Q/A Session

Transcript

1. Storing User Files with Express, Stormpath, and Amazon S3 @rdegges
2. I’m Randall Degges Developer Evangelist at Stormpath Python / Node / Go Hacker
3. Agenda - Stormpath Intro (5 minutes) - Main Talk (30 minutes) - Q/A (15 minutes)
4. Intro to Stormpath API Service Website Mobile App
5. We Do a Lot - Libraries for many languages - AD / LDAP - Single Sign On (SAML) - OAuth2 - Social Login - Multi-Tenancy - Groups and Roles - Email Workflows
6. What’s the problem?
7. www.awesome.io avatar.png receipt.pdf invoice.pdf Stormpath! ???
8. How do people usually store user files?
9. Database Columns CREATE TABLE IF NOT EXISTS users ( id UUID DEFAULT uuid_generate_v4(), email TEXT PRIMARY KEY, password TEXT NOT NULL, avatar TEXT ); avatar.png Base64 encode
10. No!!! - Makes DB queries for each image view. - Slows down DB. - DBs aren’t good at this sort of IO (heavy disk reading). - Slow performance for end users.
11. Your Webserver(s) Webserver avatar.png avatar.png avatar.png avatar.png avatar.png avatar.png avatar.png avatar.png
13. Amazon S3 - Reliability. - Durability. - Availability. - Cost. - Speed. - Security ACLs.
14. How S3 Works avatar.png webserver S3 Bucket Custom Data (for user)
15. User CustomData { "href": "https://api.stormpath.com/v1/accounts/gbMUL3uP8rFLZUMAw2XhI", "email": "r@rdegges.com", "givenName": "Randall", "surname": "Degges", "customData": { "href": "https://api.stormpath.com/v1/accounts/gbMUL3uP8rFLZUMAw2XhI/customData", "s3": { "fluent.jpg": { "href": "https://s3.amazonaws.com/express-stormpath- s3/gbMUL3uP8rFLZUMAw2XhI/fluent.jpg", "lastModified": "2016-10-05T23:20:53.508Z" }, "wallhaven-204175.jpg": { "href": "https://s3.amazonaws.com/express-stormpath-s3/gbMUL3uP8rFLZUMAw2XhI/wallhaven- 204175.jpg", "lastModified": "2016-10-06T01:08:58.898Z" } } } }
16. Cool, Right?
17. So… Let’s Build Something! $ npm install express $ npm install express-stormpath $ npm install express-stormpath-s3
18. "use strict"; const express = require("express"); const stormpath = require("express-stormpath"); const stormpathS3 = require("express-stormpath-s3"); let app = express(); app.use(stormpath.init(app)); app.use(stormpath.getUser); // Other middleware here // Routes here app.listen(3000); The Magic!
19. /register
20. /login
23. app.use(stormpathS3({ awsAccessKeyId: process.env.AWS_ACCESS_KEY_ID, awsSecretAccessKey: process.env.AWS_SECRET_ACCESS_KEY, awsBucket: 'express-stormpath-s3' })); This sets up the S3 client and adds simple file methods onto req.user. Required.
24. Setup Done!
25. Upload Files req.user.uploadFile("./avatar.png", (err) => { if (err) throw err; console.log("Successfully uploaded file!"); }); Path to local file you want to upload.
26. Upload Files (cont) req.user.uploadFile("./avatar.png", "public-read", (err) => { if (err) throw err; console.log("Successfully uploaded file!"); }); Desired ACL for file.
27. Delete Files req.user.deleteFile("avatar.png", (err) => { if (err) throw err; console.log("Successfully deleted file!"); });
28. (demo)
29. Resources - https://github.com/rdegges/express-stormpath-s3 - https://aws.amazon.com/s3/ - https://stormpath.com/ - https://github.com/rdegges/express-stormpath-s3- webinar - https://docs.aws.amazon.com/AmazonS3/latest/de v/acl-overview.html
30. You’re awesome. @rdegges