Redshift Introduction

Brief intro for amazon redshift service

Transcript

1. Redshift introduction A distributed data ware house
2. Agenda • What is the problem • How to solve it by Redshift • Compared to other technologies
3. Data, more data
4. Data, more data
5. Data, more data • User information • User blog articles • User visit log User_id Gender Age 1000 Female 18 User_id Article_id Contents Alice Female Hello,world User_id URL Time 1000 http://baidu.com 2014-03-01 01:00
6. How to use data? • NoSQL • RDBMS • Hive • Redshift
7. Data warehouse concepts • Dimensions and metrics
8. Data warehouse concepts
9. Redshift • An Amazon Redshift data warehouse is an enterprise-class relational database query and management system.
10. Redshift Targets • Interactive • Volume • Variety • Security
11. Architecture • Postgres console • Query process
12. Architecture
13. Storage(Reduce I/O) • Column • Compression • Block size • Sort key
14. Computer(MPP) • Parallel unit: Slice • Distributed key • Join optimize
15. Performance • https://amplab.cs.berkeley.edu/benchmark/
16. Management • Scalable • Create/Clone Cluster
17. Security • Backup: Snapshot • User auth • User quota: Workload management
18. Compared to Hadoop Hive • Speed • Volume • Flexible • Operation
19. Question?