Slide 1

Slide 1 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. JP Santana Principal Startup SA Unlock the value of your data with Apache Pinot and AWS Wahab Syed Startup SA

Slide 2

Slide 2 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What we’re going to cover • Breadth & Depth of AWS services for RT Analytics • Options for running Apache Pinot on AWS • Demo – Apache Pinot on Amazon ECS

Slide 3

Slide 3 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Breadth & Depth of AWS services for RT Analytics

Slide 4

Slide 4 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building streaming data pipelines is easier with AWS Processing Ingestion and storage Amazon Kinesis Data Streams Amazon Managed Streaming for Apache Kafka Apache Pinot Batch Sources IOT sensors Enterprise apps Social media Logs Data lakes Amazon S3

Slide 5

Slide 5 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Kinesis Data Streams Kinesis Data Analytics Kinesis Video Streams Kinesis Data Firehose Amazon Kinesis COLLECT, PROCESS, AND ANALYZE VIDEO AND DATA STREAMS IN REAL TIME

Slide 6

Slide 6 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Compatible Fully managed Highly available Secure Kafk a Amazon MSK FULLY MANAGED, HIGHLY AVAILABLE, AND SECURE

Slide 7

Slide 7 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Built to store and retrieve any amount of data Supports Apache Pinot Auto Ingest and Batch Import Unmatched durability, availability, and scalability Amazon S3 Amazon S3

Slide 8

Slide 8 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Customer references Online stylist processing 100 million events per day Facilitate communications between 100+ microservices 1 billion events per day from connected devices Migrated data bus to Amazon Kinesis Near real-time home valuation (Zestimates) Billions of events per day from TVs and connected devices 10 TB per day clickstreams from 250+ sites Live clickstream dashboards refreshed under 10s IoT predictive analytics 50 billion daily ad impressions, sub-50 ms responses NORDSTRO M

Slide 9

Slide 9 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Options for running Apache Pinot on AWS

Slide 10

Slide 10 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Control Plane Deployment, Scheduling, Scalability & management Data Plane Where containers run Amazon Elastic Container Service Amazon Elastic Container Service for Kubernetes Amazon EC2 AWS Fargate Image Repo Container Image Repository Amazon Elastic Container Registry Container Services on AWS

Slide 11

Slide 11 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon ECS and Amazon EKS EKS ECS Powerful simplicity Open flexibility

Slide 12

Slide 12 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Powerful simplicity AWS-opinionated way to run containers at scale Reduce decisions without sacrificing scale or features Reduce time to build, deploy, and migrate applications ECS

Slide 13

Slide 13 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Open flexibility Gain agility and efficiency with AWS-optimized Kubernetes, and standardize operations everywhere Secure, highly available, with observability across all Kubernetes deployments Build with choice of solutions from the broader community around Kubernetes EKS

Slide 14

Slide 14 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Serverless Containers Fargate No need to manage compute provisioning, management, and scalability Scale easily and pay only for what you use Natively integrated with VPC, ELB, IAM, CloudWatch, and more

Slide 15

Slide 15 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Demo: Apache Pinot on Amazon EKS

Slide 16

Slide 16 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ADD DEMO RECORDING

Slide 17

Slide 17 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. References for Apache Pinot on AWS • Apache Pinot on AWS Quickstart https://docs.pinot.apache.org/basics/getting-started/public-cloud -examples/aws-quickstart • Ingest events from an Amazon Kinesis stream into Pinot https://docs.pinot.apache.org/basics/data-import/pinot-stream-in gestion/amazon-kinesis • JSON Batch Import and Auto Ingest from S3 into Apache Pinot https://youtu.be/1EMBx1XeI9o https://youtu.be/fXraQygBzxg

Slide 18

Slide 18 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ! Please, don’t forget to rate our session in the app!

Slide 19

Slide 19 text

© 2023, Amazon Web Services, Inc. or its Affiliates. All rights reserved. JP Santana linkedin.com/in/jpsantana Wahab Syed linkedin.com/in/wahab-io Thank you!