GCP 101 Products and Services

Slide 1

Slide 1 text

GCP 101 - Products and Services - @sakajunquality 19.03.26 #gcpug #sendai

Slide 2

Slide 2 text

About me - @sakajunquality - Google Developers Expert, Cloud - Software Engineer, Reliability @ Ubie, Inc.

Slide 3

Slide 3 text

Agenda - Cloud Computing - GCP Products - Getting Started

Slide 4

Slide 4 text

1 Cloud Computing

Slide 5

Slide 5 text

Cloud Computing - Networking - Compute - Database and Storage - Big Data and Machine Learning - Developer Tools

Slide 6

Slide 6 text

2 GCP Products

Slide 7

Slide 7 text

GCP Products - Networking - Compute - Database and Storage - Big Data and Machine Learning - Developer Tools

Slide 8

Slide 8 text

GCP Products - Networking - Compute - Database and Storage - Big Data and Machine Learning - Developer Tools

Slide 9

Slide 9 text

Network

Slide 10

Slide 10 text

Network - VPC VPC - Virtual version of a physical network - RFC1918 Private Network - IPv4 unicast - Network and Subnet

Slide 11

Slide 11 text

Network - Load Balancing Cloud Load Balancing / Cloud CDN / Cloud Armor - Anycast IP Global Load Balancer - From zero to full-throttle - CDN and WAF

Slide 12

Slide 12 text

Network - VPN / Routing Cloud Nat / Cloud Router / Cloud VPN / Cloud Interconnect - Managed NAT service - Managed Router - Managed VPN Endpoint - Fixed Line Endpoint

Slide 13

Slide 13 text

Network - VPN / Routing Cloud Nat / Cloud Router / Cloud VPN / Cloud Interconnect - Managed NAT service - Managed Router - Managed VPN Endpoint - Fixed Line Endpoint

Slide 14

Slide 14 text

GCP Products - Networking - Compute - Database and Storage - Big Data and Machine Learning - Developer Tools

Slide 15

Slide 15 text

Compute

Slide 16

Slide 16 text

Compute Types - Virtual Machine - Container - Serveless

Slide 17

Slide 17 text

Compute Types - Virtual Machine - Container - Serveless

Slide 18

Slide 18 text

Virtual Machine - Compute Engine Compute Engine - IaaS - Scalable, High-Performance VM - Live migration - Automatic Discounts - Preemptible Option

Slide 19

Slide 19 text

Compute Types - Virtual Machine - Container - Serveless

Slide 20

Slide 20 text

Container - Kubernetes Engine Kubernetes Engine - Full-managed Kubernetes - Deploy “Containered” Application

Slide 21

Slide 21 text

What’s Kubernetes? - Container Platform based on Google’s Borg - Borg has supported Google’s service over 12 years - Orchestrates computing, networking, and storage infrastructure - Microservices Platform - OSS written in Go - Borg is written in C++ - “Graduated” CNCF project - Crossed the Chasm https://speakerdeck.com/sakajunquality/starting-google-kubernetes-engine-2019

Slide 22

Slide 22 text

Compute Types - Virtual Machine - Container - Serveless

Slide 23

Slide 23 text

Serverless - AppEngine AppEngine - Full Managed Application Platform - Triggered by HTTP(S) - Standard and Flexible

Slide 24

Slide 24 text

Serverless - Cloud Functions Cloud Functions - Function as a Service - Triggered by Events and HTTP

Slide 25

Slide 25 text

Which Compute Should I use?

Slide 26

Slide 26 text

Which Compute Should I use? Up To You

Slide 27

Slide 27 text

- Workload Type - HTTP triggered or Event triggered or cron triggers? - Languages - GAE Supported? - Monolithic? Microservices? Considerations for Compute Resource

Slide 28

Slide 28 text

GCP Products - Networking - Compute - Database and Storage - Big Data and Machine Learning - Developer Tools

Slide 29

Slide 29 text

Database and Storage

Slide 30

Slide 30 text

Database - Cloud SQL Cloud SQL - Managed MySQL and PostgreSQL - Private IP Access - Auto-Backup

Slide 31

Slide 31 text

Database - Cloud Datastore Cloud Datastore - Full-managed NoSQL Database - Automatic Sharding and Replication - ACID transactions - SQL-like queries - Indexes

Slide 32

Slide 32 text

Database - Cloud Firestore Cloud Firestore - Full-managed NoSQL Database - Next Generation of Cloud Datastore - Datastore mode - Realtime Database - ACID Transaction - Multi-region replication

Slide 33

Slide 33 text

Database - Cloud Bigtable Cloud BigTable - Low latency, massively scalable NoSQL - Eventually Consistent

Slide 34

Slide 34 text

Database - Cloud Spanner Cloud Spanner - No-Compromise Relational Database Service - Global Scalable and strongly consistent

Slide 35

Slide 35 text

Database - Cloud Memorystore Cloud Memorystore - Full managed Redis - Redis cluster is not supported yet

Slide 36

Slide 36 text

Which Database Should I use?

Slide 37

Slide 37 text

Which Database Should I use? Up To You

Slide 38

Slide 38 text

Considerations for database - Use traditional RDBMS? - CAP Theorem - Datasize? - Scalable?

Slide 39

Slide 39 text

Storage - Persistent Disk Persistent Disk - Block storage - can be mounted on GCE

Slide 40

Slide 40 text

Storage - Cloud Storage Cloud Storage - Object Storage

Slide 41

Slide 41 text

GCP Products - Networking - Compute - Database and Storage - Big Data and Machine Learning - Developer Tools

Slide 42

Slide 42 text

Big Data

Slide 43

Slide 43 text

Big Data - BigQuery BigQuery - Serverless - Highly Scalable - Full-Managed Data Warehouse - Standard SQL

Slide 44

Slide 44 text

Big Data - Cloud Pub/Sub Cloud Pub/Sub - Event Stream (Queue) - Data Analytics - Event-driven Computing

Slide 45

Slide 45 text

Big Data - Cloud Dataflow Cloud Dataflow - Managed Apache Beam - Batch + Stream data processing

Slide 46

Slide 46 text

Big Data - Cloud Composer Cloud Composer - Managed Apache Airflow

Slide 47

Slide 47 text

Example Use-case of Big Data Product

Slide 48

Slide 48 text

Machine Learning

Slide 49

Slide 49 text

Machine Learning - ML Engine ML Engine - Create Custom Model - Tensorflow / XGBoost / scikit-learn - Managed JupyterLab with Deep Learning Image

Slide 50

Slide 50 text

Machine Learning - BQ ML BigQuery ML - Machine Learning with BigQuery - Linear regression - Binary logistic regression - Multiclass logistic regression for classification

Slide 51

Slide 51 text

Machine Learning - AutoML AutoML - Create Custom Model Easily - Just Prepare dataset - Vision - Natural Language - Translation

Slide 52

Slide 52 text

Machine Learning - ML APIs ML APIs - Trained Model by Google - Available as API

Slide 53

Slide 53 text

Which ML Product Should I use?

Slide 54

Slide 54 text

Which ML Product Should I use? Up To You

Slide 55

Slide 55 text

If you are a data analyst or marketing… - Try BQ ML Suggestions for ML on GCP

Slide 56

Slide 56 text

If you are a software engineer… - Try pre-trained model with ML APIs ﬁrst - Try custom model with AutoML - Consider custom model with ML Engine Suggestions for ML on GCP

Slide 57

Slide 57 text

GCP Products - Networking - Compute - Database and Storage - Big Data and Machine Learning - Developer Tools

Slide 58

Slide 58 text

Developer Tools

Slide 59

Slide 59 text

Developer Tools - Cloud Shell - Cloud Build - Cloud Source Code Repository - Cloud Registry

Slide 60

Slide 60 text

GKE Ecosystems: CI/CD Cloud Build - Fully-managed CI - 120 min free tiers per Day - Native Docker Support - Custom Builders - https://github.com/GoogleCloudPlatform /cloud-builders - https://github.com/GoogleCloudPlatform /cloud-builders-community https://speakerdeck.com/sakajunquality/starting-google-kubernetes-engine-2019

Slide 61

Slide 61 text

GKE Ecosystems: CI/CD More Kubernetes Specific: Simple GitOps from GitOps-style continuous delivery with Cloud Build https://cloud.google.com/kubernetes-engine/docs/tutorials/gitops-cloud-build?hl=en

Slide 62

Slide 62 text

Monitoring

Slide 63

Slide 63 text

Monitoring - Stackdriver

Slide 64

Slide 64 text

GKE Ecosystems: Monitoring Stackdriver Monitoring - Full-Stack Monitoring Suite - New Features - New Kubernetes Dashboard - Istio Integration - Prometheus Integration https://speakerdeck.com/sakajunquality/starting-google-kubernetes-engine-2019

Slide 65

Slide 65 text

GKE Ecosystems: Monitoring Stackdriver Logging - Full-managed Log platform - GKE has pre-installed fluentd - Collects Stdout/Stderr of containers - Parse JSON to structured log https://speakerdeck.com/sakajunquality/starting-google-kubernetes-engine-2019

Slide 66

Slide 66 text

3 Getting Started

Slide 67

Slide 67 text

Getting Started - Create a new account - Try “Quickstart” - Oﬃcial Support - Community Support

Slide 68

Slide 68 text

Create a new account https://goo.gl/2ib1Hs

Slide 69

Slide 69 text

Try “Quickstart”

Slide 70

Slide 70 text

Oﬃcial Support - Basic - Role-base - Enterprise - https://cloud.google.com/support/

Slide 71

Slide 71 text

gcpug.jp Community Support

Slide 72

Slide 72 text

4 Live Demo

Slide 73

Slide 73 text

Live Demo Maybe

Slide 74

Slide 74 text

5 Takeaways

Slide 75

Slide 75 text

Takeaways - Plenty of product is available in GCP - Try it out with “Quickstart” - Enjoy #gcpug