Navigating Google Cloud Platform

Navigating Google Cloud Platform Your first week on GCP +Terrence
Ryan @tpryan

@tpryan Introduction

@tpryan Who are you?

@tpryan Help developers and sysadmins new to GCP identify the
stuff they need Goal

@tpryan

@tpryan (╯°□°)╯︵ ┻━┻

@tpryan • Computing • Networking • Storage • Big data
• Administration • Development • Machine learning Agenda

@tpryan Computing Doing things

@tpryan Virtual machines Containers Serverless Computing

@tpryan Virtual Machines • 1 - 64 processors • .6
- 416 GB (.9 - 6.5 GB per proc) • Disk limits 65 TB Persistent 3 TB SSD 208 RAM • Preconfigured images • Can build your own • Spin up in 10s of seconds Compute Engine

@tpryan Virtual Machines • Prebuilt software images • Single systems
• Groups of systems Cloud Launcher

@tpryan Compute Engine Demo Kick the tires and launch a
few VMs

@tpryan Containers

@tpryan Containers • Managed Kubernetes Container Engine

@tpryan Kuber-what-es?

@tpryan Frontend 10.0.0.1 Public 130.91.x.x1 API 10.0.0.2 Public 130.91.x.x2 Data
10.0.0.3 Kubernetes • Container Orchestration System • Allows for running a large number of containers in production • Organizing them into workloads Microservices Scheduled jobs Batch jobs

@tpryan DNS Server Logging Service Discovery Monitoring ! Kubernetes

@tpryan DNS Server Logging Service Discovery Monitoring !

@tpryan Container Engine demo Launch a few services

@tpryan • Managed Kubernetes (Containers as a service) • Smart
defaults for Monitoring Logging DNS Service Discovery • Auto scaling Container Engine • Custom Runtime Bring your own Dockerfile • Autoscaling • Given one endpoint per service App Engine flexible environment

@tpryan • Container image storage • Works with Container Engine
App Engine flexible Docker Container Registry • Container building as service • Integrates with Container Registry • Integrated with build processes Container Builder

@tpryan • Languages Java 8 / Servlet 3.1 /
Jetty 9 Python 2.7 & 3.5 Node.js Ruby PHP Go Open capabilities App Engine flexible runtime • Languages Python 2.7 Java 7 PHP 5.5 Go • Constrained capabilities • Incredibly rapid scale App Engine standard runtime • Javascript / Node.js • Respond to events Cloud functions

@tpryan App Engine Load Demo Quick demo showing App Engine
in comparison to Compute Engine

@tpryan Networking Connecting things

@tpryan • Create custom private cloud networks • Set up
custom routes to your other non-Google locations Cloud Virtual Network • Create a dedicated connection to Google • Direct Peer to one of our local or regional Points of Presence Cloud Interconnect

@tpryan • Gateway to Gateway Only • Can be used
to connect to any IPSEC compliant gateway VPN • Set up rules • Apply rules to tags • Apply tags to hosts Firewall

@tpryan • Activate through our load balancers • Uses HTTP
headers to determine cacheability CDN • Manage DNS on Google’s network • SLA promises 100% availability of our Authoritative Name Servers DNS • HTTP • SSL • Internal • Network Load Balancers

@tpryan What if I need something you don’t offer?

@tpryan • Build by hand Compute Engine • Prebuilt solutions
for: Barracuda Brocade Cloudflare more... Cloud Launcher

@tpryan Storage Keeping things

@tpryan Files Databases Big Data Storage

@tpryan File Storage • One set of interfaces • Several
types Multi-regional Regional Nearline Coldline Cloud Storage

@tpryan Public Content Processed Data Long Term Storage File Storage

@tpryan Public Processed Long Term Storage Characteristics 99.95% availability Geo-redundant
99.9% availability Data stored in a narrow geographic region 99.0% availability 30-day minimum storage duration 99.0% availability 90-day minimum storage duration Uses Cases Frequently accessed World Audience Website content Streaming video Gaming Mobile Accessed by your system But not by your customers Big Data sets for processing Backup Long tail multimedia Disaster recovery Compliance archives Storage Cost GB/month $.026 $.02 $.01 $.007 Retrieval Cost GB $.01 $.05 Storage Type Multi-region Regional Nearline Coldline

@tpryan NoSQL Application data SQL

@tpryan • Traditional SQL Server • Vertically scalable • Managed
backups • Easy to setup replicas • Types MySQL Postgres Cloud SQL • Structured data • Highly available • Strongly consistent • CAP theorem says impossible • Globally distributed • Horizontally scalable Cloud Spanner

@tpryan • Document based • Indexable • Giant Cloud Datastore
• Columnar • Low latency • Hbase API compatible • Needs scale to be cost effective Cloud Bigtable

@tpryan Databases Big data Storage Files

@tpryan Where do you store Big Data?

@tpryan Cloud Datastore Cloud SQL Cloud Spanner Cloud Bigtable Cloud
Storage

@tpryan Big Data • Pipe in semi-structured data • Analyze
it quickly • Use SQL to do it. BigQuery

@tpryan BigQuery Demo Quick demo showing BigQuery

@tpryan • Messaging Bus • Many to many Pub/Sub •
Managed service for data analysis • Apache Beam Dataflow • Managed Spark and Hadoop • With Autoscaling DataProc

@tpryan Cloud Datastore Cloud SQL Cloud Spanner Cloud Bigtable BigQuery
Translation API Natural Language API Speech API Vision API Cloud Dataflow Compute Engine App Engine Container Engine Cloud Functions Cloud Pub/Sub Cloud Storage

@tpryan What if I need something you don’t offer?

@tpryan • Build by hand Compute Engine • Prebuilt solutions
for: Cassandra Redis Mongo CouchDB more... Cloud Launcher

@tpryan Administration Operations

@tpryan • Cross Cloud Logging GCP AWS On Prem
possible Stackdriver Logging • Cross Cloud Monitoring GCP AWS • Alerts based off Logs Uptime checks Built in or Custom Metrics Stackdriver Monitoring

@tpryan Security • Allow for group of resources • Role
based permissions • Fine grained controls • Vary from product to product Cloud IAM

@tpryan • Gcloud • gsutil CLI • SDK for most
languages • REST endpoints • Functional equivalent to gcloud API • Repeatable Complex deployments • Configs • Templates • Disk Images • Network setup • more Deployment Manager

@tpryan Development Code

@tpryan • Gcloud • gsutil SDK • IntelliJ • Android
Studio • Powershell • Visual Studio • Eclipse Plugins • Cloud Source Repository Others

@tpryan Reporting • Automatic App Engine Load Balancers
• Enabled through an SDK Java Node.js Go Ruby Zipkin • Links to logs Stackdriver Trace

@tpryan

@tpryan Reporting • Aggregate • Logs or API • Alerts
Stackdriver Error Reporting

@tpryan

@tpryan Debugging • App Engine Java Python Node.js Ruby •
Compute Engine Java Python Go Stackdriver Debugging

@tpryan Services API Manager

@tpryan Using Models Creating Models Extending Models Machine Learning

@tpryan Natural Language API • Syntax Analysis • Entity Recognition
• Sentiment Analysis • Multi-Language Speech API • Automatic Speech Recognition • Streaming • 80 languages Translation API • Language Detection • Translation • Whole document Vision API • Face Detection • Label Detection • Logo Detection • OCR Machine Learning

@tpryan Machine Learning • Managed Tensor Flow Cloud ML Engine

@tpryan What-flow?

@tpryan Machine Learning • Open Source ML Library • Builds
models • Allows you to compute with variable levels of CPU/GPU power Tensor Flow

@tpryan Machine Learning • Managed Tensor Flow • Self-tuning •
Portable Cloud ML Engine

@tpryan Conclusions ┬─┬ ノ( ゜-゜ノ)

@tpryan There’s a lot of stuff here

@tpryan

@tpryan What’s next? Start a free trial cloud.google.com/free Stop by
Dome Sandbox H

Thank you! +Terrence Ryan @tpryan

Thank you @tpryan

@tpryan Connection Security Availability Networking

@tpryan Reporting Security Configuration Administration

@tpryan Coding Reporting Services Development

@tpryan Development

Navigating Google Cloud Platform

Navigating Google Cloud Platform

More Decks by Terrence Ryan

Other Decks in Technology

Featured

Transcript