Navigating Google Cloud Platform

Navigating Google Cloud Platform

An introduction for all of GCP at I/O

6c18ceafef161be26ae441469b29c475?s=128

Terrence Ryan

August 02, 2017
Tweet

Transcript

  1. None
  2. None
  3. Navigating Google Cloud Platform Your first week on GCP +Terrence

    Ryan @tpryan
  4. @tpryan Introduction

  5. @tpryan Who are you?

  6. @tpryan Help developers and sysadmins new to GCP identify the

    stuff they need Goal
  7. @tpryan

  8. @tpryan (╯°□°)╯︵ ┻━┻

  9. @tpryan • Computing • Networking • Storage • Big data

    • Administration • Development • Machine learning Agenda
  10. @tpryan Computing Doing things

  11. @tpryan Virtual machines Containers Serverless Computing

  12. @tpryan Virtual Machines • 1 - 64 processors • .6

    - 416 GB (.9 - 6.5 GB per proc) • Disk limits ­ 65 TB Persistent ­ 3 TB SSD ­ 208 RAM • Preconfigured images • Can build your own • Spin up in 10s of seconds Compute Engine
  13. @tpryan Virtual Machines • Prebuilt software images • Single systems

    • Groups of systems Cloud Launcher
  14. @tpryan Compute Engine Demo Kick the tires and launch a

    few VMs
  15. @tpryan Containers

  16. @tpryan Containers • Managed Kubernetes Container Engine

  17. @tpryan Kuber-what-es?

  18. @tpryan Frontend 10.0.0.1 Public 130.91.x.x1 API 10.0.0.2 Public 130.91.x.x2 Data

    10.0.0.3 Kubernetes • Container Orchestration System • Allows for running a large number of containers in production • Organizing them into workloads ­ Microservices Scheduled jobs Batch jobs
  19. @tpryan DNS Server Logging Service Discovery Monitoring ! Kubernetes

  20. @tpryan DNS Server Logging Service Discovery Monitoring !

  21. @tpryan Container Engine demo Launch a few services

  22. @tpryan • Managed Kubernetes (Containers as a service) • Smart

    defaults for ­ Monitoring ­ Logging ­ DNS ­ Service Discovery • Auto scaling Container Engine • Custom Runtime ­ Bring your own Dockerfile • Autoscaling • Given one endpoint per service App Engine flexible environment
  23. @tpryan • Container image storage • Works with Container Engine

    App Engine flexible Docker Container Registry • Container building as service • Integrates with Container Registry • Integrated with build processes Container Builder
  24. @tpryan • Languages ­ Java 8 / Servlet 3.1 /

    ­ Jetty 9 ­ Python 2.7 & 3.5 ­ Node.js ­ Ruby ­ PHP ­ Go ­ Open capabilities App Engine flexible runtime • Languages ­ Python 2.7 ­ Java 7 ­ PHP 5.5 ­ Go • Constrained capabilities • Incredibly rapid scale App Engine standard runtime • Javascript / Node.js • Respond to events Cloud functions
  25. @tpryan App Engine Load Demo Quick demo showing App Engine

    in comparison to Compute Engine
  26. @tpryan Networking Connecting things

  27. @tpryan • Create custom private cloud networks • Set up

    custom routes to your other non-Google locations Cloud Virtual Network • Create a dedicated connection to Google • Direct Peer to one of our local or regional Points of Presence Cloud Interconnect
  28. @tpryan • Gateway to Gateway Only • Can be used

    to connect to any IPSEC compliant gateway VPN • Set up rules • Apply rules to tags • Apply tags to hosts Firewall
  29. @tpryan • Activate through our load balancers • Uses HTTP

    headers to determine cacheability CDN • Manage DNS on Google’s network • SLA promises 100% availability of our Authoritative Name Servers DNS • HTTP • SSL • Internal • Network Load Balancers
  30. @tpryan What if I need something you don’t offer?

  31. @tpryan • Build by hand Compute Engine • Prebuilt solutions

    for: ­ Barracuda ­ Brocade ­ Cloudflare ­ more... Cloud Launcher
  32. @tpryan Storage Keeping things

  33. @tpryan Files Databases Big Data Storage

  34. @tpryan File Storage • One set of interfaces • Several

    types ­ Multi-regional ­ Regional ­ Nearline ­ Coldline Cloud Storage
  35. @tpryan Public Content Processed Data Long Term Storage File Storage

  36. @tpryan Public Processed Long Term Storage Characteristics 99.95% availability Geo-redundant

    99.9% availability Data stored in a narrow geographic region 99.0% availability 30-day minimum storage duration 99.0% availability 90-day minimum storage duration Uses Cases Frequently accessed World Audience Website content Streaming video Gaming Mobile Accessed by your system But not by your customers Big Data sets for processing Backup Long tail multimedia Disaster recovery Compliance archives Storage Cost GB/month $.026 $.02 $.01 $.007 Retrieval Cost GB $.01 $.05 Storage Type Multi-region Regional Nearline Coldline
  37. @tpryan NoSQL Application data SQL

  38. @tpryan • Traditional SQL Server • Vertically scalable • Managed

    backups • Easy to setup replicas • Types ­ MySQL ­ Postgres Cloud SQL • Structured data • Highly available • Strongly consistent • CAP theorem says impossible • Globally distributed • Horizontally scalable Cloud Spanner
  39. @tpryan • Document based • Indexable • Giant Cloud Datastore

    • Columnar • Low latency • Hbase API compatible • Needs scale to be cost effective Cloud Bigtable
  40. @tpryan Databases Big data Storage Files

  41. @tpryan Where do you store Big Data?

  42. @tpryan Cloud Datastore Cloud SQL Cloud Spanner Cloud Bigtable Cloud

    Storage
  43. @tpryan Big Data • Pipe in semi-structured data • Analyze

    it quickly • Use SQL to do it. BigQuery
  44. @tpryan BigQuery Demo Quick demo showing BigQuery

  45. @tpryan • Messaging Bus • Many to many Pub/Sub •

    Managed service for data analysis • Apache Beam Dataflow • Managed Spark and Hadoop • With Autoscaling DataProc
  46. @tpryan Cloud Datastore Cloud SQL Cloud Spanner Cloud Bigtable BigQuery

    Translation API Natural Language API Speech API Vision API Cloud Dataflow Compute Engine App Engine Container Engine Cloud Functions Cloud Pub/Sub Cloud Storage
  47. @tpryan What if I need something you don’t offer?

  48. @tpryan • Build by hand Compute Engine • Prebuilt solutions

    for: ­ Cassandra Redis Mongo CouchDB more... Cloud Launcher
  49. @tpryan Administration Operations

  50. @tpryan • Cross Cloud Logging ­ GCP AWS On Prem

    possible Stackdriver Logging • Cross Cloud Monitoring ­ GCP ­ AWS • Alerts based off ­ Logs ­ Uptime checks ­ Built in or Custom Metrics Stackdriver Monitoring
  51. @tpryan Security • Allow for group of resources • Role

    based permissions • Fine grained controls • Vary from product to product Cloud IAM
  52. @tpryan • Gcloud • gsutil CLI • SDK for most

    languages • REST endpoints • Functional equivalent to gcloud API • Repeatable Complex deployments • Configs • Templates • Disk Images • Network setup • more Deployment Manager
  53. @tpryan Development Code

  54. @tpryan • Gcloud • gsutil SDK • IntelliJ • Android

    Studio • Powershell • Visual Studio • Eclipse Plugins • Cloud Source Repository Others
  55. @tpryan Reporting • Automatic ­ App Engine ­ Load Balancers

    • Enabled through an SDK ­ Java ­ Node.js ­ Go ­ Ruby ­ Zipkin • Links to logs Stackdriver Trace
  56. @tpryan

  57. @tpryan Reporting • Aggregate • Logs or API • Alerts

    Stackdriver Error Reporting
  58. @tpryan

  59. @tpryan Debugging • App Engine Java Python Node.js Ruby •

    Compute Engine Java Python Go Stackdriver Debugging
  60. @tpryan Services API Manager

  61. @tpryan Using Models Creating Models Extending Models Machine Learning

  62. @tpryan Natural Language API • Syntax Analysis • Entity Recognition

    • Sentiment Analysis • Multi-Language Speech API • Automatic Speech Recognition • Streaming • 80 languages Translation API • Language Detection • Translation • Whole document Vision API • Face Detection • Label Detection • Logo Detection • OCR Machine Learning
  63. @tpryan Machine Learning • Managed Tensor Flow Cloud ML Engine

  64. @tpryan What-flow?

  65. @tpryan Machine Learning • Open Source ML Library • Builds

    models • Allows you to compute with variable levels of CPU/GPU power Tensor Flow
  66. @tpryan Machine Learning • Managed Tensor Flow • Self-tuning •

    Portable Cloud ML Engine
  67. @tpryan Conclusions ┬─┬ ノ( ゜-゜ノ)

  68. @tpryan There’s a lot of stuff here

  69. @tpryan

  70. @tpryan What’s next? Start a free trial cloud.google.com/free Stop by

    Dome Sandbox H
  71. Thank you! +Terrence Ryan @tpryan

  72. Thank you @tpryan

  73. @tpryan Connection Security Availability Networking

  74. @tpryan Reporting Security Configuration Administration

  75. @tpryan Coding Reporting Services Development

  76. @tpryan Development