Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Navigating Google Cloud Platform

Navigating Google Cloud Platform

An introduction for all of GCP at I/O

Terrence Ryan

August 02, 2017
Tweet

More Decks by Terrence Ryan

Other Decks in Technology

Transcript

  1. View Slide

  2. View Slide

  3. Navigating Google Cloud Platform
    Your first week on GCP
    +Terrence Ryan
    @tpryan

    View Slide

  4. @tpryan
    Introduction

    View Slide

  5. @tpryan
    Who are you?

    View Slide

  6. @tpryan
    Help developers and sysadmins new
    to GCP identify the stuff they need
    Goal

    View Slide

  7. @tpryan

    View Slide

  8. @tpryan
    (╯°□°)╯︵ ┻━┻

    View Slide

  9. @tpryan
    ● Computing
    ● Networking
    ● Storage
    ● Big data
    ● Administration
    ● Development
    ● Machine learning
    Agenda

    View Slide

  10. @tpryan
    Computing
    Doing things

    View Slide

  11. @tpryan
    Virtual machines Containers Serverless
    Computing

    View Slide

  12. @tpryan
    Virtual Machines
    ● 1 - 64 processors
    ● .6 - 416 GB (.9 - 6.5 GB per proc)
    ● Disk limits
    ­ 65 TB Persistent
    ­ 3 TB SSD
    ­ 208 RAM
    ● Preconfigured images
    ● Can build your own
    ● Spin up in 10s of seconds
    Compute Engine

    View Slide

  13. @tpryan
    Virtual Machines
    ● Prebuilt software images
    ● Single systems
    ● Groups of systems
    Cloud Launcher

    View Slide

  14. @tpryan
    Compute Engine Demo
    Kick the tires and launch a few VMs

    View Slide

  15. @tpryan
    Containers

    View Slide

  16. @tpryan
    Containers
    ● Managed Kubernetes
    Container Engine

    View Slide

  17. @tpryan
    Kuber-what-es?

    View Slide

  18. @tpryan
    Frontend
    10.0.0.1
    Public
    130.91.x.x1
    API
    10.0.0.2
    Public
    130.91.x.x2
    Data
    10.0.0.3
    Kubernetes
    ● Container Orchestration System
    ● Allows for running a large number of containers
    in production
    ● Organizing them into workloads
    ­ Microservices
    Scheduled jobs
    Batch jobs

    View Slide

  19. @tpryan
    DNS
    Server
    Logging
    Service
    Discovery
    Monitoring
    !
    Kubernetes

    View Slide

  20. @tpryan
    DNS
    Server
    Logging
    Service
    Discovery
    Monitoring
    !

    View Slide

  21. @tpryan
    Container Engine demo
    Launch a few services

    View Slide

  22. @tpryan
    ● Managed Kubernetes
    (Containers as a service)
    ● Smart defaults for
    ­ Monitoring
    ­ Logging
    ­ DNS
    ­ Service Discovery
    ● Auto scaling
    Container Engine
    ● Custom Runtime
    ­ Bring your own Dockerfile
    ● Autoscaling
    ● Given one endpoint per service
    App Engine flexible environment

    View Slide

  23. @tpryan
    ● Container image storage
    ● Works with
    Container Engine
    App Engine flexible
    Docker
    Container Registry
    ● Container building as service
    ● Integrates with Container Registry
    ● Integrated with build processes
    Container Builder

    View Slide

  24. @tpryan
    ● Languages
    ­ Java 8 / Servlet 3.1 /
    ­ Jetty 9
    ­ Python 2.7 & 3.5
    ­ Node.js
    ­ Ruby
    ­ PHP
    ­ Go
    ­ Open capabilities
    App Engine flexible runtime
    ● Languages
    ­ Python 2.7
    ­ Java 7
    ­ PHP 5.5
    ­ Go
    ● Constrained capabilities
    ● Incredibly rapid scale
    App Engine standard runtime
    ● Javascript / Node.js
    ● Respond to events
    Cloud functions

    View Slide

  25. @tpryan
    App Engine Load Demo
    Quick demo showing App Engine in comparison
    to Compute Engine

    View Slide

  26. @tpryan
    Networking
    Connecting things

    View Slide

  27. @tpryan
    ● Create custom private cloud networks
    ● Set up custom routes to your other non-Google
    locations
    Cloud Virtual Network
    ● Create a dedicated connection to Google
    ● Direct Peer to one of our local or regional
    Points of Presence
    Cloud Interconnect

    View Slide

  28. @tpryan
    ● Gateway to Gateway Only
    ● Can be used to connect to any IPSEC compliant
    gateway
    VPN
    ● Set up rules
    ● Apply rules to tags
    ● Apply tags to hosts
    Firewall

    View Slide

  29. @tpryan
    ● Activate through our
    load balancers
    ● Uses HTTP headers to
    determine cacheability
    CDN
    ● Manage DNS on Google’s network
    ● SLA promises 100% availability of
    our Authoritative Name Servers
    DNS
    ● HTTP
    ● SSL
    ● Internal
    ● Network
    Load Balancers

    View Slide

  30. @tpryan
    What if I need
    something you don’t
    offer?

    View Slide

  31. @tpryan
    ● Build by hand
    Compute Engine
    ● Prebuilt solutions for:
    ­ Barracuda
    ­ Brocade
    ­ Cloudflare
    ­ more...
    Cloud Launcher

    View Slide

  32. @tpryan
    Storage
    Keeping things

    View Slide

  33. @tpryan
    Files Databases Big Data
    Storage

    View Slide

  34. @tpryan
    File Storage
    ● One set of interfaces
    ● Several types
    ­ Multi-regional
    ­ Regional
    ­ Nearline
    ­ Coldline
    Cloud Storage

    View Slide

  35. @tpryan
    Public Content Processed Data Long Term Storage
    File Storage

    View Slide

  36. @tpryan
    Public Processed Long Term Storage
    Characteristics 99.95% availability
    Geo-redundant
    99.9% availability
    Data stored in a narrow
    geographic region
    99.0% availability
    30-day minimum storage duration
    99.0% availability
    90-day minimum storage duration
    Uses Cases Frequently accessed
    World Audience
    Website content
    Streaming video
    Gaming
    Mobile
    Accessed by your system
    But not by your customers
    Big Data sets for processing
    Backup
    Long tail multimedia
    Disaster recovery
    Compliance archives
    Storage Cost
    GB/month
    $.026 $.02 $.01 $.007
    Retrieval Cost
    GB
    $.01 $.05
    Storage Type Multi-region Regional Nearline Coldline

    View Slide

  37. @tpryan
    NoSQL
    Application data
    SQL

    View Slide

  38. @tpryan
    ● Traditional SQL Server
    ● Vertically scalable
    ● Managed backups
    ● Easy to setup replicas
    ● Types
    ­ MySQL
    ­ Postgres
    Cloud SQL
    ● Structured data
    ● Highly available
    ● Strongly consistent
    ● CAP theorem says impossible
    ● Globally distributed
    ● Horizontally scalable
    Cloud Spanner

    View Slide

  39. @tpryan
    ● Document based
    ● Indexable
    ● Giant
    Cloud Datastore
    ● Columnar
    ● Low latency
    ● Hbase API compatible
    ● Needs scale to be cost effective
    Cloud Bigtable

    View Slide

  40. @tpryan
    Databases Big data
    Storage
    Files

    View Slide

  41. @tpryan
    Where do you store
    Big Data?

    View Slide

  42. @tpryan
    Cloud
    Datastore
    Cloud
    SQL
    Cloud
    Spanner
    Cloud
    Bigtable
    Cloud
    Storage

    View Slide

  43. @tpryan
    Big Data
    ● Pipe in semi-structured data
    ● Analyze it quickly
    ● Use SQL to do it.
    BigQuery

    View Slide

  44. @tpryan
    BigQuery Demo
    Quick demo showing BigQuery

    View Slide

  45. @tpryan
    ● Messaging Bus
    ● Many to many
    Pub/Sub
    ● Managed service for data analysis
    ● Apache Beam
    Dataflow
    ● Managed Spark and
    Hadoop
    ● With Autoscaling
    DataProc

    View Slide

  46. @tpryan
    Cloud
    Datastore
    Cloud
    SQL
    Cloud
    Spanner
    Cloud
    Bigtable
    BigQuery
    Translation
    API
    Natural
    Language API
    Speech
    API
    Vision
    API
    Cloud
    Dataflow
    Compute
    Engine
    App
    Engine
    Container
    Engine
    Cloud
    Functions
    Cloud
    Pub/Sub
    Cloud
    Storage

    View Slide

  47. @tpryan
    What if I need
    something you don’t
    offer?

    View Slide

  48. @tpryan
    ● Build by hand
    Compute Engine
    ● Prebuilt solutions for:
    ­ Cassandra
    Redis
    Mongo
    CouchDB
    more...
    Cloud Launcher

    View Slide

  49. @tpryan
    Administration
    Operations

    View Slide

  50. @tpryan
    ● Cross Cloud Logging
    ­ GCP
    AWS
    On Prem possible
    Stackdriver Logging
    ● Cross Cloud Monitoring
    ­ GCP
    ­ AWS
    ● Alerts based off
    ­ Logs
    ­ Uptime checks
    ­ Built in or Custom Metrics
    Stackdriver Monitoring

    View Slide

  51. @tpryan
    Security
    ● Allow for group of resources
    ● Role based permissions
    ● Fine grained controls
    ● Vary from product to product
    Cloud IAM

    View Slide

  52. @tpryan
    ● Gcloud
    ● gsutil
    CLI
    ● SDK for most languages
    ● REST endpoints
    ● Functional equivalent to gcloud
    API
    ● Repeatable Complex
    deployments
    ● Configs
    ● Templates
    ● Disk Images
    ● Network setup
    ● more
    Deployment Manager

    View Slide

  53. @tpryan
    Development
    Code

    View Slide

  54. @tpryan
    ● Gcloud
    ● gsutil
    SDK
    ● IntelliJ
    ● Android Studio
    ● Powershell
    ● Visual Studio
    ● Eclipse
    Plugins
    ● Cloud Source Repository
    Others

    View Slide

  55. @tpryan
    Reporting
    ● Automatic
    ­ App Engine
    ­ Load Balancers
    ● Enabled through an SDK
    ­ Java
    ­ Node.js
    ­ Go
    ­ Ruby
    ­ Zipkin
    ● Links to logs
    Stackdriver Trace

    View Slide

  56. @tpryan

    View Slide

  57. @tpryan
    Reporting
    ● Aggregate
    ● Logs or API
    ● Alerts
    Stackdriver Error Reporting

    View Slide

  58. @tpryan

    View Slide

  59. @tpryan
    Debugging
    ● App Engine
    Java
    Python
    Node.js
    Ruby
    ● Compute Engine
    Java
    Python
    Go
    Stackdriver Debugging

    View Slide

  60. @tpryan
    Services
    API Manager

    View Slide

  61. @tpryan
    Using Models Creating Models Extending Models
    Machine Learning

    View Slide

  62. @tpryan
    Natural Language API
    ● Syntax Analysis
    ● Entity
    Recognition
    ● Sentiment
    Analysis
    ● Multi-Language
    Speech API
    ● Automatic
    Speech
    Recognition
    ● Streaming
    ● 80 languages
    Translation API
    ● Language
    Detection
    ● Translation
    ● Whole document
    Vision API
    ● Face Detection
    ● Label Detection
    ● Logo Detection
    ● OCR
    Machine Learning

    View Slide

  63. @tpryan
    Machine Learning
    ● Managed Tensor Flow
    Cloud ML Engine

    View Slide

  64. @tpryan
    What-flow?

    View Slide

  65. @tpryan
    Machine Learning
    ● Open Source ML Library
    ● Builds models
    ● Allows you to compute with variable
    levels of CPU/GPU power
    Tensor Flow

    View Slide

  66. @tpryan
    Machine Learning
    ● Managed Tensor Flow
    ● Self-tuning
    ● Portable
    Cloud ML Engine

    View Slide

  67. @tpryan
    Conclusions
    ┬─┬ ノ( ゜-゜ノ)

    View Slide

  68. @tpryan
    There’s a lot of stuff
    here

    View Slide

  69. @tpryan

    View Slide

  70. @tpryan
    What’s next?
    Start a free trial
    cloud.google.com/free
    Stop by Dome Sandbox H

    View Slide

  71. Thank you!
    +Terrence Ryan
    @tpryan

    View Slide

  72. Thank you
    @tpryan

    View Slide

  73. @tpryan
    Connection Security Availability
    Networking

    View Slide

  74. @tpryan
    Reporting Security Configuration
    Administration

    View Slide

  75. @tpryan
    Coding Reporting Services
    Development

    View Slide

  76. @tpryan
    Development

    View Slide