Upgrade to Pro — share decks privately, control downloads, hide ads and more …

GCP 2015/2016 Updates @ GCPUG Hanoi

GCP 2015/2016 Updates @ GCPUG Hanoi

Ian Lewis

May 28, 2016
Tweet

More Decks by Ian Lewis

Other Decks in Technology

Transcript

  1. Confidential & Proprietary Google Cloud Platform 2 Ian Lewis Developer

    Advocate - Google Cloud Platform Tokyo, Japan google.com/+IanLewis-hoge @IanMLewis
  2. Confidential & Proprietary Google Cloud Platform 4 Cloud Bigtable Q2

    2015 Q3 2015 Q4 2015 Q1 2016 GKE GA Dataflow GA Tensorflow Cloud Vision API Innovation
  3. Confidential & Proprietary Google Cloud Platform 5 Networking Management Networking

    Big Data Storage Machine Learning Developer Tools Compute Engine Container Engine Compute Google Cloud Platform Compute
  4. Confidential & Proprietary Google Cloud Platform 6 Compute Engine •

    Custom Instance Types • Change size of volume without downtime • Persistent disks up to 64TB • Preemptable Instances GA
  5. @tekgrrl #gcpug #googlecloud Greek for “Helmsman”; also the root of

    the word “Governor” • Orchestrator for Docker containers • Supports multi-cloud environments • Inspired and informed by Google’s experiences and internal systems • Open source, written in Go Manage applications, not machines Kubernetes
  6. @tekgrrl #gcpug #googlecloud • Ready for Production since 1.0 •

    Speed and Stability improvements • Deployments • Ingress • ConfigMaps • Horizontal Pod Autoscaler • New Dashboard UI Kubernetes 1.2
  7. @tekgrrl #gcpug #googlecloud • GA (Aug 2015) • Managed Kubernetes

    • Manages Kubernetes Uptime • Manages Updates • Cloud Logging • Use Google Cloud VPN to have cluster IPs coexist with your private network IPs Google Container Engine
  8. 10 • Part of HTTP load balancer backends • Cache

    data at the edge of Google’ s network Google Cloud CDN
  9. Confidential & Proprietary Google Cloud Platform 11 Management Networking Compute

    Big Data Storage Machine Learning Developer Tools Google Cloud Platform Big Data Cloud Dataproc Cloud Dataflow BigQuery
  10. Confidential & Proprietary Google Cloud Platform 12 BigQuery • Long

    Term Storage Pricing • Query Explain • User Defined Functions (UDFs)
  11. 14 • GA (Aug 2015) • Stream + Batch Processing

    • Apache Beam Google Cloud Dataflow
  12. 15 • GA (Feb 2016) • Managed Hadoop, Spark, Pig,

    and Hive • Create data managed data processing clusters in a few clicks Google Cloud Dataproc
  13. Confidential & Proprietary Google Cloud Platform 16 Management Networking Compute

    Big Data Storage Machine Learning Developer Tools Google Cloud Platform Storage Cloud Bigtable
  14. 17 • Beta (May 2015) • Supports HBase API (Managed

    HBase) • The same database that powers Search, Analytics, Maps, and Gmail. • Read/Write p99% latency <6ms Google Cloud Bigtable
  15. Cloud Translate API Cloud Prediction API Cloud Vision API Fully

    trained, easy to use Machine Learning models
  16. Confidential & Proprietary Google Cloud Platform 20 Vision API •

    Classify Images by Tag • Detect Faces and Sentiment • Detect inappropriate content • Text Detection (OCR) • Landmark & Logo Detection
  17. Confidential & Proprietary Google Cloud Platform 25 Tensorflow • General

    Purpose Machine Learning Library • Python (Core in C++) • Models can run on many devices (even Android!) • Use models in production using Tensorflow Serve • Distributed version that uses gRPC
  18. # define the network import tensorflow as tf x =

    tf.placeholder(tf.float32, [None, 784]) W = tf.Variable(tf.zeros([784, 10])) b = tf.Variable(tf.zeros([10])) y = tf.nn.softmax(tf.matmul(x, W) + b) # define a training step y_ = tf.placeholder(tf.float32, [None, 10]) xent = -tf.reduce_sum(y_*tf.log(y)) step = tf.train.GradientDescentOptimizer(0.01).minimize (xent) Example
  19. Fully managed, distributed training and prediction for custom TensorFlow graph

    Supports Regression and Classification initially Integrated with Cloud Dataflow and Cloud Datalab Limited Preview - cloud.google.com/ml Cloud Machine Learning (Cloud ML)
  20. ALPHA Use your own data to train models GA GA

    Cloud Storage Google BigQuery Cloud Machine Learning Cloud Datalab BETA Develop / Model / Test