Share
Embed
GCP 2015/2016 Updates @ GCPUG Hanoi
Ian Lewis
May 28, 2016
Transcript
32 slides
-
Confidential & Proprietary Google Cloud Platform 2 Ian Lewis Developer
Advocate - Google Cloud Platform Tokyo, Japan google.com/+IanLewis-hoge @IanMLewis -
Confidential & Proprietary Google Cloud Platform 4 Cloud Bigtable Q2
2015 Q3 2015 Q4 2015 Q1 2016 GKE GA Dataflow GA Tensorflow Cloud Vision API Innovation -
Confidential & Proprietary Google Cloud Platform 5 Networking Management Networking
Big Data Storage Machine Learning Developer Tools Compute Engine Container Engine Compute Google Cloud Platform Compute -
Confidential & Proprietary Google Cloud Platform 6 Compute Engine •
Custom Instance Types • Change size of volume without downtime • Persistent disks up to 64TB • Preemptable Instances GA -
@tekgrrl #gcpug #googlecloud Greek for “Helmsman”; also the root of
the word “Governor” • Orchestrator for Docker containers • Supports multi-cloud environments • Inspired and informed by Google’s experiences and internal systems • Open source, written in Go Manage applications, not machines Kubernetes -
@tekgrrl #gcpug #googlecloud • Ready for Production since 1.0 •
Speed and Stability improvements • Deployments • Ingress • ConfigMaps • Horizontal Pod Autoscaler • New Dashboard UI Kubernetes 1.2 -
@tekgrrl #gcpug #googlecloud • GA (Aug 2015) • Managed Kubernetes
• Manages Kubernetes Uptime • Manages Updates • Cloud Logging • Use Google Cloud VPN to have cluster IPs coexist with your private network IPs Google Container Engine -
10 • Part of HTTP load balancer backends • Cache
data at the edge of Google’ s network Google Cloud CDN -
Confidential & Proprietary Google Cloud Platform 11 Management Networking Compute
Big Data Storage Machine Learning Developer Tools Google Cloud Platform Big Data Cloud Dataproc Cloud Dataflow BigQuery -
Confidential & Proprietary Google Cloud Platform 12 BigQuery • Long
Term Storage Pricing • Query Explain • User Defined Functions (UDFs) -
14 • GA (Aug 2015) • Stream + Batch Processing
• Apache Beam Google Cloud Dataflow -
15 • GA (Feb 2016) • Managed Hadoop, Spark, Pig,
and Hive • Create data managed data processing clusters in a few clicks Google Cloud Dataproc -
Confidential & Proprietary Google Cloud Platform 16 Management Networking Compute
Big Data Storage Machine Learning Developer Tools Google Cloud Platform Storage Cloud Bigtable -
17 • Beta (May 2015) • Supports HBase API (Managed
HBase) • The same database that powers Search, Analytics, Maps, and Gmail. • Read/Write p99% latency <6ms Google Cloud Bigtable -
Cloud Translate API Cloud Prediction API Cloud Vision API Fully
trained, easy to use Machine Learning models -
Confidential & Proprietary Google Cloud Platform 20 Vision API •
Classify Images by Tag • Detect Faces and Sentiment • Detect inappropriate content • Text Detection (OCR) • Landmark & Logo Detection -
Confidential & Proprietary Google Cloud Platform 25 Tensorflow • General
Purpose Machine Learning Library • Python (Core in C++) • Models can run on many devices (even Android!) • Use models in production using Tensorflow Serve • Distributed version that uses gRPC -
# define the network import tensorflow as tf x =
tf.placeholder(tf.float32, [None, 784]) W = tf.Variable(tf.zeros([784, 10])) b = tf.Variable(tf.zeros([10])) y = tf.nn.softmax(tf.matmul(x, W) + b) # define a training step y_ = tf.placeholder(tf.float32, [None, 10]) xent = -tf.reduce_sum(y_*tf.log(y)) step = tf.train.GradientDescentOptimizer(0.01).minimize (xent) Example -
Fully managed, distributed training and prediction for custom TensorFlow graph
Supports Regression and Classification initially Integrated with Cloud Dataflow and Cloud Datalab Limited Preview - cloud.google.com/ml Cloud Machine Learning (Cloud ML) -
ALPHA Use your own data to train models GA GA
Cloud Storage Google BigQuery Cloud Machine Learning Cloud Datalab BETA Develop / Model / Test