Slide 1

Slide 1 text

August 31, 2016 Joe Intrakamhang, Deanna Rowe Solutions Engineers Google Cloud Platform Overview Demo’s galore

Slide 2

Slide 2 text

Confidential & Proprietary Google Cloud Platform 2 Joe Intrakamhang Solutions Engineer Chicago Email: [email protected] Deanna Rowe Solutions Engineer Chicago Email: [email protected]

Slide 3

Slide 3 text

01 Introduction Google as a Cloud Service Provider

Slide 4

Slide 4 text

For the past 16 years, Google has been building the world’s fastest, most powerful cloud infrastructure on the planet.

Slide 5

Slide 5 text

Confidential & Proprietary Google Cloud Platform 5 2012 2014 2002 2004 2006 2008 2010 Google Research Publications referenced are available here: http://research.google.com/pubs/papers.html The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 2009 http://research.google.com/pubs/pub35290.html GFS MapReduce Bigtable Google research in data technologies Colossus Dremel Flume Megastore Spanner Millwheel F1 PubSub 2016 Borg

Slide 6

Slide 6 text

Confidential & Proprietary Google Cloud Platform 6 2012 2014 2002 2004 2006 2008 2010 GFS MapReduce Bigtable Google research in data technologies Colossus Dremel Flume Megastore Spanner Millwheel F1 PubSub 2016 Borg Tensor Flow

Slide 7

Slide 7 text

Confidential & Proprietary Google Cloud Platform 7 2012 2014 2002 2004 2006 2008 2010 GFS MapReduce Bigtable Google research in data technologies Colossus Dremel Flume Megastore Spanner Millwheel F1 PubSub 2016 Borg Tensor Flow ? ?

Slide 8

Slide 8 text

02 Google Technical Infrastructure

Slide 9

Slide 9 text

Confidential & Proprietary Google Cloud Platform 9 “[Google's] ability to build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels. This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.” - Wired Images by Connie Zhou

Slide 10

Slide 10 text

Google backbone We lay our own cables across the ocean Google confidential │ Do not distribute

Slide 11

Slide 11 text

Global Network World’s Largest SDN Edge locations in 33 countries 100+ peering locations Global CDN Global Load Balancing with single Anycast IP Seamlessly autoscale to over 1M QPS with no pre-warming

Slide 12

Slide 12 text

Sustainability Google datacenters have half the overhead of typical industry datacenters Largest private investor in renewables: $2 billion generating 3.2 GW Applying Machine Learning produced 40% reduction in cooling energy

Slide 13

Slide 13 text

13 10 more coming by end of 2017 Google Cloud Regions Oregon Tokyo

Slide 14

Slide 14 text

03 Cloud Platform Services

Slide 15

Slide 15 text

© 2016 Google 15 Cloud Storage Cloud SQL Cloud Datastore Big Table Storage Compute Engine (IaaS) App Engine (PaaS) Container Engine (powered by Kubernetes) Compute BigQuery Pub/Sub Dataflow Big Data Dataproc Datalab Translate API Cloud Vision Speech API Machine Learning Cloud ML

Slide 16

Slide 16 text

04 Compute

Slide 17

Slide 17 text

Compute Engine App Engine Container Engine Continuum of Compute Virtualized hardware Abstracted computing power Manages your container cluster and actively schedules your containers Infrastructure at Google speed Build your scalable app faster

Slide 18

Slide 18 text

High-performance Virtual Machines Consistently performant, scalable, highly secure & reliable. (Really) Pay for what you use We bill in minute-level increments so you don’t pay for unused computing time, and automatically apply sustained use discounts. Fast, Easy Provisioning Quickly deploy large clusters of virtual machines with intuitive tools. Compliance & Security All data written to disk in Compute Engine is encrypted on the fly and then transmitted and stored in encrypted form. Compute Engine Batch Run short duration, heavy compute jobs. The more flexibility in timing and location you give us the better the pricing! $

Slide 19

Slide 19 text

Confidential & Proprietary Google Cloud Platform 19 Compute Engine Demo

Slide 20

Slide 20 text

Confidential & Proprietary Google Cloud Platform 20 Live migration for transparent maintenance (cont’d)

Slide 21

Slide 21 text

Declarative management Declare your containers’ requirements, such as the amount of CPU/memory to reserve and keepalive policy, in a simple JSON config file. Container Engine will schedule your containers as declared. Better ops Your container cluster is equipped with capabilities, such as logging, container health checking, and autoscaling, to make application management easier. Docker support Container Engine supports the common Docker container format. And with Google Container Registry, Cloud Platform makes it easy to store and access your private Docker images. Managed container cluster Spin up a managed container cluster of virtual machines, ready for deployment. The vm nodes that comprise your cluster are fully managed, ensuring they are healthy and updated with critical patches. Container Engine Cloud flexibility With Red Hat, Microsoft, IBM, Mirantis OpenStack, and VMWare -- and the list keeps growing -- working to integrate Kubernetes into their platforms, you’ll be able to move workloads, or take advantage of multiple cloud providers, more easily.

Slide 22

Slide 22 text

Powerful built-in services Managed services, such as Task Queues, Memcache and the Users API, let you build any application. Deploy at Google scale You can scale up to 7 billion requests per day and automatically scale down when traffic subsides. Focus on your code Let Google worry about database administration, server configuration, sharding & load balancing. Popular languages & frameworks Write applications in some of the most popular programming languages, use existing frameworks and integrate with other familiar technologies. App Engine Familiar development tools Use the tools you know, including Eclipse, IntellIJ, Maven, Git, Jenkins, PyCharm & more. Multiple storage options Choose the storage option you need: a traditional MySQL database using Cloud SQL, a schemaless NoSQL datastore, or object storage using Cloud Storage.

Slide 23

Slide 23 text

23 Provision server and infra environments ● Install web and database servers ● Stitch it all together - db connection strings ● Duplicate for dev, test, and prod Manage the app ● Deploy it ● Scale it ● Pager duty What would it take to launch this tiny app? This is a 90s style guestbook. All it needs is a rotating GIF.

Slide 24

Slide 24 text

24 Focus on code, not infrastructure

Slide 25

Slide 25 text

25 Build efficiently with tools, services & APIs Integrated developer experience ● Integrated SDK across Cloud Platform ● Compile source into binary containers with one command Easy microservices ● Built-in API for building microservices App versioning and A/B testing ● Application versioning and traffic splitting for slow rollouts / rollbacks ● A/B testing across multiple experiments Common app building blocks ● Managed services and APIs for storage, queueing, caching, logging, and auth

Slide 26

Slide 26 text

Confidential & Proprietary Google Cloud Platform 26 App Engine Demo

Slide 27

Slide 27 text

05 Data Storage Solutions

Slide 28

Slide 28 text

NoSQL SQL Blob Block Easy-to-use storage options

Slide 29

Slide 29 text

Cloud Storage Cloud Datastore Cloud SQL Storage Store and manage data using a fully-managed, relational MySQL database Powerful, simple and cost effective object storage service Managed, NoSQL, schemaless database for storing non-relational data

Slide 30

Slide 30 text

Durable Reduced Availability Storage Durable Reduced Availability (DRA) Storage has lower cost and lower availability than Standard Storage but is designed to have the same durability and performance as Standard Storage. Standard Storage Standard Storage provides the highest level of durability, availability and performance of all Google Cloud Storage services. It’s specifically designed for use cases requiring low latency and frequent data access, such as website content distribution and video streaming. Standard storage is all about performance. Simple Access Google created three simple product options to help you improve the performance of your applications while keeping your costs low. These three product options use the same API, providing you with a simple and consistent method of access. Cloud Storage Nearline Storage Nearline Storage is a low-cost, highly durable storage service for data archiving, online backup, and disaster recovery. Unlike other cloud or on-premises archive and backup offerings, you don’t have to wait hours or days to retrieve or access your data.

Slide 31

Slide 31 text

ACID Transactions Cloud Datastore provides ACID transactions using optimistic concurrency control. Your application can execute multiple datastore operations in a single transaction in which either all succeed or all fail, ensuring the integrity of your data. Managed Database Cloud Datastore is fully managed. Google automatically handles sharding and replication in order to provide you with a highly available & consistent database. Autoscale with your users Cloud Datastore automatically scales depending on your needs. This allows you to focus on building your application and not on worrying about provisioning & load anticipation. Built-in Redundancy With a single API call, data is automatically replicated across multiple data centers. High availability & durability are built in from the very core. Cloud Datastore Schemaless Access with SQL-like querying No need to worry about data models and migration. Cloud Datastore is a schemaless storage service that allows you to be agile by removing the need to think about the underlying structure of the data. Access your data from anywhere Build solutions that span App Engine and Compute Engine, and rely on Cloud Datastore as the integration point. With the RESTful interface that is exposed by Cloud Datastore, data can easily be accessed by any deployment target.

Slide 32

Slide 32 text

Control It's easy to manage and access your instances through a web Console or a command-line interface. Transfer data to your instance by importing and exporting databases and CSV files. Flexible Charging If you're running a lightly or sporadically used database, you'll save money by only paying for the time you access your data. Easier Migration; No Lock-in Standard connections and tools such as mysqldump, MySQL Wire Protocol, and JDBC make it easier to migrate onto (or off!) Google Cloud Platform, and avoids lock-in. Familiar Infrastructure Build and deploy for the cloud faster because Cloud SQL offers standard MySQL databases, the most popular open source database in the world. Instances available up to 16GB RAM, 100GB storage. Cloud SQL Fully managed No worrying about replication, patch management or database management: we take care of it. Security, Availability, Durability Your data is replicated in many geographic locations as standard, and failover between them is handled automatically. We also manage your backups, making it easy for you to restore when needed, including point-in-time recovery.

Slide 33

Slide 33 text

What is BigQuery? Externalization of Google Dremel Convenience of SQL Petabyte-Scale and Fast Fully Managed, No-Ops Data Warehouse

Slide 34

Slide 34 text

Confidential & Proprietary Google Cloud Platform 34 BQ Demo

Slide 35

Slide 35 text

Fun BigQuery Stats Streaming ingest at peak Largest Data Lake on BigQuery Largest query by data size Largest query by rows 10.5 Trillion rows 2.3 Million rows per second 38 Petabytes 2.1 Petabytes

Slide 36

Slide 36 text

Most importantly, complexity is hidden from end user We only paid $20 We just rented 9000 cores from Google for ~45 seconds 1 2 3 BigQuery - explained 4 End users do not need to think about cores

Slide 37

Slide 37 text

06 Machine Learning

Slide 38

Slide 38 text

TensorFlow ● Deep Learning technology currently powering over 100 Google services ● Generalizable to vision, sound, text, video and other data ● Runs on CPUs or GPUs, desktop, server, or mobile computing platforms. ● Distributed via Apache 2.0 OSS license

Slide 39

Slide 39 text

What Cloud Machine Learning Can Do ● Fully managed service ● Train using a custom TensorFlow graph ● Batch and online predictions at scale ● Integrated Datalab experience ● Regression and classification tasks ● Runs on Google Brain using GPU & TPU

Slide 40

Slide 40 text

Fully trained, easy to use Machine Learning models Cloud Translate Cloud Vision Cloud Speech Cloud Natural Language Stay tuned…

Slide 41

Slide 41 text

Cloud Vision API Insight from images with our powerful Cloud Vision API

Slide 42

Slide 42 text

Cloud Vision API Label Detection Landmark Detection OCR Logo Detection Face Detection Explicit Content Detection

Slide 43

Slide 43 text

Confidential & Proprietary Google Cloud Platform 43 Vision API Demo

Slide 44

Slide 44 text

Cloud Speech API Speech to text conversion

Slide 45

Slide 45 text

Cloud Speech API Recognize Speech Streaming Recognition Transcribe Audio Transcribe stored audio Global Supports > 80 languages

Slide 46

Slide 46 text

Cloud Natural Language API For sentiment analysis and entity recognition in a piece of text

Slide 47

Slide 47 text

Confidential & Proprietary Google Cloud Platform 47 Identify Entities Entities with salience Cloud Natural Language API - Call API from anywhere, with support for embedded Text, and Google Cloud storage - Support for English, Spanish and Japanese Understand Sentiment Sentiment Analysis Text Syntax Analysis Identify POS with dependency trees

Slide 48

Slide 48 text

Confidential & Proprietary Google Cloud Platform 48 Demo Speech & NLP

Slide 49

Slide 49 text

Cloud Translate API Dynamically translate between thousands of available language pairs

Slide 50

Slide 50 text

Confidential & Proprietary Google Cloud Platform 50 Translate API Features Language Detection Simple Integration Translate Many Languages 90 different languages, from Afrikaans to Zulu. Used in combination, this enables translation between thousands of language pairs. Translate API can automatically identify languages with high accuracy. Easy to use Google REST API. No need to extract text from your document, just send it HTML documents and get back translated text. High Quality Translations High quality translations that push the boundary of Machine Translation. Updated constantly to seamlessly improve translations and introduce new languages and language pairs.

Slide 51

Slide 51 text

06 Closing