2004 2006 2008 2010 Google Research Publications referenced are available here: http://research.google.com/pubs/papers.html The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 2009 http://research.google.com/pubs/pub35290.html GFS MapReduce Bigtable Google research in data technologies Colossus Dremel Flume Megastore Spanner Millwheel F1 PubSub 2016 Borg
2004 2006 2008 2010 GFS MapReduce Bigtable Google research in data technologies Colossus Dremel Flume Megastore Spanner Millwheel F1 PubSub 2016 Borg Tensor Flow
2004 2006 2008 2010 GFS MapReduce Bigtable Google research in data technologies Colossus Dremel Flume Megastore Spanner Millwheel F1 PubSub 2016 Borg Tensor Flow ? ?
build, organize, and operate a huge network of servers and fiber-optic cables with an efficiency and speed that rocks physics on its heels. This is what makes Google Google: its physical network, its thousands of fiber miles, and those many thousands of servers that, in aggregate, add up to the mother of all clouds.” - Wired Images by Connie Zhou
Big Table Storage Compute Engine (IaaS) App Engine (PaaS) Container Engine (powered by Kubernetes) Compute BigQuery Pub/Sub Dataflow Big Data Dataproc Datalab Translate API Cloud Vision Speech API Machine Learning Cloud ML
hardware Abstracted computing power Manages your container cluster and actively schedules your containers Infrastructure at Google speed Build your scalable app faster
(Really) Pay for what you use We bill in minute-level increments so you don’t pay for unused computing time, and automatically apply sustained use discounts. Fast, Easy Provisioning Quickly deploy large clusters of virtual machines with intuitive tools. Compliance & Security All data written to disk in Compute Engine is encrypted on the fly and then transmitted and stored in encrypted form. Compute Engine Batch Run short duration, heavy compute jobs. The more flexibility in timing and location you give us the better the pricing! $
of CPU/memory to reserve and keepalive policy, in a simple JSON config file. Container Engine will schedule your containers as declared. Better ops Your container cluster is equipped with capabilities, such as logging, container health checking, and autoscaling, to make application management easier. Docker support Container Engine supports the common Docker container format. And with Google Container Registry, Cloud Platform makes it easy to store and access your private Docker images. Managed container cluster Spin up a managed container cluster of virtual machines, ready for deployment. The vm nodes that comprise your cluster are fully managed, ensuring they are healthy and updated with critical patches. Container Engine Cloud flexibility With Red Hat, Microsoft, IBM, Mirantis OpenStack, and VMWare -- and the list keeps growing -- working to integrate Kubernetes into their platforms, you’ll be able to move workloads, or take advantage of multiple cloud providers, more easily.
and the Users API, let you build any application. Deploy at Google scale You can scale up to 7 billion requests per day and automatically scale down when traffic subsides. Focus on your code Let Google worry about database administration, server configuration, sharding & load balancing. Popular languages & frameworks Write applications in some of the most popular programming languages, use existing frameworks and integrate with other familiar technologies. App Engine Familiar development tools Use the tools you know, including Eclipse, IntellIJ, Maven, Git, Jenkins, PyCharm & more. Multiple storage options Choose the storage option you need: a traditional MySQL database using Cloud SQL, a schemaless NoSQL datastore, or object storage using Cloud Storage.
database servers • Stitch it all together - db connection strings • Duplicate for dev, test, and prod Manage the app • Deploy it • Scale it • Pager duty What would it take to launch this tiny app? This is a 90s style guestbook. All it needs is a rotating GIF.
experience • Integrated SDK across Cloud Platform • Compile source into binary containers with one command Easy microservices • Built-in API for building microservices App versioning and A/B testing • Application versioning and traffic splitting for slow rollouts / rollbacks • A/B testing across multiple experiments Common app building blocks • Managed services and APIs for storage, queueing, caching, logging, and auth
data using a fully-managed, relational MySQL database Powerful, simple and cost effective object storage service Managed, NoSQL, schemaless database for storing non-relational data
lower cost and lower availability than Standard Storage but is designed to have the same durability and performance as Standard Storage. Standard Storage Standard Storage provides the highest level of durability, availability and performance of all Google Cloud Storage services. It’s specifically designed for use cases requiring low latency and frequent data access, such as website content distribution and video streaming. Standard storage is all about performance. Simple Access Google created three simple product options to help you improve the performance of your applications while keeping your costs low. These three product options use the same API, providing you with a simple and consistent method of access. Cloud Storage Nearline Storage Nearline Storage is a low-cost, highly durable storage service for data archiving, online backup, and disaster recovery. Unlike other cloud or on-premises archive and backup offerings, you don’t have to wait hours or days to retrieve or access your data.
control. Your application can execute multiple datastore operations in a single transaction in which either all succeed or all fail, ensuring the integrity of your data. Managed Database Cloud Datastore is fully managed. Google automatically handles sharding and replication in order to provide you with a highly available & consistent database. Autoscale with your users Cloud Datastore automatically scales depending on your needs. This allows you to focus on building your application and not on worrying about provisioning & load anticipation. Built-in Redundancy With a single API call, data is automatically replicated across multiple data centers. High availability & durability are built in from the very core. Cloud Datastore Schemaless Access with SQL-like querying No need to worry about data models and migration. Cloud Datastore is a schemaless storage service that allows you to be agile by removing the need to think about the underlying structure of the data. Access your data from anywhere Build solutions that span App Engine and Compute Engine, and rely on Cloud Datastore as the integration point. With the RESTful interface that is exposed by Cloud Datastore, data can easily be accessed by any deployment target.
a web Console or a command-line interface. Transfer data to your instance by importing and exporting databases and CSV files. Flexible Charging If you're running a lightly or sporadically used database, you'll save money by only paying for the time you access your data. Easier Migration; No Lock-in Standard connections and tools such as mysqldump, MySQL Wire Protocol, and JDBC make it easier to migrate onto (or off!) Google Cloud Platform, and avoids lock-in. Familiar Infrastructure Build and deploy for the cloud faster because Cloud SQL offers standard MySQL databases, the most popular open source database in the world. Instances available up to 16GB RAM, 100GB storage. Cloud SQL Fully managed No worrying about replication, patch management or database management: we take care of it. Security, Availability, Durability Your data is replicated in many geographic locations as standard, and failover between them is handled automatically. We also manage your backups, making it easy for you to restore when needed, including point-in-time recovery.
services • Generalizable to vision, sound, text, video and other data • Runs on CPUs or GPUs, desktop, server, or mobile computing platforms. • Distributed via Apache 2.0 OSS license
• Train using a custom TensorFlow graph • Batch and online predictions at scale • Integrated Datalab experience • Regression and classification tasks • Runs on Google Brain using GPU & TPU
with salience Cloud Natural Language API - Call API from anywhere, with support for embedded Text, and Google Cloud storage - Support for English, Spanish and Japanese Understand Sentiment Sentiment Analysis Text Syntax Analysis Identify POS with dependency trees
Language Detection Simple Integration Translate Many Languages 90 different languages, from Afrikaans to Zulu. Used in combination, this enables translation between thousands of language pairs. Translate API can automatically identify languages with high accuracy. Easy to use Google REST API. No need to extract text from your document, just send it HTML documents and get back translated text. High Quality Translations High quality translations that push the boundary of Machine Translation. Updated constantly to seamlessly improve translations and introduce new languages and language pairs.