Google Cloud Platform for Research

Presentation on Google Cloud Platform to the AGM of the UK Research Software Engineers community on Monday the 15th of September 2014.

Transcript

1. Sharif Salah Google Developer Expert 2014 Google+ profile @sharif_salah about.me/sharif.salah Google Cloud Platform for Research
2. Image courtesy of Google/Connie Zhou
3. Agenda Research at Google Cloud Platform overview Resources Q&A
4. Research at Google
5. GFS Map Reduce Bigtable Dremel Spanner Colossus https://research.google.com/
6. “Bigtable: A Distributed Storage System for Structured Data Fay Chang, Jeffrey Dean, Sanjay Ghemawat, Wilson C. Hsieh, Deborah A. Wallach, Mike Burrows, Tushar Chandra, Andrew Fikes, and Robert E. Gruber Abstract Bigtable is a distributed storage system for managing structured data that is designed to scale to a very large size: petabytes of data across thousands of commodity servers. Many projects at Google store data in Bigtable, including web indexing, Google Earth, and Google Finance. These applications place very different demands on Bigtable, both in terms of data size (from URLs to web pages to satellite imagery) and latency requirements (from backend bulk processing to real-time data serving). Despite these varied demands, Bigtable has successfully provided a flexible, high-performance solution for all of these Google products. In this paper we describe the simple data model provided by Bigtable, which gives clients dynamic control over data layout and format, and we describe the design and implementation of Bigtable.” To appear in: OSDI'06: Seventh Symposium on Operating System Design and Implementation, Seattle, WA, November, 2006. Source: http://research.google.com/archive/bigtable.html
7. IaaS PaaS SaaS Gmail, Google Drive and Google Calendar App Engine Compute Engine Cloud Storage
8. Cloud Platform overview
9. Compute Compute Engine App Engine
10. Compute Engine IaaS Compute, Storage & Network Sub-hour billing Hugely scalable Consistent performance Support for containers
11. App Engine PaaS Java, Python, PHP & Go Free quota Auto scaling Massively scalable Managed VMs
12. Storage Cloud Datastore Cloud Storage Cloud SQL
13. Cloud Datastore NoSQL-like Fully managed Highly available Hugely scalable Flexible access Auto scaling
14. Cloud Storage IaaS Multi-petabyte Globally replicated Tightly integrated into GCP Flexible security model
15. Cloud SQL MySQL Easy to use Flexible configuration Upto 500 GB Managed service Highly available
16. Services Cloud Endpoints BigQuery
17. Cloud Endpoints Generate your own APIs Built on App Engine Integrates OAuth 2.0 Client libraries Mobile and web support Expose your data
18. BigQuery SQL-like queries Easy to use interface Supports 3rd party tools Analyse terabytes of data Streaming data Batch processing
19. Cloud Console Cloud SDK REST APIs
20. Resources
21. Google Developer Experts directory Google Cloud Platform Blog Official Google Cloud Platform Community Stack Overflow
23. Case studies Compliance information Pricing calculator Research at Google Support packages Further reading
24. Google Cloud Platform would like to offer all participants of the RSE AGM $500 of credit to build your applications! To get started, follow the three steps below: 1. http://g.co/cloudstarterpack 2. Click "apply now" 3. Use the code: gde-in
25. These slides: http://goo.gl/hDpggR Credits: use code ‘gde-in’ http://g.co/cloudstarterpack Thank you! Any questions?