BigQuery: da teoria à prática

Apresentação sobre o Google BigQuery feita no Living Lab para o GDG Campo Grande.

Transcript

1. Explorando o banco de dados de Big Data do Google
2. @antonielcm - Engenheiro de Software na Magnetis Investimentos - Ruby, C#, JS, Python... - Entusiasta de tecnologias baseadas na nuvem - Fazer devops é
3. magnetis.workable.com
5. https://cloud.google.com/bigquery
6. ➔ Serverless ➔ Altamente escalável ➔ Economicamente viável ➔ In-memory BI ➔ Machine Learning
7. ➔ Serverless ➔ Altamente escalável ➔ Economicamente viável ➔ In-memory BI ➔ Machine Learning
8. “BigQuery is an SQL-based Data Warehouse as a Service (DWaaS) that requires no upfront hardware provisioning or management. Single queries can cover petabyte-sized datasets and utilise thousands of CPUs distributed across 100s of machines. While you aren’t running queries, you only pay a tiny amount for data stored ($0.02 per GB per month, or less).” https://medium.com/sajari/bigquery-a-serverless-data-warehouse-9a4d623f3f43
9. ➔ Serverless ➔ Altamente escalável ➔ Economicamente viável ➔ In-memory BI ➔ Machine Learning
10. https://ai.google/research/pubs/pub36632
11. https://cloud.google.com/blog/products/gcp/inside-capacitor-bigquerys-next-generation-columnar-storage-format
12. https://ai.google/research/pubs/pub36632
13. https://cloud.google.com/blog/products/gcp/anatomy-of-a-bigquery-query
14. ➔ Serverless ➔ Altamente escalável ➔ Economicamente viável ➔ In-memory BI ➔ Machine Learning
17. ➔ Serverless ➔ Altamente escalável ➔ Economicamente viável ➔ In-memory BI ➔ Machine Learning
18. https://cloud.google.com/bi-engine/docs/overview
19. ➔ Serverless ➔ Altamente escalável ➔ Economicamente viável ➔ In-memory BI ➔ Machine Learning
20. https://cloud.google.com/bigquery/docs/bigqueryml-intro
21. https://datastudio.google.com
24. - https://cloud.google.com/files/BigQueryTechnicalWP.pdf - https://medium.com/skyshidigital/what-bigquery-is-and-isnt-d092fa173d53 - https://cloud.google.com/blog/products/gcp/bigquery-under-the-hood - https://medium.com/google-cloud/bigquery-optimized-cluster-your-tables-6 5e2f684594b - https://panoply.io/data-warehouse-guide/bigquery-architecture/ - https://tech.marksblogg.com/billion-nyc-taxi-rides-bigquery.html - https://cloud.google.com/bigquery/docs/best-practices-costs - https://cloud.google.com/products/calculator/
25. about.me/antonielcm