Big Data on GoogleCloud

Transcript

1. Big Data on Google Cloud Kenneth Kinyanjui @kenju254 Google Agency Day Nairobi
2. Problem Solver ❖ Jr Software Engineer ❖ Jr Linux System Admin ❖ Rookie Entrepreneur ❖ Sr Engineer - Backend & Infrastructure ❖ Design Sprint Master ❖ Product Manager ❖ Still can’t get out of writing code ...
4. This talk will tell help you know... ❖ What Big Data is? ❖ Why we should care about Big Data? ❖ When are we ready ? ❖ How we can leverage on Big Data with ease?
5. What is Big Data?
6. Well it can be summarized in the 5vs ❖ Volume - Data Size ❖ Variety - Different forms of data sources ❖ Veracity - Uncertainty of Data ❖ Value - Impact ❖ Velocity - Speed of Change
8. Easier said than done?
9. Hold on you need ... ❖ Data Warehouse ❖ Data Processing ❖ Data Streaming ❖ Highly Scalable Database ❖ Visualization ❖ Analyze the Data
10. A big data ecosystem
12. All that just simply ❖ Access ❖ Analyze ❖ Visualize
13. In Reality...
14. The Solution
16. Focus on the real stuff don’t lose time on managing infrastructure
18. But in reality , I bet most ...
20. I don’t want to be like that guy!!!
21. Stages of Companies/Startups Domain Early Stage High Growth Late Stage Users A few hundred to thousand Thousands to millions Millions to Billions Team <20 <1000 >1000 X-Functional Team Few Many Many Data Size GigaByte GigaByte-TeraByte TeraByte -PetaByte Agility Yes Yes Not necessarily Flexibility Not necessarily Yes Yes
22. Ask yourself ❖ Which stage of the company life cycle am I ? ❖ How is my data collection process? ❖ Are we making decisions based on Data ? ❖ Is Experimentation and Validation at the core of our business? ❖ Is my data accessible ? ❖ Is my data clean ? ❖ Can we confidently say we are a data driven company?
23. Keep in mind ... Its 3 Simple things ❖ Data Collection ❖ Data Analysis ❖ Data Visualization
24. Data Collection ❖ Your App ❖ Your Website ❖ An API
25. Data Analysis ❖ Easily Access your data ❖ Clean it ❖ Some Crunching of Data ❖ Some ML/AI
26. Data Visualization ❖ Graphs ❖ Output ❖ Charts
27. Big Data on Google Cloud
28. Questions ? #gde Kenneth Kinyanjui @kenju254
29. Thank you! #gde Kenneth Kinyanjui @kenju254