Here be Big Query

Session from Google i/o 2013 looking at Gamesys' use of the Google Cloud Platform ( App Engine + BIg Query ) to build gaming infrastructure.

Talk: https://www.youtube.com/watch?v=OPfvnfnFuBs

Transcript

2. Here be Big Query Building Social Gaming Infrastructure on the Google Cloud Platform Matt McNeill Head of Strategic Customer Relationships, Google Cloud Platform, EMEA Tom Newton Director of Social Gaming, Gamesys
3. Game lifetime measured in weeks The Life of a Game 1 2 1 http://www.localytics.com/blog/2011/first-impressions-matter-26-percent-of-apps-downloaded-used-just-once/ 2 Representative sample of usage data from a typical mobile game
4. Connected Games are the Future Interest in connected games has been trending upwards in Google search since Q4 2012 1 data from google.com/trends for interest in mobile backend as a service solutions 1 Reduces Piracy Enables Social Enables Measurement
5. The Science of Gaming Tom Newton, Director of Social Gaming, Gamesys
6. Who is Gamesys? • Founded in 2001 • #1 in the UK • Handle $5 Billion in turnover annually • First company to launch real money gaming on Facebook • Employ 1,000 globally
7. • Started investing in Social in 2011 • 100 people employed on the Social Team today • Currently operating 5 cross-platform games • Leader in Social Casino genre, also powering games for PopCap/EA Social and Mobile Gaming at Gamesys
8. Gamesys chose Google
9. Why Google? APIs Scale Take advantage of the scalability, reliability and availability of Google’s infrastructure Google provide 99.95% SLA and 24x7 phone, and many other support options Reliability Utilise the full range of Google APIs to access many powerful and sophisticated services
10. Inside a Game 1 Case Study: Here Be Monsters 2 Data, Data, Data: processing and reporting 3 Industrialising our systems on the Google Cloud 4 Putting it all together
12. Travel, Collect, Craft!
13. Trap Monsters Demo
14. Importance of insight Data
15. 01001001010010010010100100010101110010 01001001010010010010100100010101110010100010 01001001010010010010100100010101110010100010 01001001010010010010100100010101110010100010 01001001010010010010100100010101110010100010 01001001010010010010100100010101110010100010 01001001010010010010100100010101110010100010 Enables deeper ad hoc analysis. Analysis goes only as far as the data. Finer the grain, the bigger the volume. Events drive Analysis
16. Be Ready for Success Game 1 Game 2 Here Be Monsters ( Beta ) DAU 600,000+ 150,000+ 10,000+ Sessions 45 Million+ 8 Million+ 1 Million+ Events 5 Billion + 500 Million + 200 Million +
17. Why Big Query? Scales Managed Fully managed architecture, allows instant project startup, and rapid time to insight Easy to learn, no training necessary. SQL Grows with your project, scales horizontally to 100 Bn's of rows with no loss of performance on interactive queries
18. Nightly ETL Cloud Storage Big Query ETL Events
19. Aggregations Drive Reporting Profiles Transactions Sessions
20. Reporting Reporting Apps Script Spreadsheets Cloud Storage Big Query ETL
21. KPI Dashboards in Google Spreadsheets Demo
22. Data driven tools with App Engine Industrialise
23. email mobile push notifications 4 facebook notifications Engagement Reporting Apps Script Spreadsheets Mailman App Engine Cloud Storage Big Query ETL
24. Why App Engine? Deployment Productivity Focus on solving the problem, and building the application, don't need to worry about the plumbing One click deployment makes it easy. Iterate very fast. No maintenance overheads. Scale Take advantage of the scalability, reliability and availability of Google’s infrastructure
25. Mailman cron blobstore Lists Big Query App Engine Jobs App Engine Pipeline API * blobstore cron datastore • Automated, scheduled message delivery service • Designed to improve player retention, and improve life time value • Allows definition of message recipients based on profile, session and events data Task Queue mobile push notifications email 4 facebook notifications *ETA
26. Personalised Offers Reporting Apps Script Spreadsheets Mailman App Engine Cloud Storage Big Query ETL email mobile push notifications 4 facebook notifications Cobra App Engine Prediction API
27. Cobra Big Query • A real-time offer system • Builds offers tailored to each user based on their profile • Built with App Engine, integrated with our games platform • Support for purchases through Google Play, App Store, Amazon and Facebook (anti-piracy) Cobra App Engine Offer Verification
28. Prediction Train Model Predict
29. Cobra Cobra App Engine Big Query Offer Verification Prediction API With prediction: • Update our prediction model with data as users redeem offers • Eventually using the Prediction API to help improve the quality of offer conversions.
30. A single, scalable, platform for rapid innovation Putting it Together
31. Focus on the Game... Reporting Apps Script Spreadsheets Cobra App Engine Prediction API Cloud Storage Big Query ETL Mailman App Engine email mobile push notifications 4 facebook notifications
32. Google Cloud - A Platform for Success Technology Marketing Analytics
33. Questions ? cloud.google.com developers.google.com cloud.google.com/newsletter googlecloudplatform.blogspot.com
34. Sample Dashboard
35. Putting it all together • Success means a lot of players • High volumes of data • Aggregated data drives dashboard reporting on KPIs • Ad hoc analysis digs deeper into a large volume of events data
36. Install Day
37. Putting it all together
39. Today: 1. Clients communicate with Cobra to fetch offers 2. Offers returned are based on the users profile 3. All purchases flow through Cobra and back into our reporting. 4. Human intervention to modify promotions to test for results What about the Prediction API? Cobra
40. Today: 1. Clients communicate with Cobra to fetch offers 2. Offers returned are based on the users profile 3. All purchases flow through Cobra and back into our reporting. 4. Human intervention to modify promotions to test for results With prediction: • 5. Update our prediction model with data as users redeem offers • 6. Eventually using the Prediction API to help improve the quality of offer conversions. Cobra + Prediction
41. Reporting and Analysis
42. Here Be Monsters Demo
43. • Data is the key • Analysis and reporting only go as deep as the data • Powers optimisation and iteration You're under an obligation to record everything. The Challenge of Connected Games
44. • Automated, scheduled message delivery service • Designed to improve player retention, and improve life time value • Allows definition of message recipients based on profile, session and events data Mailman Big Query list definition & template App Engine cron blobstore Task Queue Pipeline API * mobile push notifications email 4 facebook notifications
45. Prediction API With prediction: • Update our prediction model with data as users redeem offers • Eventually using the Prediction API to help improve the quality of offer conversions. Cobra Big Query App Engine datastore Task Queue Reporting
46. • A real-time offer system • Builds offers tailored to each user based on their profile • Built with App Engine, integrated with our games platform • Support for purchases through Google Play, App Store, Amazon and Facebook Cobra Big Query App Engine datastore Task Queue Reporting
47. Google Cloud - A Platform for Success PLAY ITERATE INDUSTRIALISE