Slide 1

Slide 1 text

Final presentation wherecamp berlin 2019 1

Slide 2

Slide 2 text

Design Patterns of GeoData Driven Apps Shoaib Burq https://geografia.com.au http://deeplearningbox.com WhereCamp 2019 (Berlin)

Slide 3

Slide 3 text

Complexity in Data Driven Apps 3 greater number of data sources more stakeholders more applications bigger datasets

Slide 4

Slide 4 text

4

Slide 5

Slide 5 text

5

Slide 6

Slide 6 text

6

Slide 7

Slide 7 text

7 Client Name

Slide 8

Slide 8 text

v1 (2017) - Traditional Geo Applications 8

Slide 9

Slide 9 text

v1: Challenges 9 No Quality Checks Poor Schema Enforcement Time Consuming Not Scalable for Growth

Slide 10

Slide 10 text

10

Slide 11

Slide 11 text

11 v2: add workflow system

Slide 12

Slide 12 text

12 v2: add workflow system Add S3 to Store Raw Data Trigger Workflow (AWS lambda)

Slide 13

Slide 13 text

13 v2: add workflow system Add S3 to Store Raw Data Trigger Workflow (AWS lambda) https://docs.prefect.io/core

Slide 14

Slide 14 text

14 Forecasting with Machine / Deep Learning

Slide 15

Slide 15 text

v3: Doing Data Science 15

Slide 16

Slide 16 text

v3: Doing Data Science 16 Workstation with GPUs to train ML & DL Models ————————— deeplearningbox.com —————————

Slide 17

Slide 17 text

v3: Doing Data Science 17 Workstation with GPUs to build Deep Learning Models Competing for Resources with applicatioon Manual Deployment of ML Models

Slide 18

Slide 18 text

v4: ML Model Tracking + Deployments 18

Slide 19

Slide 19 text

v4: PostgreSQL read only replicas 19

Slide 20

Slide 20 text

v4: MLFlow + RDMBS scaling 20

Slide 21

Slide 21 text

v4: MLFlow + RDMBS scaling 21 Fix: Competing for Resources Fix: ML Experiment Track & Deploy

Slide 22

Slide 22 text

Future expected demands from customers & team 22

Slide 23

Slide 23 text

Future Interactive Big Data Queries via Hadoop + Presto 23

Slide 24

Slide 24 text

Future Real-Time events integration (e.g. social media feed) 24

Slide 25

Slide 25 text

Thank you! Questions? Shoaib Burq https://geografia.com.au | http:// deeplearningbox.com 25