Tweet
Tweet

Slide 1

Slide 1 text

No content

Slide 2

Slide 2 text

ESP Evolving Sustainable {data} Pipelines Anna Smith - @OMGannaks 29 January 2015

Slide 3

Slide 3 text

A bit about RTR A bit about our analytics Some evolution stuff A bit about Luigi The future bits

Slide 4

Slide 4 text

A bit about RTR A bit about our analytics Some evolution stuff A bit about Luigi The future bits

Slide 5

Slide 5 text

No content

Slide 6

Slide 6 text

1. 2. 3.

Slide 7

Slide 7 text

WHERE THE MAGIC HAPPENS

Slide 8

Slide 8 text

A bit about RTR A bit about our analytics Some evolution stuff A bit about Luigi The future bits

Slide 9

Slide 9 text

DEMAND website user interaction transactions SUPPLY warehouse inventory allocation

Slide 10

Slide 10 text

DEMAND website user interaction transactions SUPPLY warehouse inventory allocation INTERACTION reservation calendar

Slide 11

Slide 11 text

No content

Slide 12

Slide 12 text

No content

Slide 13

Slide 13 text

No content

Slide 14

Slide 14 text

A bit about RTR A bit about our analytics Some evolution stuff A bit about Luigi The future bits

Slide 15

Slide 15 text

PHASE 0

Slide 16

Slide 16 text

No content

Slide 17

Slide 17 text

YUP

Slide 18

Slide 18 text

KEEP IT TOGETHER

Slide 19

Slide 19 text

PHASE 1 primordial soup

Slide 20

Slide 20 text

STABILITY

Slide 21

Slide 21 text

PHASE 2 process

Slide 22

Slide 22 text

orderwarehouse.job

Slide 23

Slide 23 text

$ ./runjob.py orderwarehouse.job $ ./runjob.py orderwarehouse.job --show $ ./runjob.py orderwarehouse.job --only 2

Slide 24

Slide 24 text

runjob.py

Slide 25

Slide 25 text

ADAPTING ensuring data quality

Slide 26

Slide 26 text

PHASE 3 exposing weaknesses

Slide 27

Slide 27 text

A bit about RTR A bit about our analytics Some evolution stuff A bit about Luigi The future bits

Slide 28

Slide 28 text

dependency manager

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

No content

Slide 31

Slide 31 text

A bit about RTR A bit about our analytics Some evolution stuff A bit about Luigi The future bits

Slide 32

Slide 32 text

PHASE 4 ownership

Slide 33

Slide 33 text

RELIABILITY

Slide 34

Slide 34 text

COMMUNICATION

Slide 35

Slide 35 text

THE FUTURE @OMGannaks [email protected]