Slide 1

Slide 1 text

The Hardest Problem in Data Ronnie Chen @rondoftw Data Engineering Slack 1 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 2

Slide 2 text

2 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 3

Slide 3 text

→ Machine learning → Predictive modeling → Neural networks → Artificial intelligence 3 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 4

Slide 4 text

Counting ?! 4 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 5

Slide 5 text

5 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 6

Slide 6 text

A simple counting problem 6 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 7

Slide 7 text

The Rules: 1. Only one number 2. Convince me it's correct 7 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 8

Slide 8 text

How many friends do you have? 8 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 9

Slide 9 text

Will I get the same number if... !"#$ I ask every person you know if they consider you their friend? 9 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 10

Slide 10 text

Will I get the same number if... ! " I ask every person that knows you if they think you would consider them a friend? 10 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 11

Slide 11 text

Is this the number of people that you'd tell a secret to? 11 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 12

Slide 12 text

But it depends!! 12 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 13

Slide 13 text

How many users do we have? 13 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 14

Slide 14 text

SELECT COUNT(*) FROM prod.users 14 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 15

Slide 15 text

user_id name email deleted 1 Alice alice@*** 2 Bob bob@*** true 3 Carol 15 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 16

Slide 16 text

SELECT COUNT(*) FROM prod.users WHERE deleted != true AND email != null 16 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 17

Slide 17 text

SELECT COUNT(*) FROM prod.users WHERE last_active > 2017-07-24 17 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 18

Slide 18 text

user_id email 12334 [email protected] 38602 [email protected] 52981 [email protected] 67640 [email protected] 18 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 19

Slide 19 text

¯\_(ϑ)_/¯ 19 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 20

Slide 20 text

What are you not even aware of? 20 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 21

Slide 21 text

Okay, I get it. But what's the big deal? 21 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 22

Slide 22 text

26% of professional computing jobs were held by women in 2016 22 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 23

Slide 23 text

23 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 24

Slide 24 text

Numbers give you authority and the appearance of objectivity 24 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 25

Slide 25 text

Counting is power. 25 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 26

Slide 26 text

26 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 27

Slide 27 text

Counts can determine funding, set agendas, and shift priorities 27 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 28

Slide 28 text

Machine learning is like money laundering for bias — Maciej Cegłowski, founder of @Pinboard 28 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 29

Slide 29 text

29 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 30

Slide 30 text

30 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw

Slide 31

Slide 31 text

What you count determines what is important. 31 — WriteSpeakCode 2017 | Ronnie Chen @rondoftw