Python Floripa - Teste A/B

Avaliação de testes A/B com Pandas.

Transcript

1. Python Floripa Teste A/B com Jupyter + Python + pandas JANEIRO.2017 - Daniel Severo
2. 1. What is A/B testing? 2. Why do we need statistics? 3. The stack: Jupyter + Python + pandas 4. Examples Agenda
3. WHAT IS A/B TESTING?
4. Time What is A/B testing?→ The basic concept. Visitor Webpage
5. Time What is A/B testing?→ The basic concept. • Examples: ◦ Green Button vs. Red Button; ◦ Landing page A vs. Landing Page B; ◦ Algorithm A vs. Algorithm B; ◦ Product A vs. Product B;
6. Time What is A/B testing?→ The basic concept. Visitor Webpage A Webpage B 50% 50%
7. Time What is A/B testing?→ The basic concept. A B METRICS
8. What is A/B testing?→ The basic concept.
9. What is A/B testing?→ The basic concept.
10. WHY DO WE NEED STATISTICS?
11. WHY DO WE NEED STATISTICS? • Is the difference between metrics significant or due to random fluctuations? • When should we stop the test?
12. WHY DO WE NEED STATISTICS?
13. WHY DO WE NEED STATISTICS?
14. WHY DO WE NEED STATISTICS?
15. WHY DO WE NEED STATISTICS?
16. THE STACK: JUPYTER+PYTHON+PANDAS
17. users buy orders products oid, pid, uid, timestamp, ... pid, name, specs, ... uid, email, gender, ... THE STACK: JUPYTER+PYTHON+PANDAS
18. users buy orders products oid, pid, uid, timestamp, ... pid, name, specs, ... uid, email, gender, ... THE STACK: JUPYTER+PYTHON+PANDAS
19. users buy orders products joint table oid, pid, uid, timestamp, ... pid, name, specs, ... uid, email, gender, ... oid, uid, pid, email, gender, timestamp, name, specs, ... THE STACK: JUPYTER+PYTHON+PANDAS
20. users buy orders products joint table oid, pid, uid, timestamp, ... pid, name, specs, ... uid, email, gender, ... reports THE STACK: JUPYTER+PYTHON+PANDAS
21. TURBO ANALYTICS → CÁLCULO DA ELASTICIDADE DE PRODUTOS price quantity '2016-01-01 15:48:50' '2016-01-02 21:26:12' '2016-01-02 21:41:17' '2016-01-02 23:56:05' '2016-01-03 03:48:57' '2016-01-03 10:42:11' '2016-01-03 12:25:38' '2016-01-03 12:30:55' '2016-01-03 13:23:13' '2016-01-04 16:09:16' . . . 1 2 1 3 2 6 7 10 8 7 R$ 79.99 R$ 79.99 R$ 79.99 R$ 79.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99
22. TURBO ANALYTICS → CÁLCULO DA ELASTICIDADE DE PRODUTOS price quantity '2016-01-01 15:48:50' '2016-01-02 21:26:12' '2016-01-02 21:41:17' '2016-01-02 23:56:05' '2016-01-03 03:48:57' '2016-01-03 10:42:11' '2016-01-03 12:25:38' '2016-01-03 12:30:55' '2016-01-03 13:23:13' '2016-01-04 16:09:16' . . . 1 2 1 3 2 6 7 10 8 7 R$ 79.99 R$ 79.99 R$ 79.99 R$ 79.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 price quantity '2016-01-01' '2016-01-02' '2016-01-03’ . . . 1 6 40 . . . R$ 79.99 R$ 79.99 R$ 69.99 . . .
23. TURBO ANALYTICS → CÁLCULO DA ELASTICIDADE DE PRODUTOS price quantity '2016-01-01 15:48:50' '2016-01-02 21:26:12' '2016-01-02 21:41:17' '2016-01-02 23:56:05' '2016-01-03 03:48:57' '2016-01-03 10:42:11' '2016-01-03 12:25:38' '2016-01-03 12:30:55' '2016-01-03 13:23:13' '2016-01-04 16:09:16' . . . 1 2 1 3 2 6 7 10 8 7 R$ 79.99 R$ 79.99 R$ 79.99 R$ 79.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 price quantity '2016-01-01' '2016-01-02' '2016-01-03’ . . . 1 6 40 . . . R$ 79.99 R$ 79.99 R$ 69.99 . . .
24. TURBO ANALYTICS → CÁLCULO DA ELASTICIDADE DE PRODUTOS price quantity '2016-01-01 15:48:50' '2016-01-02 21:26:12' '2016-01-02 21:41:17' '2016-01-02 23:56:05' '2016-01-03 03:48:57' '2016-01-03 10:42:11' '2016-01-03 12:25:38' '2016-01-03 12:30:55' '2016-01-03 13:23:13' '2016-01-04 16:09:16' . . . 1 2 1 3 2 6 7 10 8 7 R$ 79.99 R$ 79.99 R$ 79.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 R$ 69.99 price quantity '2016-01-01' '2016-01-02' '2016-01-03’ . . . 1 6 40 . . . R$ 79.99 R$ 76.66 R$ 69.99 . . .
27. + + ++ + + OBRIGADO!