[PyConKR2017] Best-first search를 이용한 다차원 큐브 탐색

Slide 1

Slide 1 text

Best-ﬁrst searchܳ ੉ਊೠ ׮ରਗ ௸࠳ ఐ࢝ -[|]- Box and Whisker ߅੢द

Slide 2

Slide 2 text

Commerce platform Data, Google Analytics…

Slide 3

Slide 3 text

Google Analytics powerful but ...

Slide 4

Slide 4 text

Dimension + Metrics

Slide 5

Slide 5 text

Dims’ Combination + Metrics

Slide 6

Slide 6 text

Many dimensions https://developers.google.com/analytics/devguides/reporting/core/dimsmets 200+

Slide 7

Slide 7 text

More combinations 137,979

Slide 8

Slide 8 text

Much more numbers (Region, Gender) #32 lines(segments)

Slide 9

Slide 9 text

Much more numbers (A,) = 5 (A, B) = 25 (A, B, C) = 125 … (A, B, …, G) = 5 ** 7 6.7B

Slide 10

Slide 10 text

Multidimensional cube s: 427 r: 87 d: 122 s: 283 r: 23 d: 124 s: 291 r: 19 d: 872 s: 123 r: 108 d: 503 s: 287 r: 13 d: 687 s: 987 r: 432 d: 1113 s: 293 r: 18 d: 983 s: 293 r: 2929 d: 7023 s: 111 r: 72 d: 982 s: 293 r: 199 d: 777 s: 28 r: 1 d: 134 s: 19 r: 0 d: 29 s: 100 r: 29 d: 89 s: 192 r: 19 d: 192 s: 293 r: 18 d: 298 s: 19 r: 1 d: 29 Region Gender Age The most eﬃcient

Slide 11

Slide 11 text

GA Reporting API google-api-python-client

Slide 12

Slide 12 text

Restrictions 137,979 10 queries per second (QPS) per IP address 10 concurrent requests per view (proﬁle) 137,979 / 10 / 60 = 230min 10,000 requests per view (proﬁle) per day

Slide 13

Slide 13 text

Better way Gender Age Region / Campaign Usertype Gender, Region Age, Campaign Region, Usertype Region, Usertype, Gender Region, Usertype, Campaign Usertype, Age Region, Usertype, Gender, Age s: 427 r: 87 d: 122 s: 283 r: 23 d: 124 s: 291 r: 19 d: 872 s: 123 r: 108 d: 503 s: 287 r: 13 d: 687 s: 987 r: 432 d: 1113 s: 293 r: 18 d: 983 s: 293 r: 2929 d: 7023 s: 111 r: 72 d: 982 s: 293 r: 199 d: 777 s: 28 r: 1 d: 134 s: 19 r: 0 d: 29 s: 100 r: 29 d: 89 s: 192 r: 19 d: 192 s: 293 r: 18 d: 298 s: 19 r: 1 d: 29 Region Gender Age

Slide 14

Slide 14 text

Graph search A B D H I E J K C F L M G N O

Slide 15

Slide 15 text

Graph search

Slide 16

Slide 16 text

Breadth-ﬁrst search

Slide 17

Slide 17 text

Breadth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier:

Slide 18

Slide 18 text

Breadth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C

Slide 19

Slide 19 text

Breadth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: C D E B

Slide 20

Slide 20 text

Breadth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: D E B C F G

Slide 21

Slide 21 text

Breadth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: D E B C F G H I

Slide 22

Slide 22 text

Breadth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: D E B C F G H I J K

Slide 23

Slide 23 text

Breadth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: D E B C F G H I J K L

Slide 24

Slide 24 text

Breadth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: D E B C F G H I J K L

Slide 25

Slide 25 text

Depth-ﬁrst search

Slide 26

Slide 26 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier:

Slide 27

Slide 27 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C

Slide 28

Slide 28 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D

Slide 29

Slide 29 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D I H

Slide 30

Slide 30 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D I H

Slide 31

Slide 31 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D I H

Slide 32

Slide 32 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D I H K J

Slide 33

Slide 33 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D I H K J

Slide 34

Slide 34 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D I H K J

Slide 35

Slide 35 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D I H K J F G

Slide 36

Slide 36 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D I H K J F G

Slide 37

Slide 37 text

Depth-ﬁrst search A B D H I E J K C F L M G N O A Explored: Frontier: B C E D I H K J F G

Slide 38

Slide 38 text

Best-ﬁrst search

Slide 39

Slide 39 text

Best-ﬁrst search A B C D E F G H I J K L M N O P 3 4 5 3 2 4 7 6 4 3 2 1 2 2 3 4 1 2 4 A: 15 B: 15 C: 10 D: 12 E: 12 F: 7 G: 11 H: 5 I: 5 J: 6 K: 4 L: 4 M: 0 N: 1 O: 4 P: 6

Slide 40

Slide 40 text

Best-ﬁrst search A B C D E F G H I J K L M N O P 3 4 5 3 2 4 7 6 4 3 2 1 2 2 3 4 1 2 4 A: 15 B: 15 C: 10 D: 12 E: 12 F: 7 G: 11 H: 5 I: 5 J: 6 K: 4 L: 4 M: 0 N: 1 O: 4 P: 6 3+15=18 5+10=15 4+12=16

Slide 41

Slide 41 text

Best-ﬁrst search A B C D E F G H I J K L M N O P 3 4 5 3 2 4 7 6 4 3 2 1 2 2 3 4 1 2 4 A: 15 B: 15 C: 10 D: 12 E: 12 F: 7 G: 11 H: 5 I: 5 J: 6 K: 4 L: 4 M: 0 N: 1 O: 4 P: 6 3+15=18 4+12=16 12+7=19 11+5=16

Slide 42

Slide 42 text

Best-ﬁrst search A B C D E F G H I J K L M N O P 3 4 5 3 2 4 7 6 4 3 2 1 2 2 3 4 1 2 4 A: 15 B: 15 C: 10 D: 12 E: 12 F: 7 G: 11 H: 5 I: 5 J: 6 K: 4 L: 4 M: 0 N: 1 O: 4 P: 6 3+15=18 8+6=14 12+7=19 11+5=16

Slide 43

Slide 43 text

Best-ﬁrst search A B C D E F G H I J K L M N O P 3 4 5 3 2 4 7 6 4 3 2 1 2 2 3 4 1 2 4 A: 15 B: 15 C: 10 D: 12 E: 12 F: 7 G: 11 H: 5 I: 5 J: 6 K: 4 L: 4 M: 0 N: 1 O: 4 P: 6 3+15=18 11+4=15 12+7=19 10+5=15

Slide 44

Slide 44 text

Best-ﬁrst search A B C D E F G H I J K L M N O P 3 4 5 3 2 4 7 6 4 3 2 1 2 2 3 4 1 2 4 A: 15 B: 15 C: 10 D: 12 E: 12 F: 7 G: 11 H: 5 I: 5 J: 6 K: 4 L: 4 M: 0 N: 1 O: 4 P: 6 3+15=18 11+4=15 12+7=19 12+4=16

Slide 45

Slide 45 text

Best-ﬁrst search A B C D E F G H I J K L M N O P 3 4 5 3 2 4 7 6 4 3 2 1 2 2 3 4 1 2 4 A: 15 B: 15 C: 10 D: 12 E: 12 F: 7 G: 11 H: 5 I: 5 J: 6 K: 4 L: 4 M: 0 N: 1 O: 4 P: 6 3+15=18 13+4=17 12+7=19 12+4=16 15+0=15

Slide 46

Slide 46 text

More about Best-ﬁrst search heapq — Heap queue algorithm https://docs.python.org/3.6/library/heapq.html#theory [AIMA] 3.5 INFORMED (HEURISTIC) SEARCH STRATEGIES [AIMA] 3.6 HEURISTIC FUNCTIONS

Slide 47

Slide 47 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type S: 1000 R: 10000

Slide 48

Slide 48 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type S: 1000 R: 10000 Female S: 600 R: 8000 Male S: 400 R: 2000

Slide 49

Slide 49 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type Gender Age Gender Region Gender Camp Gender Type

Slide 50

Slide 50 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type Gender Age Gender Region Gender Camp Gender Type 1.0 1.0 1.0 1.0 0.8 0.8 0.8 0.8 0.8

Slide 51

Slide 51 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type 0.6 1.0 1.0 1.0 0.8 10s S: 100 R: 200 20s S: 500 R: 2000 30s S: 200 R: 6000 40s S: 100 R: 1000 50+ S: 100 R: 800

Slide 52

Slide 52 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type Gender Age Gender Region Gender Camp Gender Type 0.6 1.0 1.0 1.0 0.48 0.8 0.8 0.8 0.8 Age Region Age Camp Age Type 0.6 0.6 0.6

Slide 53

Slide 53 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type Gender Age Gender Region Gender Camp Gender Type 0.6 0.4 1.0 1.0 0.48 0.8 0.32 0.8 0.8 Age Region Age Camp Age Type 0.24 0.6 0.6

Slide 54

Slide 54 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type Gender Age Gender Region Gender Camp Gender Type 0.6 0.4 1.0 1.0 0.48 0.8 0.32 0.8 0.8 Age Region Age Camp Age Type 0.24 0.6 0.6 Region Camp Region Type 0.4 0.4

Slide 55

Slide 55 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type Gender Age Gender Region Gender Camp Gender Type 0.6 0.4 0.2 1.0 0.48 0.8 0.32 0.16 0.8 Age Region Age Camp Age Type 0.24 0.12 0.6 Region Camp Region Type 0.08 0.4 Camp Type 0.2

Slide 56

Slide 56 text

Best-ﬁrst search for GA API Gender Age Region / Camp Type Gender Age Gender Region Gender Camp Gender Type 0.6 0.4 0.2 0.5 0.48 0.8 0.32 0.16 0.4 Age Region Age Camp Age Type 0.24 0.12 0.3 Region Camp Region Type 0.08 0.2 Camp Type 0.1