Ranking Visualizations of Correlation Using Weber's Law

Paper presentation at IEEE VIS.

Paper: http://www.eecs.tufts.edu/~lane/files/harrison2014ranking.pdf

Transcript

1. Ranking Visualizations of Correlation using Weber’s Law Lane Harrison, Fumeng Yang, Steven Franconeri*, Remco Chang Tufts University, *Northwestern University
2. Many techniques for the same data…
3. Comparative Evaluation
4. Comparative Evaluation … 8 C2 = 28 condition 1 condition 2 condition 3 conditions
5. Model-based Evaluation
6. Model-based Evaluation M1 Model the performance of scatterplots on a task.
7. Model-based Evaluation M1 M2 M3 M4 M5 Model the performance of visualizations on a task.
8. Model-based Evaluation M1 M2 M3 M4 M5 M3 M2 M4 M1 M5 > > > >
9. Model-based Evaluation M1 M2 M3 M4 M5 M3 M2 M4 M1 M5 Models of performance can be compared directly and efficiently. Models are scalable and falsifiable. > > > >
10. Model-based Evaluation M1 M2 M3 M4 M5 M3 M2 M4 M1 M5 To be effective, models must be grounded in theory. > > > >
11. Model-based Evaluation M1 M2 M3 M4 M5 M3 M2 M4 M1 M5 To be effective, models must be grounded in theory. vs vs > > > >
12. A model grounded in theory: The Perception of Correlation in Scatterplots Ron Rensink, Gideon Baldridge (2010) - Used psychophysiological methodologies.
13. A model grounded in theory: The Perception of Correlation in Scatterplots Ron Rensink, Gideon Baldridge (2010) - Used psychophysiological methodologies. - Inferred just-noticeable differences for scatterplots depicting positive correlations.
14. A model grounded in theory: The Perception of Correlation in Scatterplots Ron Rensink, Gideon Baldridge (2010) - Used psychophysiological methodologies. - Established that the perception of correlation in scatterplots can be modeled using Weber’s law. - Inferred just-noticeable differences for scatterplots depicting positive correlations.
15. Psychophysiological methodology: 
 Which is more correlated?
22. Same difference
 but harder, why? 1.0 0.95 0.35 0.3
23. just-noticeable differences (jnd)
24. imagine yourself in a dark room…
31. JND: the smallest difference necessary to perceive two stimuli as being different.
32. after many trials…
33. 0. 0.00 0.06 0.12 0.18 0.24 ;ĂͿƐĐĂƩĞƌƉůŽƚ͕ZĞŶƐŝŶŬ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ƽ භ from above from below JND Rensink plotted JND as a function of correlation (r) (bright room) (dark room) better worse
34. 0. 0.00 0.06 0.12 0.18 0.24 ;ĂͿƐĐĂƩĞƌƉůŽƚ͕ZĞŶƐŝŶŬ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ƽ භ from above from below JND To see a difference in data with correlation of 0.3, the comparison r must be +/- 0.2. (dark room) (bright room) better worse
35. increase to 0.5! To see a diff,
37. decrease to 0.1! To see a diff,
39. Rensink’s insight…
40. ;ďͿƐĐĂƩĞƌƉůŽƚ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ;ĐͿƐĐĂƩĞƌƉůŽƚƌĞŐƌĞƐƐŝŽŶ rA 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ 0.0 0.00 0.06 0.12 0.18 0.24 Because the trend of JND & correlation is linear… 0 0.00 0.06 0.12 0.18 0.24 ;ĂͿƐĐĂƩĞƌƉůŽƚ͕ZĞŶƐŝŶŬ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ƽ භ from above from below JND “The perception of correlation in scatterplots can be modeled using Weber’s Law.” (dark room) (bright room) better worse
41. Weber's Law - sound, taste, weight, brightness, line-length - model for low-level perceptual discrimination ΔP = k * ΔI _ I
42. Weber's Law - sound, taste, weight, brightness, line-length - model for low-level perceptual discrimination ΔP = k * ΔI _ I
43. Weber's Law ΔP = k * ΔI I _
44. ΔP = k * ΔI I _ Perceived diff
45. ΔP = k * ΔI I _ Perceived diff Actual intensity of Stimulus
46. ΔP = k * ΔI I _ Actual intensity of Stimulus Change in Intensity Perceived diff
47. ΔP = k * ΔI I _ Actual intensity of Stimulus Change in Intensity Perceived diff via experiment
48. ΔP = k * ΔI I _ bright room, high intensity
49. ΔP = k * ΔI I __ super bright light needed
51. Our hypothesis…
52. ;ďͿƐĐĂƩĞƌƉůŽƚ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ;ĐͿƐĐĂƩĞƌƉůŽƚƌĞŐƌĞƐƐŝŽŶ rA 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ 0.0 0.00 0.06 0.12 0.18 0.24 0.00 0.06 0.12 0.18 0.24 ;ĂͿƐĐĂƩĞƌƉůŽƚ͕ZĞŶƐŝŶŬ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ƽ භ from above from below JND If the perception of correlation in scatterplots follows Weber’s law… better worse
53. ;ďͿƐĐĂƩĞƌƉůŽƚ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ;ĐͿƐĐĂƩĞƌƉůŽƚƌĞŐƌĞƐƐŝŽŶ rA 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ 0.0 0.00 0.06 0.12 0.18 0.24 0.00 0.06 0.12 0.18 0.24 ;ĂͿƐĐĂƩĞƌƉůŽƚ͕ZĞŶƐŝŶŬ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ƽ භ from above from below JND What does the perception of correlation in other charts look like? better worse
54. ;ďͿƐĐĂƩĞƌƉůŽƚ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ;ĐͿƐĐĂƩĞƌƉůŽƚƌĞŐƌĞƐƐŝŽŶ rA 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ 0.0 0.00 0.06 0.12 0.18 0.24 0.00 0.06 0.12 0.18 0.24 ;ĂͿƐĐĂƩĞƌƉůŽƚ͕ZĞŶƐŝŶŬ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ƽ භ from above from below JND vs What does the perception of correlation in other charts look like? better worse
55. ;ďͿƐĐĂƩĞƌƉůŽƚ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ;ĐͿƐĐĂƩĞƌƉůŽƚƌĞŐƌĞƐƐŝŽŶ rA 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ 0.0 0.00 0.06 0.12 0.18 0.24 0.00 0.06 0.12 0.18 0.24 ;ĂͿƐĐĂƩĞƌƉůŽƚ͕ZĞŶƐŝŶŬ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ƽ භ from above from below JND What if the perception of correlation in other charts also follows Weber’s law? better worse
56. ;ďͿƐĐĂƩĞƌƉůŽƚ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ;ĐͿƐĐĂƩĞƌƉůŽƚƌĞŐƌĞƐƐŝŽŶ rA 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ 0.0 0.00 0.06 0.12 0.18 0.24 0.00 0.06 0.12 0.18 0.24 ;ĂͿƐĐĂƩĞƌƉůŽƚ͕ZĞŶƐŝŶŬ r 0.0 0.2 0.4 0.6 0.8 1.0 0.00 0.06 0.12 0.18 0.24 ƽ ƽ ƽ ƽ ƽ ƽ ƽ භ from above from below JND What if the perception of correlation in other charts also follows Weber’s law? vs better worse
57. Experiment
58. Stimuli: 
 9 chart types depicting 
 bi-variate data
59. r = -1 r = -0.8 r = -0.3 r = 0.3 r = 0.8 r = 1 scatterplot parallel coordinates (pcp) stackedarea
60. coordinates (pcp) stackedarea stackedline stackedbar r = -1 r = -0.8 r = -0.3 r = 0.3 r = 0.8 r = 1 scatterplot parallel coordinates (pcp) stackedarea
61. radar line ordered line r = -1 r = -0.8 r = -0.3 r = 0.3 r = 0.8 r = 1 scatterplot parallel coordinates (pcp) stackedarea
62. stackedbar donut radar line r = -1 r = -0.8 r = -0.3 r = 0.3 r = 0.8 r = 1 scatterplot parallel coordinates (pcp) stackedarea
63. Methodology: Crowdsourced* on Amazon’s Mechanical Turk
64. - n=1687 (AMT) - 9 charts - Normal data (in charts) - Between subjects - “Staircase” methodology - Kruskal-Wallis (overall) - Mann-Whitney 
 (post-hoc) - Bonferonni correction
 (p < 0.0036) Design Analyses
65. Results
66. scatterplot − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • scatterplot − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • parallel coordinates − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • parallel coordinates − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • stackedarea − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • stackedarea − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedline − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedline − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedbar − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedbar − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • donut − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • donut − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • line − positive jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • line − negative jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • radar − positive jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • radar − negative jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • ordered line − positive jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • ordered line − negative jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • 1. Inferred JNDs from experiment data for each chart and for 
 positive/negative correlations.
67. scatterplot − positive r 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • scatterplot − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • parallel coordinates − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • parallel coordinates − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • stackedarea − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • stackedarea − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedline − positive r 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedline − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedbar − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedbar − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • donut − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • donut − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • line − positive 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • line − negative jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • radar − positive jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • radar − negative jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • ordered line − positive jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • ordered line − negative jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • •
68. scatterplot − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • scatterplot − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • parallel coordinates − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • parallel coordinates − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • stackedarea − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • • stackedarea − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedline − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedline − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedbar − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • stackedbar − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • donut − positive r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • donut − negative r jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • line − positive jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • line − negative jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • radar − positive jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • radar − negative jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • ordered line − positive jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • ordered line − negative jnd 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 • • • • • • • • • • • • 2. Tested Weber-model fit using previously- established methodologies. 1. Inferred JNDs from experiment data for each chart and for 
 positive/negative correlations. model fit results 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 ordered line line radar stackedline stackedarea stackedbar donut scatterplot parallel coordinates scatterplot, Rensink positive negative JND rA
69. model fit results 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 ordered line line radar stackedline stackedarea stackedbar donut scatterplot parallel coordinates scatterplot, Rensink positive negative JND rA less precise more precise
70. ! !!! !
71. The perception of correlation 
 in every tested chart can be modeled using Weber’s law.
72. You can do a lot of good with good models.
73. 1. Perceptually-backed ranking of precision for judging correlation
74. model fit results 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 ordered line line radar stackedline stackedarea stackedbar donut scatterplot parallel coordinates scatterplot, Rensink positive negative JND rA less precise more precise
75. model fit results 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 ordered line line radar stackedline stackedarea stackedbar donut scatterplot parallel coordinates scatterplot, Rensink positive negative JND rA Obtain rankings at each |r|
76. Perceptually-backed ranking for vis of correlation
79. Interpolated (predicted) performance from models
80. Overall ranking
81. Perceptually-backed ranking for vis of correlation
82. 2. Explore properties of the perceptual space of correlation.
83. r = -1 r = -0.8 r = -0.3 r = 0.3 r = 0.8 r = 1 scatterplot parallel coordinates (pcp) stackedarea
84. 0.7 0.8 0.85 scatterplot (positive) scatterplot (negative) parallel coordinates (negative) parallel coordinates (positive) Symmetric Not Symmetric ✓ ✓ ✓ X 0.7 0.8 0.85 ✓ Differences reliably 
 perceived Differences
 (not) reliably 
 perceived X
85. 0.7 0.8 0.85 scatterplot (positive) scatterplot (negative) parallel coordinates (negative) parallel coordinates (positive) Symmetric Asymmetric ✓ ✓ ✓ X 0.7 0.8 0.85 ✓ Differences reliably 
 perceived Differences
 (not) reliably 
 perceived X
86. sp and pcp 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 parallelCoordinates scatterplot positive negative -PCP as good as scatterplots +PCP terrible
87. To show correlations precisely in parallel coordinates plots, flip the axes to show as many negative correlations as possible. Design implication: scatterplot (positive) scatterplot (negative) parallel coordinates (negative) parallel coordinates (positive) scatterplot (positive) scatterplot (negative) parallel coordinates (negative)
88. 3. Guide the novice user in depicting correlation.
89. stackedarea, stackedline and stackedbar 0.0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1.0 0.0 0.1 0.2 0.3 0.4 0.5 0.6 stackedline stackedarea stackedbar positive negative parallel coordinates (pcp) stackedarea stackedline stackedline stackedbar donut parallel coordinates (pcp) stackedarea stackedline stackedbar Worst Best OK
90. Future Work
91. Why does Weber’s law, which typically applies to low-level aspects of perception, work so well for modeling correlation?
92. conj: People aren’t perceiving correlation, but the visual features related to correlation.
93. r = 0.8 r = 0.5
94. r = 0.8 r = 0.5 - -
95. Theory-grounded models help build the science of visualization while providing actionable information to inform visualization design. To summarize:
96. Data, Code, Analysis Scripts, Paper:
 github.com/TuftsVALT/ranking-correlation Lane Harrison (lane@cs.tufts.edu)