generate metrics that help us get healthy -- which is awesome! I know I’ve started getting a lot more active now that it’s being measured, because I can see how active I really am, and compare myself to others to get a feel for where I stand.
measure our web traffic with Google Analytics; we measure how inﬂuential we are with Klout... And this goes back more than a hundred years - the science of ‘productivity’ came out of measuring assembly line workers to increase factory output.
Anyone remember this quote from the Team call? There’s a weird side effect that often emerges when we have a lot of metrics at our disposal. We start altering our behaviors to match the metrics, often in ways that would feel silly if we weren’t measuring things.
“The Information Diet” talks about how SEO and viewer-targeting has turned our news landscape into “junk food.” “The Filter Bubble” talks about how “magical” metrics-driven ﬁltering on sites like Google reinforces our biases rather than improving the information we have.
We’re wired to respond to metrics and measurements in potentially destructive ways. In this talk we’re going to look at three well-documented “cognitive biases” -- ruts the brain falls into easily -- that can sabotage metrics-driven approaches to problem solving.
EVENTS are more common than they really are. Nancy Grace fans are bad judges of risk. Why? Human brains are wired to believe that things we’ve seen, things we have already learned, have more weight than unknown stuff ‘out there.’
he and lots of other economists were trying to come up with good metrics for a nation’s economic health. It was important because they wanted to weigh different economic strategies and ﬁgure out which ones worked better.
and gamed the system when they realized they were being measured. Other members assumed that the easy-to-access information (someone’s score) was the best measurement. The interesting metric became a target in and of itself, and became decoupled from the underlying values.