So, you think you're a good person

by Per Axbom

Slide 1

Slide 1 text

@axbom you’re a you think So… good person @axbom World IA Day Zürich 2019 axbom.eu/wiad19

Slide 2

Slide 2 text

@axbom

Slide 3

Slide 3 text

@axbom Nest Secure from Google

Slide 4

Slide 4 text

@axbom I have lied

Slide 5

Slide 5 text

@axbom I have lied

Slide 6

Slide 6 text

@axbom I have lied I have lied to someone I care about

Slide 7

Slide 7 text

@axbom I have lied I have lied to someone I care about I have made design decisions with too little data

Slide 8

Slide 8 text

@axbom I have lied I have lied to someone I care about I have made design decisions with too little data I believe I will continue to lie

Slide 9

Slide 9 text

@axbom I have lied I have lied to someone I care about I have made design decisions with too little data I believe I will continue to lie I believe I will continue to design with too little data

Slide 10

Slide 10 text

@axbom I have lied I have lied to someone I care about I have made design decisions with too little data I believe I will continue to lie I believe I will continue to design with too little data I am a good liar

Slide 11

Slide 11 text

@axbom a person who is skilled in lying good liar

Slide 12

Slide 12 text

@axbom a person who is skilled in lying a person who is skilled in being a person good liar good person

Slide 13

Slide 13 text

@axbom IDEO: We create positive impact through design. Smart design: We are a ﬆrategic design company that helps people live better and work smarter. Cooper: We work with companies to create products and services that people love. Frog: frog advances the human experience through design. Adobe: Changing the world through digital experiences We want so much…

Slide 14

Slide 14 text

@axbom “Making the world a better place” If you can suggeﬆ that this is your calling, then chances are you are yourself in a pretty decent place.

Slide 15

Slide 15 text

@axbom Donating clothes https://www.nytimes.com/2017/10/12/world/africa/east-africa-rwanda-used-clothing.html?

Slide 16

Slide 16 text

@axbom “Who was that person in that movie with the pyramids and the spaceships? That bald guy with the laugh? He was in that Christmas movie with the skyscraper. Oh and married to that woman from Ghost…”

Slide 17

Slide 17 text

@axbom “Please don’t chew with your mouth open.”

Slide 18

Slide 18 text

@axbom “Please don’t google at the dinner table.”

Slide 19

Slide 19 text

@axbom A human moment

Slide 20

Slide 20 text

@axbom A human moment The correct answer is not the goal.   The shared experience is.

Slide 21

Slide 21 text

@axbom A human moment The correct answer is not the goal.   The shared experience is. Design solves for the correct answer, but should also allow the choice of not pursuing the answer.

Slide 22

Slide 22 text

@axbom Taking breaks from devices  Turning off notifications  Not installing more apps  Smartphone-free zones Pushing back Closing accounts  VPN and Adblockers  Organising walkouts  Noise boxes

Slide 23

Slide 23 text

@axbom

Slide 24

Slide 24 text

@axbom https://www.fastcompany.com/90290703/this-is-the-ﬁrst-truly-great-amazon-alexa-and-google-home-hack

Slide 25

Slide 25 text

@axbom Photo: Paul Clarke (CC-BY) https://www.vanityfair.com/news/2018/07/the-man-who-created-the-world-wide-web-has-some-regrets

Slide 26

Slide 26 text

@axbom What is a human enabled by technology? Maybe more important: What is one without? What are we getting wrong?

Slide 27

Slide 27 text

@axbom com puter hum an

Slide 28

Slide 28 text

@axbom com puter hum an state m arket

Slide 29

Slide 29 text

@axbom com puter hum an state m arket

Slide 30

Slide 30 text

@axbom com puter hum an state m arket Accountability? Well-being?  Ethics?

Slide 31

Slide 31 text

@axbom “Although these measures were crafted with the best of intentions, I am concerned that they inadvertently undermine our eﬀorts to ensure individualized and equal justice,” he said, adding, “they may exacerbate unwarranted and unjust disparities that are already far too common in our criminal justice system and in our society.” Attorney General Eric Holder, 2014 20% https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing

Slide 32

Slide 32 text

@axbom https://www.reuters.com/article/us-amazon-com-jobs-automation-insight/amazon-scraps-secret-ai-recruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G

Slide 33

Slide 33 text

@axbom Scraps = “You’re fired!” https://www.reuters.com/article/us-amazon-com-jobs-automation-insight/amazon-scraps-secret-ai-recruiting-tool-that-showed-bias-against-women-idUSKCN1MK08G

Slide 34

Slide 34 text

@axbom “Recycling is NOT good for the world. It is bad for the environment, it is bad for our health, and it is bad for our economy. I’m not kidding. Recycling is not good for the environment. It is destructive to the earth and it is a major contributor to global warming. Recycling is not good for our health. It contributes to obesity and diseases like heart disease and cancer. Recycling is bad for our economy. It increases the cost of a product, and in turn, the price of everything that is made with that product. Recycling is not good for our nation. We pay a tremendous price for the privilege of having the world’s most advanced and eﬃcient recycling system. Recycling is a huge, colossal waste of time, energy, money, and resources.”

Slide 35

Slide 35 text

@axbom This person does not exist thispersondoesnotexist.com

Slide 36

Slide 36 text

@axbom Women received the  right to vote. Voted ﬁrst time 1921. 1919 People in care by poorhouses received the right to vote. The practice of removing adult rights from people with disabilities ended. 1945 1989 When norms change Universal suﬀrage in Sweden. (The right to vote, for all adult citizens)

Slide 37

Slide 37 text

@axbom How will algorithms change when human norms change? Or will they force a slowing of progress?

Slide 38

Slide 38 text

@axbom

Slide 39

Slide 39 text

@axbom Not being invited Not being able to pay Not being able to apply for a job Becoming less human

Slide 40

Slide 40 text

@axbom com puter hum an Do I need to be in the intersection to take part in life? As you “empowered” me, did you also take away my other choices?

Slide 41

Slide 41 text

@axbom Sorry, we’re closed.

Slide 42

Slide 42 text

@axbom Could human-centric design be making some people less human?

Slide 43

Slide 43 text

@axbom profit buyer uses reptilian brain also, making people less human is proﬁtable

Slide 44

Slide 44 text

@axbom The material we are working with is hazardous. How are we managing this in our work? physical health personal relationships mental health privacy and integrity political leverage truﬆ fact resilience decision-making

Slide 45

Slide 45 text

@axbom

Slide 46

Slide 46 text

@axbom City points in Cascais, Portugal

Slide 47

Slide 47 text

@axbom City points in Cascais, Portugal

Slide 48

Slide 48 text

@axbom City points in Cascais, Portugal

Slide 49

Slide 49 text

@axbom good person? External factors are determining what constitutes a good choice. The human is given less ability to consider which choice is best for them.

Slide 50

Slide 50 text

@axbom Impact 1st 2nd 3rd

Slide 51

Slide 51 text

@axbom Impact 1st 2nd 3rd People do good deeds Some deeds are valued more than others People won’t do good deeds without points People with more points are valued higher Crime networks Pets getting hurt

Slide 52

Slide 52 text

@axbom https://gizmodo.com/predictim-claims-its-ai-can-ﬂag-risky-babysitters-so-1830913997

Slide 53

Slide 53 text

@axbom https://www.wired.com/story/why-netﬂix-features-black-actors-promos-to-black-users/

Slide 54

Slide 54 text

@axbom Discover Deﬁne Develop Deliver

Slide 55

Slide 55 text

@axbom Discover Deﬁne Develop Deliver Who is excluded when the lines converge?

Slide 56

Slide 56 text

@axbom Design is often a source of exclusion

Slide 57

Slide 57 text

@axbom When accessibility is a side project, you are always designing for exclusion.

Slide 58

Slide 58 text

@axbom assuming responsibility

Slide 59

Slide 59 text

@axbom Did the pilot get a good night’s sleep?

Slide 60

Slide 60 text

@axbom Did the designer get a good night’s sleep?

Slide 61

Slide 61 text

@axbom Why we make bad choices Self-awareness  Time  Resilience  Understanding  Health

Slide 62

Slide 62 text

@axbom Spheres of influence I control I can influence Everything else

Slide 63

Slide 63 text

@axbom

Slide 64

Slide 64 text

@axbom The con in consent

Slide 65

Slide 65 text

@axbom The con in consent 76 work days to read all privacy policies you’re exposed to during a year https://www.theatlantic.com/technology/archive/2012/03/reading-the-privacy-policies-you-encounter-in-a-year-would-take-76-work-days/253851/

Slide 66

Slide 66 text

@axbom Who on the team has the biggeﬆ insight into the impact of the design on human beings?

Slide 67

Slide 67 text

@axbom Who on the team has the biggeﬆ insight into the impact of the design on human beings?

Slide 68

Slide 68 text

@axbom a deﬁning moment…

Slide 69

Slide 69 text

@axbom

Slide 70

Slide 70 text

@axbom the tools

Slide 71

Slide 71 text

@axbom

Slide 72

Slide 72 text

@axbom

Slide 73

Slide 73 text

@axbom

Slide 74

Slide 74 text

@axbom

Slide 75

Slide 75 text

@axbom

Slide 76

Slide 76 text

@axbom mapﬁght.appspot.com

Slide 77

Slide 77 text

@axbom

Slide 78

Slide 78 text

@axbom

Slide 79

Slide 79 text

@axbom The Authagraph map projection centered on Europe Hajime Narukawa worked for 6 years on this map, and won the 2016 Good Design Awards - Grand Award. https://curiosity.com/topics/the-authagraph-is-the-worlds-most-accurate-map-curiosity/

Slide 80

Slide 80 text

@axbom

Slide 81

Slide 81 text

@axbom

Slide 82

Slide 82 text

@axbom

Slide 83

Slide 83 text

@axbom Road space taken by 60 people on a bus on bicycles in cars

Slide 84

Slide 84 text

@axbom Road space taken by 60 people fossil-fuel cars electric cars autonomous cars

Slide 85

Slide 85 text

@axbom We can not keep using the same maps and expect negative impact to reveal itself.

Slide 86

Slide 86 text

@axbom The Inclusive Panda axbom.eu/panda

Slide 87

Slide 87 text

@axbom participants included excluded unwanted (non-participants) harmed by us at risk at risk The Inclusive Panda axbom.eu/panda

Slide 88

Slide 88 text

@axbom participants included excluded unwanted (non-participants) harmed by us at risk at risk The Inclusive Panda Use it to consider the eﬀects on more people than your “target group”. axbom.eu/panda

Slide 89

Slide 89 text

@axbom Impact mapping How harmful? How much do we contribute? How likely? How burdened? What? Who?

Slide 90

Slide 90 text

@axbom Impact mapping How harmful? How much do we contribute? How likely? How burdened? What? Who? Use it to help your organization underﬆand impact, and prioritise the backlog.

Slide 91

Slide 91 text

@axbom Force considered decisions  Educate before wider use  Match expectations  Avoid conflicts  Give relevant challenges  Improve service quality Friction

Slide 92

Slide 92 text

@axbom Force considered decisions  Educate before use  Match expectations  Avoid conflicts  Give relevant challenges  Improve service quality Friction Use it to help people think before they act

Slide 93

Slide 93 text

@axbom what now?

Slide 94

Slide 94 text

@axbom • Design excludes • Design removes abilities • Design is often short-term and manipulative • Organizations are not realising the harm until very late in the game • People are not happy and are pushing back.

Slide 95

Slide 95 text

@axbom people as cattle • The not-so-profitable are excluded and put aside, • while the rest are branded with tracking devices. • A points system separates the good ones from the bad ones, • as they are herded around specific paths to provide the highest value for the farmer…

Slide 96

Slide 96 text

@axbom As designers proclaiming human insight and a willingness to improve people’s lives…

Slide 97

Slide 97 text

@axbom As designers proclaiming human insight and a willingness to improve people’s lives… we can do better.

Slide 98

Slide 98 text

@axbom Always assume there is harm happening that you can not yet see. Take actions to find and manage it.

Slide 99

Slide 99 text

@axbom Always assume there is harm happening that you can not yet see. Take actions to find and manage it. Believe people when they say they are being hurt.

Slide 100

Slide 100 text

@axbom Ethical design is not about stopping technical innovation. It’s about influencing its direction. (with better maps and indicators) human less human less human

Slide 101

Slide 101 text

@axbom Remember:  Technology is not harmful in itself.  Technology is designed. human less human less human

Slide 102

Slide 102 text

@axbom Per, I just realised: Now I can go to work with a new goal in mind. It’s not to make as many people as possible buy as much as possible. It’s helping people make the choice that is best for them. “

Slide 103

Slide 103 text

Slide 104

Slide 104 text

@axbom In the end, the queﬆion isn’t whether or not you are a good person. It’s not about you. The queﬆion is whether you are supporting, or limiting, other people in making decisions that allow them to be a good person.