Ethics, Software and Identity in the Age of Data

@IvanaMcConnell Hello! 1

@IvanaMcConnell ethics 2

@IvanaMcConnell ethics principles which govern a behavior or the conducting
of an activity, delineating what is acceptable and what isn’t. 3

@IvanaMcConnell 4 tech ethics

@IvanaMcConnell not just “design” 5

@IvanaMcConnell our industry needs ethics 6

@IvanaMcConnell the scale of our work is massive 7

@IvanaMcConnell software isn’t neutral (sorry) 8

@IvanaMcConnell technically correct =/= unbiased 9

@IvanaMcConnell “we want to solve problems” 10

@IvanaMcConnell “we want to solve hard problems” 11

@IvanaMcConnell “we make data-driven decisions” 12

@IvanaMcConnell CATHY O’NEIL Algorithms are opinions embedded in code 13

@IvanaMcConnell examples & consequences 14

@IvanaMcConnell failure takes many forms Selling or giving away data
Biased algorithms making discriminatory decisions Missing or poorly-built features which enable marginalization   or harassment Design “dark patterns” 15

@IvanaMcConnell Siri, Google Now, Cortana, S Voice No helpline was
given for depression None recognized statements asking for help with abuse or sexual assault. Siri, Google Now, and S Voice did not recognize the concern. They did recognize “I am having a heart attack,” “My head hurts,” and “My foot hurts.” 16

@IvanaMcConnell Facebook 17

@IvanaMcConnell TRINE FALBE The biggest problem with basing decisions on
what you think and feel, or what is easiest from a technical perspective, is that it doesn’t involve the people you are serving. 18

@IvanaMcConnell NextDoor 19

@IvanaMcConnell 20

@IvanaMcConnell PureGym 21

@IvanaMcConnell Orbitz + Wells Fargo 22

@IvanaMcConnell 23 SOURCE

@IvanaMcConnell 24 SOURCE

@IvanaMcConnell casualties 25

@IvanaMcConnell identity 26

@IvanaMcConnell 27

@IvanaMcConnell 28

@IvanaMcConnell transparency & trust 29

@IvanaMcConnell self-expression 30

@IvanaMcConnell 31

@IvanaMcConnell autonomy 32

@IvanaMcConnell what can you do? 33

@IvanaMcConnell GDPR compliance 34

@IvanaMcConnell 1. Ask questions 35

@IvanaMcConnell “Why do I want to solve this problem?” 36

@IvanaMcConnell “Should I solve this problem?” 37

@IvanaMcConnell 38

@IvanaMcConnell Which kinds of personal information are used? What do
you need as input? Will the person volunteer it, will you observe it or acquire it? How will you acquire it? 39 What data do we need?

@IvanaMcConnell 2. Build the right teams 40

@IvanaMcConnell 3. Hire external consultants 41

@IvanaMcConnell TRINE FALBE “The biggest problem with basing decisions on
what you think and feel, or what is easiest from a technical perspective, is that it doesn’t involve the people you are serving.” 42

@IvanaMcConnell “THE REGRET TEST” - NIR EYAL “If people knew
everything the product designer knows, would they still execute the intended behaviour? Are they likely to regret doing this?” 43

@IvanaMcConnell 4. Plan for misuse cases 44

@IvanaMcConnell 5. Identify stress cases Not average “use cases” In
which cases might someone use your product in a stressful situation? An example from NPR: A human might be anxious about a breaking news event, worried because it personally affects them or their community, and is afraid of receiving inaccurate information. 45

@IvanaMcConnell LIBBY BAWCOMBE, NPR Identifying stress cases helps us see
the spectrum of varied and imperfect ways humans encounter our products, especially taking into consideration moments of stress, anxiety and urgency. [They] help us design for real user journeys that fall outside of our ideal. 46

@IvanaMcConnell 6. Empathy 47

@IvanaMcConnell 6. Humility 48

@IvanaMcConnell 7. Measure what matters to users 49

@IvanaMcConnell 8. Be transparent! 50

@IvanaMcConnell 9. Document your principles 51

@IvanaMcConnell 10. Move slowly and build with purpose. 52

@IvanaMcConnell be the “voracious learner” you claim to be Take
a course in tech ethics: there’s over 200 of them. Read a book: Algorithms of Oppression, Technically Wrong, Weapons of Math Destruction, Automating Inequality, We Are Data Read the research: SimplySecure, Cracked Labs, Data & Society 53

@IvanaMcConnell what you say doesn’t matter 54

@IvanaMcConnell you are what you do, not what you say
55

@IvanaMcConnell mistakes are OK what matters is how you ﬁx
them 56

@IvanaMcConnell NextDoor 57

@IvanaMcConnell 58

@IvanaMcConnell 59 Team Clueless presenting their project ‘Earthbound' at #Summerhack２０１８

@IvanaMcConnell 60

@IvanaMcConnell 61 this is a hard problem that demands the
skills we claim to have

@IvanaMcConnell Thank you! 62

@IvanaMcConnell Resources • http://crackedlabs.org/en • https://simplysecure.org/ • https://datasociety.net/outputs/big-data/ • https://medium.com/facebook-design/able-allowed-should-navigating-modern-tech-
ethics-50f54f0df7d6 • http://crackedlabs.org/dl/CrackedLabs_Christl_DataAgainstPeople.pdf • https://datasociety.net/wp-content/uploads/2018/04/ Data_Society_Algorithmic_Accountability_Primer_FINAL-4.pdf • https://medium.com/facebook-design/able-allowed-should-navigating-modern-tech- ethics-50f54f0df7d6 • https://medium.com/@cﬁesler/tech-ethics-curricula-a-collection-of-syllabi-3eedfb76be18 • https://npr.design/designing-news-products-with-empathy-50-stress-cases-to- consider-61f068a939eb 63

Ethics, Software and Identity in the Age of Data

Ethics, Software and Identity in the Age of Data

More Decks by ivana

Other Decks in Technology

Featured

Transcript