Tweet
Tweet

Slide 1

Slide 1 text

Open Source is Not Enough: The Importance of Algorithm Transparency

Slide 2

Slide 2 text

Rachel Shadoan @rachelshadoan @akashiclabs

Slide 3

Slide 3 text

What is an algorithm? Inputs Finite ordered list of instructions Outputs

Slide 4

Slide 4 text

Recipes are algorithms Yogurt Mango Ice 1.Place inputs in blender 2.Blend until smooth Smoothie

Slide 5

Slide 5 text

Outputs Depend on Inputs Yogurt Mango Ice 1.Place inputs in blender 2.Blend until smooth Smoothie No ingredients → No smoothie

Slide 6

Slide 6 text

Outputs Depend on Inputs Rocks Wood chips Motor oil 1.Place inputs in blender 2.Blend until smooth Giant mess Bad ingredients → bad smoothie

Slide 7

Slide 7 text

We are algorithms Environmental Stimulus Really Complex Biological Stuff Thoughts and Actions

Slide 8

Slide 8 text

We can only think about the things we’ve been exposed to

Slide 9

Slide 9 text

Evaluating the quality of the inputs we receive is necessary to evaluate the quality of our thoughts

Slide 10

Slide 10 text

Unknown Unknowns Really Complex Biological Stuff Thoughts and Actions Opaque algorithms interfere with our ability to evaluate the validity/value of inputs to our brain algorithm ???? ???? Opaque (“Black Box”) Algorithm

Slide 11

Slide 11 text

Algorithm Transparency Means No Secrets • Inputs can be scrutinized • Control surfaces are clearly described • Algorithm steps and internal state can be scrutinized • Assumptions and models used by the algorithm are clearly described • Justification available for outputs produced

Slide 12

Slide 12 text

Old Information Access Algorithms

Slide 13

Slide 13 text

No content

Slide 14

Slide 14 text

No content

Slide 15

Slide 15 text

No content

Slide 16

Slide 16 text

Internet-Age Information Access Algorithms

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

No content

Slide 19

Slide 19 text

No content

Slide 20

Slide 20 text

No content

Slide 21

Slide 21 text

So what can we do?

Slide 22

Slide 22 text

Open those opaque boxes! • Support projects that use transparent algorithms • Demand transparency from the opaque algorithms you use • Foster algorithm transparency in your own projects

Slide 23

Slide 23 text

But my algorithms are already open source!

Slide 24

Slide 24 text

But my users don’t want to know!

Slide 25

Slide 25 text

But my algorithm is too advanced to explain to my users!

Slide 26

Slide 26 text

Transparency for Your Projects

Slide 27

Slide 27 text

Talk to Your Users • How do they think it works? • What control do they think they have over its outputs? • What do they wish they knew about it?

Slide 28

Slide 28 text

Document, Document, Document • What inputs does the algorithm work on? • What internal state does the algorithm maintain? • What assumptions/models does the algorithm use? • What control surfaces does the algorithm have? • For any given result, why was that result produced?

Slide 29

Slide 29 text

No content

Slide 30

Slide 30 text

Credits Al McNutty, CC 2.0, via Flickr Megan Amaral, CC 2.0, via Flickr Kyle aka Wackyland, CC 2.0, via Flickr UConn Libraries MAGIC, CC 2.0, via Flickr Pete aka ComedyNose, CC 2.0, via Flickr Smithsonian’s National Zoo, CC 2.0, via Flickr

Slide 31

Slide 31 text

Credits, Continued Malingering, CC 2.0, via Flickr Ourania, CC 2.0, via Flickr