Slide 1

Slide 1 text

SAFETY SCIENCE A PRIMER Michiel Rook 
 @michieltcs

Slide 2

Slide 2 text

LEARNING FROM INCIDENTS A PRIMER Michiel Rook 
 @michieltcs

Slide 3

Slide 3 text

No content

Slide 4

Slide 4 text

No content

Slide 5

Slide 5 text

@michieltcs #StandWithUkraine (JUST) AN INTRODUCTION TO

Slide 6

Slide 6 text

@michieltcs #StandWithUkraine SAFETY SCIENCE

Slide 7

Slide 7 text

@michieltcs #StandWithUkraine INCIDENTS & ACCIDENTS

Slide 8

Slide 8 text

No content

Slide 9

Slide 9 text

No content

Slide 10

Slide 10 text

@michieltcs #StandWithUkraine LEARNING, UNDERSTANDING, IMPROVING

Slide 11

Slide 11 text

@michieltcs #StandWithUkraine LEARNING, UNDERSTANDING, IMPROVING?

Slide 12

Slide 12 text

@michieltcs #StandWithUkraine IMPORTANT THEMES AND THEORIES

Slide 13

Slide 13 text

@michieltcs #StandWithUkraine NEWTONIAN / CARTESIAN VIEWS

Slide 14

Slide 14 text

No content

Slide 15

Slide 15 text

@michieltcs #StandWithUkraine "Cartesians view the mind as being wholly separate from the corporeal body"

Slide 16

Slide 16 text

@michieltcs #StandWithUkraine REDUCTIONIST VIEW

Slide 17

Slide 17 text

No content

Slide 18

Slide 18 text

@michieltcs #StandWithUkraine 2ND & 3RD LAWS

Slide 19

Slide 19 text

@michieltcs #StandWithUkraine "The change of motion of an object is proportional to the force impressed; and is made in the direction... in which the force is impressed."

Slide 20

Slide 20 text

@michieltcs #StandWithUkraine "To every action, there is always opposed an equal reaction"

Slide 21

Slide 21 text

@michieltcs #StandWithUkraine CAUSALITY

Slide 22

Slide 22 text

@michieltcs #StandWithUkraine SYMMETRY BETWEEN 
 CAUSE & EFFECT

Slide 23

Slide 23 text

@michieltcs #StandWithUkraine “What is the cause of the accident? This question is just as bizarre as asking what the cause is of not having an accident.” S I D N E Y D E K K E R

Slide 24

Slide 24 text

@michieltcs #StandWithUkraine "SWISS CHEESE MODEL" AND SAFETY BOUNDARIES

Slide 25

Slide 25 text

@michieltcs #StandWithUkraine

Slide 26

Slide 26 text

@michieltcs #StandWithUkraine "UNCONTAINED AND HARMFUL ENERGY"

Slide 27

Slide 27 text

@michieltcs @michieltcs #StandWithUkraine

Slide 28

Slide 28 text

@michieltcs @michieltcs #StandWithUkraine

Slide 29

Slide 29 text

@michieltcs #StandWithUkraine NORMAL ACCIDENTS

Slide 30

Slide 30 text

@michieltcs #StandWithUkraine

Slide 31

Slide 31 text

@michieltcs #StandWithUkraine POTENTIAL FOR CATASTROPHE = INHERENT PROPERTY OF SOME SYSTEMS

Slide 32

Slide 32 text

@michieltcs #StandWithUkraine COMPLEXITY & COUPLING

Slide 33

Slide 33 text

@michieltcs #StandWithUkraine TIGHT COUPLING NO DELAYS & SLACK RESPONSIBILITIES CLEARLY STATED ONE METHOD TO REACH GOAL COMPLEX SYSTEM UNFAMILIAR FEEDBACK LOOPS NON-LINEAR LIMITED UNDERSTANDING FAILURES NOT ISOLATED

Slide 34

Slide 34 text

@michieltcs #StandWithUkraine REDUNDANCY & AUTOMATION BEGETS COMPLEXITY?

Slide 35

Slide 35 text

@michieltcs #StandWithUkraine COMPLEX SYSTEMS CAN BE HIGHLY RELIABLE!

Slide 36

Slide 36 text

No content

Slide 37

Slide 37 text

@michieltcs #StandWithUkraine NORMALIZATION OF DEVIANCE & PRACTICAL DRIFT

Slide 38

Slide 38 text

@michieltcs #StandWithUkraine

Slide 39

Slide 39 text

@michieltcs #StandWithUkraine ACCIDENTS HAVE HISTORY

Slide 40

Slide 40 text

@michieltcs #StandWithUkraine ACCIDENTS HAPPEN EVEN WHEN EVERY ACTOR BEHAVES AS EXPECTED!

Slide 41

Slide 41 text

@michieltcs #StandWithUkraine

Slide 42

Slide 42 text

@michieltcs #StandWithUkraine WHAT CAN GO WRONG USUALLY GOES RIGHT

Slide 43

Slide 43 text

@michieltcs #StandWithUkraine HUMAN FACTORS & HUMAN ERROR

Slide 44

Slide 44 text

@michieltcs #StandWithUkraine “A preliminary FAA review of last week’s outage of the Notice to Air Missions (NOTAM) system determined that contract personnel unintentionally deleted fi les while working to correct synchronization between the live primary database and a backup database” "According to the RBQ, a mechanic carried out a simple visual inspection of the lifts after a malfunction message — contrary to the manufacturer's guidelines — and authorized a restart."

Slide 45

Slide 45 text

@michieltcs #StandWithUkraine "LOSS OF SITUATIONAL AWARENESS"

Slide 46

Slide 46 text

@michieltcs #StandWithUkraine "INEFFECTIVE COMMUNICATION"

Slide 47

Slide 47 text

@michieltcs #StandWithUkraine "COMPLACENT"

Slide 48

Slide 48 text

@michieltcs #StandWithUkraine "NOT FOLLOWING THE ESTABLISHED RULES"

Slide 49

Slide 49 text

@michieltcs #StandWithUkraine “There is almost no human action or decision that cannot be made to look fl awed and less sensible in the misleading light of hindsight.” S I D N E Y D E K K E R

Slide 50

Slide 50 text

@michieltcs #StandWithUkraine SHARP END & BLUNT END

Slide 51

Slide 51 text

@michieltcs #StandWithUkraine HINDSIGHT BIAS

Slide 52

Slide 52 text

@michieltcs #StandWithUkraine OUTCOME BIAS

Slide 53

Slide 53 text

@michieltcs #StandWithUkraine CONFIRMATION BIAS

Slide 54

Slide 54 text

@michieltcs #StandWithUkraine WORK AS IMAGINED VS. WORK AS DONE

Slide 55

Slide 55 text

@michieltcs #StandWithUkraine LOCAL RATIONALITY

Slide 56

Slide 56 text

@michieltcs #StandWithUkraine “People do things that make sense to them, given their goals, understanding of the situation and focus of attention at that time.” E U R O C O N T R O L

Slide 57

Slide 57 text

@michieltcs #StandWithUkraine HUMANS AS A PROBLEM TO CONTROL

Slide 58

Slide 58 text

@michieltcs #StandWithUkraine VS

Slide 59

Slide 59 text

@michieltcs #StandWithUkraine HUMANS AS AN ASSET TO USE

Slide 60

Slide 60 text

@michieltcs #StandWithUkraine “Human error is both universal & inevitable.” JA M ES R E AS O N

Slide 61

Slide 61 text

@michieltcs #StandWithUkraine CONSERVATIVE & PROGRESSIVE VIEWS

Slide 62

Slide 62 text

@michieltcs #StandWithUkraine FINDING MALFUNCTIONS IN SYSTEMS

Slide 63

Slide 63 text

@michieltcs #StandWithUkraine VS

Slide 64

Slide 64 text

@michieltcs #StandWithUkraine LEARNING HOW A SYSTEM WORKS IN PRACTICE

Slide 65

Slide 65 text

@michieltcs #StandWithUkraine HUMANS AS A CAUSE

Slide 66

Slide 66 text

@michieltcs #StandWithUkraine VS

Slide 67

Slide 67 text

@michieltcs #StandWithUkraine HUMANS ARE PART OF THE SYSTEM & SUBJECT TO ITS COMPLEXITY

Slide 68

Slide 68 text

@michieltcs #StandWithUkraine ASKING WHY PEOPLE DO THINGS

Slide 69

Slide 69 text

@michieltcs #StandWithUkraine VS

Slide 70

Slide 70 text

@michieltcs #StandWithUkraine UNDERSTANDING HOW PEOPLE ADAPT

Slide 71

Slide 71 text

BACK TO HAWAII https:/ / fl ic.kr/p/9cJyEY

Slide 72

Slide 72 text

@michieltcs #StandWithUkraine TWO CLICKS OF A MOUSE?

Slide 73

Slide 73 text

@michieltcs #StandWithUkraine Events Leading Up to the False Alert 3 Time Events 0805 • HI-EMA’s midnight shift supervisor begins a no-notice ballistic missile defense drill at a shift change by placing a call, pretending to be U.S. Pacific Command, to the day shift warning officers. • The midnight shift supervisor plays a recording over the phone that properly includes the drill language “EXERCISE, EXERCISE, EXERCISE,” but also erroneously contains the text of an EAS message for a live ballistic missile alert, including the language, “THIS IS NOT A DRILL.” The recording does not follow the script contained in HI-EMA’s standard operating procedure for this drill. • The day shift warning officers receive this recorded message on speakerphone. • While other warning officers understand that this is a drill, the warning officer at the alert origination terminal claimed to believe, in a written statement provided to HI- EMA, that this was a real emergency, not a drill. 0807 • This day shift warning officer responds, as trained for a real event, by transmitting a live incoming ballistic missile alert to the State of Hawaii. • In doing so, the day shift warning officer selects the template for a live alert from a drop-down menu, and clicks “yes” in response to a prompt that reads, “Are you sure that you want to send this Alert?” Preliminary Report: Hawaii Emergency Management Agency’s January 13, 2018 False Ballistic Missile Alert.

Slide 74

Slide 74 text

@michieltcs #StandWithUkraine Preliminary Report: Hawaii Emergency Management Agency’s January 13, 2018 False Ballistic Missile Alert. Events After the False Alert 4 Time Events 0808 • Day shift warning officer receives false WEA on mobile device 0809 • HI-EMA notifies Hawaii Governor of false alert 0810 • HI-EMA to U.S. Pacific Command and Honolulu PD: no missile launch 0812 • HI-EMA issues a cancellation, ceasing retransmission over EAS, WEA 0813 • HI-EMA begins outreach, but its phone lines become congested 0820 • HI-EMA posts on Facebook, Twitter – “NO missile threat to Hawaii” 0824 • Hawaii Governor retweets notice that there is no missile threat 0827 • HI-EMA determines that an EAS, WEA Civil Emergency Message (CEM) is the best vehicle for correction 0830 • FEMA confirms HI-EMA’s view on CEM; Hawaii Governor posts correction on Facebook 0831 • HI-EMA supervisor logs into alert system, begins to create false alert correction 0845 • HI-EMA issues correction through EAS and WEA that there is no missile threat

Slide 75

Slide 75 text

@michieltcs #StandWithUkraine HUMAN ERROR?

Slide 76

Slide 76 text

@michieltcs #StandWithUkraine False Ballistic Missile Alert Investigation for January 13, 2018, Hawaii Department of Defense

Slide 77

Slide 77 text

@michieltcs #StandWithUkraine Stress or stressors ‣ Stress and anxiety created by recent North Korea nuclear attack concerns. ‣ Drills were a recently added training exercise. ‣ Drills were administered spontaneously. ‣ Experience and training ‣ Employee was a 10-year veteran of the agency and a supervisor. ‣ Standard practice test conducted during each shift change three times a day were not yet routine enough to be predictable, but they were not entirely new. ‣ Employees had not been trained on the new FEMA software currently being used. ‣ No records maintained for employee training and to what degree. Ergonomics or HMI ‣ Interfaces had not been updated. ‣ File names were very similar with little distinction between the test missile alert and the genuine missile alert. Procedures ‣ The recording does not follow the script contained in HI-EMA’s standard operating procedure for this drill. ‣ Recorded message was incorrectly interpreted as part of an unscheduled drill. ‣ “The day-shift manager was not prepared to supervise the morning test,” the FCC said. ‣ Following standard procedures, the night-shift supervisor posing as Paci fi c Command played a recorded message to the emergency workers warning them of the fake threat. The message included the phrase “Exercise, exercise, exercise.” But the message inaccurately included the phrase “This is not a drill.” Fitness for duty ‣ Reports stated that Hawaii emergency management o ff i cials knew for years that the employee had problems performing his job. ‣ In the past, the employee in question had mistakenly believed drills for tsunami and fi re warnings were actual events. ‣ Colleagues reported not feeling comfortable working with the individual. Supervisors had counselled the employee repeatedly, yet retained him for a decade in a position that had to be renewed each year. ‣ During the drill, the employee reported that he did not hear the word “exercise” repeated six times. All of the fellow o ff i cers participating in the drill con fi rmed that they had clearly heard the word “exercise” during the drill. Work processes ‣ FEMA and HI-EMA did not have clear policies for issuing alerts. HI-EMA waited for permission to issue a second alert stating that the fi rst alert was a false alarm. According to FEMA, this was not a requirement. ‣ The agency had a vague checklist for missile alerts, allowing workers to interpret the steps they should follow di ff erently. ‣ HI-EMA Managers didn’t require a second person to sign o ff on alerts before they were sent. ‣ The agency lacked any preparation on how to correct a false warning. New computer software programs had been added to the agency’s computers but no training had been conducted to teach o ff i cers how to apply it. Human Reliability Considerations from the Hawaii Ballistic Missile Alert Event

Slide 78

Slide 78 text

@michieltcs #StandWithUkraine “another clear example of how failures occur in complex technological systems” H E AT H E R M E D E M A , H A R O L D B L AC K M A N , K AT E RY N A SAVC H E N KO, R O N A L D B O R I N G

Slide 79

Slide 79 text

No content

Slide 80

Slide 80 text

@michieltcs #StandWithUkraine "Incidents are a fact of life. 
 
 How well you respond is your choice." J I M S E V E R I N O

Slide 81

Slide 81 text

@michieltcs #StandWithUkraine POST-INCIDENT REVIEWS

Slide 82

Slide 82 text

@michieltcs #StandWithUkraine (HUMAN) LIMITATIONS AND TENDENCIES

Slide 83

Slide 83 text

@michieltcs #StandWithUkraine STRESS & EMOTIONS

Slide 84

Slide 84 text

@michieltcs #StandWithUkraine BLAMELESS 
 VS 
 BLAME-AWARE

Slide 85

Slide 85 text

@michieltcs #StandWithUkraine BIASES

Slide 86

Slide 86 text

@michieltcs #StandWithUkraine COUNTERFACTUALS

Slide 87

Slide 87 text

@michieltcs #StandWithUkraine COGNITIVE EFFECTS OF CHANGES

Slide 88

Slide 88 text

@michieltcs #StandWithUkraine ROOT CAUSE ANALYSIS?

Slide 89

Slide 89 text

@michieltcs #StandWithUkraine "What you call 'root cause' is simply the place where you stop looking any further." S I D N E Y D E K K E R

Slide 90

Slide 90 text

@michieltcs #StandWithUkraine ROOT CAUSES?

Slide 91

Slide 91 text

@michieltcs #StandWithUkraine 5 WHYS

Slide 92

Slide 92 text

@michieltcs #StandWithUkraine Figure 1 A causal event tree (adapted from ref. 21). ID, identification; IT, information technology. The problem with… Alan J. Card - The problem with '5 whys' 
 BMJ quality & safety · September 2016 DOI: 10.1136/bmjqs-2016-005849

Slide 93

Slide 93 text

@michieltcs #StandWithUkraine “For every complex problem, there is an answer that is clear, simple, and wrong.” H . L . M E N C K E N

Slide 94

Slide 94 text

@michieltcs #StandWithUkraine DIAGNOSING AND FIXING PROBLEMS

Slide 95

Slide 95 text

@michieltcs #StandWithUkraine PREVENTING INCIDENTS?

Slide 96

Slide 96 text

@michieltcs #StandWithUkraine CREATING NEW INCIDENTS?

Slide 97

Slide 97 text

@michieltcs #StandWithUkraine WHAT THEN?

Slide 98

Slide 98 text

@michieltcs #StandWithUkraine WHAT INFORMATION WAS AVAILABLE?

Slide 99

Slide 99 text

@michieltcs #StandWithUkraine WHAT INFORMATION MADE SENSE?

Slide 100

Slide 100 text

@michieltcs #StandWithUkraine WHAT FACTORS CONTRIBUTED TO THE EVENT?

Slide 101

Slide 101 text

@michieltcs #StandWithUkraine HOW DID THIS DIFFER FROM "NORMAL" OPS?

Slide 102

Slide 102 text

@michieltcs #StandWithUkraine WEAK VS STRONG SIGNALS

Slide 103

Slide 103 text

@michieltcs #StandWithUkraine HOW DID PEOPLE ADAPT?

Slide 104

Slide 104 text

@michieltcs #StandWithUkraine OPERATOR EXPERIENCE

Slide 105

Slide 105 text

@michieltcs #StandWithUkraine JUST CULTURE & PSYCHOLOGICAL SAFETY

Slide 106

Slide 106 text

@michieltcs #StandWithUkraine INCIDENTS & METRICS

Slide 107

Slide 107 text

@michieltcs #StandWithUkraine DAYS SINCE LAST INCIDENT?

Slide 108

Slide 108 text

@michieltcs #StandWithUkraine

Slide 109

Slide 109 text

@michieltcs #StandWithUkraine NUMBER OF INCIDENTS?

Slide 110

Slide 110 text

@michieltcs #StandWithUkraine

Slide 111

Slide 111 text

@michieltcs #StandWithUkraine TIME TO DETECT?

Slide 112

Slide 112 text

@michieltcs #StandWithUkraine TIME TO RECOVER?

Slide 113

Slide 113 text

@michieltcs #StandWithUkraine READERS OF INCIDENT REPORTS?

Slide 114

Slide 114 text

@michieltcs #StandWithUkraine NEAR MISSES?

Slide 115

Slide 115 text

@michieltcs #StandWithUkraine HUMANS AS AN 
 (ADAPTABLE) 
 ASSET TO USE

Slide 116

Slide 116 text

@michieltcs #StandWithUkraine H T T P S : // V I M EO.C O M /370 0 0 8 1 57

Slide 117

Slide 117 text

@michieltcs #StandWithUkraine WHERE TO GO 
 FROM HERE?

Slide 118

Slide 118 text

@michieltcs #StandWithUkraine

Slide 119

Slide 119 text

@michieltcs #StandWithUkraine https:/ /www.humanfactors.lth.se/ https:/ /www.learningfromincidents.io/ https:/ /www.thevoid.community/ http:/ /resiliencepapers.club/

Slide 120

Slide 120 text

@michieltcs #StandWithUkraine “Everything is unprecedented until it happens for the fi rst time.” C H ES L E Y B . S U L L E N B E R G E R

Slide 121

Slide 121 text

@michieltcs @michieltcs #StandWithUkraine THANK YOU FOR LISTENING! twitter: @michieltcs 
 mastodon: @[email protected] 
 email: [email protected] www.michielrook.nl