Skip to main content
SpringerLink
Log in

Judgemental errors in aviation maintenance

  • Original Article
  • Published:
Cognition, Technology & Work Aims and scope Submit manuscript

Abstract

Aircraft maintenance is a critical success factor in the aviation sector, and incorrect maintenance actions themselves can be the cause of accidents. Judgemental errors are the top causal factors of maintenance-related aviation accidents. This study asks why judgemental errors occur in maintenance. Referring to six aviation accidents, we show how various biases contributed to those accidents. We first filtered aviation accident reports, looking for accidents linked to errors in maintenance judgements. We analysed the investigation reports, as well as the relevant interview transcriptions. Then we set the characteristics of the actions behind the accidents within the context of the literature and the taxonomy of reasons for judgemental biases. Our results demonstrate how various biases, such as theory-induced blindness, optimistic bias, and substitution bias misled maintenance technicians and eventually become the main cause of a catastrophe. We also find these biases are interrelated, with one causing another to develop. We discuss how these judgemental errors could relate to loss of situation awareness, and suggest interventions to mitigate them.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  • Almutairi AF, Gardner GE, McCarthy A (2014) Practical guidance for the use of a pattern-matching technique in case-study research: a case presentation. Nurs Health Sci 16(2):239–244

    Google Scholar 

  • Arnott D (1998) A taxonomy of decision biases. Monash University, School of Information Management and Systems, Caulfield

    Google Scholar 

  • Arnott DR (2006) Cognitive biases and decision support systems development: a design science approach. Inf Syst J 16:55–78

    Google Scholar 

  • Baddeley M (2015) Herding, social influences and behavioural bias in scientific research. EMBO reports 1;16(8):902-5

  • Bauer M (2000) Classical content analysis: a review. In Bauer MW, Gaskell G Qualitative researching with text, image and sound. SAGE Publications Ltd, London, pp 132–151. https://doi.org/10.4135/9781849209731

  • Baybutt P (2016) Cognitive biases in process hazard analysis. J Loss Prev Process Ind 1(43):372–377

    Google Scholar 

  • Brooks B, Curnin S, Owen C, Bearman C (2019) Managing cognitive biases during disaster response: the development of an aide memoire. Cognition, Technology & Work, pp 1–3

  • Chen T (2017) Not just noise: individual differences in cognitive ability and response bias. Dissertations, University of Massachusetts, Amherst

  • Dobler CC, Morrow AS, Kamath CC (2019) Clinicians’ cognitive biases: a potential barrier to implementation of evidence-based clinical practice. BMJ Evid-Based Med 24:137–140

    Google Scholar 

  • Doyle JR (2013) Survey of time preference, delay discounting models. Judgm Decision Mak 8(2):116–135

    Google Scholar 

  • Dube C, Rotello CM, Heit E (2010) Assessing the belief bias effect with ROCs: it’s a response bias effect. Psychol Rev 117(3):831–863. https://doi.org/10.1037/a0019634

    Article  Google Scholar 

  • East R (2016) Bias in the evaluation of research methods. Mark Theory 16(2):219–231

    Google Scholar 

  • Endsley MR (1988) Design and evaluation for situation awareness enhancement. In: Proceedings of the human factors society 32nd annual meeting, human factors society, Santa Monica, pp 97–101

  • Endsley MR (1995) Toward a theory of situation awareness in dynamic systems. Hum Factors 37(1):32–64

    Google Scholar 

  • Endsley MR (2000) Theoretical underpinnings of situation awareness: a critical review. In: Endsley MR, Garland DJ (eds) Situation awareness analysis and measurement, Mahwah, NJ, pp 3–32

  • Endsley MR (2004) Situation awareness: progress and directions. In: Banbury S, Tremblay S (eds) A cognitive approach to situation awareness: theory, measurement and application. Ashgate Publishing, Aldershot, pp 317–341

    Google Scholar 

  • Endsley MR (2015) Situation awareness misconceptions and misunderstandings. J Cogn Eng Decision Mak 9(1):4–32

    Google Scholar 

  • Endsley MR, Jones DG (2012) Designing for situation awareness: an approach to human-centered design, 2nd edn. Taylor & Francis, London

    Google Scholar 

  • Festinger L (1962) Cognitive dissonance. Sci Am 207(4):93–106

    Google Scholar 

  • Fischhoff B (1982) Debiasing. In: Kahneman D, Slovic P, Tversky A (eds) Judgment under uncertainty: Heuristics and biases Cambridge. Cambridge University Press, England, pp 422–444

    Google Scholar 

  • Gauffroy C, Barrouillet P (2009) Heuristic and analytic processes in mental models for conditionals: an integrative developmental theory. Dev Rev 29:249–282

    Google Scholar 

  • Gerring J, Cojocaru L (2016) Case-selection: a diversity of methods and criteria. Sociol Methods Res 4:392–423

    Google Scholar 

  • Getzmann S, Jasny J, Falkenstein M (2016) Switching of auditory attention in “cocktail-party” listening: ERP evidence of cueing effects in younger and older adults. Brain Cogn 111:1–12. https://doi.org/10.1016/j.bandc.2016.09.006

    Article  Google Scholar 

  • Gigerenzer G, Todd P (1999) Simple heuristics that make us smart. Oxford Univ. Press, Oxford

    Google Scholar 

  • Gigerenzer G, Hoffrage U, Goldstein DG (2008) Postscript: fast and frugal heuristics. Psychol Rev 115(1):238–239

    Google Scholar 

  • Griffin D, Tversky A (1992) The weighing of evidence and the determinants of confidence. Cogn Psychol 24(3):411–435

    Google Scholar 

  • Illankoon P, Abeysekera J, Singh S (2016) Ergonomics for enhancing detection of machine abnormalities. Work 55(2):271–280

    Google Scholar 

  • Illankoon P, Tretten P, Kumar U (2018) Identifying significance of human cognition in future maintenance operations. In: International conference on intelligent human systems integration. Springer, Cham, pp 550–556

  • Illankoon P, Manathunge Y, Tretten P, Abeysekara J, Singh S (2019a) Lockout and tagout in a manufacturing setting from a situation awareness perspective. Safety 5(2):25

    Google Scholar 

  • Illankoon P, Tretten P, Kumar U (2019b) A prospective study of maintenance deviations using HFACS–ME. Int J Ind Ergon. https://doi.org/10.1016/j.ergon.2019.102852

    Article  Google Scholar 

  • Illankoon P, Tretten P, Kumar U (2019c) Modelling human cognition of abnormal machine behaviour. Hum-Intell Syst Integr 1:3. https://doi.org/10.1007/s42454-019-00002-x

    Article  Google Scholar 

  • Kahneman D (2011) Thinking, fast and slow. Macmillan, London

    Google Scholar 

  • Kahneman D, Frederick S (2002) Representativeness revisited: attribute substitution in intuitive judgment. Heuristics Biases Psychol Intuitive Judgm 49:81

    Google Scholar 

  • Kahneman D, Klein G (2009) Conditions for intuitive expertise: a failure to disagree. Am Psychol 80:237–251

    Google Scholar 

  • Kahneman D, Slovic P, Tversky A (1982) Judgment under uncertainty: heuristics and biases. Cambridge University Press, Cambridge. https://doi.org/10.1017/cbo9780511809477

    Book  Google Scholar 

  • Kelly TP, Lam W, Whittle BR (1996) Diary of a domain analyst: a domain analysis case-study from avionics. In: Proceedings of IFIP Working Groups 8.1/13.2 Conference, Domain Knowledge for Interactive System Design, Geneva, pp 8–10

  • Kinsey MJ, Gwynne SM, Kuligowski ED, Kinateder M (2019) Cognitive biases within decision making during fire evacuations. Fire Technol 55(2):465–485

    Google Scholar 

  • Klein G (2008) Naturalistic decision making. Hum Factors 50(3):456–460

    Google Scholar 

  • Krulak DC (2004) Human factors in maintenance: impact on aircraft mishap frequency and severity. Aviat Space Environ Med 75:429–432

    Google Scholar 

  • Lewis-Beck MS, Bryman A, Futing Liao T (2004) The SAGE encyclopedia of social science research methods. Sage Publications, Thousand Oaks. https://doi.org/10.4135/9781412950589

    Book  Google Scholar 

  • Liu P, Du Y, Xu Z (2019) Machines versus humans: people’s biased responses to traffic accidents involving self-driving vehicles. Accid Anal Prev 1(125):232–240

    Google Scholar 

  • Mack A, Rock I (1999) Inattentional blindness. MIT Press, Cambridge

    Google Scholar 

  • Marewski JN, Gaissmaier W, Gigerenzer G (2010) Good judgments do not require complex cognition. Cogn Process 11(2):103–121

    Google Scholar 

  • Mills AJ, Durepos G, Wiebe E (2010) Encyclopedia of case study research (Vols. 1–0). SAGE Publications, Thousand Oaks. https://doi.org/10.4135/9781412957397

    Book  Google Scholar 

  • Mittal SK (2019) Behavior biases and investment decision: theoretical and research framework. Qual Res Financ Markets. https://doi.org/10.1108/QRFM-09-2017-0085

    Article  Google Scholar 

  • Moray NA (1990) Lattice theory approach to the structure of mental models. Philos Trans R Soc Lond Biol Sci 327(1241):577–583

    Google Scholar 

  • Murata A, Nakamura T, Karwowski W (2015) Influence of cognitive biases in distorting decision making and leading to critical unfavorable incidents. Safety 1(1):44–58

    Google Scholar 

  • Nelson GS (2019) Bias in artificial intelligence. N C Med J 80(4):220–222

    Google Scholar 

  • NTSB (2002) Accident Report NTSB/AAR-02/01, PB2002-910402. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0201.pdf. Accessed 14 Nov 2018

  • NTSB (2004) Accident Report NTSB/AAR-04/01, PB2004-910401. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0401.pdf. Accessed 11 Feb 2019

  • NTSB (2007) Accident Report NTSB/AAR-07/04, PB2007-910405. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0704.pdf. Accessed 27 Nov 2018

  • NTSB (2009a) Accident Report NTSB/AAR-09/03, PB2009-910403. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0903.pdf. Accessed 16 Jan 2019

  • NTSB (2009b) Accident Report NTSB/AAR-09/01/SUM, PB2009-910401. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR0901.pdf. Accessed 16 Nov 2018

  • NTSB (2013) Accident Report NTSB/AAR-13/01, PB2013-103890. https://www.ntsb.gov/investigations/AccidentReports/Reports/AAR1301.pdf. Accessed 27 Nov 2018

  • Onwuegbuzie AJ, Leech NL, Collins KM (2012) Qualitative analysis techniques for the review of the literature. Qualitative Report 17(56):1–28. http://www.nova.edu/ssss/QR/QR17/onwuegbuzie.pdf. Accessed 5 Dec 2018

    Google Scholar 

  • O’Regan JK, Rensink RA, Clark JJ (1999) Change-blindness as a result of “mudsplashes”“. Nature 398(6722):34. https://doi.org/10.1038/17953

    Article  Google Scholar 

  • Peón D, Antelo M, Calvo-Silvosa A (2017) An inclusive taxonomy of behavioral biases. Eur J Gov Econ 6(1):24–58. https://doi.org/10.17979/ejge.2017.6.1.4322

    Article  Google Scholar 

  • Plant KL, Stanton NA (2013) The explanatory power of schema theory: theoretical foundations and future applications in Ergonomics. Ergonomics 56(1):1–15

    Google Scholar 

  • Rabin M, Schrag J (1999) First impressions matter: a model of confirmatory bias. Quart J Econ 114(1):37–82. https://doi.org/10.1162/003355399555945

    Article  MATH  Google Scholar 

  • Rashid HSJ, Place CS, Braithwaite GR (2013) Investigating the investigations: a retrospective study in the aviation maintenance error causation. Cogn Technol Work 15:171. https://doi.org/10.1007/s10111-011-0210-7

    Article  Google Scholar 

  • Rasmussen J (1983) Skills, rules, and knowledge; signals, signs and symbols, and other distinctions in human performance models. IEEE Trans Sys Man Cybern 13:257–266

    Google Scholar 

  • Reason J, Hobbs A (2003) Managing maintenance error: a practical guide. Ashgate Publishing Company, Burlington

    Google Scholar 

  • Ryan A, Duignan S, Kenny D, McMahon CJ (2018) Decision making in paediatric cardiology. Are we prone to heuristics, biases and traps?. Pediatric cardiology 1;39(1):160-7

  • Sarter NB, Woods DD (1991) Situation awareness: a critical but ill-defined phenomenon. Int J Aviation Psychol 1(1):45–57

    Google Scholar 

  • Schmidt JK, Figlock RC, Teeters CD (1999) Human factors analysis of naval transport aircraft maintenance and flight line related incidents (No. 1999-01-2981). SAE Technical Paper

  • Schmidt J, Schmorrow D, Figlock R (2000) Human factors analysis of naval aviation maintenance related mishaps. Proc Hum Factors Ergon Soc Annu Meeting 44(22):775–778

    Google Scholar 

  • Schmidt JK, Lawson D, Figlock R (2003) Human Factors Analysis & Classification System–Maintenance Extension (HFACS–ME) Review of Select NTSB Maintenance Mishaps: An Update

  • Schoenlein M (2017) Assessing the Relationship Between Change Blindness and the Anchoring Effect. Honors Projects. 245. https://scholarworks.bgsu.edu/honorsprojects/245. Accessed 5 Mar 2019

  • Stake RE (2000) Case studies. In: Denzin NK, Lincoln YS (eds) Handbook of qualitative research. Sage, Thousand Oaks, pp 435–453

    Google Scholar 

  • Taylor J (2016) Cognitive biases are bad for business: industry insights. Prof Account 1(27):24–25

    Google Scholar 

  • Tversky A, Kahneman D (1971) The belief in the law of small numbers. Psychol Bull 76(2):105–110. https://doi.org/10.1037/h0031322

    Article  Google Scholar 

  • Tversky A, Kahneman D (1974) Judgment under Uncertainty: heuristics and Biases. Science 185(4157):1124–1131 (New Series)

    Google Scholar 

  • Tversky A, Kahneman D (1991) Loss aversion in riskless choice: a reference-dependent model. Q J Econ 106(4):1039–1061. https://doi.org/10.2307/2937956

    Article  Google Scholar 

  • Vanderhaegen F (2017) Towards increased systems resilience: new challenges based on dissonance control for human reliability in Cyber-Physical & Human Systems. Annu Rev Control 1(44):316–322

    Google Scholar 

  • Vanderhaegen F, Carsten O (2017) Can dissonance engineering improve risk analysis of human–machine systems? Cogn Tech Work 19:1–12. https://doi.org/10.1007/s10111-017-0405-7

    Article  Google Scholar 

  • Virine L, Trumper M, Virine E (2018) Heuristics and biases in project management. PM World J 7(1):1–11

    Google Scholar 

  • Wattanacharoensil W, La-ornual D (2019) A systematic review of cognitive biases in tourist decisions. Tour Manag 1(75):353–369

    Google Scholar 

  • Weick K (1993) Sensemaking in organizations: small structures with large consequences. In: Mumingham J (ed) Social psychology in organizations: Advances in theory and research. Prentice-Hall, Englewood Cliffs, NJ

    Google Scholar 

  • Wickens TD (2002) Elementary signal detection theory. Oxford University Press, Oxford

    Google Scholar 

  • Wickens CD, Parasuraman R, Simon B, Hollands JG (2015) Engineering psychology and human performance, 4th edn. Routledge, London

    Google Scholar 

  • Wood G (1978) The knew-it-all-along effect. J Exp Psychol Hum Percept Perform 4:345–353

    Google Scholar 

  • Yin RK (2009) Case study research: design and methods, 4th edn. Sage, Thousand Oaks

    Google Scholar 

  • Zhang SX, Cueto J (2017) The study of bias in entrepreneurship. Entrep Theory Pract 41(3):419–454

    Google Scholar 

Download references

Acknowledgements

Open access funding provided by Lulea University of Technology. This project is a part of the human factors research at the Division of Operations and Maintenance, Luleå University of Technology, funded by the Luleå Railway Research Centre (JVTC).

Author information

Authors and Affiliations

  1. Division of Operations and Maintenance, Luleå University of Technology, Luleå, Sweden

    Prasanna Illankoon & Phillip Tretten

Authors
  1. Prasanna Illankoon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Phillip Tretten
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Prasanna Illankoon.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Illankoon, P., Tretten, P. Judgemental errors in aviation maintenance. Cogn Tech Work 22, 769–786 (2020). https://doi.org/10.1007/s10111-019-00609-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10111-019-00609-9

Keywords

Search

Navigation