You are on page 1of 6

See

discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/271080745

Cognitive fallacies and criminal investigations

ARTICLE in SCIENCE & JUSTICE · JANUARY 2015


Impact Factor: 1.42 · DOI: 10.1016/j.scijus.2014.12.007

READS

54

1 AUTHOR:

Hans Ditrich
University of Vienna
28 PUBLICATIONS 132 CITATIONS

SEE PROFILE

All in-text references underlined in blue are linked to publications on ResearchGate, Available from: Hans Ditrich
letting you access and read them immediately. Retrieved on: 15 February 2016
SCIJUS-00498; No of Pages 5
Science and Justice xxx (2014) xxx–xxx

Contents lists available at ScienceDirect

Science and Justice


journal homepage: www.elsevier.com/locate/scijus

Cognitive fallacies and criminal investigations


Hans Ditrich
Department I/9 SIAK, Institute for Science and Research, Federal Ministry of the Interior, Herrengasse 7, Vienna 1014, Austria

a r t i c l e i n f o a b s t r a c t

Article history: The human mind is susceptible to inherent fallacies that often hamper fully rational action. Many such miscon-
Received 15 May 2014 ceptions have an evolutionary background and are thus difficult to avert. Deficits in the reliability of eye-
Received in revised form 15 December 2014 witnesses are well known to legal professionals; however, less attention has been paid to such effects in crime
Accepted 17 December 2014
investigators.
Available online xxxx
In order to obtain an “inside view” on the role of cognitive misconceptions in criminalistic work, a list of fallacies
Keywords:
from the literature was adapted to criminalistic settings. The statements on this list were rated by highly experi-
Criminal investigations enced crime scene investigators according to the assumed likelihood of these errors to appear and their severity
Cognitive errors of effect. Among others, selective perception, expectation and confirmation bias, anchoring/“pars per toto” errors
Error management and “onus probandi”—shifting the burden of proof from the investigator to the suspect—were frequently consid-
ered to negatively affect criminal investigations.
As a consequence, the following measures are proposed: alerting investigating officers in their training to cogni-
tive fallacies and promoting the exchange of experiences in peer circles of investigators on a regular basis. Fur-
thermore, the improvement of the organizational error culture and the establishment of a failure analysis
system in order to identify and alleviate error prone processes are suggested.
© 2014 Forensic Science Society. Published by Elsevier Ireland Ltd. All rights reserved.

1. Introduction concerning the implications of cognitive fallacies in crime investigators


are gaining attention in the last decades (see, e.g., [7] for references).
There can be no doubt that every suspect is entitled to the highest There are several, partly conflicting, error-handling strategies. In the
possible standards of investigation in a modern legal system. Despite production of goods or services, a reduction of errors (defined as varia-
potential constraints from budgetary restrictions or political trends, tions), preferably to zero, is the goal of quality management and quality
such a high-level-approach to criminal examinations forms an integral assurance programs. Instead, an open approach to mistakes and a positive
part of a fair trial and thus is a basal human right. However, even taking attitude that reduces personal fears of admitting them is often promoted
best intentions for granted, errors do occur at all levels and are inherent- in organizations that are devoted to innovation, research and develop-
ly unavoidable (e.g., [1]). This fact is often attributed to “Murphy's law” ment. The latter often favor a position that regards errors as an opportu-
but was already accepted in ancient Rome. However, while Seneca's nity for improvement. Accordingly, flexibility in problem management
(4 BC–65 AC) aphorism, “errare humanum est—to err is human”—is and collective solving strategies, as well as successful handling of unex-
common knowledge, the rest of this sentence “… sed persevare pected complications, are regarded as assets to be refined [8,9]. None of
diabolicum—to persist (in error) is diabolical”—is less often cited. these approaches seems ideally suited for criminalistic investigations.
Any attempt at improvement requires intense investigation of the Formal quality management systems by their very nature can only
causative factors (e.g., [2,3]) that lead to an error. Instead, the first im- measure aberrations from a “perfect” prototype. Consequently, such
pulse of individuals and organizations is often to cover up eventual mis- control systems are aiming at highest homogeny. The establishment of
takes. Such a “denial behavior” can itself already be regarded as a quality standards (e.g., [10]) is certainly essential in criminalistic work.
cognitive distortion strategy (e.g., [4,5]). Inappropriate error-handling However, merely following some methodical guidelines might be insuf-
strategies not only violate individual rights, with often tragic conse- ficient for reaching an accurate conclusion even in rather small, techni-
quences, but also negate the basis of scientific progress [6]—gaining in- cal fields of forensic investigations (e.g., gunshot residue analysis [11]).
formation from eliminating mistakes. In the classical scientific process, the peer-review system, as well as
The unreliability of human perception had already been demonstrated follow-up studies, serves as error correction measures. However, this
for eye-witnesses by Franz von Liszt over a century ago. However, studies approach is usually unfeasible in forensic investigations [12]. For medi-
cal procedures and doubtful cases of death, autopsies may be regarded
as an (ultimate) quality control.
Generally, in the legal system, the well-established practice of error
E-mail address: hans.ditrich@bmi.gv.at. correction involves appeal and a new hearing. Nevertheless, this

http://dx.doi.org/10.1016/j.scijus.2014.12.007
1355-0306/© 2014 Forensic Science Society. Published by Elsevier Ireland Ltd. All rights reserved.

Please cite this article as: H. Ditrich, Cognitive fallacies and criminal investigations, Sci. Justice (2014), http://dx.doi.org/10.1016/
j.scijus.2014.12.007
2 H. Ditrich / Science and Justice xxx (2014) xxx–xxx

approach also has its eminent drawbacks. First, it requires knowledge awareness of practitioners may or may not represent the most critical
(and proof) of where, when and in which context a mistake happened sources of errors but certainly can be regarded as a substantial source
as the burden of proof rests on the appellant. Second, a certain financial of information. Nevertheless, it should be kept in mind that categoriza-
capacity and sufficient time are required, the latter being a resource that tions are intrinsically theoretical models and that real world mistakes
is normally not refundable (e.g., child custody, business options, etc.). may be the combined product of several fallacies.
Consequently, while recognizing that 100% perfection is not sustain-
able—even if it might be achieved temporarily—the establishment of a 3.1. Selective perception, expectation and confirmation bias—the tendency
supplementary system of error handling at the organizational level to search for, agree with or interpret information in a way that confirms
might further improve the overall quality of the legal system. one's own presumptions

2. Incentives This mental bias is common to nearly everyone. However, every pre-
caution should be taken to avoid this mistake in a criminal investigation
Mistakes may be divided into several categories. Many technical or (see also e.g., [36,37]). While it might not always be favorable for per-
structural mistakes can be avoided by organizational measures, such sonal self-esteem to question, critically review and eventually declare
as better equipment, modified operating rules or improved training. one's own hypotheses to be false, this is certainly indispensable—not
A similar approach pertains to qualification/competence/profession- only in forensic work but in every knowledge gaining process (e.g.,
alism issues. High levels of training and education are essential and have [6]). In crime scene work, an overlooked or disregarded piece of evi-
to be provided, ensured and continuously refined. However, personal dence is often lost forever. Consequently, traces that are seemingly irrel-
experience and mental agility are essential qualities (compare [13]), evant or even disagree with the “working hypothesis” also deserve
that unfortunately can be transferred by formal teaching only to a limit- careful documentation and preservation.
ed extent. Personal integrity and commitment of the investigating offi- Concealing exculpatory evidence from the defendant and the court
cers are additional qualities of central significance. To select for, keep, was reported as the most common serious form of official misconduct
maintain and monitor such characteristics are demanding challenges [2, p. 66]. However, whether such deficiencies are the result of willful
for both the investigating officer and his/her organization. misconduct or a consequence of negligent action is a matter of liability,
In addition to such demands, an often underestimated problem that though initially of lesser importance to the individual under suspicion.
afflicts successful problem solving at the individual (and consequently Still, if such negligence is a consequence of cognitive fallacies there
also the organizational) level are cognitive failures that subconsciously might be procedural measures to avoid it.
influence the perception and evaluation of evidence. However, as forensic
investigations—like any other—involve human assessment and interpre-
tation, the cognitive premises of human cognition must not be ignored. 3.2. Anchoring/“pars per toto”—overestimating the validity of (even inap-
Numerous examinations relating to erroneous action and their propriate) partial information, i.e., to “anchor” a decision on a previously
prevention have been carried out in the fields of aviation (see registered detail while disregarding new, supplementary facts
e.g., [14–17]), clinical medicine (e.g., [18–22]) and also in general man-
agement (e.g., [9]). Systematic error analysis is also often carried out for Professional experience is undoubtedly an important asset. Previ-
sites where an accumulation of traffic accidents is encountered. In con- ously collected information concerning other issues can profoundly
sequence, architectural measures (road design, traffic signs/lights, mir- support the process of finding and evaluating evidence. However, it is
rors, roundabouts, etc.) are implemented independently of the eventual rather tempting to conclude the following: “When I see a bird that
personal faults (e.g., [23,24]). walks like a duck and swims like a duck and quacks like a duck, I call
Still, there are comparatively few studies on the influence of the that bird a duck.”1 This theorem is often valid, but it should be kept in
individual's cognitive disposition to forensic problem solving. However, mind that there are about 150 different species in the family of ducks
certain aspects such as decision making [25,26] or the coordination of (Anatidae). Accordingly, decisions based on a few, familiar features
experts at crime scenes [27], and different aspects of criminological may probably be correct very often (and time saving, thus “economic”)
work like the interpretation of fingerprints [28–31] or the reliability of but regrettably not always, as they might also ignore other crucial de-
person identification by witnesses (e.g., in CCTV recordings, line ups tails (see also [38]).
or photo-collections) have been investigated [32–35]. In contrast, long tried and tested methods should not be dismissed.
Overconfidence in a—usually modern—technical method might also be
3. Assessment included in this group of conceptual failures. For example, at the begin-
ning of the century the collection of DNA, data was frequently consid-
The professional opinion of highly experienced crime scene officers ered as “ultima ratio” in criminalistics, thought to deliver doubt-free
was obtained for assessing the relevance of cognitive bias for criminal evidence and thus rendering many other investigation methods outdat-
investigations. These officers had a minimum of 10 years, mostly over ed. However, this resulted in adverse effects when more traditional ap-
20 years of professional practice and are in charge of investigation proaches were neglected. While DNA typing increasingly becomes a
teams as leading officers. standard technique, it is also demystified and more conventional
A list of cognitive errors in medical diagnosis [18] was abridged and crime scene procedures are employed again.
adapted to criminal scenarios. The resulting list of statements was
rated by the officers according to their personal opinion on a five grade 3.3. Burden of proof/“onus probandi”—shifting the burden of proof from the
verbal scale from appearing “very often” to “never.” The officers were investigator to the suspect
asked to select those problematic concepts that they regard as most com-
monly appearing and having the strongest adverse effect on practical Most legal systems respect the ancient roman legal rule “in dubio pro
criminalistic work based on their expert knowledge. Accordingly, the rat- rheo.” Even though this principle of “being innocent until proven guilty”
ings are based solely on the individual experience of the investigators. is occasionally ignored in prosecution, it is fundamental to all modern,
No ranking or quantitative interpretation can be derived from these democratic, juridical frameworks. However, this standard is sometimes
statements as the number of available individuals was too small to allow even disregarded in the formulation of legal acts, for example, in the
statistically significant evaluations. Still, using a structured approach, fields of product liability or environmental safety issues. Shifting or
the experience of qualified investigators may provide useful “inside in-
formation” to assess caveats in their professional duties. The problem 1
Quote attributed to the poet James W. Riley around 1883-1885.

Please cite this article as: H. Ditrich, Cognitive fallacies and criminal investigations, Sci. Justice (2014), http://dx.doi.org/10.1016/
j.scijus.2014.12.007
H. Ditrich / Science and Justice xxx (2014) xxx–xxx 3

reversing of the burden of proof regrettably often forms the rationale fallacy, clustering error)—can be expected to adversely influence solving
behind large scale surveillance or public monitoring measures. a criminal case. This group of errors is based on positing that a hypoth-
While some success may be attributed to such methods, it is logically esis based on a sequence of observations is true, even though the under-
impossible and often also practically difficult to prove that something lying data are insufficient (i.e., not enough observations were made).
“was not there” or “didn't happen.” The argument from ignorance2— Closely related to the latter misconceptions is the “search satisficing”
the absence of evidence is no evidence of absence …—may not always error. This is often promoted or even provoked by economic consider-
lead to valid conclusions and certainly implies caution when evaluating ations. Hence, if a search is called off as soon as a presumably conclusive
evidence. feature is discovered, resources are certainly spared but important evi-
Nevertheless, in any investigation, it is clearly the obligation of the dence might be lost. As such, a compromise—completeness versus effi-
investigator to provide evidence for the guilt and/or innocence of a sus- ciency (and swiftness)—is required in every search.
pect as part of the “fair trial” principle (e.g., §3 StPO in Austria). All humans—not only criminal investigators—are prone to “cum/post
hoc ergo propter hoc” errors, i.e., accepting spurious correlations. How-
3.4. The cognitive biases outlined above were picked as having the highest ever, neglecting the axiom that correlation is not equivalent to causation
de facto potential to influence a criminal investigation adversely. In addi- has severe consequences in the interpretation of evidence.
tion, the following errors were also marked as likely to appear and obstruc- For example, a personal trace, such as DNA or a fingerprint, can only
tive to perceive facts be considered as evidence that a suspect was in contact with a given ob-
ject (disregarding the possibility of secondary transfer for the moment).
To deduce a progression of events from such a trace remains a supposi-
⁎ “Knowledge bias” should not be confused with the selective percep-
tion based on probability (see also [41]). While the detection of causal-
tion, expectation and confirmation bias complex mentioned before.
ity is certainly the most important issue in all research, this subject
Instead, this error results from the tendency to choose the most fa-
remains often rather speculative in some criminal investigations. Still,
miliar option, i.e., to “walk the well-known path” and thus seems
attempts of fitting the evidence to the conclusions—or “Procrustes” at-
more related to anchoring bias. However, while it is highly probable
tempts at explanations—should be avoided.
that a solution that already worked for several times before will also
be suited to solving future problems, better alternatives may be
overlooked due to a lack of flexibility.
4. External factors
Knowledge bias may also be a consequence of (inherently inflexible)
standard operating procedures (SOPs) that are often endorsed by
Significant contributions to the identification of mistakes that oc-
quality management systems. Nevertheless, standardization (and
curred during the investigation of a crime often come solely from the
certification) of operating procedures can only assure formal com-
side of the defendant/lawyer, by appealing, occasionally from the
pliance with an approved method for dealing with repetitive and
media or also just from the wisdom of hindsight.
substantially homogenous processes. Thus, quality management
It is a common practice to attribute and explain failures on the basis
rules can only be applied to a certain limit to “new,” unforeseen
of personal incompetence. However, individual culpability is not always
problems. While a certain standardization of the criminal investiga-
sufficient to explain flaws in complex investigations that involve nu-
tion process is clearly indispensable, the question of how to provide
merous, apparently capable and often also highly experienced officers.
the highest investigative quality when dealing with “extraordinary”
Nevertheless, some errors can be attributed to human failure of a single
criminal cases remains.
investigator or a few individuals. Still, inadequate actions may originate
⁎ Thinking in stereotypes—“overgeneralization” can also be viewed as
from widely different premises.
a special form of the anchoring/“pars per toto” fallacy. Prejudices are
There can be no doubt that police work and especially crime scene
often derived from socio-cultural differences, thus discriminating
investigations impose high stress levels on the officers in charge. Right
“us” from “the other” based on common, distinctive features.
from the beginning, in addition to the challenges of crime scene work it-
When certain properties of individuals are generalized as character-
self, there is strong pressure from superiors, the public and the media, at
istic of the whole group, such an attitude may lead to inappropriate
least in seemingly spectacular cases. High pressure to succeed lasts on
reactions, breach of the principle of equality and acting out eventual
otherwise often under-supported units. This high stress level at a
tendencies of xenophobia and racism. Conversely, “attractive”
crime scene, and also insufficient training or personal motives such as
suspects may face bias as well, e.g., in assessing their likelihood of
burnout and resignation or, on the other hand, hubris and craving for
committing certain crime types [39] or in judgments of their ac-
recognition, may lead to inadequate action. Pressure from media can
countability [40]. This bias is not only an issue for juries or judges
have strongly adverse effects on an investigation. If not handled proper-
but may also play a role in the initial investigations, e.g., in an inter-
ly, the request from journalists to achieve (and communicate) results
rogation or a line-up.
quickly almost inevitably provokes premature conclusions.
⁎ Similar to the former problem are the “fallacy of division” and the “fal-
Some additional factors that can lead to failure have a methodical
lacy of composition” biases. Properties that are found to be true in one
background. Applying sometimes poorly understood new scientific
part of a complex issue do not necessarily imply that the whole com-
methods to an investigation may lead to “tunnel vision”—thus neglecting
plex is correct. Vice versa, if a statement is accepted as being true, this
other, maybe less trendy alternatives. In general, relying on authorities
does not necessarily mean that all of its details must be true as well.
without challenging the validity of their competence can be problematic.
Moreover, written sources should be evaluated critically, as not every
study is based on consensus and even correct information may lead to
3.5. The following issues were not particularly marked in the survey but wrong conclusions (e.g., anchoring). This is certainly difficult for anyone
were still regarded as problematic upon questioning, albeit considered as who is unfamiliar with the specific subject; however, it should be re-
less substantial in the initial steps of an investigation membered that an expert can only be an expert in a specific field.
Usage of statistical methods—while indispensable in many scientific
Many widespread misconceptions—especially those regarding (sta- and practical questions—may have only limited benefits in criminal in-
tistical) probabilities, such as assuming a homogenous distribution of vestigations. Even the highest levels of statistical significance can only
data values (hasty generalizations, black swan blindness, gambler's prove correlations and do not provide information on causalities. Forensic
reasoning on a statistical basis is restrained by the induction problem—
2
attributed to John Locke, 1689. the “black swan fallacy.” Furthermore, objects to be statistically evaluated

Please cite this article as: H. Ditrich, Cognitive fallacies and criminal investigations, Sci. Justice (2014), http://dx.doi.org/10.1016/
j.scijus.2014.12.007
4 H. Ditrich / Science and Justice xxx (2014) xxx–xxx

should ideally differ in only a very few properties, a condition that is nor- are usually carried out by superiors, special commissions or legal
mally not found when looking at criminal cases. bodies. Individual culpability normally results in disciplinary mea-
Obstacles to a successful investigation may also be generated from sures, liability or even penal law. Uncovered structural problems
within the organization. Frequently, intra-organizational pressures can be dealt with comparatively easily, e.g., by refining training pro-
such as the compulsion to “solve” a certain amount of cases—implying grams, modified operation rules, better equipment or improved su-
sentencing as guilty—can result in a biased collection and evaluation pervision.
of evidence, thus disregarding “fair trial” and the principle of “innocent However, as failures are not always just a consequence of faulty
until proven guilty” mentioned before (e.g., [34]). equipment or individual mistakes, organizations should also critical-
It should also be kept in mind that in strongly hierarchical organiza- ly evaluate some of their own premises. Hierarchical structure, uni-
tions such as the police, an unconventional, potentially appropriate or formity as well as peer pressure are inherent characteristics of law
creative approach at a lower level might be obstructed by superiors enforcement organizations (among others). Unfortunately, the
for a variety of reasons. Furthermore, the Dunning–Kruger effect— same factors are fundamental triggers for inappropriate actions. Ac-
overestimating one's own competence [42]—may result in a “chain re- cordingly, a corporate strategy should be developed that is open to
action” that hinders innovative initiatives—especially under “bottom- acknowledging mistakes—independently of possible liability, disci-
up” circumstances. The adverse consequences of the Dunning–Kruger plinary or legal questions. Understandably, many experts—not only
effect cannot be over-estimated—in organizations in general, as well in law enforcement—have a certain disposition to cover mistakes
as in criminal prosecution services. The combination of incompetence in order not to harm the public image of their profession. This
and hubris underlying this fallacy inevitably leads to selective percep- attitude, however, may also hinder the rational analysis of errors
tions or cognitive dissonance experiences, resulting in inappropriate ap- and consequently their mitigation. A policy of error denial—even
preciation of circumstances and consequently in flawed actions. when based on considerations to maintain society's confidence in
the legal system—inhibits the improvement of investigative process-
5. Conclusions es and discourages the critical evaluation of actions. Consequently, a
setting where errors are regarded as an incentive for improvement—
It seems evident that, in many criminal cases that were not optimally notwithstanding all personal implications—is required. This is
investigated, the crucial faults were made at the very beginning of the in- certainly a demanding task; however, numerous pertinent manage-
vestigation, often at the crime scene itself. Most other, subsequent stages ment consulting companies or counselors for organizational culture
of a criminal procedure can be reviewed, repeated and also corrected if development can be recruited for implementing such a strategy.
necessary. However, in crime scene work, each piece of evidence ⁎) Errors that already have been uncovered should be investigated by a
that is initially neglected may be lost forever. Considering this pivotal po- commission that is as far as possible apart from the regular hierarchy
sition in a legal procedure, the question of how optimum performance in where the error occurred. Members should conform to high profes-
the initial stage of an investigation can be assured seems fundamental. sional standards but be from outside to avoid routine-blindness. Ob-
In addition, a general improvement in error management for viously, influences from peer pressure as well as from superiors
criminalistic work seems desirable. Focusing on the possible effects of must be prevented.
cognitive biases, a few provisions may help in diminishing—if not Such a commission should not be targeting personal culpability nor
preventing—some of the negative consequences: should it attempt to repair a mistake, i.e., solve a case. The former
should remain in the competence of the established disciplinary au-
⁎) At the individual level, the crime scene investigators in charge or offi- thorities; the latter would be “cold case management” and thus a
cers leading a criminal investigation should be made aware of the in- different task. Instead, the commission should focus on the premises
fluence of cognitive biases. In accordance with their specific role in the that resulted in an error, investigating mainly the operational and
legal process, prosecutors, coroners, forensic medical experts and structural causes.
judges might also benefit from pertinent training (compare [27]).
While it is unlikely that basic human cognitive predispositions can Economic constraints may suggest that only spectacular, “impor-
easily be changed, it may be assumed that a certain attention towards tant” cases should be reviewed. However, everyday routine errors
possibly misleading conceptions might be acquired by adequate train- might in particular be identified by an established error analysis process
ing. Such an educational program module should point out the behav- (see e.g., [43]), resulting in an overall reduced error rate and conse-
ioral roots of cognitive fallacies and include coaching as well as quently better performance and higher efficiency in the long run. Anal-
practical training (e.g., video-controlled exercises and group feed- ogous to, e.g., traffic safety, such studies may identify “hot spots” where
back). Officers who participate in criminal investigations should be errors accumulate and thus provide the opportunity to neutralize such
made aware of their own cognitive premises. Once alerted, the inves- “danger zones” by suitable measures. By recognizing and marking pro-
tigators might be more mindful to the effects of otherwise fully un- cesses that are particularly prone to errors, it might also be possible to
conscious influences. At least they should be made aware of the avoid small adverse effects that would otherwise be too “insignificant”
most common bias, i.e., the conviction that oneself is free of biases. for official consideration. Although prominent cases make headlines in
⁎) Furthermore, officers from different investigative teams should the media, it is rather the small faults in a criminal process that influence
meet on a regular basis to present and openly discuss “peculiar” the performance of a legal system and also increase overall costs.
cases—how they were treated and possibly solved, what were the Establishing a board of error analysis (and improvement) might
obstacles and how they were overcome. The usual (vertical) infor- therefore be well worth the effort with regard to investigative perfor-
mation flow—reporting just to superiors, prosecutors and judges— mance as well as economically. Analogous to boards that are regularly
hinders the sharing of experiences and thus restricts the most valu- established for controlling disciplinary and financial matters in most
able source of information for practitioners. This holds even true for private and public administrations, it is suggested here that criminal in-
cases covered by the media, as accuracy and completeness of public vestigations should be evaluated by a group of experts that is operating
information is often insufficient for professional commitments. Such independent from the regular organizational hierarchy on an institu-
a structured exchange of experience would likely contribute to the tionalized basis.
“seven distinct critical skill sets for top performance in CSE (crime
scene examiners)” as postulated by Kelty et al. [13]. Summarizing, it may be stated that criminal investigators are—like
⁎) Attempting to improve the error culture at the level of an organiza- all humans—prone to cognitive fallacies. Nevertheless, the professional
tion is a rather complex task. Examinations of personal misconduct experience and problem awareness of senior officers is an important

Please cite this article as: H. Ditrich, Cognitive fallacies and criminal investigations, Sci. Justice (2014), http://dx.doi.org/10.1016/
j.scijus.2014.12.007
H. Ditrich / Science and Justice xxx (2014) xxx–xxx 5

resource of information. Several types of cognitive errors were marked [16] US Department of Defense, The Human Factors Analysis and Classification System
HFACS 2005, http://www.uscg.mil/safety/docs/ergo_hfacs/hfacs.pdf (acc. 17. 10.
as having a high potential of adversely influencing criminal investiga- 2013).
tions. This first-hand knowledge was thus integrated in this study, in ad- [17] I.E. Dror, Cognitive science serving security: assuring useable and efficient biometric
dition to academic studies from the literature. and technological solutions, Aviat. Secur. Int. 12 (2006) (2006) 21–28.
[18] P. Croskerry, The importance of cognitive errors in diagnosis and strategies to min-
The implications of misconceptions for the results of an inquiry may imize them, Acad. Med. 78 (2003) 775–780.
be severe. It is therefore suggested that the awareness of the officers to [19] J. Zhang, V.L. Patel, T.R. Johnson, E.H. Shortliffe, A cognitive taxonomy of medical er-
adverse cognitive effects should be increased by dedicated training and rors, J. Biomed. Inform. 37 (2004) 193–204.
[20] J.W. Hurst, Cognitive errors (Can they be prevented?), Am. J. Cardiol. 101 (2008)
in peer group discussions. 1513–1517.
Additionally, interdependencies and the background of activities, as [21] I. Patel, R. Balkrishnan, Medication error management around the globe: an over-
well as the influence of the organizational framework, should be ana- view, Ind. J. Pharm. Sci. 72 (2010) 539–545.
[22] I.E. Dror, A novel approach to minimize error in the medical domain: cognitive neu-
lyzed by an independent board in order to examine eventual flaws in
roscientific insights into training, Med. Teach. 33 (2011) 34–38.
criminal investigations. Such assessments should target the develop- [23] http://www.usroads.com/journals/rmej/9801/rm980102.htm (acc. 18. 10. 2013).
ment and further refinement of a system that—while recognizing that [24] G. Lovegrove, T. Sayed, Macro-level collision models for evaluating neighborhood
a failure rate of zero is unattainable—absorbs mistakes and minimizes traffic safety, Can. J. Civ. Eng. 33 (2006) 609–621.
[25] I. Helsloot, J. Groenendaal, Naturalistic decision making in forensic science: toward a
the adverse effects of errors. better understanding of decision making by forensic team leaders, J. Forensic Sci. 56
(2011) 890–897.
Acknowledgments [26] I. Dror, The ambition to be scientific: human expert performance and objectivity, Sci.
Justice 53 (2013) 81–82.
[27] R. Julian, S. Kelty, J. Robertson, “Get it right the first time”: critical issues at the crime
The author is greatly indebted to the officers that helped in this scene, Curr. Issues Crim. Justice 24 (2012) 25–37.
study and feels obliged to respect their request to remain anonymous. [28] I.E. Dror, D. Charlton, Why experts make errors, J. Forensic Identif. 56 (2006)
600–616.
[29] T.A. Busey, I.E. Dror, Special abilities and vulnerabilities in forensic expertise, The
References Fingerprint Sourcebook, US Dept. of Justice, Washington, 2012, pp. 15/1–15/23
(Chapter 15).
[1] P. Watzlawick, The situation is hopeless, but not serious: (the pursuit of unhappi- [30] J.R. Vanderkolk, Examination Process, The Fingerprint Sourcebook, US Dept. of Jus-
ness), Norton, New York, 1983, ISBN 978-0-393-31021-4. tice, Washington, 2012, pp. 9/1–9/26 (Chapter 9).
[2] S.R. Gross, M. Schaffner, Exonerations in the United States, 1989–2012, Report by [31] P.A.F. Frazer-Mackenzie, I.E. Dror, K. Wertheim, Cognitive and contextual influences
the National Registry of Exonerations, University of Michigan Public Law Working in determination of latent fingerprint suitability for identification judgments, Sci.
Paper 277, 2012, pp. 1–103. Justice 53 (2013) 144–153.
[3] I.E. Dror, Combating bias: the next step in fighting cognitive and psychological con- [32] G.L. Wells, M. Small, S. Penrod, R.S. Malpass, S.M. Fulero, C.A.E. Brimacombe, Eyewit-
tamination, J. Forensic Sci. 57 (2012) 267–277. ness identification procedures: recommendations for lineups and photospreads,
[4] I. Stringer, Cognitive Distortions—A Practitioner's Portfolio, Forensic Psychology Law Hum. Behav. 22 (1998) 603–647.
Practice Ltd, Boldmere, 1999. 1–27. [33] T.A. Busey, G.R. Loftus, Cognitive science and the law, Trends Cogn. Sci. 11 (2007)
[5] C. Tavris, E. Aronson, in: Mistakes were made (but not by me) (Ed.), Law and Disor- 111–117.
der, Harvest Harcourt, Orlando, ISBN: 978-0-15-101098-1, 2008, pp. 127–157. [34] A.C. Krix, M. Sauerland, Im Zweifel für den Angeklagten: Über Fehlerquellen von
[6] K. Popper, Objective Knowledge: An Evolutionary Approach, Clarendon Press, Ox- Zeugenaussagen, Inquisitive Mind 1 (2011) (2011) 12–21.
ford, 1972, ISBN 0-19-875024-2. [35] D. Canter, L. Hammond, D. Youngs, Cognitive bias in line-up identifications: the im-
[7] I. Dror (Ed.)Cognitive Factors in Forensic Science, Science and Justice—Topical Col- pact of administrator knowledge, Sci. Justice 53 (2013) 83–88.
lection Issue, 2014 (http://scienceandjusticejournal.com/content/scijus-forensic – [36] S.D. Charman, The forensic confirmation bias: a problem of evidence integration, not
acc. 27. 3. 2014). just evidence evaluation, J. Appl. Res. Mem. Cognit. 2 (2013) 56–58.
[8] R.L. Helmreich, Error management as organisational strategy, Proceedings of the [37] S.M. Kassin, I.E. Dror, J. Kukucka, The forensic confirmation bias: problems, perspec-
IATA Human Factors Seminar, Bangkok, 1998, pp. 1–7. tives and proposed solutions, J. Appl. Res. Mem. Cognit. 2 (2013) 42–52.
[9] C. van Dyck, M. Frese, M. Baer, S. Sonntag, Organizational error management culture [38] M.J. Saks, D.M. Risinger, R. Rosenthal, W.C. Thompson, Context effects in forensic sci-
and its impact on performance: a two-study replication, J. Appl. Psychol. 90 (2005) ence: a review and application of the science of science to crime laboratory practice
1228–1240. in the United States, Sci. Justice 43 (2003) 77–90.
[10] EA-5/03 Guidance for the implementation of ISO/IEC 17020 in the field of crime [39] M. Saladin, Z. Saper, L. Breen, Perceived attractiveness and attributions of criminal-
scene investigation, http://www.european-accreditation.org/n1/doc/EA-1-01. ity: what is beautiful is not criminal, Can. J. Criminol. 30 (1988) 251–259.
pdf2008 (acc. 12. 11. 2013). [40] H. Sigall, N. Ostrove, Beautiful but dangerous: effects of offender attractiveness and
[11] H. Ditrich, Distribution of gunshot residues—the influence of weapon type, Forensic nature of the crime on juridic judgement, J. Pers. Soc. Psychol. 31 (1975) 410–414.
Sci. Int. 220 (2012) 85–90. [41] A. Biedermann, P. Garbolino, F. Taroni, The subjectivist interpretation of probability
[12] H. Ditrich, Scientific background of criminal investigations—does “forensic science” and the problem of individualization in forensic science, Sci. Justice 53 (2013)
exist? Forensic Perspectives, SIAK Scientific Series, vol. 6, 2011, pp. 13–40. 192–200.
[13] S.F. Kelty, R. Julian, J. Robertson, Professionalism in crime scene examination: the [42] J. Kruger, D. Dunning, Unskilled and unaware of it: how difficulties in recognizing
seven key attributes of top crime scene examiners, Forensic Sci. Policy Manage. 2 one's own incompetence lead to inflated self-assessments, J. Pers. Soc. Psychol. 77
(2011) 175–186. (1999) 1121–1134.
[14] R.L. Helmreich, On error management: lessons from aviation, Br. Med. J. 320 (2000) [43] Department of Defense Human Factors Analysis and Classification System (DOD
781–785. HFACS).
[15] D. Maurino, Threat and Error Management (TEM), Proceedings of the Canadian Avi-
ation Safety Seminar (CASS) Vancouver, Threat and Error Management (TEM) in Air
Traffic Control, ICAO 2005, 2005 (http://www.skybrary.aero/bookshelf/books/515.
pdf - acc. 6. 5. 2013).

Please cite this article as: H. Ditrich, Cognitive fallacies and criminal investigations, Sci. Justice (2014), http://dx.doi.org/10.1016/
j.scijus.2014.12.007

You might also like