Professional Documents
Culture Documents
net/publication/267335410
CITATIONS READS
16 644
3 authors:
Andrew Thatcher
University of the Witwatersrand
139 PUBLICATIONS 2,085 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Fiona Margaret Donald on 27 February 2018.
Applied Ergonomics
journal homepage: www.elsevier.com/locate/apergo
a r t i c l e i n f o a b s t r a c t
Article history: The aim of this study was to examine operator effectiveness in terms of detection rates and potential
Received 23 January 2014 vigilance decrements in a proactive or real time CCTV surveillance task. The study was conducted in two
Accepted 2 October 2014 stages. During stage one, 42 operators who were employed full-time in CCTV surveillance observed a 90-
Available online
min video and were required to detect four types of target behaviours. No vigilance decrement was found
for this sample as a whole. Stage two involved collecting additional data from 31 novices and dividing the
Keywords:
existing operators into two sub-samples, consisting of generalists and specialists depending on the type
Closed circuit television
of surveillance they performed at work (total N ¼ 73). Fifty percent of target behaviours were detected
Vigilance decrement
Operator performance
and false alarms were high. Vigilance decrements were found for novices and generalists, but specialists
maintained their performance for the first hour and then increased it. Results are discussed in terms of
surveillance background, work exposure, transfer of learning, selection, training and motivation and the
impact of these on vigilance and CCTV performance.
© 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.
http://dx.doi.org/10.1016/j.apergo.2014.10.001
0003-6870/© 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.
F. Donald et al. / Applied Ergonomics 47 (2015) 220e228 221
the overall level of vigilance and the vigilance decrement (Davies prison scenes but showing a lot of movement found that the range
and Parasuraman, 1982). The overall level of vigilance is a steady of detection rates decreased considerably in some instances (32%e
state that operators bring to the task and is indicated by overall 100% across experimental conditions) (Tickner and Poulton, 1973).
detection rates. The vigilance decrement refers to a decrease in Perfect detection rates were achieved only when one display was
performance over time (Parasuraman, 1984) and generally occurs observed at a time. The comparatively lower detection rates were
from 20 to 35 min (Sawin and Scerbo, 1995) after engaging in the consistent with a study of a traffic scene with lots of movement
task. If the overall level of vigilance is very low, “vigilance perfor- (Tickner and Poulton, 1968). Based on these studies, it was
mance is likely to be poor throughout the task, irrespective of concluded that continuous activity distracts participants.
whether performance declines with time on task” (Parasuraman, A comparably high detection rate of 91% was obtained in a study
1984, p. 253). Operators with a steady but low overall level of where simulated city centre incidents had to be identified, such as
vigilance are likely to miss a larger proportion of significant events the theft of a handbag (van Voorthuijsen et al., 2005). When par-
than people with high overall vigilance levels. However, the total ticipants were required to detect a person carrying a visually con-
number of significant events detected is also influenced by the spicuous open umbrella in scenes where no other umbrellas were
vigilance decrement, which may be experienced by people with present, an 85% detection rate was reported which declined to 54%
either high or low overall levels of vigilance. Anecdotal evidence as the number of monitors was increased to nine (Wallace et al.,
suggests that operator attention drifts after 15 min (Security Park, n.d.). This contrasted with the 25% detection rate obtained by op-
2001), but this has not been examined in relation to detection erators who were required to identify transient, dynamic, incon-
performance and it is not clear whether this applies to all operators. spicuous incidents of theft in an industrial setting on a single
Although there is the potential for vigilance decrements in work display (Andrew et al., 2003). Incidents were made up of a number
requiring vigilance, inconsistent results regarding the existence of of suspicious behaviours, each of which was of short duration (no
vigilance decrements have been found in complex tasks (Adams more than a few seconds). Lower detection rates were also found in
et al., 1961) and tasks that are similar to those performed in real a study involving the identification of particular individuals in
world settings (Hollenbeck et al., 1995; Molloy and Parasuraman, simulated CCTV footage over 25 min, where correct detections
1996; Moray and Haudegond, 1998; Pigeau et al., 1995). In view varied from 15% when identification was based on memory, to 30%
of variations in the information processing requirements of when observers could make comparisons with a still-frame image
different vigilance intensive jobs and the numerous factors that (Davies and Thasen, 2000). False alarm rates were high under both
affect vigilance performance, this is not surprising. However, it is conditions (60% and 65% respectively). In both Andrew et al.'s
important to understand whether decrements are likely to occur in (2003) and Davies and Thasen's (2000) studies, focal attention
specific types of work, as this has implications for system and job and detailed visual analysis were required for correct detection.
design, selection, and training. In the case of CCTV it has implica- CCTV research involving more complex and dynamic scenes con-
tions for the provision of effective service delivery in respect of trasts with the studies by Tickner and Poulton (1968, 1973, 1975),
public and organisational safety and security. Tickner and colleagues (1972), van Voorthuijsen et al. (2005), and
CCTV systems typically consist of numerous cameras, moni- Wallace et al. (n.d.) where much higher detection rates were ob-
toring and recording systems, and control room operations. Oper- tained with more visually conspicuous significant events of longer
ators may observe displays ranging from a couple of spot monitors duration.
to banks of multiplex displays, with each monitor possibly showing Regarding vigilance decrements, Tickner and Poulton (1973)
scenes from a number of cameras. Operators generally observe found significant decrements in the two-hour CCTV task but not
anything from 2 to 30 camera scenes, yielding multiple sources of in the one-hour condition. However, no decrements were found in
data. The use of multiple sources of data is not unique to CCTV. a three-hour traffic surveillance task (Tickner and Poulton, 1968)
However, with CCTV, significant events often cannot be detected at and a four-hour task involving the identification of particular in-
a glance due to the complexity and dynamic nature of the scenes dividuals and actions in a street scene (Tickner and Poulton, 1975).
being analysed and the visual inconspicuity of many significant The condition where vigilance decrements were found used scenes
events. The scenes are frequently cluttered, consist of 2- depicting only occasional movement. Tickner and Poulton (1975)
dimensional representations of 3-dimensional scenes, and concluded that vigilance decrements occur when there is little to
include events and objects that are hidden or partially obscured. observe. Andrew et al. (2003) did not find a statistically significant
Consequently, detection is not merely a perceptual process but decrement in their three-hour study. Andrew et al.'s (2003) finding
involves a high degree of interpretation and visual analysis (Donald, regarding the absence of a decrement is somewhat surprising as
2008a,b). This is particularly relevant to situations where people the complex information processing requirements of CCTV sur-
deliberately obscure objects and situations from the camera's view veillance are similar to those of tasks where vigilance decrements
to avoid detection e a feature that is shared by contexts such as typically occur (Donald, 2008a,b; Howard et al., 2009). However, it
military surveillance. Consequently many significant events in has been shown that the effects of practice can compensate for
CCTV are visually inconspicuous and are unlikely to draw attention waning vigilance (Washburn et al., 2004). This suggests that in
unless the operator understands their significance. Andrew et al.'s (2003) study, the experience and work exposure of
Existing research on CCTV surveillance has reported mixed the participants could have prevented a decrement from occurring.
findings regarding overall detection rates and vigilance decre- All participants in their study were surveillance operators who
ments. The studies have used different experimental conditions worked in the same processing plant context from which the video
(e.g. settings, camera configurations, significant events with vary- was derived.
ing degrees of visual conspicuity, samples, and time periods during The mixed results obtained in studies regarding vigilance dec-
which monitoring was required) that could account for some of the rements in CCTV surveillance suggest that a number of factors
inconsistencies in results. In a study with 16 television displays and could be influencing performance over time, including for example,
footage of prison scenes with very little movement, detection rates the types of samples, incidents, footage and task characteristics
varied from 85% to 97%, depending on experimental conditions involved (Donald, 2010). In the current study we propose that the
(Tickner et al., 1972). The significant events were conspicuous and types of CCTV surveillance which operators are accustomed to
involved two suspicious behaviours (running, and looking exces- performing could contribute to the vigilance decrement. This is
sively at perimeters such as walls). A follow-up study with similar based on evidence that task characteristics influence vigilance
222 F. Donald et al. / Applied Ergonomics 47 (2015) 220e228
decrements (Parasuraman, 1984). We identified two types of CCTV number of people whose actions unfolded over several minutes.
surveillance functions through observation of the tasks performed Participants were told to report incidents of theft, but were not
by operators and discussion with operators and managers. This informed as to how theft could occur. This is likely to have influ-
resulted in the identification of ‘generalist’ and ‘specialist’ surveil- enced participants' attention sets for incidents. As all participants
lance and we refer to participants as ‘generalists’ and ‘specialists.’ worked in the types of processing plant that was filmed in the
Generalist surveillance took place within a multifunctional role video, participants probably applied the attention sets and
within a control room. Besides surveillance, it included alarm knowledge of theft in this same context to the research task. The
monitoring, access control, ongoing communication including call task required high levels of interpretation and situation awareness
taking, and responses to parties on the ground such as police offi- regarding the specific type of processing plant filmed in the video.
cers or security. Although monitoring was an important part of the In the Andrew et al. (2003) study, participants were given a break
generalists' role, there was fairly heavy reliance on external cues after each thirty-minute period, whereas no breaks were given
(e.g., alarms, requests to monitor certain targets) that facilitated during the ninety-minute video of this study. It is possible that
knowing which cameras to monitor and where to look. This assis- breaks allowed for attention resources to be replenished and pre-
ted them in perceiving and interpreting significant events. Operator vented the vigilance decrement from occurring.
surveillance involves a lot of dichotomous detection where de- The research questions for this study were:
cisions are required regarding the presence or absence of signifi-
cant events. Generalists’ attention was therefore frequently divided What is the detection rate and level of false alarms for transient,
between these multiple tasks and monitoring, and they were not dynamic, inconspicuous target behaviours associated with theft
accustomed to deploying focused attention to the cameras for long in heavy industry, when one camera view with almost contin-
periods of time without interruption by other activities. uous movement is observed?
Operators performing specialist surveillance were primarily Is there a vigilance decrement over a ninety-minute period for
focused on monitoring and detection, and communication was the above type of footage?
usually initiated from their side in response to observed conditions. Does past experience with the specific task impact on detection
They performed extensive dedicated or focused surveillance ac- levels and the vigilance decrement?
tivities where they were responsible for identifying suspects
through associated crime behaviour, made extensive use of
behavioural indicators, observed people for long durations, and 2. Methods
audited procedures and processes. They received few external
stimuli to guide their monitoring of cameras and relied far more on The study initially focused on experienced CCTV surveillance
visual analysis and monitoring to detect significant events. Their operators (Stage 1). Stage 2 included the original operators and 31
role required focused attention over long periods of time, with few novices. Data were then analysed in terms of three strata, with
interruptions by other tasks. These activities occur routinely in high operators categorised as “generalists” and “specialists” depending
risk company operations such as casinos and precious goods on the type of surveillance task which they were accustomed to
handling, but would require police authorisation as dedicated performing at work (as defined in the introduction), and novices
surveillance in UK town centres in terms of the Regulation of forming a separate sub-sample. The same research design, pro-
Investigatory Powers Act. As with generalists, specialists were cedures, materials and types of analyses were used for the two
required to make decisions regarding the presence or absence of stages.
significant events. However, these events were generally more
inconspicuous, difficult to detect and required more interpretation
in order to make the decision. For example, in generalist surveil- 2.1. Participants
lance, significant events tended to involve larger movements (e.g., a
person crawling under a fence) that were easier to detect than the 2.1.1. Pilot studies
small, inconspicuous and transient movements involved in The sample for the pilot study on clips with target behaviours
specialist surveillance (e.g., quickly flicking a small diamond to consisted of six people. Participants were faculty members who
another location while sweeping with a broom). The researchers participated voluntarily, aged between 25 and 58. For a second pilot
speculated that subtle differences in the types of surveillance tasks study on clips without target behaviours, participants were three
conducted by participants could influence vigilance decrements. people with expertise in CCTV surveillance in a similar processing
The categorisation of operators into specialists and generalists industry.
allowed for the examination of the vigilance decrement in relation
to different samples. We extended the use of different samples to 2.1.2. Stage 1 sample
include novices with no previous exposure to the CCTV surveillance The Stage 1 sample consisted of 42 (32 male) operators
task. employed full-time in CCTV surveillance. Operators were drawn
The current research is most similar to Andrew et al.'s (2003) from six organisations in the hospitality and gaming, town centre
study in that both use footage of theft in heavy industry; incon- surveillance, academic, and mining sectors in South Africa. All had
spicuous, transient significant events where perpetrators normal or corrected to normal vision. Non-probability purposive
frequently try to camouflage or make detection more difficult, sampling was used and participation in the research was voluntary.
require one camera to be monitored at a time, and show continuous Participants' ages ranged from 21 to 53, with a mean of 36.48 years
movement in most clips. However, the two studies are different in and standard deviation of 8.2 years. Almost two-thirds (62%) had
terms of the definition of significant events and instructions to five or fewer years' experience with CCTV surveillance, and only 7%
participants. Andrew et al.'s (2003) study required participants to had more than ten years' experience. Participants were represen-
detect incidents of theft. Incidents typically consisted of a number tative of the cultural variations present within the country. The
of suspicious behaviours that preceded the theft, such as perpe- setting for the task was a processing plant. As no participants had
trators getting into position. Several minutes or seconds passed worked in such a processing plant previously, none had an
between the suspicious behaviours, during which time people advantage in terms of situation awareness specific to the context of
performed normal work activities. Some incidents involved a the video used in the study.
F. Donald et al. / Applied Ergonomics 47 (2015) 220e228 223
2.1.3. Stage 2 sample clips where behaviours were ambiguous or high numbers of false
The Stage 2 sample consisted of 31 student novices who were alarms occurred, and ensuring that the thirty-minute phases were
new to the task of CCTV surveillance. Combining their data with equivalent in terms of detection difficulty levels. It was decided that
those of Stage 1, this resulted in a total sample of 73. This created a visible, specific target behaviours consisting of a single action and
stratified sample consisting of 31 novices, 13 generalist operators, associated with incidents would be the significant events.
and 29 specialist operators. The allocation of participants to The final set of significant events consisted of four types of
specialist or generalist sub-samples was not based on performance target behaviours: picking up a small object; kicking the object to
evaluations in their work settings, but on the sort of surveillance another location; flicking the object to another location with a
conducted at their employing organisation. broom; and swivelling the ankle with the intention of grinding the
Certain biographical characteristics differed for generalist and object into the underside of a boot in order to walk away with the
specialist operators. The mean length of experience with CCTV object. The target behaviours were all associated with theft that
surveillance for generalists was 2.83 years and for specialists was could occur in a range of CCTV environments. During the first pilot
5.85 years (t ¼ 2.73, p < 0.05). Specialists had a wider range of study, participants rated the clips that contained target behaviours
experience levels (SD ¼ 4.62) than generalists (SD ¼ 2.44). Gener- in terms of their detection difficulty levels (1 ¼ extremely easy,
alists and specialists also differed in terms of their education levels. 5 ¼ extremely difficult). This was necessary to ensure an even
While most (66.67%) generalists had less than a grade 12, most spread of clips with different detection difficulty levels in the final
specialists (71.05%) had a grade 12. Generalists and specialists had video. The target behaviours were inconspicuous but noticeable,
similar ages. and of short duration, lasting from one to four seconds. The
The novice sub-sample was obtained through convenience outcome of this pilot study was a list of suitable clips with target
sampling. Novices' ages ranged from 20 to 28, with a mean of 21.55 behaviours that were categorised by type of target behaviour, dif-
years and a standard deviation of 1.48 years. In addition to their lack ficulty rating, area of the processing plant, and number of people
of experience with CCTV surveillance, the novice sub-sample was included in the scene. The detection difficulty ratings were aver-
younger, better educated, and included a greater proportion of fe- aged and were used in the allocation of target behaviour clips to
males than the operator sample. No incentives were offered but the time phases in the video for pilot study 2.
students were given letters stating that they had participated in the The aim of pilot study 2 was to identify video clips containing
study. behaviours that were likely to be incorrectly perceived as target
behaviours and those that yielded high numbers of false alarms.
2.2. Procedure Where false alarms were noted at the same time by two or more
raters, the clip was eliminated or edited to remove ambiguous
Standardised, video-taped instructions included explanations behaviours. Where only one rater reported a false alarm, the other
and demonstrations of the target behaviours and were followed by two raters observed the clip again, and through discussion, reached
practice sessions of 12 min, during which time participants could consensus on whether the behaviour was likely to create a false
ask questions and replay clips. For ethical and practical reasons, alarm in the final study. Pilot study 2 was also aimed at ensuring
participants were told how long the video would last. Once the trial that suitable video clips were used in the video for the main study,
started, the video could not be replayed and no breaks were given. that there would be equivalence across time phases in terms of
Participants responded verbally when they detected specific target detection difficulty in the final video, and that instructions to par-
behaviours and trained research assistants logged responses and ticipants were appropriate. Three videos of thirty minutes were
their time of occurrence, recording hits, misses and false alarms. prepared for this pilot study. Clips where all participants detected
Prior approval for the research was obtained from the university's the target behaviour were considered too easy and were eliminated
ethics committee. The same procedure was used for stages 1 and 2. for the final video. Conversely, target behaviour clips with low
detection rates needed to be spread more evenly between the time
2.3. Materials phases for the main study. Pilot study 2 was an essential step in
creating an appropriate continuous video with appropriate
The task consisted of watching a 90-min video of CCTV sur- numbers of target behaviours for the final study.
veillance footage and verbally reporting the detection of four types The final video consisted of a mixture of clips with target be-
of target behaviours. All clips were situated in a processing plant haviours and others without target behaviours. For the purpose of
and represented realistic work activities such as sweeping and analysis, the video was divided into thirty-minute phases, with
shovelling spillage, inspecting machines, hosing areas, filling con- each phase containing six instances of target behaviours, resulting
tainers, and employees talking to each other. The scenes showed in a total of eighteen target behaviours. Each phase included a
from one to three people working with or near heavy machinery. mixture of comparable target behaviours that were easy and
Most clips contained continuous movement, but five clips showed difficult to detect. Although the target behaviours were transient,
no movement for periods up to 2 min. The number of people and they were all visible to the researchers and experts in the field who
continual movement were seen as being typical of the scenes were involved in developing the video.
depicted by cameras in this type of environment. Some clips were
real and others were simulations acted by professional actors in a 2.4. Analysis
processing plant. However, simulated clips were realistic in all re-
spects and could not be visually distinguished from real clips. Un- In order to analyse the differences across the three thirty-
like traditional laboratory vigilance research where simple stimuli minute time phases, repeated measures ANOVAs were conducted
are used and their detection difficulty levels can be assumed to be at Stage 1 using target behaviours (TB) and false alarms (FA) as the
similar, significant events on CCTV differ greatly in conspicuity, dependent variables. At Stage 2, repeated measures analysis of
duration, and detection difficulty. Therefore it was important to covariance (ANCOVAs) were conducted using CCTV experience, age
ensure that time phases in the video were equivalent in terms of and education level as covariates using target behaviours, false
factors such as visual complexity and detection difficulty levels. alarms, and groups as the dependent variables. Training could not
The video was developed through two pilot studies aimed at be included as a covariate due to the wide range of content in
selecting clips with a suitable range of difficulty levels, removing training courses attended, which meant that the courses were not
224 F. Donald et al. / Applied Ergonomics 47 (2015) 220e228
equivalent. As a measure of the effectiveness of vigilance, re- p < 0.05) phases. However, the mean FAs were similar for the
searchers often turn to Signal Detection Theory (SDT) as a way of second and third phases (t ¼ 0.40, n.s.). Examination of the means
balancing correct responses against false alarms (Tanner and Swets, indicates that FAs decreased from the first to second phase, after
1954). A common measure within SDT is d0 (d-prime, or sensitivity), which they were fairly stable. There were no significant differences
which assesses the operator's ability to distinguish target behav- in A between the phases (F(2, 36) ¼ 1.32, p > 0.05) although age was
iours from false alarms. However, it was noted that d0 produces an a significant covariate for A (F(1, 37) ¼ 5.11, p < 0.05).
infinite result if either the target behaviours or false alarms are zero To identify factors that confounded the results in stage 1, bio-
(a common occurrence when target behaviours are either very graphical factors were examined. A significant inverse correlation
difficult or very easy for certain operators to detect). Pollack and was obtained between the total number of TBs detected and age
Norman (1964) introduced a non-parametric equivalent to (r ¼ 0.45, p < 0.05), but not for duration of CCTV experience or
d0 known as A0 (A-prime). A number of authors have noted errors in education level. ANOVAs were significant on ethnicity where the
the calculation of A0 and its most recent formulation. Zhang and total number of TBs detected was the dependent variable (F(2,
Mueller's (2005) calculation of A, was used in this study. The pro- 39) ¼ 4.69, p < 0.05), but not for type of surveillance conducted at
portion of false alarms was calculated by dividing each phase into work (live, review only, or a combination of these) or type of
thirty second intervals and determining the number of false alarms training received (technical, surveillance skills, or both). A t-test
across the thirty second time intervals where target behaviours indicated that gender was not significant for the total number of
were not present. The proportion of target behaviours and false detections. No significant results were obtained for any bio-
alarms were then used to calculate A. Repeated measures analysis graphical factors on FAs or TBs.
of variance (ANOVAs) and ANCOVAs were used to calculate differ-
ence across phases and groups. 3.2. Stage 2
Table 1 Table 2
Summary statistics on dependent variables for operators (N ¼ 42). Summary statistics for dependent variables by surveillance background (N ¼ 73).
Table 3
Type 3 Tests of fixed effects for TBs detected.
vigilance tasks are likely to be more vulnerable to the vigilance placed on the operator's role in CCTV effectiveness and in-
decrement compared with people with relevant and extensive work terventions aimed at improving detection rates.
exposure. However, this is contrary to a number of vigilance studies
that found a steady vigilance decrement for both novice personnel 5. Conclusion
and experienced personnel (Baker, 1962; Mackworth, 1970; Pigeau
et al., 1995; Schmidke, 1976). In these previous studies, both novices The changes in the vigilance decrement across the initial sample
and experts were employed to perform the task used in the relevant group, and subsequent different work exposure groups, show that
study. This differs from the current research where novices were not the vigilance effect is not consistent across people, or indeed across
operators and were drawn from a different population from operators time. Variations in group performance, and that of individuals
with different expectancies, motivation, and skills. These differences within groups, mean that one cannot automatically expect a
in motivation could have confounded the results of the current study, decrement, or a particular type of decrement, to occur for all those
but they do not explain the different trends for generalists and involved in CCTV surveillance. This is likely to extend to other real
specialists. world visual analysis intensive viewing tasks. Further, the capacity
The findings of the current research suggest that the nature of the of the specialist group to raise performance in the final 30 min
sample is a significant and frequently overlooked factor in relation to period compared to the middle 30 min shows that there are some
the vigilance decrement. Closer examination of the studies with people who can maintain performance in real life settings for
complex tasks referred to above, indicates that a number used stu- extended periods that are well beyond the 20e35 min periods
dent samples despite using tasks or simulations that were similar to indicated by Sawin and Scerbo (1995). The impact of the viewing
those encountered in the real world (e.g. Hollenbeck et al., 1995; task and environment may also be an important element of vigi-
Molloy and Parasuraman, 1996; Pigeau et al., 1995). The current lance that requires more extensive consideration in vigilance
research found a distinct difference in the vigilance dynamics be- research.
tween participants (novices and generalists) with no or less expe- These results appear to confirm the suggestions made in a
rience, training, and exposure to the type of surveillance task number of studies that operator performance in CCTV is less than
performed in the study, and specialists with more experience, ideal (Donald and Andrew, 2003; Donald et al., 2007; Edkins and
training, and exposure to this type of task. This suggests that pre- Pollock, 1997; Keval and Sasse, 2006; Wells et al., 2006), although
vious work exposure is an important variable to consider when the standards for ‘satisfactory’ detection have not been defined.
selecting a sample for some research using real world type tasks. Previous research has found mixed results for CCTV effectiveness
The notion that the vigilance decrement may not be as prevalent (Greenberg and Roush, 2009; Keval and Sasse, 2006; Wells et al.,
as implied in much vigilance research, suggests that Parasuraman's 2006; Welsh and Farrington, 2002). However, none of these
(1987) call for a shift in the focus of research towards the overall studies examined actual detection rates. Where the effectiveness of
level of vigilance and related attention processes is still relevant. the overall CCTV system has been unsatisfactory, researchers have
This is supported by the low overall detection rates achieved in this attributed this to a number of factors, many of which relate to the
study (50%), and the high false alarm rate which further reduced broader context in which the CCTV system operates, and not
detection accuracy. The detection rate for the CCTV surveillance necessarily to operator performance (e.g., Cameron et al., 2008). By
task used in this research was lower than those reported in studies contrast, the current research focuses specifically on operator
where the significant events were known and visually salient (e.g., performance and demonstrates that operator detection perfor-
Tickner and Poulton, 1968, 1973; Tickner et al., 1972; van mance is likely to be a significant contributor in situations where
Voorthuijsen et al., 2005; Wallace et al., n.d.), but higher than CCTV effectiveness is unsatisfactory.
Andrew et al.'s (2003) study where the significant events were Differences between generalist and specialist CCTV contexts
inconspicuous and transient, and participants were not told what suggest that CCTV surveillance is not a unitary function and that the
constituted a significant event. nature of the work and related demands on operators vary across
As target inconspicuity (Bauer et al., 1996; Itti and Koch, 2000) contexts. This is an important distinction as it represents the first
and duration (Tickner and Poulton, 1973) increase detection diffi- step in developing a typology of CCTV surveillance jobs and the
culty, the detection task in this study is considered to be more cognitive processes involved. Previous research has assumed that
difficult than in Tickner and Poulton (1968, 1973, 1975), Tickner and all CCTV surveillance contexts are similar in terms of demands on
colleagues (1972), van Voorthuijsen et al.'s (2005) and Wallace operators. Differences between contexts have implications for
et al.'s (n.d.) studies. However, consultation with experts (pilot theory and practice. The identification of CCTV contexts allows for
study 2) confirmed that the types of scenes and TBs were repre- future research to be specific in terms of the contexts to which the
sentative of the scenes and significant events encountered inside research is intended to apply. It also has implications for the se-
industrial processing plants. The low detection rate in this study lection, training and development of operators. Existing typologies
suggests that expectations regarding CCTV detection rates require of vigilance tasks (e.g., Parasuraman and Davies, 1977; Donald,
careful evaluation. A one hundred percent detection rate is unre- 2008a,b) could be used as a starting point for a typology for CCTV
alistic, even for top performers and those with extensive experi- surveillance tasks.
ence and training in CCTV surveillance. If this is the case, it is
inevitable that significant events are missed in operational con-
texts, although the proportion of missed significant events will vary References
according to the type of surveillance performed, the nature of sig- Adams, J.A., Stenson, H.H., Humes, J.M., 1961. Monitoring of complex visual displays
nificant events, and the skills and experience of operators. This II: effects of visual load and response complexity on human vigilance. Hum.
finding indicates that it may be necessary to re-evaluate what is Factors 3, 213e221.
Andrew, C., Landgrebe, T., Donald, C., 2003. Enhanced Surveillance Platform Vali-
feasible in human detection and CCTV environments and the con-
dation Testing: Methodology Report. Technical Report, de Beers, Johannesburg.
ditions that support and enhance detection. This would include Baker, C.H., 1962. Man and Radar Displays. MacMillan, New York.
examining the implications of having to view multiple displays, and Bauer, B., Jolicoeur, P., Cowan, W.B., 1996. Visual search for colour targets that are or
implications of the nature of the viewed environment and detec- are not linearly separable from distracters. Vis. Res. 36 (10), 1439e1466.
Bergum, B.O., Lehr, D.J., 1963. End spurt in vigilance. J. Exp. Psychol. 66, 383e385.
tion tasks on the likely performance success. These are important Cameron, A., Kolodinski, E., May, H., Williams, N., . Measuring the Effects of Video
findings because they confirm that a greater emphasis should be Surveillance on Crime in Los Angeles. Technical Report Number CRB-08-00,
228 F. Donald et al. / Applied Ergonomics 47 (2015) 220e228
prepared for the California Research Bureau by the USC School of Policy, Parasuraman, R., 1984. Sustained attention in detection and discrimination. In:
Planning and Development, Los Angeles. Retrieved from: http://www.library.ca. Parasuraman, R., Davies, D.R. (Eds.), Varieties of Attention. Academic Press,
gov/crb/08/08-007.pdf. Orlando, pp. 243e272.
Davies, D.R., Parasuraman, R., 1982. The Psychology of Vigilance. Academic Press, Parasuraman, R., 1987. Human-computer monitoring. Hum. Factors 29 (6),
New York. 695e706.
Davies, G., Thasen, S., 2000. Closed-circuit television: how effective an identification Parasuraman, R., Davies, D.R., 1977. A taxonomic analysis of vigilance performance.
aid? Br. J. Psychol. 91, 411e426. In: Mackie, R.R. (Ed.), Vigilance: Theory, Operational Performance, and Physi-
Donald, C., 2001. Vigilance. In: Noyes, J., Bransby, M. (Eds.), People in Control: ological Correlates. Plenum, New York, pp. 559e574.
Human Factors in Control Room Design. The Institution of Electrical Engineers, Security Park, 2001. Space-age surveillance comes to Newham. Retrieved from:
London, pp. 35e50. www.securitypark.co.uk/pfv.asp?articleid¼1832.
Donald, C., 2008a. A Strategic Approach to Security Technology Implementation e Pigeau, R.A., Angus, R.G., O'Neill, P., Mack, I., 1995. Vigilance latencies to aircraft
the Case for CCTV and Implications for Public Protection. Key Note Address in detection among NORAD surveillance operators. Hum. Factors 37 (3), 622e634.
Proceedings of the First Security Australia (SECAU) Conference, 1 December, Pollack, L., Norman, D.A., 1964. Non-parametric analysis of recognition experiments.
Edith Cowan University, Perth, Australia. Psychon. Sci. 1, 125e126.
Donald, F., 2008b. The classification of vigilance tasks in the real world. Ergonomics Sawin, D.A., Scerbo, M.W., 1995. Effects of instruction type and boredom proneness in
51 (11), 1643e1655. vigilance: implications for boredom and workload. Hum. Factors 37 (4), 752e765.
Donald, F., 2010. A model of CCTV surveillance operator performance. Ergon. SA 22 Schmidke, I.I., 1976. Vigilance. In: Simonson, E., Weiser, P.C. (Eds.), Psychological and
(2), 2e13. Physiological Correlates of Work and Fatigue. Thomas, Springfield, MA,
Donald, C., Andrew, C., 2003. Technology Enhancement of CCTV Operator Effec- pp. 126e138.
tiveness. Paper presented at the CCTV User Group Conference, 9 April, Bolton, Squires, P., . Evaluating CCTV: Lessons from a Surveillance Culture. Paper presented
UK. at the Final Conference of the European Forum for Urban Safety: Citizens, Cities
Donald, C., Andrew, C., Landgrebe, T., 2007. The Impact of CCTV TIP Implementation. and Video-Surveillance Programme and for the EFUS CCTV Charter launched in
Paper presented at the Human Factors in Transport Security Academic Forum, Rotterdam, May 2010. Retrieved from: http://www.fesu.org/.
24e25 September, Trinity College, Oxford. Tanner, W.P., Swets, J.A., 1954. A decision-making theory of visual detection. Psy-
Edkins, G.D., Pollock, C.M., 1997. The influence of sustained attention on railway chol. Rev. 61 (6), 401e409.
accidents. Accident Anal. Prev. 29 (4), 533e539. Tickner, A.H., Poulton, E.C., 1968. Remote monitoring of motorways using closed-
Greenberg, D.F., Roush, J.B., 2009. The effectiveness of an electronic security man- circuit television. Ergonomics 11, 455e466.
agement system in a privately owned apartment complex. Eval. Rev. 33, 3e26. Tickner, A.H., Poulton, E.C., 1973. Monitoring up to 16 synthetic television pictures
Hollenbeck, J.R., Ilgen, D.R., Tuttle, D.B., Sego, D.J., 1995. Team performance on showing a great deal of movement. Ergonomics 16 (4), 381e401.
monitoring tasks: an examination of decision errors in contexts requiring Tickner, A.H., Poulton, E.C., 1975. Watching for people and actions. Ergonomics 18,
sustained attention. J. Appl. Psychol. 80 (6), 685e696. 35e51.
House of Lords, 2009. Constitution Committee e Second Report. Surveillance: Cit- Tickner, A.H., Poulton, E.C., Copeman, A.K., Simmonds, D.C.V., 1972. Monitoring 16
izens and the State. Constitution Committee Publications. television screens showing little movement. Ergonomics 16 (3), 279e291.
Howard, C.J., Troscianko, T., Gilchrist, I.D., Behera, A., Hogg, D.C., 2009. Searching for van Voorthuijsen, G., van Hoof, H., Klima, M., Roubik, K., Bernas, M., Pata, P., 2005.
threat: factors determining performance during CCTV monitoring. In: De CCTV effectiveness study. In: Proceedings of the 39th IEEE Annual 2005 Inter-
Waard, Godthelp, J., Kooi, F.L., Brookhuis, K.A. (Eds.), Human Factors, Security national Carnahan Conference on Security Technology, Piscataway,
and Safety. Shaker Publishing, Maastricht, pp. 333e339. pp. 105e108.
Itti, L., Koch, C., 2000. A saliency-based search mechanism for overt and covert Wallace, E., Diffley, C., Baines, E., Aldridge, J., n.d. Ergonomic design considerations
shifts of visual attention. Vis. Res. 40 (10e12), 1489e1506. for public area CCTV safety and security applications. Home Office, Police Sci-
Kenward, M.G., Roger, J.H., 1997. Small sample inference for fixed effects from entific Development Branch (PSDB), UK.
restricted maximum likelihood. Biometrics 53 (3), 983e987. Washburn, D.A., Taglialatela, L.A., Rice, P.R., Smith, J.D., 2004. Individual differences
Keval, H., Sasse, M.A., 2006. Man or gorilla? Performance Issues with CCTV Tech- in sustained attention and threat detection. Int. J. Cognit. Technol. 9 (2), 30e33.
nology in Security Control Rooms. In: Proceedings of the 16th World Congress Wells, H., Allard, T., Wilson, P., 2006. Crime and CCTV in Australia: Understanding
on Ergonomics Conference, Maastricht, Netherlands, International Ergonomics the Relationship. Centre of Applied Psychology and Criminology, Faculty of
Association, 10e14 July. Humanities and Social Sciences, Bond University, Gold Coast, Australia.
Mackworth, J.F., 1970. Vigilance and Attention. Penguin, Baltimore. Welsh, B.C., Farrington, D.P., 2002. Crime Prevention Effects of CCTV: a Systematic
Molloy, R., Parasuraman, R., 1996. Monitoring an automated system for a single Review. Technical Research Report No. 252, Home Office Research, Develop-
failure: vigilance and task complexity effects. Hum. Factors 38 (2), 311e322. ment and Statistics Directorate, UK.
Moray, N., Haudegond, S., 1998. An absence of vigilance decrement in a complex Wickens, C.D., 2002. Multiple resources and performance prediction. Theor. Issues
dynamic task. In: Proceedings of the Human Factors and Ergonomics Society Ergon. Sci. 3 (2), 159e177.
Annual Meeting, Cognitive Engineering and Decision Making, pp. 234e238. Zhang, J., Mueller, S.T., 2005. A note on ROC analysis and non-parametric estimate of
Neil, D., Thomas, N., Baker, B., 2007. Threat Image Projection in CCTV. In: Pro- sensitivity. Psychometrika 70 (1), 203e212.
ceedings of the 41st Annual International IEEE Carnahan Conference on Secu-
rity Technology, Ottawa, ON, Canada, pp. 272e280.