Professional Documents
Culture Documents
Article history: It is widely acknowledged that adopting a socio-technical approach to system development leads to sys-
Received 9 November 2009 tems that are more acceptable to end users and deliver better value to stakeholders. Despite this, such
Received in revised form 30 July 2010 approaches are not widely practised. We analyse the reasons for this, highlighting some of the problems
Accepted 31 July 2010
with the better known socio-technical design methods. Based on this analysis we propose a new prag-
Available online 7 August 2010
matic framework for socio-technical systems engineering (STSE) which builds on the (largely indepen-
dent) research of groups investigating work design, information systems, computer-supported
Keywords:
cooperative work, and cognitive systems engineering. STSE bridges the traditional gap between organi-
Socio-technical systems
Systems engineering
sational change and system development using two main types of activity: sensitisation and awareness;
Software engineering and constructive engagement. From the framework, we identify an initial set of interdisciplinary research
problems that address how to apply socio-technical approaches in a cost-effective way, and how to facil-
itate the integration of STSE with existing systems and software engineering approaches.
Ó 2010 Elsevier B.V. All rights reserved.
0953-5438/$ - see front matter Ó 2010 Elsevier B.V. All rights reserved.
doi:10.1016/j.intcom.2010.07.003
G. Baxter, I. Sommerville / Interacting with Computers 23 (2011) 4–17 5
significant research communities that have explored and ad- We believe that we need to integrate the work of these dispa-
dressed socio-technical issues that affect the specification, design rate communities under a common heading of socio-technical sys-
and operation of complex computer-based systems: tems engineering. Our objectives here, therefore, are to summarise
the contributions of the different research communities in this
1. Researchers interested in work, in general, and the workplace. area, and to propose a practical vision for further developments.
An interest in the design of work was the original stimulus for We do not provide a complete survey of socio-technical systems
proposing socio-technical approaches. Mumford (1983) and design (that would be impossibly long). Instead we present differ-
Eason’s (1988) research typify the approach of this community. ent perspectives on STSD, which we use as a basis for introducing a
The original objective was to make work more humanistic and pragmatic framework for STSE that is deliberately limited in scope
the initial focus was on manufacturing systems. As computers but which leaves room for the application of different STSD ap-
have become pervasive in the workplace, however, the commu- proaches. In this paper we have focused our discussions on organ-
nity has also examined the relationships between work and its isational systems, but we believe that STSE applies to other types of
computer-based support noting, for example, that the computer systems based on Commercial Off the Shelf equipment and appli-
system can shape and constrain work practices (Eason, 1997). cations, for example, or domestic systems. After laying out our
2. Researchers interested in information systems. Information sys- framework, we go on to propose a research agenda for socio-tech-
there have been several attempts at applying the ideas of STSD. system and CSCW, as does the recent special issue of the journal
Some of these were successful, others less so (Mumford, 2006). Computer-Supported Cooperative Work which deals with CSCW
The prevailing climate within a particular company (or sometimes and dependability in health care systems (Procter et al., 2006).
within a country) affected attitudes towards the idea of STSD: The field of dependability3 (Laprie, 1985; Avizienis et al., 2004) is
where attitudes were positive this often led to the successful up- also intrinsically concerned with socio-technical systems, although
take of the ideas. this field sometimes uses the term ‘computer-based systems’ to refer
Mumford (2006) provides an historical overview of develop- to socio-technical systems.
ments in STSD. The general aim was to investigate the organisation STSD methods continue to be advocated for systems develop-
of work, with early work in STSD focused mostly on manufacturing ment and appear to be particularly suited to some application
and production industries such as coal, textiles, and petrochemi- areas. Since the late 1990s, for example, STSD has been frequently
cals. The aim was to see whether work in these industries could advocated within health informatics for the development of health
be made more humanistic. In other words, the intention was to care applications (e.g., Whetton, 2005). Many such systems are un-
move away from the mechanistic view of work encompassed by der-utilised because they introduce ways of working that conflict
Taylor’s (1911) principles of scientific management, which largely with other aspects of the user’s job, or they require changes to pro-
relied on the specialisation of work and the division of labour. cedures that affect other people’s responsibilities. One of the keys
approaches is an open question. STSD remains an active field of re- implemented using IT) and also considers those tasks that have
search and practice, although in many cases it is the ideas, rather to be performed by humans (both individually, and as teams).
than the original methods, that are being applied. This method is designed for general use in function allocation
Even though the notion of user participation lies at the heart of and socio-technical work systems.
STSD, there has been a disappointing uptake of user-centred meth- 4. Ethnographic workplace analysis (e.g., Suchman, 1987; Hughes
ods in general. Eason (2001), for example, found that none of the et al., 1997; Viller and Sommerville, 2000; Martin and Sommer-
10 most widely advocated methods (including socio-technical de- ville, 2004) emphasises the situated nature of action, and has
sign) were in common use. Furthermore, even where the methods investigated how the results from ethnographic studies can
were being used, user involvement was still largely to assist in the inform the design of socio-technical systems. Ethnographic
development of a techno-centric system. Users were not seen as workplace analysis has largely focused on the operational issues
participants in an integrated systems development process to pro- that affect the functionality and use of a system. It has high-
duce a system that took appropriate account of social and organi- lighted how workarounds and dynamic process modifications
sational requirements. are commonplace and revealed the importance of awareness
One area where user participation has been taken seriously is in and the physical workplace in getting work done.
software development using agile methods, such as extreme pro- 5. Contextual design (Beyer and Holtzblatt, 1999) is aimed at
Table 1
Relationship between socio-technical systems design approaches and the development phases of the systems engineering life cycle. A double tick (UU) indicates that a particular
design approach provides strong support for the associated phase of the life cycle; a single tick (U) indicates some support.
ences in demonstrator projects, however, these methods have not explain why humans perform erroneous actions and, hence, cannot
tively scarce. Consequently, there has generally been little evalua- re-use of insights gained from previous fieldwork in new system
tion of the efficacy of using STSD approaches. Indeed, one of design.
Majchrzak and Borys’ (2001) major criticisms is that existing so-
cio-technical systems theories are not specific enough to allow 4.6. Multidisciplinarity
for empirical testing. Other reasons for the lack of evaluation in-
clude the predominant research emphasis on system design rather Some of the failings of STSD can be attributed to the multidisci-
than evaluation and, in the UK at least, the difficulties of funding plinary nature of system development. The need for several disci-
long-term, longitudinal research. Large scale complex IT systems plines to be involved is widely accepted, but the borders
often have a lead time that is measured in years, rather than between the disciplines have been largely maintained, despite
months—in a hospital for example, it may take several years to efforts at creating interdisciplinary teams by involving domain
introduce a new system throughout the organisation. specialists in the design process. The issue is mainly down to fail-
Another problem of assessing success is the difficulty in estab- ures in understanding and communication, where one discipline
lishing evaluation criteria for the social elements of the system. does not fully understand what the other disciplines can do (Bader
Whilst benchmark tests can be used to determine whether the and Nyce, 1998), and hence does not ask them to deliver some-
technical part of the system meets the appropriate criteria (re- thing that assists the system development processes. Dekker
unfashionable. This is particularly true when designing new sys- cal approach pervades the entire systems engineering life-cycle.
tems that are based on innovative ways of working and novel Our vision is for a discipline that combines the philosophies of
technology. the STSD approaches with the complementary methods identified
in Section 3. STSE has to be founded on the recognised strengths of
4.8. Fieldwork issues socio-technical approaches but must also address the recognised
problems in existing approaches (see Section 4). Furthermore, we
Although STSD methods such as participatory design prescribe have to take into account the barriers to introducing any new ap-
the involvement of users, it is comparatively silent on issues such proach namely:
as which users to select, what level of experience in design they
need and so on (Damodoran, 1996; Scacchi, 2004). More generally 1. New methods require upfront investment for an unknown later
for fieldwork, there are problems with identifying the system return.
stakeholders in the first place, before deciding which groups of 2. There is often a high entry cost in terms of tooling and training
stakeholders (and which individuals) should be involved. Tradi- to use new methods.
tional approaches involving an embedded ethnographer are expen- 3. The challenge of method usability–experience is required to
sive and prolonged, although notions such as ‘quick and dirty’ improve method usability but if initial usability is poor, the
Socio-
Goal setting Process mapping Systems
technical Change
engineering
systems process
process
engineering
Information
flow
Constructive
Process execution Process design engagement
involved in designing the system database might be made 2. Sensitising those involved in procuring a new, complex IT sys-
aware of the fact that collecting complete data in some settings tem to the socio-technical considerations that may influence
may be practically impossible. the design and use of the system.
2. Constructive engagement. These activities are concerned with 3. Sensitising system stakeholders to the socio-technical issues
integrating STSD approaches into the practical systems devel- that, almost inevitably, are a source of conflict with other
opment and change management processes in an organisation. stakeholders.
The nature of the constructive engagement varies depending on 4. Sensitising system stakeholders to the notion that an analyst
the development or change activities that are involved. will be studying their work with a view to a deeper understand-
ing of it, rather than to assess or audit what they do. Here, con-
We discuss below in a little more detail what we mean by sen- cerns such as snooping and reporting to management have to
sitisation and constructive engagement. Rather than just noting be addressed.
that we need to take account of the social and technical factors 5. Sensitising stakeholder groups to the different world views of
and their interdependencies, we explicitly identify who needs to other groups, perhaps from different disciplines, in the organi-
be made aware of which factors, and provide a focus for the activ- sation. For example, accountants think about financial transac-
ities that are needed to integrate STSD approaches into the engi- tions in one way and are concerned about ensuring accounting
5.2. Constructive engagement agreement within the organisation about which methods will be
used during development. In this way we can alleviate design
Constructive engagement activities provide a means of integrat- and implementation decisions that make it more difficult to incor-
ing STSD approaches into the systems engineering and the organ- porate the system into everyday, routine work.
isational change processes, and synchronising the two processes at Getting the construction right is not simply a matter of writing
appropriate points. The precise nature of the constructive engage- better system requirements. In the same way that requirements for
ment will vary from project to project, largely determined by a user interface cannot adequately express the richness of the
which particular activities in the development and change pro- interaction with a particular system, social and organisational
cesses are involved. Here we discuss three types of constructive complexity cannot be simply distilled into ‘social’ or ‘cooperation’
engagement. requirements. System requirements are still needed to provide
engineers with a broad understanding of what has to be con-
5.2.1. Problem definition structed. The agile approach of involving end-users as ‘owners’ of
Software design methods are geared towards developing a solu- requirements is a good one but needs to be extended to take into
tion to ‘the problem’, so if that ‘problem’ is not understood, apply- account a broader set of system stakeholders.
ing the methods will generate an inappropriate solution. The An unavoidable constraint on construction is the need to fit
of subsequent organisational change. In other words, when new makes explicit the relationship between system development
requirements arise, or existing requirements change on the organ- and organisational change.
isational side, or when problems arise with satisfying the original We believe that the different socio-technical design methods
requirements on the systems development side, these need to be have much in common and our notions of the basic activities of
assessed in their own right, and in terms of the wider development STSE allow any method of socio-technical analysis to be used.
project. This is because they are likely to change the shape of the Methods of analysis, in our view, are not the issue. Rather, research
delivered system, and hence the nature of the evaluation of in STSE should address the engineering problems of applying
whether the system meets its goals. socio-technical approaches in a cost-effective way and integrat-
We see the one of the primary roles of evaluation as being its ing STSE with existing systems and software engineering pro-
contribution to the process of ‘domestication’ (Williams and Edge, cesses.
1996) where the system gets bedded into the organisation. Domes- Research in this area requires an interdisciplinary approach and
tication is the activity of familiarisation with new software and may involve computer scientists, software engineers, HCI design-
changing both the software and business processes so that the soft- ers, psychologists, sociologists and human factors specialists. We
ware becomes an integral part of everyday work. The types of believe that all of these areas still have much to learn from each
questions asked during evaluation are therefore not ‘does this other. We would advocate the use of techniques such as action
term issue which involves extending the scope of our are becoming increasingly familiar with Web 2.0 collaboration
framework beyond the change process in organisations to con- tools. Using these as a basis for organisational learning means
sider broader issues of organisational politics and dynamics. that initial barriers to tool use are lowered. We are convinced
3. Integrated human-centred design The importance of effective that using these web-based systems is the most effective way
human-centred design is now generally recognised, if not uni- to reduce the costs of collecting and using organisational infor-
versally practised (Woods et al., 2007). However, most methods mation. To do so, however, we need to investigate how to struc-
of socio-technical analysis have paid little attention to those ture these tools to maintain long-term information about an
areas of design relating to individuals (Hollnagel, 1998). Fur- organisation and its processes.
thermore, there is a tendency in the engineering community 5. Global systems Existing approaches to STSD are virtually all
to identify all human, social and organisational issues as prob- based on an assumption that systems are located within a
lems of the human interacting with the technology (such as coherent organisation where the system stakeholders have sim-
‘‘finger trouble”). In doing so, they ignore the relationship ilar cultural values and assumptions. However, there is now an
between individual interaction and the social organisation of increasing trend to create global systems, which may involve
work, and particularly how the latter can influence the former. several disparate organisations that are located around the
Research issues here include: world. Similarly, the teams involved in complex systems engi-
paper. This work was funded by the EPSRC as part of the Large Damodoran, L., 1996. User involvement in the systems design process – a practical
guide for users. Behaviour & Information Technology 15 (6), 363–377.
Scale Complex IT Systems Project.
Dankbaar, B., 1997. Lean production: denial, confirmation or extension of
sociotechnical systems design? Human Relations 50 (5), 567–583.
De Sitter, L.U., Den Hertog, J.F., Dankbaar, B., 1997. From complex organizations
References with simple jobs to simple organizations with complex jobs. Human Relations
50 (5), 497–534.
Dekker, S.W.A., Nyce, J.M., Hoffman, R.R., 2003. From contextual inquiry to
Abrahamsson, P., Salo, O., Ronkainen, J., Warsta, J., 2002. Agile Software
designable futures: what do we need to get there? IEEE Intelligent Systems
Development Methods: Review and Analysis (No. VTT 478). VTT Technical
18 (2), 74–77.
Research Centre of Finland, Oulou, Finland.
Dix, A., Finlay, J., Abowd, G.D., Beale, R., 2004. Human Computer Interaction, third
Ackroyd, S., Harper, R., Hughes, J.A., Shapiro, D., 1992. Information Technology and
ed. Addison-Wesley, Harlow, UK.
Practical Police Work. Open University Press, Milton Keynes, UK.
Doherty, N., King, M., 2001. The treatment of organisational issues in systems
Artman, H., 2002. Procurer usability requirements: negotiations in contract
development projects: the implications for the evaluation of information
development. In: Proceedings of NordiCHI 2002. ACM Press, New York, NY,
technology investments. Electronic Journal of Information Systems Evaluation 4
pp. 61–70.
(2). 13pp.
Avgerou, C., Ciborra, C., Land, F., 2004. The Social Study of Information and
Eason, K., 1988. Information Technology and Organisational Change. Taylor &
Communication Technology. Oxford University Press, Oxford, UK.
Francis, London, UK.
Avison, D., Baskerville, R., Myers, M., 2001. Controlling action research projects.
Eason, K., 1997. Understanding the organisational ramifications of implementing
Information Technology & People 14 (1), 28–45.
information technology systems. In: Helander, M., Landauer, T., Prabhu, P.
Avizienis, A., Laprie, J.-C., Randell, B., 2004. Basic concepts and taxonomy of
Laprie, J.-C., 1985. Dependable computing AND Fault tolerance. Concepts and Pollock, N., Williams, R., 2009. Software and Organisations. Routledge, New York,
terminology. In: Proceedings of 15th IEEE International Symposium on Fault- NY.
Tolerant Computing. IEEE, Ann Arbor, MI, pp. 2–11. Procter, R., Rouncefield, M., Balka, E., Berg, M., 2006. Special issue: CSCW and
Leonard, D., Rayport, J.F., 1997. Spark innovation through empathic design. Harvard dependable healthcare systems. Computer Supported Cooperative Work 15 (5–
Business Review 75 (6), 102–113. 6), 413–418.
Lock, R., Storer, T., Harvey, N., Hughes, C., Sommerville, I., 2008. Observations of the Rasmussen, J., Pejtersen, A.-M., Goodstein, L.P., 1994a. Cognitive Systems
Scottish elections, 2007. Transforming Government: People Process and Policy 2 Engineering. Wiley, Chichester, UK.
(2), 104–118. Rasmussen, J., Pejtersen, A.M., Goodstein, L.P., 1994b. Cognitive Systems
Lock, R., Sommerville, I., Storer, T., 2009. Responsibility modelling for civil Engineering. Wiley, Chichester, UK.
emergency planning. Risk Management 11, 179–207. Revans, R., 1982. What is action learning? Journal of Management Development 1
Mackie, J., 2006. War stories: A collection of potential hazards. <http:// (3), 64–75.
www.comp.lancs.ac.uk/~mackie/WarStoriesWeb/hazards.php> (retrieved Rouncefield, M., 1998. An Ethnography of ‘Everyday Admissions Work’. Lancaster
06.04.10). University, Lancaster, UK.
Majchrzak, A., Borys, B., 2001. Generating testable socio-technical systems theory. Scacchi, W., 2004. Socio-technical design. In: Bainbridge, W.S. (Ed.), The
Journal of Engineering and Technology Management 18 (3–4), 219–240. Encyclopedia of Human–Computer Interaction. Berkshire Publishing Group,
Martin, D., Sommerville, I., 2004. Patterns of cooperative interaction: linking Great Barrington, MA, pp. 656–659.
ethnomethodology and design. ACM Transactions on Computer–Human Segarra, G., 1999. The advanced information technology innovation roadmap.
Interaction (TOCHI) 11 (1), 59–89. Computers in Industry 40, 185–195.
Martin, D., Mariani, J., Rouncefield, M., 2004. Implementing an EPR project: Sommerville, I., Dewsbury, G., 2007. Dependable domestic system design: a socio-
everyday features and practicalities of NHS project work. In: Proceedings of technical approach. Interacting with Computers 19, 438–456.