You are on page 1of 16

Team Performance Management

The predictive validity of the team diagnostic survey: Testing a model with
performance and satisfaction as output variables
Per Eisele
Article information:
To cite this document:
Per Eisele , (2015),"The predictive validity of the team diagnostic survey", Team Performance
Management, Vol. 21 Iss 5/6 pp. 293 - 306
Permanent link to this document:
http://dx.doi.org/10.1108/TPM-08-2014-0049
Downloaded on: 05 August 2015, At: 08:02 (PT)
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

References: this document contains references to 33 other documents.


To copy this document: permissions@emeraldinsight.com
The fulltext of this document has been downloaded 8 times since 2015*
Users who downloaded this article also downloaded:
Gabi Dodoiu, (2015),"Intentions for cooperative conflict resolution in groups: An application of the
theory of planned behavior", Team Performance Management: An International Journal, Vol. 21 Iss
5/6 pp. 259-273 http://dx.doi.org/10.1108/TPM-12-2014-0062
Verlin Hinsz, (2015),"Teams as technology: strengths, weaknesses, and trade-offs in cognitive task
performance", Team Performance Management: An International Journal, Vol. 21 Iss 5/6 pp. 218-230
http://dx.doi.org/10.1108/TPM-02-2015-0006
Christian Moldjord, Anne Iversen, (2015),"Developing vulnerability trust in temporary high
performance teams", Team Performance Management: An International Journal, Vol. 21 Iss 5/6 pp.
231-246 http://dx.doi.org/10.1108/TPM-08-2014-0050

Access to this document was granted through an Emerald subscription provided by


Token:JournalAuthor:D47ECABC-4459-4DC3-80BC-A35628924903:
For Authors
If you would like to write for this, or any other Emerald publication, then please use our Emerald
for Authors service information about how to choose which publication to write for and submission
guidelines are available for all. Please visit www.emeraldinsight.com/authors for more information.
About Emerald www.emeraldinsight.com
Emerald is a global publisher linking research and practice to the benefit of society. The company
manages a portfolio of more than 290 journals and over 2,350 books and book series volumes, as
well as providing an extensive range of online products and additional customer resources and
services.
Emerald is both COUNTER 4 and TRANSFER compliant. The organization is a partner of the
Committee on Publication Ethics (COPE) and also works with Portico and the LOCKSS initiative for
digital archive preservation.
*Related content and download information correct at time of
download.
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)
The current issue and full text archive of this journal is available on Emerald Insight at:
www.emeraldinsight.com/1352-7592.htm

The predictive validity of the Team


diagnostic
team diagnostic survey survey
Testing a model with performance and
satisfaction as output variables 293
Per Eisele
Received 25 August 2014
Management Division, Blekinge Institute of Technology, Revised 17 February 2015
Karlskrona, Sweden 24 April 2015
29 April 2015
Accepted 29 April 2015

Abstract
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

Purpose – The aims of the present study were to test the predictive validity of the Swedish version of
the Team Diagnostic Survey (TDS).
Design/methodology/approach – A model with both performance and satisfaction was tested with
structural equation model (SEM) analyses. Participants completing the survey were employees (N ⫽
214) across three large workplaces. Analyses were done at the group level and data from 33 teams were
included in the final data material.
Findings – Results from validation data indicate that the TDS has satisfactory high Cronbach’s alpha
values on most factors. Results from the SEM analyses show a moderate model fit for the main model.
Team-level factors predict both performance and satisfaction, while organization and coaching factors
do not.
Research limitations/implications – The present study was limited to a cross-sectional design,
but earlier studies have shown that the accuracy of the TDS remains consistent over time. The main
purpose of this study was to test the predictive validity of the instrument. Theoretical implications of
the study are that a survey can be used to get a valid overall picture of the real-life work team’s
effectiveness.
Practical implications – Practical implications of the study are that communication between
researcher and/or consultant and organizational stakeholders is made easier, as the most important
factors that affect team effectiveness are identified.
Originality/value – The work on the development on TDS has shown that it is possible to use a
complex instrument to diagnose work groups, and this line of research is leading the way for better
instruments.
Keywords Team working, Team management, Group work, Group behaviour
Paper type Research paper

The aims of the present study were to further validate the Swedish language version of
the Team Diagnostic Survey (TDS). Earlier studies (Wageman et al., 2005, Eisele, 2013)
have shown that TDS is psychometrically sound and that it has sufficiently high
internal consistency and discriminant validity. The emphasis on the present study was
on the predictive validity of TDS.
There are numerous instruments trying to measure team performance, but very few Team Performance Management
address a sufficient amount of factors. Beside TDS, there is the Aston Team Vol. 21 No. 5/6, 2015
pp. 293-306
Performance Inventory (ATPI) which have been created by Dawson et al. (2006) and © Emerald Group Publishing Limited
1352-7592
recently validated by Callea et al. (2014). DOI 10.1108/TPM-08-2014-0049
TPM The TDS addresses the most prominent factors that are known to affect performance
21,5/6 and reflects Hackman’s (2002) model of team effectiveness. The TDS was created to be
a useful tool for giving advice (Wageman et al., 2005). In a field experiment, it was shown
that the TDS can be fruitful as a feedback tool (Eisele, 2013).
Team effectiveness is an evaluation of the outcomes of team performance processes
relative to some set of criteria (Hackman, 1987). Models of team effectiveness exist at
294 different levels, contextual or generalizable. Some are task-specific frameworks or
models that focus on a specific team process or function (Salas et al., 2008). Hackman’s
(1992) model of team effectiveness (1992) is a generalizable model within the most
common input–process– output (I–P–O) framework.
The basic structure of Hackman’s (1992, 2002) model of group effectiveness identifies
three main factors of work team effectiveness:
(1) a group structure that promotes competent work on the task;
(2) an organizational context that supports and reinforces excellence; and
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

(3) available, expert coaching and process assistance.

Group structure refers to task clarity, group composition and core norms.
Organizational context includes the organization’s reward, educational and
informational systems. External assistance is a factor that pinpoints that an
organization should provide the teams with adequate resources to learn these skills
(Hackman, 2002). Thus, TDS incorporates most important factors that are essential for
successful teamwork but exclude inter-team interactions.

The theoretical and conceptual framework


Team effectiveness is defined as the quantity and quality of group output (both
performance and well-being) and the capacity of groups to work interdependently
(Wageman et al., 2005).
Hackman’s (2002) Team Effectiveness Model describes three core factors – the real
team, compelling direction and enabling structure – that are most important for team
effectiveness. Additional to these internal factors, two external factors – supportive
organizational context and expert coaching availability – are emphasized in the model.

Real team
The real team conditions have three features. Members and non-members are
distinguished so that the team is bounded. Members have some common purpose and
collective responsibility, making them interdependent. Members in the real team have
stability of membership, making it possible to learn how to work together well. So, real
teams are bounded, interdependent and stable.

Compelling direction
This condition is about how the team’s purposes are specified. Good team direction is
clear, challenging and consequential. Challenging direction energizes members, clear
directions orient them toward their main goal and a consequential direction engages
members’ abilities.
In the TDS framework, goal setting or compelling direction is measured in terms of
clarity, challenge and consequentiality of team purposes.
Alper et al. (1998) investigated effects of two different goals (cooperative and Team
competitive) on efficient decision-making of self-managing teams. The strong positive diagnostic
effect of cooperative goals has implications for team leadership that should encourage survey
groups to create cooperative goals on their own. In a study by Hertel et al. (2004) on
management practices related to goals, tasks and output interdependence correlated
with effectiveness of virtual teams. Aube and Rousseau (2005) found a positive
relationship between team goal commitment and different criteria of team effectiveness, 295
and additionally, a moderating role of task interdependence and a mediating role of
supportive behavior. Rousseau and Aube (2010) found that team self-managing
behaviors was positively related to team effectiveness (team performance, team
viability and team process improvement), with a moderating effect of task routineness.
Passos and Caetano (2005) tested a model of the effects of intragroup conflict on team
performance and affective responses, based on Jehns (1995) distinction between three
different types of conflicts: task, relationship and process. Affective responses were
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

measured via direct assessment of satisfaction with team, team function and
communication among members, team leadership and relationship climate. In the TDS,
individual well-being is measured in a similar way.

Enabling structure
It is well established that task structure that is clear and consistent with a group’s
purpose has positive effects on performance. But the TDS also acknowledges
meaningful shared responsibility and the opportunity to learn how well the team is
doing as factors that are most important for team performance. One of the most common
mistakes organizations make when they start with team work is that the groups are not
set up right. As described by Wageman et al. (2005), sometimes, the team’s structure is
labored and strained which can create obstacles in getting things done and, at other
times, groups are neglected and missed. The latter often because people assume that
group work is so superior to individual work that groups perform better than single
individuals even without any deliberate work on their structure. Additionally,
sometimes the direct observable structure is faulty. The model that describes the
foundation of TDS describes three structural features: task design, team composition
and norms of conduct.
Edwards et al. (2006) examined how team composition based on members’ abilities is
related to team mental models and how these two constructs affect team performance.
The strong direct relationship between composition and performance highlight the
importance of this factor.
Diversity affects team effectiveness differently depending on circumstances. Put
simply, a high diversity is associated with potentially higher creativity but only if
coordination problems can be solved. Whether group members view the team as
sufficiently diverse is dependent not only on the degree of diversity per se but also on
how the diversity is perceived. As an example of current research on team diversity,
Peters and Karren (2009) investigated the relationship between trust, diversity and team
performance, and trust was found to mediate the relationship between diversity and
team performance. Stewart and Johnson (2009) found that, in more gender-diverse
groups leader–member exchange (LMX) differentiation was positively associated with
work group performance.
TPM Team norms are the shared beliefs regarding the social behaviors expected of its
21,5/6 members. Taggar and Ellis (2007) developed and assessed a model that depicts the
impact of team leaders and staff on negotiated and agreed upon team norms for
collaborative problem-solving in newly formed teams. Expectations had a significant
impact on the norms that teams adopted around collaborative problem-solving. Norms
about how to solve problems in teams significantly influenced individual team
296 members’ problem-solving behaviors. Earlier studies examining the impact of norms on
group outcomes also show that beneficial norms affect team performance (Feldman,
1984). There have been a few recent studies providing insight into norm formation,
including the influence of demographic heterogeneity on the emergence of cooperative
norms (Chatman and Flynn, 2001) and the development of strategic norms (Levine et al.,
2000). Although it is clear that team norms guide performance relevant behavior, there
is a need for studies in field settings.
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

Team leadership
In studying five leadership behavior factors (aversive, directive, transactional,
transformational and empowering), it was concluded that both vertical and shared
leadership was related to team effectiveness (Pearce and Sims, 2002). In the TDS
framework, team leadership is connected with the identified factors that affect team
effectiveness and how the leader acts toward those factors.

Supportive organizational context


Even if a team is well-composed and has accepted clear and challenging goals, it can still
perform badly due to lack of support from the organization. Besides material resources,
the organization should give reward or recognition to teams that perform well or
(perhaps even more importantly) teams that show an extra effort. Further, organizations
should be designed so that it is possible for them to give information that helps teams to
choose the most appropriate strategies, as well as make available educational assistance
including technical support. Thus, the supportive organizational context condition
consists of education/consultation, information system and reward system and material
resources.
According to Hackman (2002) an organizational context that supports and reinforces
team effectiveness has the following features:
• reward system, recognition, reinforcement, group or individuals, collaboration or
differentiation;
• educational system, training or technical assistance at the group initiative; and
• information system, appropriate data to select structure for different tasks and
situations.

A work organizations supportive context regards to a large degree the information


provided to employees and the lateral and vertical communication between different
functions. The team effectiveness model (Hackman, 2002) also acknowledges other
factors like the providing of education and resources.
Expert coaching availability Team
Coaching will only help teams if the coach manages or highlights the exposure to diagnostic
process losses (Steiner, 1972; Stroebe and Diehl, 1994). Therefore, the mere existence of
a coach is not enough but coaching that meets certain requirements:
survey
• minimize coordination and/or motivation problems;
• build commitment to the group and to the group task;
• avoid faulty trust in habitual routines;
297
• develop innovative ways to work;
• avoid inappropriate weighting of individual contributions such as ideas and
opinions; and
• share information and expertise within the team.

The TDS attempts to measure four different kinds of coaching: task-focused, operant,
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

interpersonal and unhelpful directives, all regarding both team leader coaching and peer
coaching. Task-focused coaching is about building commitment. Operant coaching is
about giving appropriate feedback. Interpersonal coaching is equivalent to helping
behavior and can, for example, be about conflicts. Examples of unhelpful directives are
over-instruction or fault-detection.
Team coaching theory (Hackman and Wageman, 2005) posits that team effectiveness
is a joint function of three performance processes:
(1) Choice of performance strategies is influenced by core norms and the
organizational information system.
(2) The amount of effort that is influenced by the task design and by the
organization reward system.
(3) The amount of knowledge and skill members contributes to the team that is
influenced by team composition.

Coaching can be motivational, consultative and educational and both availability and
helpfulness should be measured.
Liu et al. (2009) showed that team coaching had positive effects on team performance
processes regarding effort, skill and knowledge, which in turn had a direct impact on
team effectiveness.
Leader coaching behavior has been found to affect performance (Wageman, 2001) but
coaching behavior of peers seems to be a neglected research field.
Coaching functions are those interventions that inhibit process losses and foster
process gains; motivational coaching addresses effort; consultative coaching addresses
performance strategy; and educational coaching addresses distribution of knowledge
and skill among group members (Hackman and Wageman, 2005).

Criteria of team effectiveness


To perform well groups must:
• make an effort;
• make use of knowledge, abilities and skills of group members; and
• choose appropriate task performance strategies.
TPM Effort is about building commitment. Using members’ knowledge, ability and skills is
21,5/6 about sharing expertise. In the TDS framework effort strategy, knowledge and skill, as
well as individual well-being of group members, are measured.
In the team effectiveness literature, there are surprisingly few attempts to measure
performance in behavioral terms. Instead, productivity is the most common
measurement. For example, Kuipers and Stoker (2009) used long-term product quality in
298 their study on the development of self-managing work teams.
The aims of the present study were to further validate the Swedish language version of
TDS and to test the predictive validity of TDS. The study is the first attempt to test
Hackman’s (2002) team effectiveness model with the structural equation model (SEM)
approach. The reasoning behind utilizing the SEM method was to use a more powerful
alternative to multiple regressions. Because Hackman’s Team Effectiveness Model is quite
complex, there is a risk of finding surplus regression weights with less powerful models.
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

Method
Participants
Data from 33 teams across 8 different workplaces were collected. The workplaces were
large companies from the state sector. All teams at each workplace were selected for the
data collection. Participants (N ⫽ 214) belonged to three types of work teams:
performing teams (n ⫽ 33, 8 teams), production teams (n ⫽ 103, 21 teams) and service
teams (n ⫽ 21, 4 teams) across four different types of work organizations. In total,
72 group members come from white-collar organizations, 66 group members from
blue-collar organizations, 21 group members from service organizations and 45 group
members from work organizations dealing with education.
The response rate within each company was 90 per cent, and the response rate within
each group was 88 per cent.

Material
The TDS questionnaire
For this study, a new shorter version of TDS was used. The reason for using a shorter
version was based on improvement of internal consistency and more manageable size of
the questionnaire. Creating shorter versions of the TDS is a task of several research
groups around the world. Except where otherwise noted, all items make use of a
five-point scale ranging from highly inaccurate (1) to highly accurate (5). Group-level
composite scores are computed by averaging across items and respondents.
Reverse-scored items are computed before analysis.
Demographic information (five items) includes, for example: “How long have you
been a member of the team you described in this survey?”
Statements about the team includes, for example: “Both the purposes of our team and
the means or purposes we are suggested to use in our work are specified in detail by
others”; and “Our team has also the authority to specify what our team exists to
accomplish, its main purposes”.
Real team (six items) includes, for example: “My work on this team is just one part of
my overall job in this organization”; and “The purposes of this team don’t make much of
a difference to anybody else”.
Compelling direction (five items) includes, for example: “This team has not broad
enough experience to manage goals”.
Enabling structure includes team composition (seven items), task design (seven Team
items) and group norms (three items) – in total, 18 items on a five-point Likert-scale. diagnostic
Example items: “This team has too few members for what it has to accomplish”; and
“Team members have enough skills to leave up to expectations”.
survey
Organizational context (ten items) includes, for example: “Even teams that do an
especially good job are not recognized by the organization”.
Team coaching (four items) includes, for example: “Experts on team facilitation are 299
available”.
Team leadership (13 items) includes, for example: “The team leader helps the team to
develop a shared involvement for goals and purposes”.
Team members’ behavior (five items) includes, for example: “Regular team members take
initiatives to constructively resolve any problems or conflicts that develop among
members”.
Process criteria (nine items). The scales assess the level of effort members collectively
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

expend on the task, the quality of team task performance strategies and the degree to
which the team uses members’ knowledge and skill. Example items: “Members
demonstrate their commitment to our team by putting in extra time and effort to help it
succeed”, “Our team often falls into mindless routines, without noticing any changes
that may have been offered in our situation” and “Members of our team actively share
their special knowledge and expertise with one another.”
Interpersonal processes and individual well-being (19 items). Quality of team
interaction, example item: “Working together energizes and uplifts members of our
team”. Satisfaction with team relationship, example item: “My relations with other team
members are strained”. (R) Satisfaction growth, example item: “My own creativity and
initiative are suppressed by this team”. (R) General satisfaction, example item: “I enjoy
the kind of work we do in this team”. Internal work motivation, example item: “I feel bad
and unhappy when our team has performed poorly”.

Performance evaluation
To perform well groups must:
• make an effort;
• make use of knowledge, abilities and skills of group members; and
• choose appropriate task performance strategies.

The TDS measures performance via a three-dimensional concept of group effectiveness:


(1) the quantity and quality within certain timelines;
(2) the degree group manages to enhance the capacity of members to work together
interdependently in the future; and
(3) the growth and personal well-being of team members.

To evaluate performance, an observation scheme based on these criteria was developed.


The seven categories in the observation scheme were:
(1) effort of each group member;
(2) knowledge sharing;
(3) ability and skills of a group’s member;
TPM (4) performance strategies;
21,5/6 (5) meeting timelines;
(6) working interdependently; and
(7) constructive communication.

300 The scores were conducted by one selected group member from each group, a team
leader and one independent observer. All scores were transformed to a five-degree scale
after all data being collected.

Procedure
The original Swedish version of TDS was translated and back-translated and its
validity was tested in an earlier study (Eisele, 2013). Further validation analyses of the
shorter version used in the present study was conducted prior to this data collection. The
new shorter version has increased internal consistency and discriminant validity.
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

The questionnaire was distributed to work teams from different companies and was
sent to group members by mail and data was saved in an SPSS file after completion of
the survey. Each participant wrote down a name for their group, agreed upon before
data collection. Also, each participant wrote down a name in the demographic section
of the Web survey but was informed that they could fill out the questionnaire
anonymously. Those who wished to remain unknown wrote down a fictitious name.
This individual name and the name of each group made it possible to identify each
respondent with a maintained high degree of confidentiality.
Performance was evaluated by team members, team leaders and one independent
observer.

Result
Psychometric information on the TDS scales for 33 teams are presented for the
5 enabling conditions, the organizational support variables, the coaching variables and
the performance criterion variables in Tables I and II. Descriptive statistics include
means, standard deviations, average correlation within each scale, average correlation
between the scales and internal consistency reliabilities. The latter presented both at
individual level and group level; otherwise, all analyses were made on the group level.
As Table I shows, the discriminant validities are, in general, acceptable but
unsatisfactory for consequentiality, size and organizational resources. Most factors
presented in Table I have satisfactory Cronbach’s alpha values but note two factors,
consequentiality and organizational resources. All factors presented in Table II have
satisfactory Cronbach’s alpha values.
Table II presents psychometric data for the coaching measures, criterion measures
and output variables. These factors had in general satisfactory validity and reliability.

The model testing


The model had the following independent factors: real team, compelling directions,
enabling structure, supportive context and coaching. The dependent factors where the
process criteria, satisfaction scores and performance evaluation.
SEM was considered suitable for these data, as it is a cross-sectional statistical
modeling technique, largely confirmatory, rather than exploratory. That is, the purpose
was here to determine whether Hackman’s (2002) model is valid, rather than trying to
Team effectivness
Team
conditions Items M SD R within R between Alpha individual Alpha team diagnostic
survey
Real team 6 4.17 0.62
Bounded 2 4.61 0.70 0.46 0.23 0.54 0.84
Interdependent 2 4.06 0.81 0.51 0.19 0.45 0.74
Stable 2 3.81 1.16 0.50 0.19 0.43 0.68
301
Compelling direction 5 3.92 0.68
Clear 1 3.59 0.82 * * * *
Challenging 2 3.62 0.95 0.62 0.43 0.63 0.77
Consequentiality 2 4.14 0.92 0.63 0.34 0.33 0.35
Enabling structure 18
Team composition 7 3.77 0.73
Size 2 3.29 0.79 0.44 0.34 0.39 0.44
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

Diversity 3 3.85 0.84 0.67 0.45 0.64 0.75


Skills 3 3.64 0.90 0.49 0.35 0.59 0.71
Task design 8 3.66 0.76
Whole task 3 3.58 0.51 0.42 0.33 0.64 0.67
Autonomy 2 3.57 0.96 0.51 0.39 0.60 0.65
Knowledge of results 3 3.54 0.82 0.41 0.35 0.64 0.68
Group norms 3 3.86 0.91 0.61 0.36 0.72 0.88
Supportive context 10 3.66 0.68
Reward/recognition 2 2.72 0.99 0.75 0.66 0.80 0.82
Information 3 3.60 0.94 0.47 0.34 0.59 0.68
Education 3 3.26 0.94 0.41 0.33 0.56 0.67
Resources 2 3.41 0.97 0.47 0.24 0.19 0.22
Table I.
Team coaching 3 Descriptive statistics
Availability 2 3.26 1.01 0.82 0.80 0.76 0.82 and psychometrics
Helpfulness 1 3.09 0.71 * * * * for the five enabling
conditions in the
Note: All data are analysed at the group level (n ⫽ 33) beside data in the column Alpha individual that team effectiveness
are Cronbach’s Alphas done at an individual level (n ⫽ 214) model

find a suitable model. SEM also allows multiple measures to be associated with a single
latent construct. The decision to make use of SEM was largely a result of discussions on
development of TDS at international conferences.
Goodness-of-fit was calculated to establish whether the overall model was
acceptable. Confirmatory goodness-of-fit analyses of TDS measures and output
variables where done with Amos statistics. Several statistical tests were submitted to
test the adequacy of the proposed model. Chi-square dived with degrees of freedom
(CMIN/DF), root mean square error of approximation (RMSEA) and comparative fit
index (CFI). There was a moderate model fit for the three main models (Table III).
Because the model was acceptable, further analyses were made to establish whether
specific paths were significant. Team factors had stronger regression weights than both
organizational factors and factors related to coaching. Structural factors stronger
impact than for example compelling direction. The latent structure effectiveness load on
both process criteria and satisfaction (Figure 1).
TPM Team effectivness
21,5/6 conditions Items M SD R within R between Alpha individual Alpha team

Process criteria
Effort 3 3.46 0.99 0.41 0.40 0.64 0.78
Performance strategy 3 3.52 0.85 0.49 0.44 0.56 0.72
302 Knowledge and skill 3 3.66 0.85 0.56 0.46 0.73 0.77
Leader coaching
Task-focused 6 3.42 0.93 0.83 0.67 0.86 0.98
Operant 2 3.55 0.57 0.98 0.69 0.87 0.96
Interpersonal 2 3.06 0.99 0.88 0.80 0.86 0.96
Unhelpful directives 3 3.09 0.61 0.86 0.74 0.84 0.94
Peer coaching
Task-focused 3 3.27 0.84 0.96 0.89 0.71 0.98
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

Interpersonal 1 2.91 0.69 * * * *


Unhelpful interventions 1 3.00 0.65 * * * *
Output variables
Growth satisfaction 3 3.87 0.79 0.56 0.57 0.70 *
General satisfaction 3 4.08 0.86 0.54 0.51 0.79 *
Quality of interaction 4 3.90 0.82 0.44 0.44 0.64 0.71
Relationship satisfaction 3 4.13 0.72 0.73 0.69 0.86 *
Table II. Internal work motivation 4 3.90 0.76 0.57 0.55 0.70 *
Descriptive statistics Performance team member 7 7.81 1.35 0.67 0.50 0.77 *
and psychometrics Performance leader 7 7.25 1.61 0.61 0.53 0.67 *
for leader and peer Performance observer 7 6.60 1.28 0.63 0.54 0.72 *
coaching. Team
effectiveness criteria Notes: Team-level reliabilities were not computed for the measures of motivation and satisfaction
and output variables because these are individual-level constructs. All data are analysed at the group level (n ⫽ 33) beside
(n ⫽ 214/33) data in the column Alpha individual that are Cronbach’s Alphas done at an individual level (n ⫽ 214)

Three AMOS models Chi-square df RMSEA CMIN/DF CFI

Model with performance evaluations and one


Table III. satisfaction factor 828.76 72 0.19 11.5 0.59
Goodness-of-fit for Model with process criteria and one satisfaction
confirmatory factor factor 387.46 72 0.14 5.38 0.76
analyses of TDS Model with process criteria and two satisfaction
measures factors 495.33 98 0.13 5.05 0.77

Discussion
This study was the first attempt to examine the predictive validity of the TDS. In
doing so, Hackman’s (2002) model of team effectiveness was tested. SEM was used
due to the complexity of the subject area and the confirmatory nature of the
proposed model.
The models were admissible and gave several insights. The most important insight
being that the internal team factors predicted both performance and satisfaction more
than organizational support and coaching availability.
Team
diagnostic
survey

303
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

Figure 1.
The structural
equations of
Hackman’s (2002)
team effectiveness
model

A limitation of the study was the cross-sectional design. Because team behavior changes
over time (Gutwin and Greenberg, 2004), studies with longitudinal designs should be
used more. However, TDS data have been collected over time in an earlier study (Eisele,
2013).
No significant differences were found between the three types of teams. Thus,
differences in specific task were not further explored in this study and can be seen as
another limitation.
The TDS is a valid tool both for research and consultative work. However, it should
be complemented with investigation into certain specific behaviors such as team plans.
For example, DeChurch and Haas (2008) found that team effectiveness is determined
most strongly by reactive adjustment (occurs during the action), then by contingency
TPM planning (specifies backup plans) and least so by deliberate planning (specifies a
21,5/6 primary course of action).
Theoretical implications of the study are that a survey can be used to get a valid
overall picture of the real life work team’s effectiveness. Although other forms of data
collection should be used also, a reliable questionnaire of team effectiveness is fruitful
for future research on team effectiveness. The addition of an observation procedure was
304 a methodological improvement but did not affect the model per se.
Managerial implications of the study are that communication between researcher
and/or consultant and organizational stakeholders is made easier, as the most important
factors that affect team effectiveness are identified.
The TDS represents a bold attempt to include all of the most important factors that
affect team effectivity, and not just a few easy-to-measure factors. It is a false
assumption that the instrument is more valid if it is limited to a too small number of
factors. The non-measured factors simply make the instrument non-valid. By including
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

the factors with a bit lower reliably the instrument as a whole is in fact more valid. By
excluding them, we only create an illusion of a valid instrument. The work on the
development on TDS has shown that it is possible to use a complex instrument to
diagnose work groups, and this line of research is leading the way for better
instruments. This is even truer when it comes to applied use; data based on TDS
improve communication between researcher/consultant and stakeholders.
To conclude, the new shortened Swedish version of the TDS has high internal
consistency, discriminant validity and predictive validity. The research has increased
understanding of team effectiveness. Knowledge gained by the TDS can be used to
make better interventions. The research suggests that the TDS can facilitate the
planning of group processes, for example, acceptance of all ideas. By collecting
self-reported data based on group members’ own view of group processes and the main
factors that affect these processes, it is possible to proclaim aspects of teamwork that are
not easily observed. The main point is that the type of knowledge given by the TDS can
be used to improve communication between facilitator and stakeholder.

References
Alper, S., Tjosvold, D. and Law, K.S. (1998), “Interdependence and controversy in group decision
making: antecedents to effective self-managing teams”, Organizational Behavior and
Human Decision Processes, Vol. 74 No. 1, pp. 33-52.
Aubé, C. and Rousseau, V. (2005), “Team goal commitment and team effectiveness: the role of task
interdependence and supportive behaviors”, Group Dynamics: Theory, Research, and
Practice, Vol. 9 No. 1, pp. 189-204.
Callea, A., Urbini, F., Benevene, P., Cortini, Di Lemma, M. and West, M.A. (2014), “Psychometric
properties and factor structure of the Italian version of the Aston team performance
inventory”, Team Performance Management, Vol. 20 Nos 1/2, pp. 6-18.
Chatman, J.A. and Flynn, F.J. (2001), “The influence of demographic heterogeneity on the
emergence and consequences of cooperative norms in work teams”, Academy of
Management Review, Vol. 44 No. 5, pp. 956-974.
Dawson, J.F., West, M.A. and Markiewicz, L. (2006), Aston Team Performance Inventory:
Management Set, ASE, London.
DeChurch, L.A. and Haas, C.D. (2008), “Examining team planning through an episodic lens effects Team
of deliberate, contingency, and reactive planning on team effectiveness”, Small Group
Research, Vol. 39 No. 5, pp. 542-568.
diagnostic
Edwards, B.D., Day, E.A., Winfred, A. Jr and Bell, S.T. (2006), “Relationship among team ability
survey
composition, team mental models, and team performance”, Journal of Applied Psychology,
Vol. 91 No. 3, pp. 727-736.
Eisele, P. (2013), “Validation of the team diagnostic survey and a field experiment examine effects 305
of an intervention to increase team effectiveness”, Group Facilitation: A Research and
Applications Journal, Vol. 13 No. 1, pp. 34-49.
Feldman, D.C. (1984), “The development and enforcement of group norms”, Academy of
Management Review, Vol. 9 No. 1, pp. 47-53.
Gutwin, C. and Greenberg, S. (2004), “The importance of awareness for team cognition in
distributed collaboration”, in Salas, E. and Fiore, S.M. (Eds), Team Cognition:
Understanding the Factors that Drive Process and Performance, American Psychological
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

Association, Washington, DC, pp. 177-201.


Hackman, J.R. (1987), “The design of work teams”, in Lorsch, J. (Ed.), Handbook of Organizational
Behavior, Prentice Hall, New York, NY, pp. 315-342.
Hackman, J.R. (1992), “Group influences on individuals in organizations”, in Dunnette, M.D. and
Hough, L.M. (Eds), Handbook of Industrial and Organizational Psychology, Consulting
Psychologists Press, Palo Alto, Vol. 3.
Hackman, J.R. (2002), Leading Teams: Setting the Stage for Great Performance, Harvard Business
School Press, Boston.
Hackman, J.R. and Wageman, R. (2005), “A theory of team coaching”, Academy of Management
Review, Vol. 30 No. 2, pp. 269-287.
Hertel, G., Konradt, U. and Orlikowski, B. (2004), “Managing distance by interdependence: goal
setting, task interdependence, and team-based rewards in virtual teams”, European Journal
of Work and organizational Psychology, Vol. 13 No. 1, pp. 1-28.
Jehn, K.C. (1995), “A multimethod examination of the benefits and detriments of intragroup
conflict”, Administrative Science Quarterly, Vol. 40 No. 2, pp. 256-282.
Kuipers, B.S. and Stoker, J.I. (2009), “Development and performance of self-managing work teams:
a theoretical and empirical examination”, The International Journal of Human Resource
Management, Vol. 20 No. 2, pp. 399-419.
Levine, J.M., Higgins, E.T. and Choi, H. (2000), “Development of strategic norms in groups”,
Organizational Behavior and Human Decision Processes, Vol. 82 No. 1, pp. 88-101.
Liu, C.Y., Pirola-Merlo, A., Yang, C.A. and Huang, C. (2009), “Disseminating the functions of team
coaching regarding research and development team effectiveness: evidence from a
high-tech industry in Taiwan”, Social Behavior and Personality, Vol. 37 No. 1, pp. 41-58.
Passos, A.M. and Caetano, A. (2005), “Exploring the effects of intragroup conflict and past
performance feedback on team effectiveness”, Journal of Managerial Psychology, Special
Issue: Work Team Effectiveness in Organizational Contexts: Recent Research and
Applications in Spain and Portugal, Vol. 20 Nos 3/4, pp. 231-244.
Pearce, C.L. and Sims, H.P. Jr (2002), “Vertical versus shared leadership as predictors of the
effectiveness of change management teams: an examination of aversive, directive,
transactional, transformational, and empowering leader behaviors”, Group Dynamics:
Theory, Research, and Practice, Vol. 6 No. 2, pp. 172-187.
Peters, L. and Karren, R.J. (2009), “An examination of the roles of trust and functional diversity on virtual
team performance ratings”, Group & Organization Management, Vol. 34 No. 4, pp. 479-504.
TPM Rousseau, V. and Aubé, C. (2010), “Team self-managing behaviors and team effectiveness: the
moderating effect of task routineness”, Group & Organization Management, Vol. 35 No. 6,
21,5/6 pp. 751-781.
Salas, E., Cooke, N.J. and Rosen, M.A. (2008), “On teams, teamwork, and team performance:
discoveries and developments”, Human Factors: The Journal of the Human Factors and
Ergonomics Society, Vol. 50 No. 3, pp. 540-547.
306 Steiner, I.D. (1972), Group Process and Productivity, Academic press, New York, NY.
Stewart, M.M. and Johnson, O.E. (2009), “Leader-member exchange as a moderator of the
relationship between work group diversity and team performance”, Group & Organization
Management, Vol. 34 No. 1, pp. 507-535.
Stroebe, W. and Diehl, M. (1994), “Why groups are less effective than their members: on
productivity losses in idea-generating groups”, in Stroebe, W. and Hewstone, M. (Eds),
European Review of Social Psychology, Wiley, London, Vol. 5, pp. 271-303.
Taggar, S. and Ellis, P. (2007), “The role of leaders in shaping formal team norms”, The Leadership
Downloaded by Doctor per eisele At 08:02 05 August 2015 (PT)

Quarterly, Vol. 18 No. 2, pp. 105-120.


Wageman, R. (2001), “How leaders foster self-managing team effectiveness: design choices versus
hands-on coaching”, Organization Science, Vol. 12 No. 1, pp. 559-577.
Wageman, R., Hackman, J.R. and Lehman, E. (2005), “Team diagnostic survey: development of an
instrument”, The Journal of Applied Behavioral Science, Vol. 41 No. 4, pp. 373-398.

Further reading
Eisele, P. and Arthur, W. Jr (2014), “General performance measure: Further validation of the GPM
in a longitudinal study across different jobs”, Preparation for Scandinavian Journal of
Management.
Hackman, J.R. (1990), Groups that Work (and those that Don’t), Jossey-Bass, San Francisco.
Hackman, J.R. and Morris, C.G. (1975), “Group tasks, group interaction process, and group
performance effectiveness: a review and proposed integration”, in Berkowitz, L. (Ed.),
Advances in Experimental Social Psychology, Academic press, San Diego, CA, pp. 45-99.

Corresponding author
Per Eisele can be contacted at: per.eisele@gmail.com

For instructions on how to order reprints of this article, please visit our website:
www.emeraldgrouppublishing.com/licensing/reprints.htm
Or contact us for further details: permissions@emeraldinsight.com

You might also like