You are on page 1of 13

Current Psychology

https://doi.org/10.1007/s12144-021-01578-x

A complementary methodology to assess time


management behaviors
Miriam Romero 1 & José Manuel Hernández 1 & James F. Juola 2 & Cristina Casadevante 1 & José Santacreu 3

Accepted: 2 March 2021


# The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2021

Abstract
Managing time effectively requires making decisions to plan the order of execution of different tasks, so that the maximum gain is
achieved in a given period. We designed a test called My Schedule to assess time management, and we report a study of its
psychometric properties. Through an online web server, we administered My Schedule along with two other objective tests, one
that measures time management behaviors (Planning test) and another that assesses risk-tendency (Betting Dice test) to study
convergent and divergent validity. In addition, we administered a self-report that assesses time management (TMBQ). My
Schedule showed high reliability and moderate convergence with the Planning test and no significant correlation with the
Betting Dice test and the TMBQ. Theoretical and practical implications are discussed.

Keywords Time management . Assessment . Objective test . Self-report . Computerized testing

Time management skills promote optimal results both in the The number of instruments available to assess time
academic context and at work. Students need to learn to com- management is limited. Many of these instruments have
plete course assignments on time, as most academic subjects not been developed on the basis of an explicitly de-
have a number of deadlines that have to be met in order for the scribed theoretical framework (Hellsten, 2012). The
students to pass (Claessens et al., 2007). Some authors have most commonly used instruments for measuring time
pointed out that effective time management may lead to better management are self-reports (Hellsten, 2012). These in-
academic results (e.g., Britton & Tesser, 1991; Macan et al., struments allow information to be collected quickly but
1990), and students will eventually be faced with the need to also suffer from limitations such as limited accuracy and
manage their time in the workplace. For some jobs, especially bias effects (Ortner & Proyer, 2015). Therefore, several
those that offer flexible working hours or teleworking, time researchers have emphasized the need to develop objec-
management behaviors are highly important (Orlikowsky & tive tests as a complementary measure to assess time
Yates, 2002). Efficient time management behaviors may lead management (e.g., Jex & Elacqua, 1999; Macan, 1994).
to better job performance and increased worker satisfaction For the present study, we have designed an objective
(e.g., Claessens et al., 2009). As a result, many companies test called My Schedule to assess time management be-
and universities promote time management training programs, haviors. Its design is based on one of the theories that
sometimes without having adequately evaluated which partic- has gained the most ground in recent years in the time
ipants actually need them (Green & Skinner, 2005). management literature: the behavioral decision-making
theory (Koch & Kleinman, 2002). The aim of our work
is to study the psychometric properties of the My
Schedule objective test.
* Miriam Romero
miriam.romero@uam.es; https://orcid.org/0000-0003-1658-033X

1
Department of Psychology, Universidad Autónoma de Madrid, Time Management: Definition
Madrid, Spain and Theoretical Framework
2
Department of Psychology, University of Kansas, Lawrence, KS,
USA The concept of time management became popular in the
3
Applied Psychology Center, Universidad Autónoma de Madrid, 1960s, when it was suggested that time management programs
Madrid, Spain might have positive effects in the workplace (Claessens et al.,
Curr Psychol

2009). Two influential figures in the time management litera- Behavioral decision-making theory has received empirical
ture are Alan Lakein and Therese H. Macan. Lakein (1973) support, for example by König and Kleinman (2006), who
described time management as a process that implies estab- found that people who consider immediate options with less
lishing goals and prioritizing and planning tasks in order to value instead of future options with higher value tend to show
achieve these goals. He used a theoretical analysis of the poorer time management behaviors. Experimental studies
problem to make recommendations on how to improve time have also provided support for this theory (e.g., Fagerstrøm
management. Macan (1994) proposed a model in which she et al., 2016; Häfner et al., 2014; König & Kleinman, 2007).
described time management as being based on three dimen-
sions (three types of behaviors): setting goals and priorities,
establishing mechanisms of time management, and prefer- Assessing Time Management
ences for organization. This model has received only partial
empirical support (e.g., Adams & Jex, 1997; Jex & Elacqua, Time management behaviors are most commonly measured
1999). by using self-reports. This methodology provides descriptive
Despite the wide use of the concept of time management, information that participants offer about their own behavior.
Claessens and her colleagues noted that there was no generally The most frequently used self-report instruments in this area
agreed-upon definition. In 2007, they proposed a definition are the Time Management Behavior Questionnaire (TMBQ;
based on a thorough review of the literature, namely that time Macan et al., 1990), the Time Structure Questionnaire (TSQ;
management is comprised of “behaviours that aim at achiev- Bond & Feather, 1988), and the Time Management
ing an effective use of time while performing certain goal- Questionnaire (Britton & Tesser, 1991). They show accept-
directed activities” (Claessens et al., 2007, p. 262). able levels of reliability and allow researchers to obtain data
Claessens et al. (2009) classify these behaviors as aligning quickly, but they also have some limitations. For example,
with the following dimensions: time assessment behaviors, participants might not know how to respond to certain items,
monitoring behaviors, planning behaviors and executive be- as they might not have an accurate self-view of their own
haviors. Their model has received some empirical support motivations and decision criteria. Biases can also affect self-
(McNamara, 2016). reports. For example, social desirability can influence partic-
In recent years, behavioral decision-making theory (Koch ipants’ responses, as they might want to present themselves in
& Kleinman, 2002) has become one of the most important a favorable way (Edwards, 1957; McDonald, 2008; Ortner &
theoretical applications to time management research Proyer, 2015).
(Sevary & Kandy, 2011). Koch and Kleinman (2002) demon- Another method to assess time management uses observa-
strated how time management can be interpreted from the tional checklists: a list of behaviors that can be registered by
point of view of behavioral decision-making theory. When an observer. For example, DiPipi-Hoy et al. (2009) designed
people want to achieve a goal, they need to make decisions an observational checklist to study the effects of time manage-
about which tasks to do and in which order. People can also ment training on the behavior of participants with intellectual
make decisions to promote achievement of their goals, for disabilities. Observational checklists are less subjective than
example, by increasing or decreasing speed or by limiting questionnaires; however, they require long observer training
interruptions. In addition, people need to make decisions re- and efforts to reduce the usual reactivity of participants to the
garding their environment, such as by minimizing distrac- presence of an observer (McDonald, 2008).
tions. When making a decision, they need to consider Researchers who study time management emphasize the
the benefits (e.g., what they obtain if they finish a task) need for objective measures to complement data obtained
and the costs (e.g., the time and effort they need to from other methods (e.g., Jex & Elacqua, 1999; Macan,
spend completing the task, as well as the activities that 1994), as suggested by previous researchers such as Cattell
they will not be able to complete by choosing one task and Warburton (1967), who promoted the use of objective
over another). This allows them to estimate the utility tests to assess psychological variables. Objective tests present
or value of a specific choice. Koch and Kleinman ar- situations in which participants have to perform tasks that
gued that it is possible to manage time only if there are include mechanical or electronic means of registering data
competing tasks to do. Efficient time management re- online and automatically (Santacreu & Hernández, 2017).
quires making the optimal choices and prioritizing tasks Objective tests can be employed as a complementary meth-
that offer high benefits or consume less time. odology to assess time management. There are a few objective
Koch and Kleinman (2002) explain that people who have tests that provide measures of time management behaviors.
time management problems are those who perform tasks with For example, Tulga and Sheridan (1980) designed a basic
a small value rather than those with a high value. Usually this computerized objective test in which participants had to obtain
occurs when the tasks with small value can be completed in points by completing tasks defined in blocks that appeared
the short term. randomly. They had to select one block at a time to “work”
Curr Psychol

on before a deadline. The time management score was deter- In this work, we have designed the My Schedule objective
mined by the total number of points obtained for completing test as a complementary instrument to assess time manage-
blocks of different values. ment and to overcome some limitations of the previously de-
As another example, Gongsook (2016) designed a comput- scribed methods. It presents a schedule page with office activ-
erized objective test called “Timo’s adventure”. It includes ities (e.g., reading emails, working on a computer, attending a
some mini-games that assess time perception in children from meeting, downloading documents) of different values (as they
4 to 7 years old. Its principal aim is to assess children with have different importance represented by points and different
Attention Deficit Hyperactivity Disorder (ADHD), as they costs in terms of the time they require to be completed). As
often have problems estimating time intervals (Barkley will be described in the method section, the value of the ac-
et al., 2001). For example, in one of the scenarios presented, tivities can be higher if they are completed within specific
participants have to inflate a balloon within a time interval periods, and the time an activity takes to complete can be
between 9 and 11 s. reduced. In addition, one of the tasks (downloading docu-
Another objective test was designed by Santacreu (2004a). ments) can be completed at the same time as others, and an-
It is called the Planning test and provides a time management other of the tasks (answering calls) can interrupt other activi-
measure. It presents three dots that move at different speeds at ties. Participants obtain points when completing tasks. As de-
the top of the screen. At the bottom of the screen there is a rived from the behavioral decision-making theory (Koch &
funnel. The direction of the dots can be modified by clicking Kleinman, 2002), participants have to make optimal decisions
on arrows. The participants have to move the dots towards the to obtain larger numbers of points, and they have to select
funnel, while avoiding their progress outside the limits of the activities that provide the higher values within the given time
screen. Those who manage to direct the dots to the funnel in limits.
shorter times receive higher scores. The test provides added value compared to other method-
Tulga and Sheridan’s task, Timo’s adventure and the ologies that measure time management. First, the test con-
Planning test record data automatically and provide behavior- struction was guided by behavioral decision-making theory,
al measures of time management. However, their main limi- which is one of the most important theories in time manage-
tation is that they are not based on any explicit theoretical ment that has gained continuing empirical support. Second, it
analysis of time management behaviors, which prevents a registers behavioral data, instead of the verbal, self-reported
comprehensive study of the variable. For example, based on descriptions of participants’ behavior. Objective tests are more
behavioral decision-making theory (Koch & Kleinman, likely to free of validity issues and biases (Ortner & Proyer,
2002), it would be appropriate to assess the decisions that 2015). Therefore, My Schedule overcomes the main limita-
participants make when choosing between activities that have tions of self-reports. Third, the test registers data automatically
different values (benefits and costs). Better time managers will and requires less resources and time than the observational
be those who make optimal decisions, like choosing tasks methodology.
with higher values, and avoiding the interruption of tasks that My Schedule was designed to assess time management in
are close to completion. The objective tests presented do not adults and is especially aimed at work and academic contexts.
allow participants to show all these behaviors. Timo’s adven- In both contexts, people have to make decisions about which
ture allows assessing time estimation but it does not require tasks are most convenient and beneficial to accomplish at any
participants to make decisions about which tasks to complete given time.
and in which order. Moreover, it was designed for a specific
population: children with ADHD. Tulga and Sheridan’s task
and the Planning test allow assessing which blocks (Tulga and Aim of the Study
Sheridan’s task) or dots (Planning test) the participants
choose, and in which order. Nevertheless, regarding the The aim of this work is to study the validity and psychometric
Planning test, the dots move at different speeds, and the par- properties of My Schedule. The first goal is to study reliability
ticipants have to make decisions, but the values of the dots are (internal consistency and test-retest). It is expected that sepa-
not explicit. In Tulga and Sheridan’s task, the values of the rate trials within My Schedule will provide similar measures.
blocks are explicit, but participants can only click on one In addition, it is expected that My Schedule will provide sim-
block at a time. It does not allow several blocks to be com- ilar measures in two administrations separated by an interval
pleted at the same time, and the completion process cannot be of 1 month.
interrupted. Hellsten (2012) identified that developing assess- The second goal is to study convergent and divergent va-
ment instruments based on a theoretical framework is a neces- lidity. When presenting a new instrument, is important to
sity in the time management literature. Designing a new ob- check convergence with a similar method that assesses a sim-
jective test grounded on theoretical principles would have ilar construct in addition to divergence with a similar method
important theoretical and practical implications. that assesses a different construct (e.g., DeVellis, 2016).
Curr Psychol

Regarding convergent validity, we expect that My Schedule Method


test will show a significant relation with a test that also as-
sesses time management behaviors: the Planning test Participants
(Santacreu, 2004a).
One hundred and eight psychology students (96 females and
& H1: Time management measures provided by My 12 males) of a Spanish University participated in the study.
Schedule and the Planning test (Santacreu, 2004a) will They received course credit as a reward for their participation.
be significantly related. However, they also could get the course credit by doing a
different activity.
Regarding divergent validity, it is expected that My
Schedule test will not show a significant relation with an ob- Instruments
jective test that measures a different construct. We decided to
compare the results of My Schedule with those from a test that Time Management
assesses risk-tendency: the Betting Dice test (Rubio &
Santacreu, 1998). The scores of My Schedule should not show My Schedule This objective test was designed to assess time
a relation with risk-tendency, that is, the tendency to choose management behaviors based on behavioral decision-making
options with higher value but lesser probability when any of theory (Koch & Kleinman, 2002). Below, we will describe in
the options has the same expected value (e.g., Arend et al., detail how this theory guided the design of the characteristics
2003). In My Schedule test, each activity provides different of the test. My Schedule can be administered through an on-
points, but the probability of achieving them does not play a line server and is available upon request from the correspond-
role in the task. ing author.
As described in the introduction, behavioral decision-
& H2: Time management measured by My Schedule will not making theory states that better time managers make optimal
show a significant correlation with risk-tendency mea- choices, that is, they choose to complete tasks that offer the
sured by the Betting Dice test (Rubio & Santacreu, 1998). highest values at a given time. Therefore, we decided to create
a scenario in which participants could choose between activ-
The third goal is to evaluate the well-known lack of corre- ities of different values. The time management variable would
spondence between objective tests and self-reports that pur- be the result of participants’ decisions on which activities to
portedly measure the same underlying variable. The reason complete given their competing values and time constraints in
that several studies have not found a significant correlation order to obtain higher scores that reflect more optimal time
between these methods is that what we say and what we do management.
not necessarily stand in close correspondence (Ortner & Koch and Kleinman (2002) argue that to manage time,
Proyer, 2015; Santacreu & Hernández, 2017; Skinner & there should be competing tasks to choose from. Therefore,
Howart, 1973). An objective test allows us to record time the designed objective test should present several activities for
management behaviors, whereas a self-report obtains verbal the participants to make decisions. Since the test should be
descriptions of time management. They are therefore not designed for adults and mainly for work and educational con-
necessarily measuring the same aspects of time manage- texts, we tried to consider activities with which a large part of
ment, and should not be interchangeable measures. We the target populations would be familiar. Koch and Kleinman
believe that it is important to compare results so that simulated office activities in some of their experimental work
future practitioners who assess time management consid- (e.g., König & Kleinman, 2007). Taking this into consider-
er this information and make appropriate decisions ation, the activities that we included were the following: read-
about what measures they want to obtain (see Dang ing emails, answering calls, working on a computer, attending
et al., 2020). We will employ the TMBQ (Macan a meeting, downloading documents, and having a break (rep-
et al., 1990) to assess verbal descriptions of time man- resented by a cup of coffee). The objective test, which we
agement. TMBQ measures three dimensions of time named My Schedule, presents a schedule page with day hours
management (establishing goals and priorities, time (from 9 a.m. to 5 p.m.) and icons that represent the mentioned
management tools, and perception of control over time) activities (see Fig. 1).
but none of them is expected to show a relation with As derived from behavioral decision-making theory, man-
time management measured by My Schedule. aging time requires making decisions based on the benefits
and costs (i.e., values) of the activities. In My Schedule, the
& H3: Time management measured by My Schedule will not points awarded for completing an activity represent the bene-
show a significant correlation with any of the time man- fits, and the times the activities take to complete represent the
agement dimensions of the TMBQ (Macan et al., 1990). costs. As seen in Fig. 1, each activity icon has an oval showing
Curr Psychol

Fig. 1 Example of a display shown on each trial of My Schedule

the points it provides if completed. Under each activity, there activity is completed, it interrupts the activity, and therefore
is a bar that fills up when the activity is clicked, representing they do not obtain the points that could have provided.
how much time it takes to complete. The participants have to The behavioral decision-making theory implies that opti-
consider the values of the activities, that is, their benefits mal decisions involve consideration of when an activity is
(points) and costs (timer the activities take to complete), to expected to be completed. In some cases, if a deadline is set,
make decisions. On this issue, we give more details below. completing the activity after the deadline will have no bene-
To represent properly that the time an activity takes to fits. In the designed objective test, the schedule page repre-
complete implies a cost, the designed objective test does not sents a day. We included a bar moving from the top to the
allow participants to complete different activities at the same bottom of the schedule to represent time passing. Although the
time. Nevertheless, we included one exception. In our routine, schedule presents hours from 9 a.m. to 5 p.m., the moving bar
there are activities that we do not have to work on directly and only reaches 2 p.m., representing that the work hours end at
that can be completed in the background, while we work on that time (deadline). In other cases, depending on when some
other activities. Thus, we included “downloading documents” activities are completed during the day, the values of these
as a task that could be completed simultaneously with another activities could be higher. For example, reading emails first
activity. In My Schedule, when participants are “working” on thing in the morning might be beneficial, as it could be useful
any activity, the other activities are not active, and participants to have the information at the beginning of the working day.
cannot click on them except for “downloading documents”. However, this does not mean that reading them at another time
Participants can click on “downloading documents” to com- of the day is worthless. To represent the fact that the values of
plete it at the same time another activity is being completed some activities may be higher at certain times of day, we
and therefore obtain more points than if they click on the decided to highlight some hours. In My Schedule, if an activ-
activities consecutively. ity is completed during unhighlighted hours, it offers the
Koch and Kleinman (2002) also argued that, to make opti- points indicated in the oval of the icon. However, if an activity
mal decisions and therefore, to optimally manage time, it is is completed in the hour highlighted, it provides twice as many
important to limit interruptions. Therefore, we decided to in- points. The schedule page presents highlighted hours from
clude a task that could interrupt others: answering calls. In My 9 a.m. to 5 p.m. However, as working hours are from 9 a.m.
Schedule, the “answering calls” icon activates every 5 s. If to 2 p.m., participants would have to ignore the hours
participants click on “answering calls” before an ongoing (highlighted or not) after 2 p.m. Participants will have to make
Curr Psychol

decisions regarding the order in which to complete the activ- another activity is being completed. Participants have to take
ities and consider when to start an activity along the day. An into account the points assigned to each task, the time the tasks
optimal decision would be to start an activity so that it can be take to complete and the highlighted hours.
completed in a highlighted hour. The activities that offer the highest values if completed in a
Besides considering costs and benefits of tasks comple- specific time are “downloading documents”, “answering
tions, as mentioned in the introduction, managing time prop- calls” (without interrupting other activities), “attending a
erly also implies increasing the speed of performing a task meeting” and “working on the computer” (see the value
when necessary and possible. We reflected this issue in the column in Table 1). Therefore, optimal decisions result in
test design by including a “having a break” activity (cup of choices to complete high-value activities within advantageous
coffee icon). The function of this activity is to halve the time time frames.
the next activity takes to complete. Hence, another optimal My Schedule is available in English and Spanish. For this
decision would be to click on “having a break” just before work, we employed the Spanish version. The test first presents
clicking a high-value activity that is close to the limits of the instruction screens and then the trials (schedule pages). My
highlighted hours. Schedule has a total of 9 trials. The first trial is a training trial
Table 1 synthesizes the essential aspects of the test de- and lasts 120 s. Trials 2–9 are test trials and last 60 s each. The
scribed so far. It shows the value of each activity according total duration is therefore 10 min; to which should be added
to the rules that describe their contingency relations. The value the time it takes participants to read the instructions (instruc-
of each activity is equal to the points divided by the time it tions can be read in less than 5 min).
takes to complete the activity. In sum, we assigned different My Schedule provides a time management score based on
values to the activities and established highlighted hours so the recorded data. The time management variable is the mean
that participants would have to make a decision on which number of points obtained in test trials (trials 2–9). The re-
activity to click and when. The differences in values encour- sponse range is 0–300.
age participants to manage their available time to achieve the
highest number of points. Planning Test In the Planning test (Santacreu, 2004a), partic-
The test offers feedback about the moment an activity has ipants have to direct three moving dots so that they reach a
been completed and how many points have been awarded. funnel (Fig. 2). Each dot in the screen moves at a different
This feedback is represented by a circle placed in the schedule speed.
page. Instructions state that the three dots must reach the funnel
The participants who best manage their time are those who in the shortest possible time. In order to change the course of
make optimal decisions, that is, those who choose to click on the dots, participants have to click on arrows located at the top
the activity that offers the greatest value at a given time. They of the screen (see Fig. 2). The dots move at a constant speed
should engage in the activities that initially provide the highest through the “control area” of the top of the screen, and follow
number of points so that they can be completed in the their initial course moving away from the funnel. If partici-
highlighted hours. Optimal decisions also include clicking pants do not direct the dots when they are in the control area,
on “downloading documents” so that it completes while other they can disappear beyond the screen limits. They need to plan
activities are being engaged and ignoring “answering calls” if how to change the course of the dots so that none of them goes

Table 1 Points awarded by activities of my schedule

Time it consumes (seconds) Points awarded if completed Value (Points/Time) Value if completed in
highlighted hours

Writing emails 4 6 1.5 3


Answering calls a 2 6 3 6
Working on the computer 4 8 2 4
Attending a meeting 4 8 2 4
Downloading documents b 1–12 12 12–1 24–2
Coffee (break) c 5 – – –
a
Answering calls activates every 5 s
b
Downloading documents is available even if another task is being completed. It consumes 1 s if the participant immediately clicks on another activity or
up to 12 s if he or she clicks on another activity when “downloading documents” ends
c
The function of this activity is to halve the time that the next activity consumes after participants click on it
Curr Psychol

Fig. 2 Example of a display


shown on each trial of the
Planning test

beyond the screen. In order to do the task efficiently, they need manage time efficiently or unable to perform the task properly
to choose which of the three dots they should change course (Santacreu, 2004b). In this study, all participants fulfilled this
first, taking into account the different speed at which dots criterion. Test reliability of the Planning test reported by
move. Participants must change the course of each of the dots Santacreu (2004b) was 0.75. In the present work,
until, finally, all the dots go into the funnel in the shortest time Cronbach’s alpha was 0.86.
possible. The time required to turn the three dots toward the
funnel depends on the order in which the course of each of Time Management Bahavior Questionnarie We administered
them is modified. So that all the points enter the funnel in the the Spanish version of TMBQ (Macan et al., 1990), developed
shortest possible time, the optimal decision is to guide the by García-Ros and Pérez-González (2012). This self-report
slowest dot first. has 34 items with a 5-point Lickert scale. To measure time
The Planning test is comprised of three training trials and management, the following scales are employed (see Macan
six assessment trials. The maximum length of each trial is et al., 1990):
25 s, but trials finish earlier if participants direct the three dots
toward the funnel and leave the control area or if they do not 1. Establishing goals and priorities: this scale assesses how
direct the dots in time and they disappear beyond the screen participants prioritize tasks. It is made up of 10 items and
limits. the response range is 10–50.
The dependent variable provided by this test is calculated 2. Time management tools: it assesses if participants make a
as follows (Santacreu, 2004b). Time management = mean of list of activities to do, if they check which activities are
[total number of dots that a participant directs to the funnel in done, etc. It consists of 11 items and the response range is
test trials + (number of dots that reach the funnel/total duration 11–55.
of the test trials)]. Duration is the time spent until the last dot 3. Preference for disorganization: this scale assesses whether
leaves the control area. People who manage time efficiently participants tend to be disorganized and if they do not tend
would direct the slowest dot first. Therefore, the duration of to plan their tasks. It is made up of 8 items. The response
the trial would be shorter and their score would be high. The range is 8–40.
response range is 0–60.
Given the functional demands of the task, participants need Reliability indexes reported by García-Ros and Pérez
a minimal level of spatial orientation aptitude to direct dots to González (2012) were 0.84, 0.79 and 0.72 respectively. In
the funnel. The spatial orientation criterion established in or- the present work, reliability indexes (Cronbach’s alpha) were
der to obtain valid scores in the time management variable 0.72, 0.75 and 0.61 respectively. The factor analysis showed
was: each participant should be able to direct at least six dots results similar to those found by García-Ros and Pérez-
to the funnel in the test trials. If participants did not fulfill this González. The “Establishing goals and priorities” factor in-
criterion, we could not know whether they were unable to cluded all the items on the original scale. It explained 19%
Curr Psychol

of the data variance, with factor loadings from .37 to .60. The points if they click on 1st, 2nd, 3rd and 4th option respective-
“Time management tools” factor included all the items on the ly. The risk-tendency variable is the mean of scores obtained
original scale, with factor loadings from .36 to .61. It ex- across trials. The response range is 0–4.
plained 8.5% of the variance. The “Preference for disorgani- The reliability index of the Betting Dice test observed in
zation” factor included all the items on the original scale, and some studies varied between 0.69–0.85 (Arend et al., 2003;
explained 7% of the variance, with factor loadings from .39 to Rubio & Santacreu, 1998). In the present work the reliability
.50. index was 0.67.

Risk-Tendency
Procedure

Data collection took place in two sessions a month apart. All


Betting Dice Test In the Betting Dice test (Rubio & Santacreu,
participants signed an informed consent document guarantee-
1998), the instructions state that its aim is to make a bet about
ing their anonymity. In Session 1, participants completed My
the result of rolling a pair of dice. If participants win the bet,
Schedule, the Planning test, and Betting Dice on a computer
they will get points. In each bet participants can choose one of
and used a secure identification and password on an online
four options (see Fig. 3). The options refer to the result of
server. Finally, they completed the TMBQ self-report. A
adding the score obtained in both dice. For example, option
month later, in Session 2 (re-test session), they completed
1 indicates that X points will be obtained if the sum of the
My Schedule on a computer. In all assessments, two psychol-
spots on the dice is a number less than or equal to 4.
ogists supervised the test and self-report administration.
There are three phases, and each of them has four trials. In
Fortunately, there were no dropouts from Session 1 to
Phase 1 the possible gains are 1, 2, 5 and 30 points while in
Session 2, so the sample size remained the same. Attendance
Phase 3 the gains are 10, 20, 50 and 300 points. The high
at both sessions was probably favored because participants
value of Phase 3 gains with respect to Phase 1 usually in-
had to attend both in order to obtain the course credit. Data
creases the risk of the participants, although each of the op-
analysis was performed using the SPSS 26 package.
tions has the same expected value. In Phase 2 the possible
gains are 1, 3, 8, 50, and the expected value of each option
increases as the probability of hitting it decreases. In this
phase, the risk of the participants increases in comparison with Results
Phase 1 due to the higher expected value of the riskier options.
The test shows two rolling dice while participants decide A test can only be reliable and provide precise assessments of
their bet. After making the bet, the test never shows feedback a variable if the outcomes show variability. Therefore, we first
about the result. Participants who choose the first options are checked the variability of the distribution of the time manage-
considered the lowest risk-takers. The test awards 1, 2, 3 or 4 ment variable measured by My Schedule (Fig. 4). It was

Fig. 3 Example of a display


shown on each trial of the Betting
Dice test
Curr Psychol

proportions of participants who obtained low, medium or high


time management scores in My Schedule and the Planning
test. The division criteria were tertiles. The results are shown
in Table 3. As seen, 47.2% of the participants that obtained
low scores in My Schedule also obtained low scores in the
Planning test. 44.6% of the participants who obtained medium
scores in My Schedule, also obtained medium scores in the
Planning test. Finally, 58.4% of the participants who obtained
high scores in My Schedule also obtained high scores in the
Planning test. There is a significant relation between the mea-
sures provided by both tests, χ2 (4, N = 108) = 17.5, p = .002.

Discussion
Fig. 4 Distribution of time management score (My Schedule) in Session 1
My Schedule test was designed to assess time management
normally distributed (Kolmogorov-Smirnov normality test; behaviors based on behavioral decision-making theory (Koch
p > .05). & Kleinman, 2002). People show time management behaviors
As said before, My Schedule was administered in Session 1 when they set one or more goals and when these goals require
(M = 165.6; SD = 32.2) and Session 2 (1 month later; M = completing different tasks. They need to make decisions about
197; SD = 32.1). The increase between sessions was signifi- which task to do and in which order so that they receive the
cant with a large effect size and could be attributable to the greatest benefits. Good time managers are those who choose
effects of practice (paired samples t-test), t (92) = −13.25, and complete the most valuable tasks in a given time. The
p < .001, d = 0.97. To study reliability of the instrument, we main goal of the present study was to determine the psycho-
calculated the values of Cronbach’s alpha coefficient for the metric properties of My Schedule as a measure of time man-
test trials in Session 1 and 2 and the test-retest reliability. agement behavior.
Cronbach’s alpha of time management measured by My My Schedule appears to be a psychometrically sound mea-
Schedule in Session 1 was 0.92 (p < .001) and 0.94 sure. It showed high internal consistency and high test-retest
(p < .001) in Session 2. Test-retest reliability was high reliability. The trials and the test and retest administration
(r = .71; p < .001). Since the entire sample was exposed to provided similar measures of time management. In addition,
the same test and therefore the same amount of practice, reli- study participants also showed high consistency.
ability does not seem to have been affected. We checked convergent validity of My Schedule by ad-
Next, we determined whether participants showed consis- ministering it with a test that also assesses time management
tency throughout the My Schedule test by calculating behaviors: the Planning test (Santacreu, 2004a). The correla-
interitem-variance (Baumeister & Tice, 1988). This procedure tion value was moderate but significant (.31). In line with the
requires calculating the variance of the responses to the test previous result, the Chi-square analysis showed that there is a
trials for each participant. Then, we calculated the mean significant relation between the time management measures
interitem-variance values and classified participants depend- provided by My Schedule and the same measures provided by
ing on whether they obtained values above or below the mean. the Planning test.
Baumeister and Tice established the criterion that participants The time management objective tests are related, although
who showed values below the mean were labeled consistent. moderately. Moderate convergence between objective tests
By using this procedure, 67% of the participants showed has also been found in other studies. For example, regarding
consistency. attention measures, Fernández-Marcos et al. (2018) studied
Table 2 shows the correlations among the variables mea- convergence between the measures of three attention tasks.
sured. My schedule showed moderate but significant conver- They found significant moderate correlations only between
gence with the Planning test (r = .31; p < .001). On the other speed measures (values between .24 and .39) and global at-
hand, time management measured by My Schedule did not tention indexes (.37). Accuracy measures did not show signif-
show a significant correlation with risk-tendency (Betting icant correlations.
Dice test) nor with any of the dimensions of the self-report The design of My Schedule has been guided by the behav-
(TMBQ). ioral decision-making theory (Koch & Kleinman, 2002), and
To further explore the relation between the time manage- presents different characteristics to those presented by the
ment measures provided by My Schedule and the Planning Planning test. The time management behaviors specifically
test, we performed a Chi-square test. We studied the needed in My Schedule and the Planning test to obtain a high
Curr Psychol

Table 2 Correlations and Cronbachs’ alpha values of the variables measured

My Schedule: Planning test: time Betting dice test: TMBQ: objectives TMBQ: time TMBQ:
time management management risk-tendency and priorities manage-ment tools preference for
disorganization

My schedule: time management 1


Planning test: time management .31** 1
Betting dice test: risk-tendency .09 .07 1
TMBQ: objectives and .08 .14 −.03 1
priorities
TMBQ: time management tools .08 .03 −.13 .51** 1
TMBQ: preference for .01 .05 −.01 −.25** −.38** 1
disorganization

*p < 0.05
**p < 0.01

score are not equally important. My Schedule is complex and Another goal was to check whether the designed objective
requires that participants consider the time available in each test and a self-report that assesses time management are relat-
trial. To obtain a high score, participants have to make deci- ed and therefore should be considered complementary or in-
sions about which tasks to complete first and initiate them so terchangeable measures. Our results show an absence of sig-
that they are completed on time so that they provide the nificant relation between My Schedule and the dimensions of
highest score. The Planning test requires participants to ana- the self-report (TMBQ; Macan et al., 1990).
lyze the position of three dots moving away from a funnel. Previous studies have found that, for at least some vari-
Then, they need to decide in which order to change the direc- ables, there is a lack of correspondence between verbal de-
tions of the dots. The participants must ensure that the dots scriptions and the behavior being described (see Dang et al.,
remain in the control area until they all have access to the 2020). Some researchers have pointed out that objective tests
funnel. The duration of the trial is shorter if they manage their and self-reports might be assessing different aspects or levels
time efficiently (they should move the slowest dot first). My of the same construct. In addition, objective tests that measure
Schedule and the Planning test might not be assessing exactly the same construct might be capturing different facets (see
the same time management behaviors, but they are obviously Ortner & Proyer, 2015). It is clear that objective tests and
related overall. My Schedule might be more ecologically val- self-reports differ in the way that they collect information of
id, as it was designed to represent a situation closer to what interest (Koch et al., 2014). Self-reports rely on one’s own
people routinely do in work and academic contexts. descriptions of behavior and usually are measured on a
My Schedule also showed divergent validity. It assesses Lickert scale. Objective tests rely on samples of behavior that
the decisions that participants make regarding which task to people show when they face a specific situation and are usu-
do and in which order, and these behaviors should not neces- ally administered on a computer.
sarily be related to their propensity to make risky decisions. From a theoretical point of view, we cannot assume that
Results indicated that the My Schedule objective test did not there is a reliable correspondence between what we say (self-
show a significant relation with an objective test that assesses report) and what we do (objective tests). People’s behavior at
risk-tendency (Betting Dice test; Arend et al., 2003; Rubio & any given moment is the result of the accumulation and syn-
Santacreu, 1998). thesis of experiences across a lifetime, as well as their current

Table 3 My schedule scores by the planning test scores

Time management: planning test

Low scores Medium scores High scores


Time management: my schedule Low scores (N=36) 17 (47.2) 2.2* 13 (36.1) 0.4 6 (16.7) −2.6*
Medium scores (N=36) 11 (30.6) −0.4 16 (44.4) 1.7 9 (25) −1.3
High scores (N=36) 8 (22.2) −1.7* 7 (19.4) −2.2* 21 (58.4) 3.9*

Note: The entries are the number of participants whose data fall into each of the cells of the 3 × 3 table
*Significant standardized residual
Curr Psychol

goals and their emotional states. It is possible to infer experi- Kleinman, 2002). My Schedule represents an ecologically
ence history from current behaviors and also from the lan- valid situation in which multiple activities are to be completed
guage that people use to describe and analyze their behavior under time constraints. The values of the activities differ de-
(Santacreu et al., 2002). Therefore, we are faced with a double pending on the time at which they are completed. Properly
synthesis: behavioral synthesis and verbal synthesis. These representing situations that require time management is one
two types of syntheses do not always match. The flexibility of the important values of My Schedule. The development of
of language also implies its possible inaccuracy. Moreover, objective assessment instruments is necessary to examine the-
social desirability can influence the contents of the verbal oretical approaches to problems such as time management. To
synthesis. For example, intelligence is a valuable ability in our knowledge, this is the first objective test designed explic-
multiple contexts. People can tell themselves and others that itly on the basis of the behavioral decision-making theory, and
they are intelligent, but we cannot assume that this verbal along with its ecological validity, it may make a useful con-
description will match their performance in a test that mea- tribution to the conceptual and methodological analyses of
sures intelligence. That is why we do not assess intelligence time management.
by asking people to reveal their IQs. The same thing happens At a practical level, My Schedule is expected to be useful
with other psychological variables, and there is no reason to for practitioners who intend to obtain an objective assessment
think that it would be different in relation to time of time management behaviors. The test takes about 15 min to
management. complete and can be administered to individuals or groups
My Schedule is a complementary instrument to assess time assessed at the same time. My Schedule may be useful for
management skills that offers a behavioral measure, and re- companies and academic institutions that require an instru-
searchers should be aware of the fact that objective and sub- ment to behaviorally assess time management without
jective tests that purportedly measure the same variables employing extensive temporal resources. In line with what
might indeed be measuring different components of the same was mentioned in a previous point, My Schedule could be
trait or skill. A self-report that assesses time management pro- employed along with other methodologies to obtain informa-
vides information about the verbal descriptions that people tion about different aspects of time management. For example,
make about their behavior. However, if we want to go beyond when performing a psychological assessment in a recruitment
this self-description, it will be necessary to employ an objec- process or in the context of a time management training pro-
tive test. An objective test that assesses time management gram, it would be useful to obtain information on how the
provides information that cannot be obtained through a self- participants describe themselves (self-report) and how they
report. It collects data about the behaviors that people show execute time management behaviors (objective test) in order
when they have to manage their time in a specific situation, to provide a more complete and comprehensive overview of
and it is not affected by language inaccuracy or social desir- the variable.
ability. On the other hand, self-reports provide data that we My Schedule objective test has some limitations that
cannot obtain from an objective test, such as information should be considered in future work. First, as in other objec-
about long-term time management behaviors or people’s con- tive tests, My Schedule requires certain costs for its adminis-
sideration of their preferences. Researchers need to know what tration, since it is necessary to have adequate computer equip-
information the different methods provide, as well as their ment. Besides, it is not an appropriate instrument to assess
extent. Likewise, practitioners must not forget that, to conduct time management in children, as the functioning of the test
an adequate psychological assessment (see Fernández- may be difficult for them to understand, and this population is
Ballesteros et al., 2001), it is advisable to employ different not likely to be familiar with the activities presented.
methods in a complementary way. As Ortner and van de Likewise, it is not an appropriate tool for people who do not
Vijver (2015) state, the conjoint use of self-reports and objec- have basic knowledge of computers, as may be the case in
tive tests allows us to obtain a more complete picture of the some elderly populations. In addition, objective tests such as
profile of those being assessed. My Schedule are miniaturized situations that can be artificial,
The above discussion leads to implications for the theories even though they try to represent natural situations. In My
and methodology used to investigate time management be- Schedule, we included activities that are representative of
havior. Researchers of time management have identified the common tasks for office workers or in some routine activities
need for objective measures of this construct (e.g., Jex & of college students. In any case, representative activities from
Elacqua, 1999; Macan, 1994). Our work is designed to ad- other labor sectors or areas of knowledge should be consid-
dress this need. My Schedule is an objective test with high ered in future versions to adapt the test to the sample to be
reliability that complements data provided by other time man- assessed and foster increased ecological validity (for example,
agement instruments. In addition, our study contributes to the tasks related to medicine, to the hospitality service sector,
time management literature by providing support for the ap- etc.). Regarding the number of activities, we consider that
plication of behavioral decision-making theory (Koch & more than five activities could make the test excessively
Curr Psychol

complicated. Nevertheless, future studies should explore Cattell, R. B., & Warburton, F. W. (1967). Objective personality and
motivation tests: A theoretical introduction and practical
whether this quantity is indeed sufficient to measure time
compendium. Urbana, IL: University of Illinois Press.
management adequately. Claessens, B. J., van Eerde, W., Rutte, C. G., & Roe, R. A. (2007). A
Finally, a main limitation of this study refers to the sample. review of the time management literature. Personnel Review, 36(2),
My Schedule was administered to undergraduate psychology 255–276. https://doi.org/10.1108/00483480710726136.
Claessens, B. J., Roe, R. A., & Rutte, C. G. (2009). Time management:
students of a Spanish University and therefore cautious gen-
Logic, effectiveness and challenges. In R. A. Roe, M. J. Waller, & S.
eralization of the results is warranted. My Schedule should be R. Clegg (Eds.), Time in organizational research (pp. 23–41).
administered to larger samples with different characteristics Abingdon: Routledge.
and from different contexts (e.g., students of different Dang, J., King, K. M., & Inzlicht, M. (2020). Why are self-report and
behavioral measures weakly correlated? Trends in Cognitive
branches of knowledge; a variety of samples of workers from
Sciences, 24, 267–269. https://doi.org/10.31234/osf.io/v796c.
different companies and countries, etc.), which would enable a DeVellis, R. F. (2016). Scale development: Theory and applications
more thorough analysis of its psychometric properties. We (Vol. 26). Thousand Oaks: Sage Publications.
encourage other researchers to employ My Schedule in their DiPipi-Hoy, C., Jitendra, A. K., & Kern, L. (2009). Effects of time man-
agement instruction on adolescents’ ability to self-manage time in a
studies in order to expand our knowledge and enrich the value
vocational setting. The Journal of Special Education, 43(3), 145–
and application of the time management literature. 159. https://doi.org/10.1177/0022466908317791.
Edwards, A. L. (1957). The social desirability variable in personality
assessment and research. New York: The Dryden Press.
Data Availability The dataset analyzed during the current study is avail- Fagerstrøm, A., Aksnes, D., & Arntzen, E. (2016). An experimental study
able from the corresponding author. of intertemporal choices: The case of customer relationship manage-
ment. Managerial and Decision Economics, 37(4), 324–330. https://
doi.org/10.1002/mde.2719.
Declarations Fernández-Ballesteros, R., De Bruyn, E. E. J., Godoy, A., Hornke, L. F.,
Ter Laak, J., Vizcarro, C., Westhoff, K., Westmeyer, H., &
Ethics Approval The study was approved by the research ethics com- Zaccagnini, J. L. (2001). Guidelines for the assessment process
mittee of the Universidad Autónoma de Madrid (CEI-97-1787). All pro- (GAP): A proposal for discussion. European Journal of
cedures performed in studies involving human participants were in accor- Psychological Assessment, 17(3), 187–200. https://doi.org/10.
dance with the ethical standards of the institutional and national research 1027/1015-5759.17.3.187.
committee and with the 1964 Helsinki Declaration and its later amend- Fernández-Marcos, T., De la Fuente, C., & Santacreu, J. (2018). Test–
ments or comparable ethical standards. retest reliability and convergent validity of attention measures.
Applied Neuropsychology: Adult, 25(5), 464–472. https://doi.org/
Consent to Participate Informed consent was obtained from all individ- 10.1080/23279095.2017.1329145.
ual participants included in the study. García-Ros, R., & Pérez-González, F. (2012). Spanish version of the time
management behavior questionnaire for university students. The
Conflict of Interest The authors declare that they have no conflict of Spanish Journal of Psychology, 15(3), 1485–1494. https://doi.org/
interest. 10.5209/rev_SJOP.2012.v15.n3.39432.
Gongsook, P. (2016). Interactive diagnostic game for time perception:
Timo’s adventure game [doctoral dissertation, Technische
Universiteit Eindhoven]. TU/e. https://bit.ly/2XfYG1p
Green, P., & Skinner, D. (2005). Does time management training work?
References An evaluation. International Journal of Training and Development,
9(2), 124–139. https://doi.org/10.1111/j.1468-2419.2005.00226.x.
Häfner, A., Oberst, V., & Stock, A. (2014). Avoiding procrastination
Adams, G. A., & Jex, S. M. (1997). Confirmatory factor analysis of the
through time management: An experimental intervention study.
time management behavior scale. Psychological Reports, 80(1),
Educational Studies, 40(3), 352–360. https://doi.org/10.1080/
225–226. https://doi.org/10.2466/pr0.1997.80.1.225.
03055698.2014.899487.
Arend, I., Botella, J., Contreras, M. J., Hernández, J. M., & Santacreu, J. Hellsten, L. A. M. (2012). What do we know about time management? A
(2003). A betting dice test to study the interactive style of risk-taking review of the literature and a psychometric critique of instruments
behavior. Psychological Records, 53(2), 217–230. assessing time management. In T. Stoilov (Ed.), Time management
Barkley, R. A., Murphy, K. R., & Bush, T. (2001). Time perception and (pp. 3–28). Intech. https://bit.ly/2I98tgS
reproduction in young adults with attention deficit hyperactivity Jex, S. M., & Elacqua, T. C. (1999). Time management as a moderator of
disorder. Neuropsychology, 15(3), 351–360. https://doi.org/10. relations between stressors and employee strain. Work & Stress,
1037/0894-4105.15.3.351. 13(2), 182–191. https://doi.org/10.1080/026783799296138.
Baumeister, R. F., & Tice, D. M. (1988). Metatraits. Journal of Koch, C. J., & Kleinmann, M. (2002). A stitch in time saves nine:
Personality, 56(3), 571–598. https://doi.org/10.1037/0022-3514. Behavioural decision-making explanations for time management
65.3.554. problems. European Journal of Work and Organizational
Bond, M. J., & Feather, N. T. (1988). Some correlates of structure and Psychology, 11(2), 199–217. https://doi.org/10.1080/
purpose in the use of time. Journal of Personality and Social 13594320244000120.
Psychology, 55(2), 321–329. https://doi.org/10.1037/0022-3514. Koch, T., Ortner, T. M., Eid, M., Caspers, J., & Schmitt, M. (2014).
55.2.321. Evaluating the construct validity of objective personality tests using
Britton, B. K., & Tesser, A. (1991). Effects of time-management practices a multitrait-multimethod-multioccasion (MTMM-MO) approach.
on college grades. Journal of Educational Psychology, 83(3), 405– European Journal of Psychological Assessment, 30(3), 208–230.
410. https://doi.org/10.1037/0022-0663.83.3.405. https://doi.org/10.1027/1015-5759/a000212.
Curr Psychol

König, C. J., & Kleinmann, M. (2006). Individual differences in the use Rubio, V. J., & Santacreu, J. (1998). The betting dice test. Registration
of time management mechanics and in time discounting. Individual number, R.P.O.: M-70573.
Differences Research, 4(3), 194–207. https://doi.org/10.3200/JRLP. Santacreu, J. (2004a). Planning test. Registration number, R.P.O.:
139.1.33-45. M-003406.
König, C. J., & Kleinmann, M. (2007). Time management problems and Santacreu, J. (2004b). Informe del Proyecto para la Realización del
discounted utility. The Journal of Psychology, 141(3), 321–334. Diseño y Elaboración de un Sistema de Evaluación Psicológica
https://doi.org/10.3200/JRLP.141.3.321-336. dentro del Proceso de Selección de Controladores de la
Lakein, A. (1973). How to get control of your time and life. New York: Circulación Aérea [Report on the project for the design and devel-
Nal Penguin Inc. opment of a psychological evaluation system within the hiring pro-
Macan, T. H. (1994). Time management: Test of a process model. cess of air controllers]. Unpublished manuscript, UAM.
Journal of Applied Psychology, 79(3), 381–391. https://doi.org/10. Santacreu, J., & Hernández, J. M. (2017). T-data (Tests). In V. Zeigler-
1037/0021-9010.79.3.381. Hill & T. K. Shackelford (Eds.), Encyclopedia of personality and
Macan, T. H., Shahani, C., Dipboye, R. L., & Phillips, A. P. (1990). individual differences (pp. 1–4). New York: Springer.
College students’ time management: Correlations with academic Santacreu, J., Hernández, J. M., Adarraga, P., & Márquez, M. O. (2002).
performance and stress. Journal of Educational Psychology, 82(4), La Personalidad en el Marco de una Teoría del Comportamiento
760–768. https://doi.org/10.1037/0022-0663.82.4.760. Humano [Personality in the framework of a human behavior theo-
McDonald, J. D. (2008). Measuring personality constructs: The advan- ry]. Pirámide.
tages and disadvantages of self-reports, informant reports and be-
Sevary, K., & Kandy, M. (2011). Time management skills impact on self-
havioural assessments. Enquire, 1(1), 1–19 https://bit.ly/2Kg9CX9.
efficacy and academic performance. Journal of American Science,
McNamara, P. M. (2016). An exploration of the time-management be-
7(12), 720–726 https://bit.ly/2Ibi0UO.
haviours of small-business owner-managers. [doctoral dissertation,
Skinner, N. S. F., & Howart, E. (1973). Cross-media independence of
University of Wollongong]. University of Wollongong Thesis
questionnaire and objective test personality factors. Multivariate
Collections. https://ro.uow.edu.au/theses/4814
Behavioral Research, 8(1), 23–40. https://doi.org/10.1207/
Orlikowsky, W. J., & Yates, J. (2002). It’s about time: Temporal struc-
s15327906mbr0801_2.
turing in organizations. Organization Science, 13(6), 684–700.
https://doi.org/10.1287/orsc.13.6.684.501. Tulga, M. K., & Sheridan, T. B. (1980). Dynamic decisions and work
Ortner, T. M., & Proyer, R. T. (2015). Objective personality tests. In T. load in multitask supervisory control. IEEE Transactions on
M. Ortner & F. J. R. Van de Vijver (Eds.), Behavior-based assess- Systems, Man, and Cybernetics, 10(5), 217–232. https://doi.org/
ment in psychology (pp. 133–149). Göttingen, Germany: Hogrefe. 10.1109/TSMC.1980.4308481.
Ortner, T. M., & van de Vijver, F. J. R. (2015). Assessment beyond self-
reports. In T. M. Ortner & F. J. R. van de Vijver (Eds.), Behavior- Publisher’s Note Springer Nature remains neutral with regard to jurisdic-
based assessment in psychology (pp. 3–11). Boston: Hogrefe. tional claims in published maps and institutional affiliations.

You might also like