You are on page 1of 6

TECHNICAL REPORT

VALIDITY OF DAILY AND WEEKLY SELF-REPORTED


TRAINING LOAD MEASURES IN ADOLESCENT ATHLETES
PADRAIC J. PHIBBS,1,2 GREGORY ROE,1,2 BEN JONES,1,2 DALE B. READ,1,2 JONATHON WEAKLEY,1,2
JOSHUA DARRALL-JONES,1,2 AND KEVIN TILL1,2
1
Institute for Sport, Physical Activity and Leisure, Leeds Beckett University, Leeds, United Kingdom; and 2Yorkshire Carnegie
Rugby Club, Headingley Carnegie Stadium, Leeds, United Kingdom

ABSTRACT sRPEweekly was found to have a substantial TEE (28.5%),


Phibbs, PJ, Roe, G, Jones, B, Read, DB, Weakley, J, Darrall- limiting practical application.
Jones, J, and Till, K. Validity of daily and weekly self-reported KEY WORDS training load, perception of effort, athlete
training load measures in adolescent athletes. J Strength monitoring, youth
Cond Res 31(4): 1121–1126, 2017—The primary aim of
the study was to assess the level of agreement between INTRODUCTION

T
the criterion session rating of perceived exertion (sRPE30-
he quantification and evaluation of training load
min ) and a practical measure of a self-reported Web-based
(TL) data are important for practitioners working
training load questionnaire 24 hours after training (sRPE24h) with athletes to maximize positive training out-
in adolescent athletes. The secondary aim was to assess the comes and minimize negative risk factors (e.g.,
agreement between weekly summated sRPE24h values illness, overtraining, and injury) (6,7,9). In professional sport-
P
( sRPE24h) and a weekly Web-based training diary ing environments, TL data can be easily obtained because
(sRPEweekly) for all field-based training accumulated on athletes undertake the majority of their training under the
a subsequent training week. Thirty-six male adolescent supervision of their respective coaching and support staff.
rugby players (age, 16.7 6 0.5 years) were recruited from However, in late specialization sports (e.g., rugby union),
a regional academy. Measures of sRPE30min were recorded adolescent athletes may undertake training with multiple
30 minutes after a typical field-based training session. Par- teams supervised by various coaches concurrently (14), as
ticipants then completed the sRPE24h via a Web-based they are not contracted to one particular organization. Coor-
dinating the optimal training program for youth athletes is
training load questionnaire 24 hours after training, reporting
essential to maximize player development; however, collect-
both session duration and intensity. In addition, on a subse-
ing valid and reliable information on accumulated TLs can
quent week, participants completed the sRPE24h daily and
be challenging (15).
then completed the sRPEweekly at the end of the week, using In adolescent sport, the availability of expensive TL
the same Web-based platform, to recall all field-based train- monitoring technologies may also be limited compared
ing session durations and intensities over those 7 days. with elite adult athletic environments. Session rating of
Biases were trivial between sRPE30min and sRPE24h for perceived exertion (sRPE; duration 3 intensity), has been
sRPE (0.3% [20.9 to 1.5]), with nearly perfect correlations shown to be a valid measure of global TL in collision
(0.99 [0.98–0.99]) and small typical error of the estimate sports (3) and highly correlated with heart rate and blood
(TEE; 4.3% [3.6–5.4]). Biases were trivial between lactate measures (4,5). Therefore, the use of sRPE may be
P
sRPE24h and sRPEweekly for sRPE (5.9% [22.1 to useful for practitioners working in adolescent athletic
14.2]), with very large correlations (0.87 [0.78–0.93]) and populations to gather data for training design and moni-
moderate TEE of 28.5% [23.3–36.9]. The results of this toring purposes (9). Recently, RPE has also been shown to
study show that sRPE24h is a valid and robust method to
be temporally robust from 5 minutes to 24 hours after
exercise using a visual-analogue scale (2). However, as
quantify training loads in adolescent athletes. However,
mentioned previously, many coaches working with ado-
lescent athletes may not have contact on a daily basis to
collect TL data using this method. Therefore, the validity
Address correspondence to Padraic J. Phibbs, p.phibbs@leedsbeckett.ac.uk. of a self-reported measure in the absence of practitioners,
31(4)/1121–1126 away from the training environment, would likely have
Journal of Strength and Conditioning Research relevance for the youth athlete engaged in various training
Ó 2016 National Strength and Conditioning Association programs.

VOLUME 31 | NUMBER 4 | APRIL 2017 | 1121

Copyright © National Strength and Conditioning Association Unauthorized reproduction of this article is prohibited.
Validity of Self-Reported Training Load Measures

TABLE 1. Agreement between criterion (sRPE30min) and practical measure (sRPE24h) for sRPE, duration, and
intensity.*†

Measure sRPE30min sRPE24h Bias % (standardized bias) TEE % (standardized TEE) Correlation

sRPE (AU) 233 6 66 234 6 69 0.3 (20.9 to 1.5) 4.3 (3.6–5.4) 0.99 (0.98–0.99)
(0.01 [20.03 to 0.06]) (0.16 [0.13–0.20])
Duration (min) 63.3 6 7.1 63.1 6 7.4 20.5 (21.7 to 0.8) 4.5 (3.7–5.6) 0.93 (0.88–0.96)
(20.04 [20.15 to 0.06]) (0.37 [0.31–0.46])
Intensity (AU) 3.6 6 0.8 3.7 6 0.8 0.8 (20.5 to 2.2) 5.0 (4.1–6.3) 0.97 (0.95–0.98)
(0.04 [20.03 to 0.11]) (0.24 [0.20–0.30])

*AU = arbitrary units; sRPE = session rating of perceived exertion; sRPE30min = supervised collection 30 minutes after training;
sRPE24h = daily Web-based training load questionnaire 24 hours after training remotely.
†Data are mean 6 SD, and log-transformed percentage mean bias (Bias %), standardized mean bias (standardized bias), per-
centage typical error of the estimate (TEE %), standardized typical error of the estimate (standardized TEE), and Pearson correlation
coefficient (correlation), all with 90% confidence limits.

Daily TL questionnaires and weekly recall diaries are was to assess the levels of agreement between the criterion
often used in practice but are suggested to have limitations measure of supervised sRPE collection (sRPE30min) (5) and
related to accuracy and compliance (11,16). Currently, there a freely accessible, self-reported, Web-based, TL question-
are limited quantitative data on the precise margins of error naire reported 24 hours after exercise (sRPE24h).
in these self-reported data collection methods (1). Monitor- Additionally, as weekly TL diaries are frequently used in
ing training volumes have been previously shown to have research and practice to quantify TL in athletes (9,10), the
a significant margin of error using a self-reported measure of validity of such methods also need to be assessed because of
training duration in adult athletes (1). A freely accessible their previously suggested limitations (11,15). The accuracy
Web-based self-reported questionnaire could provide a sim- of TL recall has been suggested to increase with time (15);
ple solution for individual athletes to remotely report their however, weekly TL diaries are less time consuming for
TL when undertaking training sessions away from sports practitioners to administer and also for athletes to complete.
science or strength and conditioning staff. Training expo- If demonstrated valid, a weekly diary may provide a favorable
sures could then be modified to optimize an athlete’s work- method to collect this information compared with a daily
load and to reduce the likelihood of potential injuries questionnaire because of the reduced time commitment of
associated with large variations in workloads on an individ- both parties. Therefore, the secondary aim of the study was
ual basis (6). A Web-based questionnaire could gather useful to assess the levels of agreement between a weekly training
and trustworthy information, with minimal burden to the diary collected via a similar Web-based questionnaire
athlete, and could also be time stamped to monitor compli- (sRPEweekly) and the summated sRPE24h collected daily over
P
ance (15). Therefore, the primary aim of the present study the same training week ( sRPE24h).

P
TABLE 2. Agreement between practical measures of sRPE24h and sRPEweekly for sRPE, duration, and intensity.*†

P Bias % TEE %
Measure sRPE24h sRPEweekly (standardized bias) (standardized TEE) Correlation

sRPE (AU) 773 6 378 838 6 457 5.9 (22.1 to 14.2) 28.5 (23.3–36.9) 0.87 (0.78–0.93)
(0.11 [20.04 to 0.26]) (0.50 [0.42–0.62])
Duration (min) 188.1 6 90.1 200.3 6 111.9 1.8 (26.6 to 10.9) 30.0 (24.5–38.9) 0.87 (0.79–0.93)
(0.03 [20.13 to 0.19]) (0.49 [0.41–0.62])
Intensity (AU) 16.6 6 7.4 17.9 6 7.9 7.9 (0.6 to 15.0) 26.2 (21.5–33.8) 0.88 (0.79–0.93)
(0.15 [0.01 to 0.29]) (0.49 [0.41–0.61])
P
*AU = arbitrary units; sRPE = session rating of perceived exertion; sRPE24h = weekly summated values of self-reported Web-
based training load questionnaire 24 hours after training remotely; sRPEweekly = weekly Web-based training diary.
†Data are mean 6 SD, and log-transformed percentage mean bias (Bias %), standardized mean bias (standardized bias), per-
centage typical error of the estimate (TEE %), standardized typical error of the estimate (standardized TEE), and Pearson correlation
coefficient (correlation), all with 90% confidence limits.

the TM

1122 Journal of Strength and Conditioning Research

Copyright © National Strength and Conditioning Association Unauthorized reproduction of this article is prohibited.
the TM

Journal of Strength and Conditioning Research | www.nsca.com

Figure 2. Regression plots for agreement between practical measures


P
of sRPE24h and sRPEweekly for sRPE (A), time (B), and intensity (C).
AU = arbitrary units.

Figure 1. Regression plots for agreement between criterion


(sRPE30min) and practical measure (sRPE24h) for sRPE (A), time (B), and
intensity (C). AU = arbitrary units.
METHODS
Experimental Approach to the Problem
The study was designed to evaluate the validity of a daily TL
questionnaire by assessing the level of agreement between

VOLUME 31 | NUMBER 4 | APRIL 2017 | 1123

Copyright © National Strength and Conditioning Association Unauthorized reproduction of this article is prohibited.
Validity of Self-Reported Training Load Measures

TABLE 3. Intercept and slope values with 90% confidence limits (CL) and regression equations for all comparisons.*

Measure Intercept 90% CL Slope 90% CL Equation

sRPE30min vs. sRPE24h sRPE 8.818 20.573 to 18.209 0.957 0.918–0.996 y = 0.957x + 8.818
sRPE30min vs. sRPE24h time 7.874 0.967 to 14.780 0.880 0.771–0.998 y = 0.880x + 7.874
sRPE
P 30min vs. sRPE24h intensity 0.033 20.205 to 0.272 0.983 0.920–1.047 y = 0.983x + 0.033
PsRPE24h vs. sRPEweekly sRPE 145.002 49.028 to 240.976 0.750 0.649–0.851 y = 0.750x + 145.002
PsRPE24h vs. sRPEweekly time 42.440 19.559 to 65.321 0.728 0.627–0.828 y = 0.728x + 42.440
sRPE24h vs. sRPEweekly intensity 2.530 20.314 to 5.374 0.788 0.642–0.934 y = 0.788x + 2.530

*sRPEP= session rating of perceived exertion; sRPE24h = self-reported Web-based training load questionnaire 24 hours after
training; sRPE24h = weekly summated sRPE24h values; sRPEweekly = weekly Web-based training diary.

criterion sRPE (and its individual components; duration and Self-Reported Daily Training Load Questionnaire. Participants
intensity) collected 30 minutes after exercise (sRPE30min), completed an online questionnaire via a freely accessible Web-
and sRPE collected 24 hours after training remotely based platform approximately 24 hours after sRPE30min col-
(sRPE24h). All participants were familiar with the sRPE30min lection (24.2 6 0.4 hours), following an e-mail notification
collection method because it was a regularly used measure of containing the link to the questionnaire. The duration values
TL quantification at the rugby academy. They were also reported were the participant’s recollection of the session du-
familiarized with the Web-based questionnaire design (Goo- rations to the nearest minute, and the corresponding intensity
gle Forms; Google, Mountain View, CA, USA) before the value was selected via a drop-down menu of text descriptors
study, completing the sRPE24h daily over the previous 3 corresponding to the modified Borg CR-10 scale (5).
months. To assess the validity of a weekly TL diary, on
a subsequent week, sRPEweekly was completed on the final Self-Reported Weekly Training Load Diary. On a subsequent
day of the training week (recalling the intensity and duration training week, the participants were asked to complete the
for all field-based training sessions completed over the pre- sRPEweekly on the final day of a training week, reporting
vious 7 days on the same Web-based platform) and assessed training durations and intensities for all field-based training
for agreement with the summated sRPE24h that was also activities undertaken that week using the same Web-based
P
completed daily over the same period ( sRPE24h). platform as the sRPE24h. Ideally, the sRPEweekly would also
be compared with the criterion measure of sRPE30min for
Subjects
each individual session. However, as a result of the various
Thirty-six male adolescent rugby union players (mean 6 SD; training locations for each athlete, this was not possible
age, 16.7 6 0.5 years; height, 182.6 6 6.3 cm; weight, 84.3 6 because the participants may train with school, club, acad-
10.7 kg) were recruited for the study from a regional acad- emy, or representative teams within any particular training
emy squad (highest regional playing standard for this age week. Therefore, the level of agreement of the sRPEweekly
group). Ethics approval was granted by the Leeds Beckett P
was assessed against the sRPE24h measure, which was also
University ethics committee, and all participants and parents recorded each day of that training week.
were provided with a plain language statement outlining the
procedures and potential risks of participation. Following an Statistical Analyses
opportunity to ask any questions regarding the study to the Agreement between the criterion measure of sRPE30min and
lead researcher, all participants and parents provided written practical measure of sRPE24h, as well as the agreement
P
informed consent before participation. between sRPE24h and sRPEweekly, for sRPE, duration,
and intensity were assessed using an Excel spreadsheet de-
Procedures signed to calculate the mean bias   ð½ x diff =
xp ffiffiffi 3100Þ, typ-
criterion
Criterion Training Load Measure. Following a typical field- ical error of the estimate (TEE; SDdiff = 2), and Pearson
based training session, all participants provided an RPE correlation coefficient, all with 90% confidence limits (12).
measure 30 minutes after exercise to the lead researcher, which All data were log transformed for analyses to reduce bias as
was multiplied by the timed session duration for each individual a result of nonuniformity error ð1003logðraw valueÞÞ,
(determined by the lead researcher) to provide the criterion excluding the regression analysis (12). Raw data were pre-
sRPE value in arbitrary units (AU). The RPE selection was sented to report the regression equations, mean, and SD of
made nonverbally, by pointing to the desired text descriptor on the criterion and practical measures. Standardized measures
a modified Borg category ratio-10 (CR-10) scale (5), blinded were calculated using back-transformed data based on the
from the other participants to avoid external influence on Cohen’s d effect size principle using the following equation:
selection. x practical 2xcriterion ⁄ ½SDcriterion Þ (12). The standardized mean
ð½
the TM

1124 Journal of Strength and Conditioning Research

Copyright © National Strength and Conditioning Association Unauthorized reproduction of this article is prohibited.
the TM

Journal of Strength and Conditioning Research | www.nsca.com

bias was rated as trivial (,0.2), small (0.2–0.59), medium training information (17). Therefore, the validity of weekly
(0.6–1.19), or large (1.2–1.99) (13). The standardized TEE self-reported TL methods may need to be assessed in more
was rated as trivial (,0.1), small (0.1–0.29), moderate (0.3– experienced athletes for population-specific application. In
0.59), or large (.0.59) (12). The magnitude of correlation conclusion, the use of a self-reported Web-based daily TL
was rated as trivial (,0.1), small (0.1–0.29), moderate (0.3– questionnaire can be considered a valid and robust method
0.49), large (0.5–0.69), very large (0.7–0.89), or nearly perfect for quantifying TL in adolescent athletes, unlike the weekly
(0.9–0.99) (13). TL diary.
The results of this study are limited to those populations
RESULTS who have been familiarized with this method for a consider-
The agreement between the criterion sRPE30min and practi- able length of time. Young athletes have been suggested to
cal measure of sRPE24h for sRPE, duration, and intensity are have difficulty in understanding sRPE; however, with
P
presented in Table 1. The agreement between sRPE24h adequate familiarization and education, this method may
and sRPEweekly measures for sRPE, duration, and intensity be implemented successfully, especially in older adolescents
are presented in Table 2. The regression plots for the agree- such as the participants in this study. Adolescents are
ment between the criterion sRPE30min and practical measure progressively capable of understanding mathematical pro-
of sRPE24h for sRPE, duration, and intensity are presented in cesses and should have the cognitive ability to understand
Figure 1, and the regression plots for the agreement between and rate their sRPE at the under-18 age category (8).
P
sRPE24h and sRPEweekly measures are presented in Figure Although the participants were informed that this was not
2. The regression equations, slope, and intercept values are a memory test and that the values provided 24 hours later
presented in Table 3. should reflect the perception of the session at that time, it
Standardized biases were trivial between sRPE30min and does not discount the possibility of athletes simply remem-
sRPE24h for sRPE, duration, and intensity. Standardized bering the value reported the day before. However, these
TEE was small between sRPE30min and sRPE24h for sRPE results support the findings of a recent study where recall
and intensity, and moderate for duration. Standardized of perceived exertion remained consistent up to 24 hours
P
biases were trivial between sRPE24h and sRPEweekly for after exercise in a supervised environment (2). Our findings
sRPE, duration, and intensity. Standardized TEE was mod- provide further flexibility for strength and conditioning
P
erate between sRPE24h and sRPEweekly for sRPE, dura- coaches and sports science support staff by demonstrating
tion, and intensity. the validity of a remote collection method compared with
the previous study.
DISCUSSION
The main finding of this study is that the self-reported daily PRACTICAL APPLICATIONS
TL questionnaire 24 hours after exercise showed high levels Considering the accuracy and practicality of the self-
of agreement with the criterion measure of supervised sRPE reported daily TL questionnaire, where multiple athletes
collection 30 minutes after exercise. The sRPE24h had trivial can report workloads remotely without the need for practi-
mean bias, small TEE, and nearly perfect correlation, and tioners to be present, the sRPE24h offers a valid and robust
therefore, it can be considered a valid and robust method of method for TL quantification. The weekly TL diary may not
TL quantification for practitioners and sport scientists who be suitable for practical use because of the substantial TEE
are providing remote support for adolescent athletes. This associated with this method, where the signal may be lost in
method provides a freely accessible, Web-based alternative the noise.
for TL quantification, which may be used with large num-
bers of athletes, to provide accurate data for training moni-
REFERENCES
toring purposes.
1. Borresen, J and Lambert, M. Validity of self-reported training
Another important finding of the present study is that duration. Int J Sports Sci Coaching 1: 353–359, 2006.
although sRPEweekly showed trivial bias and very large cor-
P 2. Christen, J, Foster, C, Porcari, JP, and Mikat, RP. Temporal
relations compared with sRPE24h, the moderate TEE robustness of the session rating of perceived exertion. Int J Sports
questions its potential use as a practical TL quantification Physiol Perform 11: 1088–1093, 2016.
method. As small week-to-week changes in TL (e.g., ;10%) 3. Clarke, N, Farthing, JP, Norris, SR, Arnold, BE, and Lanovaz, JL.
have been related to injury risk (6), the use of a weekly Quantification of training load in Canadian football: Application of
session-RPE in collision-based team sports. J Strength Cond Res 27:
training diary with a typical error of 28.5% would make it 2198–2205, 2013.
impossible to detect small meaningful changes in TL that 4. Coutts, AJ, Rampinini, E, Marcora, SM, Castagna, C, and
could be placing athletes at a greater risk of injury. A recent Impellizzeri, FM. Heart rate and blood lactate correlates of
study investigating the factors that influence self-reported perceived exertion during small-sided soccer games. J Sci Med Sport
12: 79–84, 2009.
measures suggested that longer recall periods were associ-
5. Foster, C, Florhaug, JA, Franklin, J, Gottschall, L, Hrovatin, LA,
ated with greater error (15). It has also been suggested that Parker, S, Doleshal, P, and Dodge, C. A new approach to
more experienced athletes have a better ability to recall monitoring exercise training. J Strength Cond Res 15: 109–115, 2001.

VOLUME 31 | NUMBER 4 | APRIL 2017 | 1125

Copyright © National Strength and Conditioning Association Unauthorized reproduction of this article is prohibited.
Validity of Self-Reported Training Load Measures

6. Gabbett, TJ. The training-injury prevention paradox: Should 12. Hopkins, WG. Spreadsheets for analysis of validity and reliability. In:
athletes be training smarter and harder? Br J Sports Med 50: 273–280, Sportscience. 2015. pp. 36–42. sportsci.org/2015/ValidRely.htm.
2016. 13. Hopkins, WG, Marshall, SW, Batterham, AM, and Hanin, J.
7. Gabbett, TJ, Whyte, DG, Hartwig, TB, Wescombe, H, and Progressive statistics for studies in sports medicine and exercise
Naughton, GA. The relationship between workloads, physical science. Med Sci Sports Exerc 41: 3–13, 2009.
performance, injury and illness in adolescent male football players. 14. Phibbs, PJ, Jones, B, Roe, GAB, Read, DB, Weakley, JJ, Darrall-Jones, J,
Sports Med 44: 989–1003, 2014. and Till, K. We know they train, but what do they do? Implications for
8. Groslambert, A and Mahon, AD. Perceived exertion: Influence coaches working with adolescent rugby union players. Int J Sports Sci
of age and cognitive development. Sports Med 36: 911–928, Coaching 2017. In press.
2006. 15. Saw, AE, Main, LC, and Gastin, PB. Monitoring athletes through self-
9. Halson, SL. Monitoring training load to understand fatigue in report: Factors influencing implementation. J Sports Sci Med 14: 137, 2015.
athletes. Sports Medicine 2(44 Suppl l): S139–S147, 2014. 16. Shephard, RJ. Limits to the measurement of habitual physical activity by
10. Hartwig, TB, Naughton, G, and Searl, J. Defining the volume and questionnaires. Br Journal Sports Med 37: 197–206, 2003. discussion 206.
intensity of sport participation in adolescent rugby union players. Int 17. Tenenbaum, G, Levy-Kolker, N, Bar-Eli, M, and Weinberg, R.
J Sports Physiol Perform 3: 94–106, 2008. Information recall of younger and older skilled athletes: The role of
11. Hopkins, WG. Quantification of training in competitive sports. display complexity, attentional resources and visual exposure
Sports Med 12: 161–183, 1991. duration. J Sports Sciences 12: 529–534, 1994.

the TM

1126 Journal of Strength and Conditioning Research

Copyright © National Strength and Conditioning Association Unauthorized reproduction of this article is prohibited.

You might also like