Research in Developmental Disabilities 53(2016)377-390, Contents lists available at ScienceDirect Research in Developmental Disabilities Siar Cognitive profile of young well-trained athletes with Dower intellectual disabilities Debbie Van Biesen***, Jennifer Mactavish”, Katina McCulloch®, Laetitia Lenaerts®, Yves C. Vanlandewijck* 4 KU Leuven, acy of Kinestology and Reabitaon Scenes Department ofReabitarion Sens Blum ° Yeates School of Graduate Stade Ryerson Urs, Torn, Canada ARTICLE INFO ABSTRACT Jr story ‘Background: Previous research has shown that cognitive and motor skills are related, The Received 10 August 2015 precise impact of cognitive impairment on sport proficiency, however, is unknown, ecevedin evi inm24 Feb 2016 ins This stay investigatedgroup and inv dal dferencesncogiivepofiesina large ‘cohort of track and field athletes, basketball players, swimmers and table tennis players, ‘with (N= 468) and without (N= 162) intellectual disabilities (ID). ‘Mevhods and procedures: Based on the Cattell-Horn-Carroll Theory of Cognitive abilities, ‘ight subtests were selected for inclusion in a generic cognitive test (GCT) to assess execu eine aoaaay tive functions and cognitive abilities retevant t sport, uid reasoning, visual processing, Countive test reaction anc decision speed, short-term memory and processing speed. Paralympic Games ‘Outcomes and resuts: Reliability coefficients for the subtests ranged between 0.25 and Execitive function (0.38 respectively. Factor analysis revealed two clusters of subtests ie, a speed-based cHCtheory factor (simple and complex reaction time and simple and complex visual search) and a performance-based factor (Corsi Memory, Tower of London, WASI Block Design and Matrix Reasoning) After controling for psychomotor speed, the group of ID-athletes scored significantly lower than athletes without ID on alltheGCT subtests, except the complex visual earch test. ‘When cognitive profiles of individual ID- athletes were examined, some obtained higher scores than the average norm values inthe reference population. Conclusions and implications: The GCT is currently administered as part ofthe classification process for athletes with ID who compete in the Paralympic Games. The results of this study indicate that the complex visual search and Tower of London test in the GCT should be reconsidered. ‘Avilable online 18 March 2016 eywonts: Sport intelligence © 2016 Elsevier Le. All rights reserved What this paper adds? The outcome of this study has generated new insights about the relationship between cognitive abilities and sport by spanning the boundaries of distinct research areas to produce a new body of knowledge. These insights offer the potential for resolving a primary research challenge in 21st century Paralympic sport, which is to develop evidence-based systems of * Corresponding author at: KU Leuven, Faulty of Kinesiology and Rehabilitation Sciences, Department of Rehabilitation Sciences, Tervuursevest 101, 3001 Leuven, Belgium. sail address debbie vanbiesenaber kuleuven be (D, Van Biese) tr) &xdoiorg/10.1016fs14d.201603.008 (0801-4222/0 2016 Elsevier Ld. All rights reserved,378 .Van Bese ea. j Research In Developmental Disab 53 (2016) 377-390 eligibility and classification that address the impact of impairment on sport proficiency (Tweedy & Vanlandewijek. 2009). In this context, the outcomes of the present study have had a direct and positive effect by enabling the reinclusion of elite ID-athletes the world over, ina limited number of Paralympic sports. For [D-athletes, dedicated to intense training and elite performance goals, having the right to participate in Paralympic Games is highly important. ‘The cognitive test described in this study is currently being used as one component of the process for enabling ID- athletes to participate in events sanctioned by the International Paralympic Committee (IPC). Inclusion of these athletes in the Paralympic Games has provoked escalating media interest which is an important mechanism for advancing awareness of the strengths and talents of these athletes and, in turn, enhancing positive attitudes towards people with disability and diversity in general. 1, Introduction In an equal society having a disability should not be a barrier to enjoy physical activity or to excel in sport. The Paralympics ‘Games is recognized today as the pinnacle in sporting excellence for those with a large range of disabilities (Jobling, 2012) Intellectual impairment is one group of eligible impairments that has recently been re-included in the Patalympics, but only in a limited number of sports (Kwon & Block, 2012). In order for these athletes to compete at the most elite level, evidence-based sport-speciic classification systems that clearly denote the impact of impairment on performance (Tweedy & Vanlandewijck, 2009) needed to be developed. Similar to the example of a single below the elbow amputation, which has a greater affect in swimming than in marathon running, one would expect an intellectual impairment to have less affect in physically demanding events (e.g, 100m sprint) than in those with heavy cognitive demands (e.. decision making, pacing). The available literature (Burns, 2015), however, offers no straightforward conclusions that could substantiate these assumptions. There isa paucity of previous workin this area and, as such, a lack of clarity about the underlying principles and explanatory mechanisms for understanding the relationship between cognition and proficiency in sport. Multiple studies have highlighted the relationship between cognitive abilities and sport performance (Kasahara, Mashiko, & Niwa, 2008; Kioumourtzoglou, Derri, Tzetzis, & Theodorakis, 1998; Mann, Williams, Ward, & Janelle, 2007) but the precise nature of this relationship remains unclear. Elite athletes are found to perform significantly better than novices in Vatious aspects of intellectual functioning, including visual-spatial awareness, memory, and response speed and accuracy (Mann et al., 2007). Arecent systematic review by Van der Fels et al. (2014) showed, among young children, a strong linkage between cognitive skills and motor skills with the highest cognitive demand, ie, fine motor skills, bilateral body coordination, and timed performance in movements, The motor tasks with limited or no connection to cognitive skills required the least amount of cognitive engagement in the tasks (e.g. strength). From a neuropsychological view, these novel findings are consistent with the notion that motor and cognitive skill functioning is mediated by the co-activation of the cerebellum (important for complex and coordinated movements) and the prefrontal cortex (important for higher-order cognitive skis). Van der Fels etal also found evidence of a correlation between motor skills and higher-order complex cognitive skills such as fluid reasoning and visual processing. In recommendations for future research, these authors noted that to better understand the relationship between cognitive and motor skills requires moving beyond reliance on general IQ. measures by focusing on relevant categories of motor and cognitive skills, which isthe approach adopted in the present study. The Cattell-Horn-Carroll (CHC, Schneider & McGrew, 20 12) theory of cognitive abilities is widely accepted by researchers, interested in intelligence as a common nomenclature and theoretical framework for examining various aspects of human cognitive abilities, We use the CHC taxonomy as the theoretical framework for conceptualizing cognitive abilities with a facus on assessing those essential for optimal sport proficiency. According to CHC theory, there are 10 broad cognitive abilities, ranging from Gf (Fluid reasoning or the deliberate but Alexibie control of attention to solve novel problems that cannot be performed by relying exclusively on previously learned habits) to Gt (Reaction and decision speed, or the speed of making very simple decisions or judgments when items are presented one at a time). For the complete and detailed overview of the theory and all components we refer to McGrew (2008). From the total set of broad cognitive abilities as laid out in the CHC taxonomy five abilities with major relevance to sport performance were identified (ie, fluid reasoning, short-term memory, processing speed, reaction and decision speed and visual processing) and this Set of cognitive abilities was assessed by means of corresponding subtests. From a neuropsychological viewpoint it also was relevant to include a subtest to account for executive functions, as these are the basis for many cognitive abilities (Ardila, Pineda, & Rossel, 2000). Further support for this approach comes from the work of Vestberg, Gustafson, Maurex, Ingvar, and Petrovic (2012) who showed that executive functioning has potential as a predictor ‘of success in sport. ‘The main purpose of the present study was to examine differences and similarities in the cogeitive profiles of young well-trained athletes from a wide range of sports (i.., athletics, swimming, table tennis and basketball). To fully understand the relationship between sports proficiency and cognition this study included individuals with and without intellectual impairments, with a primary focus on elite athletes with intellectual disabilities (ID-athletes). To clarify the terminology we use, Paralympic systems of athlete classification, as described in the International Paralympic Committee's (IPC) classification code (IPC, 2007) is based on the language and concepts articulated in the International Classification of Functioning, Disability ‘and Health (ICF) model, According to the ICF model, disability is an umbrella term used to describe the inter-relationship between impairment, activity limitations and participation restrictions; impairment asa stand-alone term describes adeficit in body function or structure. To be consistent with the IPC Classification code, throughout the remainder of the text, the. Van Bese ea. Research In Developmental Disabiiies 53 (2016) 377-390 379 Table 1 Cognitive test composition and subtest descriptions Test Description Cognitive abilities Method Trials Scoring SRT Toreactasap.00 Reaction and Keyboard 2 ‘Mean RTin ms fixed visual decision speed (Gt) stimulus cer SimilartoSRTwith Reaction and Keyboard 2 Mean RTin ms distraters added decision speed (G0. ‘elective attention svs Toreactasap.to Processing sped Touchscreen 2 Mean RTin ms random visual @ stimulus as SimilartoSVSwith Processing speed Touchscreen 2 Mean RTin ms distracting ld (Gs) Visual added processing (Gv) wr To memorize Short-term Touchscreen 1s Best average score sncreasing memory (Gsm), on S subsequent sequences of spatial memory mals squares span ToL “Toreplicae Executive Touchscreen Vor 18 Number of coreet configurations in functioning items (max 18) ‘minimal nomber of wep ‘Toreplicate 20 Fluid reasoning Noc-compurerized max 13. Score depends on block patterns with (GfMisual comrectcems and 9 30-cubes processing (Gv) speed (max 72) wer “Tocomplete Fluid reasoning (Gf, Not-computerized max 38. [Number of corect sided patterns incloding items (max35) (atipe choice) induction, general sequential reasoning and speed of reasoning, pattem recognition) ‘ot, Max-=maximum, RT reaction time, SET~simple reaction time test, CRT=complex reaction time test, SVS simple visual search test, CVS=complex visual earch tex, CMT =corsi memory test, TOL Tower of London, WD ~Block Design tert, WMR= matrix reasoning text. The Block Design and Matrix Reasoning measures are from Wechsler Abbreviated Scale of Intligence-Second Edition (Wechsler, 2011). term ID-athletes is used to refer to the population under investigation, whereas ‘intellectual impairment’ is used to explicitly denote deficits in intellectual functioning. Psychometric properties of the test were first assessed, When 104 ID-athletes are assessed twice over a period of time (test-retest reliability), large correlations and small learning effects are expected on all subtests, The internal consistency, as assessed by means of factor analysis, is expected (0 be high (construct validity), The main hypothesis of this study is that there will be significant differences between well-trained D-athletes and their comparably trained non-ID peers. Athletes with ID are expected to score lower than their counterparts in executive functioning and cognitive measures related to sport (ie. reaction and decision time, short term memory, processing speed, fluid reasoning and visual processing) 2. Methods 241. Participants The data for this study were derived from 630 well-trained athletes participating in athletics (N= 191), swimming (N=210), basketball (N= 102), and table tennis (N= 127). The total sample consisted of male (N= 424) and female (N= 206) ID-athletes (N =468) and athletes without ID (N= 162), All [D-athletes participated in international sport events, sanctioned by the international Federation for Para-athletes with an Intellectual Disability (INAS), IPC, or ITTF (International table Tennis Federation). The participants represented 46 counties from six continents: Europe (26), Asia (9), North America (2), South ‘America (5), Australia (2) and Africa (2). The cognitive testing was completed before or after competition as part of the Classification process, with the results voluntarily approved for research purposes. All athletes were diagnosed as having an intellectual disability (ID) according to AAIDD international standards (Schalock et al., 2010): 1Q <7, significant limitations in adaptive behavior and impairment manifested before age 18. The control group was selected based on their comparability to the ID-athletes on age, principal sport and training volume. ‘Training volume was not systematically assessed for each 1D-athlete but data on training volume (M-tSD) per sport was available from previous studies: table tennis (Van Biesen, Mactavish, & Vanlandewiick, 2014): 13 +5 years of experience, athletics (unpublished data): 9.6+ 4.8 years of experience, 9.4-+ 4.0 h/week, swimming (unpublished data): 11,7+7.7 years380 .Van Bese ea. j Research In Developmental Disab 53 (2016) 377-390 Table2 Participant’ characterises With iD Without ID Male Female Toul Mate Female oval Total (N) a7 151 “68 107 5 182 Sport) Athletics 95 55 150 a 0 a Basketball a a 62 30 0 0 Swimming 104 6 169 24 7 41 ‘Table Tennis 56 31 87 2 8 0 Training volume (a years +50) ‘Athletics ws nas Basketball 16 a6 Swimming 18 35 ‘Table Tennis 1335 was ‘cea 245 no zat 239 2 233 Age SD) 64 60 53 57 a7 51 Dominant hand Right (=) 85 at Bt 37 92 88 Lett) 15 10 16 3 8 2 Psychomotor speed (M-+SD) FT dominant 66412 60213 we 1848 738 Tes8 FT non dominant ele 56013 50413 nas m8 nao ‘Nove FT = Finger Tapping ID = intelloctual disability, of experience, 14.8 3.1 h/week, and basketball (Pinilla, Perez-Terejo, Van Biesen, & Vanlandewijck, 2015): 12.2 45.8 years of experience, 6.6 +5.4hjweek. The comparison sample was recruited (1) by contacting local (Belgian) sport clubs via e- mail, phone or a personal visit, (2) by personally contacting individual athletes via e-mail, phone or a personal visit and (3) by posters in the main sport facilities of the University Sports Faculty. Informed written consent was obtained for all participants andjor their legal guardians, prior to participation in the study. The Medical Ethics Committee of the Katholieke Universiteit Leuven approved the study. 22, Materials To assess the sport cognitive profiles of the athletes, the generic cognitive test was administered, which is comprised of a series of seven subtests measuring broad cognitive abilities relevant in a sport context. i. short-term memory, visual processing, fluid reasoning, processing speed and reaction and decision speed. One subtest was added to assess executive functioning, which is related to cognitive abilities such as fuid intelligence (Salthouse, 2005) and might also be relevant ith respect to predict outcomes in sport (Vestberg et al., 2012). Additionally, psychomotor speed was assessed using a finger-tapping test to control for possible influences of motor deficits. The majority of the subtests were computerized: only two tests (WASI Block Design and WASI Matrix Reasoning) ‘were not, Table | provides an overview of the subtests and indicates the cognitive ability factors that were being assessed by each test and the testing method, Every subtest was preceded by a demonstration to acquaint the athlete with the test (exception: the Finger Tapping Test), All tests, except the WASI Block Design and Finger Tapping Test, were performed using the dominant hand only. 23, Procedure ‘The testing was either part of the athletes’ classification process prior to competition, or part ofthe classification research conducted before or after competition. Testing occurred in a quiet room, free from distractions, and set up to enable optimal visibility of the screen (e.g, no sunray interference). Included in the setting were the athlete and the fest instructor, and a translator if required (e.g, the coach if able to translate or a dedicated translator). The athlete was seated in front of the ‘computer and the test leader was seated next to the athlete, The test leader made sure that the participant sat comfortably and adjusted the screen angle for maximum visibility. All subtests were administered in accordance with precise standardized instructions presented in a user’s manual, which also included guidelines for scoring and interpretation, No feedback was given to the test taker, unless this was stated ‘explicitly in the manual (c.g. Finger Tapping). The instructions were mainly non-verbal. For every subtest, a demonstration tial was provided, and during the demonstration the instructor employed simple, clear and specific language to facilitate ‘comprehension of the instructions. The demonstration trial continued until the test instructor was sure that the participant ‘understood what was required, i. the participant correctly performed the required task. Total administration time was.Van Besen ea. / Rese rh tn Developmental Disables 53 (2016) 377-300 a1 a. SRT b. CRT Boo oe c. SVS d. CVS ne O e ©) e. Corsi fF. TOL, I 7 Fig. 1. Visual represenation ofthe computerized part of the genetic cognitive test. a) Simple reaction time (SRT), (b) complex reaction time (CRT), €) simple visual search (5V3), (complex visual search (CVS), (e) Corsi memory (CORSI (Tower of London (TOL, approximately 45 min, If there were any deviations from the prescribed protocol, the test leader recorded when and why these occurred and the test results were excluded from the analyses. When athletes failed to perform one or more of the subtests (e.g, stopped before the fest was finished), this was recorded as missing data. Of the 630 1D-athletes, only 30 had missing data, and none with missing data on more than 2 subtests. 24, Test descriptions and test instruct 24.1. Speed based tests In the CHC model of cognitive abilities (McGrew, 2009), there are two speed-related broad ability domains: reaction and. decision speed (Gt) and processing speed (Gs). Gt is defined as “the ability to make elementary decisions and/or responses (simple reaction time) on one of several elementary decisions andjor responses (complex reaction time) at the onset of simple stimuli. These abilities are typically measured by chronometric measures of reaction time and inspection time. Gs is defined as the ability to automatically and fluently perform relatively easy or over-learned elementary cognitive tasks, especially when high mental efficiency (ie. attention and focused concentration) is required. In our investigation these abilities are assessed by means of four computerized subtests, two reaction time and two visual search paradigms. For the ‘Simple Reaction Time the participant rests the index finger of the dominant hand on the space bar and taps it as Soon as a White circle appeared in the middle of the black screen with randomized time intervals (see Fig. 1a), the practice trials are followed by 12 test trials. The Complex Reaction Time testis similar but includes 16 distractors (negative stimuli: squares and triangles) appearing in the middle of the screen, randomly among the 12 targets (circles), The only action required was to tap when a circle appeared. The Simple Visual Search is a touch screen based subtest in which the participant sits in front of the screen and taps 12 times as fast as possible with the preferred hand in the middle of the circle when it appears on the screen, at randomized time intervals and randomly chosen spots (see Fig. 1c). The Complex Visual Search test was similar but this test involved a distracting background (computer screen composed of flickering dots) (see Fig. 1d). The appearing circle gradually becomes more intense and visible. For these four subtests the mean and standard deviations over 10 trials (after removing the best and worst score) were recorded in milliseconds and stored on the computer automatically. 242, Short term memory (Gsm) In the CHC model of cognitive abilities (McGrew, 2009) short-term memory (Gsm) is defined as the ability to comprehend and maintain awareness of a limited number of elements of information in the immediate situation (events that occurred in the last minute or so), This ability was assessed by means of a computerized visual memory span task (Fig. 1d), an adaptation of the original CORSI task (Corsi, 1972) in which the participant reproduces block-tapping sequences randomly generated with the provision that no block was repeated in any sequence. All squares turned blue when the order presentation was finished, which was the cue for the participant to start tapping blocks in the same order as they were lighting up. The sequence length started with two blocks and increased by one after correct recalls, and decreased by one block if any error ‘was made. The computer automatically stored the length of each sequence. The final score of the athlete, ie, the Corsi memory span was defined as the best average score of five subsequent trials (corrected by minus 0.5),.Van Bese ea. j Research In Developmental Disab 53 (2016) 377-390 382 (or sea) 09 weds Gomory a ya saapge=04N Aumont pay RosDasd pur usec 08 i) pun) sme eds wou 9 samme psu DE hoe ee a touxoo a_‘toxxoo ‘roo a Toxo - iat 2 2 y é i : a | & i ee i i 5 a 8 af i i ‘ g a i e ot i ? 7 to E 5 E ao 3 + $ ue. Van Bese ea. Research In Developmental Disabiiies 53 (2016) 377-390 383, ‘Table Factor loadings for exploratory factor analysis with varimax rotation of cognitive ability subtests Subtest Speed: based Content based ‘Simple Viswal Search (Gs) 095, O12 Complex Reaction Time (Gt) oat 017 Simple Reaction Time (Gt) ost “024 Complex Visual Sear (G3) ost 036 [wast arex Reasoning (Gt) “017 0.90 \WASt Block Design (Gv) oa 089 Corsi (Gsm) 028 os TOL Executive Functioning 021 073 Not. Factor loadings 0.80 arin boldface, TDL~Towerefandon, Gv Viswl processing, Gt= reaction and deck term memory, WASI=Wechsler Abbreviated scale of Inceligence TM) (Wechset, 2011) speed, f= Fluid reasoning, Gam=Shor 2.4.3, Executive functioning For the purpose of this investigation, we used a computerized adaptation of the Tower of London (Rainville etal, 2002: Shallice, 1982) to assess executive functioning (Fiz 1f). The test ended after 14 items with a six-move problem. For partci- Pants scoring more than 90%, four additional test items were presented (seven-move problems). The emphasis inthis test ‘was accuracy rather than speed but for practical purposes an upper time limit (120) was set for solving each item. with {wo trials for each, To limit potential distress because of repeated failure, a cessation rule was applied when the participants indicated that the task was too difficult. The test score was based on the number of correctly solved items (in the least possible number of moves). The maximum score was 18. 244, Fluid reasoning (Gf) and visual processing (Gv) ‘Two non-computerized subtests (the WASI Block Design test and the WASI Matrix Reasoning test) were administered (WASI=Wechsler Abbreviated scale of Intelligence TM) (Wechsler, 201 1)-Both subtests measure abilities in the CHC domains of Fluid reasoning Gf) and Visual processing (Gv), with the highest loading for the Block Design on Gv (defined as the ability to -generate, store, retrieve, and transform visual images and sensations) and for the Matrix Reasoning Test on Gf (defined as the use of deliberate and controlled mental operations such as problem solving and concept formation to solve novel problems that cannot be performed automatically), Absolute test scores were used for data analysis with a maximal obtainable test result of 72 points For Block Design and 35 points for Matrix Reasoning. 245. Control test for psychomotor speed (Gps) ‘The Finger Tapping test Was used as a control mechanism for psychomotor speed, defined as the ability to rapidly and fluently perform physical body motor movements largely independent of cognitive control (McGrew. 2009). The test involved tapping the spacebar for 105 as fast as possible, with one finger or all the fingers together, but without holding the key down continuously nor alternating tapping with multiple fingers. This was repeated twice for the dominant and non- dominant hand alternately. A real-time refreshing on-screen counter displayed the counted taps, which usually provides strong encouragement to tap as fast as possible, During this test, the test instructor also encouraged the participant verbally. ‘The test result was the highest number of counts reached in 105, for dominant and non-dominant hand. 25, Data analyses Statistics were performed using SPSS (version 16.2, SPSS Inc., Chicago lll, USA) with level of significance set at p<0.05, Eight dependent variables (one forevery subtest) were defined. Three independent variables were defined, of which twowere dichotomous variables, ie.. impairment (with or without ID) and gender (male and female), and one continuous variable, ie. psychomotor speed (expressed in max number of taps/10s). A factor analysis was first performed to determine construct validity and to gain information about the interdependencies between the subtests. The test-retest reliability was estimated with Pearson's correlation coefficients across two test sessions for N= 115 1D-athletes who participated in two separate international championships within one year, and administered the test once at each occasion. The average time interval ‘was 7.1 months (minimal 3 and maximum 11 months) between the first and the second test session. The mean scores and standard deviations of test-retest were compared by paired t-tests, For each of the eight subtests, a 2 x 2 analysis of variance was performed with impairment and gender as independent variables and respectively with and without psychomotor speed taken into account as a covariate in the analyses. Effect sizes (ES) were calculated as d=[mean ID-athletes ~ mean control groupl/SD. SD was calculated as the square root of the Pooled estimate of population variance. As a guide to interpreting these values, Cohen (1988) labeled an effect size ‘small if F5<05, “moderate” if ES between 0.5 and 0.8, or “large” if ES > 08.84 .Van Bese ea. j Research In Developmental Disab 53 (2016) 377-390 Tabled Bivariate Correlations among the eight subtests. Subtest ser 20Rr—~=«aSWS~=SCACWS ~—~—=CSCORSI~—=CGTOL—«C7 BLOCK EMR, 1 Simple Reaction Time (#7) 7 2. Complex Reaction Time (CRT) O85" 3 Simple Visual Search (SVS) oss: , 4 Complex Visual Search(CVS) 0.52" 050" os ' 5.CORS 04s) 036-036 -0as) 5 Tower OfLondon (TOL) 035-030" 029" 36s 1 7-WAS Block (BLOCK) -036 031 oar 03s) at ose BWASIMatrixReasoning(MR) 03003302800" 73 056 08s" 1 'P1). Two factors were extracted, explaining 77% of the variance. The rotated factor matrices are shown in Table 3 Both factors obtained tended to have a majority of similar items. The first factor contained all the speed-based subtests (simple and complex reaction time, and simple and complex visual search), whereas the second factor contained all the erformance-based subtests, i. the WASI matrix reasoning and block design, CORSI memory and executive Functioning (OL). All subtests load on only one factor and all factor loadings are >0.60. 3.2, Test-retest reliability ‘An overview of the correlations and Paired T-test results for 114 ll-athletes (45 female, 69 male) from three sports (49 athletics, 44 swimming, 21 table tennis) wito underwent the test twice is presented in Table 5. The mean scores improved between test and retest for all subtests, indicating a learning effect. This learning effect was significant for SRT, CVS, TOL, ‘WASI Block and WASI Matrix. As indicated in Table 5, test and retest results were positively correlated for all subtests (p<0.001). A weak positive correlation was found on the CVS (0.25) and TOL (0.48), moderate positive correlations on the, CRT (0.66) and SVS (0.67). Strong correlations were found for the subtests WASI Block Design (0.88), WASI Matrix Reasoning.. Van Bese ea. Research In Developmental Disabiiies 53 (2016) 377-390 585, ‘Tables Multivariate analysis of variance with psychomotor speed as covariate. ‘Subtest (unit) ‘with (N=A40) Without ID (N= 162) F_SkewnesskartosistS Cohen € MzSD_MINMAX O58 —MZSD___MINMAX 958CI ‘Speed-baved subvests Simple Reaction Time (ms) 7050 + 33153312, 2625 316734, 7366] 3825 + 45.72937,5578(3754,3895] 939°24 6909 Complex Reaction Time(ms) 22 + 362.4486, 3212.31857.7, 9367] S008 + 58.3380. 657914017, 5008]1425 24 8607 Simple Visual earch (ms) 8553 = 34404502, 2700 7[860.3, 1025 5]5304 = 7004171, 7673152886, 550.3] 70°35 195 06 Complex VisualSearch(s) 9835. 67,301 [92,09] 7604 64,00 [75.77] 0925 99 a8 Content-based subtests CORS! (average memory span) 43213 00,99 [42.44] 67=09 47.89 [65.68] 1899045 -044 28 ToL(#correctitems.max 18) 78227 O15 (76.81) 823.1 3.18 (113,122) 1225012 012 14 WAS Block (raw score,max 72) 2172158 071 (202,232) S88=97 30.71 [573.603] 4053034 13 29 WaStMatnx (correct, max35) 136274 032 [129143] 201436 10,35 [284,205] 3asT oI 1227 ‘No. 1D~ intellectual disability, C1-confdeace interval, TOL-Tower of London, CORSI~ Corsi Block Memory Test, ES=Cohen d Elect Size, p<005. (0.81), Corsi (0.76) and SRT (0.71). On the control test for psychomotor speed strong positive correlations were found: FD (0.78), FIND (0.73). 3.3, Generic cognitive test Appropriate data screening techniques were used to confirm the assumptions underlying the statistical analyses used, Not all the normality assumptions were met, i.,n}o homogeneity of variance for any of the subtests, skewness and kurtosis >2 forthe speed-based measures. Therefore, data transformation was done using log 10 transformations for the speed-based ‘measures, resulting in acceptable values for asymmetry and kurtosis inorder to prove normal univariate distribution (George & Mallery, 2010) ‘A2 x2 way MANCOVA was used to examine the effect of impairment (with or without ID) and gender (male or female) ‘on the eight cognitive subtests, taking psychomotor speed (Finger tapping with dominant hand) into account. For the speed based subtests (SRT, CRT, SVS and CVS), log 10-transformations were computed before entering the variables in the model, ‘The analysis revealed no main effects of gender, F(1, 588)= 0.74, p=0.66 and no interaction effects, F(1, 588) =0.98, p=0.17. A significant main effect for impairment was found, and the univariate analysis revealed significant differences for all subtests (except complex visual search), with overall better scores for the athletes without ID. The results are shown in Table 6. Medium Cohen d Effect Sizes were found for Complex Reaction time (0.6) and Simple Visual Search (0.7). Large Etfect Sizes (0.8) were found for all other subtests. The distributions for all subtests are visually presented by means of boxplot diagrams in Fig. 2(Performance-based subtests) and Fig. 3 (Speed-based subtests). Whereas clear group differences ‘were observed for all subtests, Fig. 2 and Fig. 3 indicate that on individual level, the distribution range is large, mostly for the ID-athletes. On every subtest there are some individual ID-athletes outperforming the mean values of athletes without ID, and even reaching maximum scores on some tests. 4, Discussion The purpose of this study was to assess the cognitive abilities of 1D-athletes and to compare their cognitive profile with a ‘group of well-trained athletes without ID, comparable in terms of training volume. As Was expected, the cognitive abilities Of athletes with ID were much lower than those of the non-ID group across the full spectrum of abilities assessed, and this remained unchanged when accounting for psychomotor speed. There were, however, large inter-individual differences among the ID-athletes, with some exceeding the group average for athletes without ID. 4.1, Psychometrics (reliability and validity) Psychometric properties of the test battery were first assessed. The results of the test-retest analysis indicated a positive correlation between the first and second testing occasions on all subtests. In general, tests need to have high test-retest reliability (TRR) coefficients to be suitable for testing, preferably above 0.8. The results we found in our investigation for Matrix Reasoning (0.81) and for Block Design (0.88) are in line with these norms and indicate high TRR. The TRR coefficients on the subtests SRT, CRT, SVS and Corsi ranged between 0.66 and 0.76. These were deemed acceptable as itis recognized that a number of many factors related to the nature of intellectual impairment could influence tite TRR. For example, itis known that stress and/or anxiety affects performance on completely new tasks conducted in unfamiliar environments (Roy, Retzer, & Sikabofori, 2013). The low reliability results for the complex visual search test (0.25) and the TOL (0.48) in our study indicate that they should be removed or replaced. The TOL results are not surprising as tests of executive functioning often have poor to moderate TRR (Lemay et al., 2004). The assessment of these abilities, such as planning, often involves.Van Bese ea. j Research In Developmental Disab 53 (2016) 377-390 86 rensia xoydusoo pur ays ‘2 peas xo “aun uor>eatajduissasaxgns pase: pods sno} ay 30 “arian saanee=< a ToENGD Pamgnetiey youn a — = = ¢ “ 7 : as 3 ; Hele aie a f i : i a ? : a 4 i as . of 3 it e : : : esp enisqozut nogu¥n pue Uavn saree UBeMNIaG SuoUaUnIp Jo UosLedWOD “Ey Gsm) awa opreay odes. Van Bese ea. Research In Developmental Disabiiies 53 (2016) 377-390 387 tasks that rely on assessing people in a new context or non-routine situations, which if done repeatedly reduces novelty and test sensitivity. ‘TRR must be distinguished from the practice effect, whereby repetition leads to improved performance. Thus, atest score can show a large practice effect, and nevertheless have a high TRR if performance remains consistent across time, as the results of our study indicate. In our study, a significant learning effect was found for five subtests (SRT, CVS, TOL, Block and Matrix). This is not uncommon as results on many neurobehavioral tests change on subsequent administration because of practice, maturation, or other intervening effects that take place between test and retest. 4.2, Speed based subtests Reaction times are a widespread, important and informative tool in the study of cognitive ability (Nissan, Liewald,& Deary, 2013). In general, associations between reaction times and cognitive ability test scores have been consistently reported in the literature (Deary, Der, & Ford, 2001), with varying estimates of the strength of these associations (Der & Deary, 2003).In the present investigation four subtests (i, simple reaction time, complex reaction time, simple visual search and complex visual search) loaded on the speed-based factor. According to the CHC mode! of cognitive abilities these four subtests cover the broad abilities: Reaction and Decision Speed (Gt), Processing Speed (Gs) and Visual Processing (Gv). Individuals with ID are known fo have slower and more variable reaction times (Klotz, Johnson, Wu, Isaacs, & Gilbert, 2011; Kosinski, 2013), ‘which corresponds to the finding in our study that ID-athletes were slower on the speed measures than their non-ID peers. Ina study of individuals without ID, Lee and Chabris (2013) found that superior ability to respond to stimuli presented in quick succession is a function of brain processing speed and not faster muscle/motor response. Schweitzer (2001) also found that the speed advantage of more intelligent people is greatest in tests requiring complex responses, The reaction time subtests used in the present study were pure speed measures that did not require substantial cognitive effort. Even the ‘more complex versions of the tests (choice reaction time and complex visual search), used distractions that did not introduce ‘greater information processing or response demands. These factors may explain why we did not find significant differences in cognitive speed assessed with the complex visual search measure when controlling for psychomotor speed. 4.3, Performance-based subtests A consistent finding in intelligence literature is the existence of a general intelligence factor (g) that results in positive correlations between a diverse range of cognitive tests with differing content (Kaufman, DeYoung, Reis, & Gray, 2011). This ‘was also found in our investigation with the four subtests (i., Corsi, Tower of London, WASI Matrix Reasoning and WAS! Block Design) loading on the same performance-based factor. Three of these subtests specifically assess cognitive abilities: Short Term Memory (Gsm), Fluid Reasoning (C1) and Visual Processing (Gv) whereas the Tower of London is an extensively used measure of executive functioning (Rainville et al., 2002), Although executive functioning and cognitive ability are different concepts, the factor analysis and correlation matrix (Table 4) reveal that all of the abilities included in this factor are clearly related. This finding corresponds with literature from studies of non-ID adults (Lezak, 1995; Salthouse, 2005) that shows that the many variables purported to assess executive functioning are in fact closely related to cognitive abilities such as reasoning and perceptual skills. As expected, as a group, the [D-athletes scored significantly lower than well-trained athletes without impairments on the four performance-based subtests; however the inter-individual variability was large. 43.1. Short-term memory (Cors!) Studies dating back to the 1970s indicated that elite athletes are superior to novices in recognizing and recalling sport specific information (Allard, Graham, & Paarsalu, 1980; Beilock, Wierenga,& Carr, 2003; Chase & Simon, 1973), and that these cognitive abilities are not directly transferable to contexts outside of the sport-specific expertise of the athlete. Cognitive abilities as examined in the present investigation were done in a generic way, ie., making use of abstract, not culturally specific or sport-specific visual information. Our purpose was to gain insights about the generic (ie., non-sport-specific) memory capacity of athletes, excluding the possible impact of training or sport-specific expertise. The results confirm that genetic memory capacity is low among athletes with ID (average sequence length of 43 blocks compared to 6.7 for athletes ‘without ID), which is consistent with Henry's (2001) comparison of spatial memory span of non-athlete samples with mild-ID (spatial span: 4.4 1.1) and a control group without ID (6.1 1.0). A few individuals with ID in our sample appeared to have ‘excellent short-term memory skills (with recall of9.9 digits which is far better than average). What is not clear is whether superior memory is an artifact of sport-specifi training or conversely, that people with better memory are more inclined to participate in high level sports. As the ‘limited transfer hypothesis’ (Charbris & Simons, 2010) is commonly accepted in literature, indicating that cognitive abilities such as spatial memory are not transferable to contexts outside the specific expertise of the athlete the latter explanation is more likely. 4.3.2. Fluid Reasoning and visual processing (WASI Block Design and Matrix Reasoning) The two subtests of the WASI utilized in the present study tap various facets of intelligence, including: visual information processing, spatial ability and fluid reasoning. Fluid reasoning refers to the use of mental operations to solve novel problems, for example, extrapolating, transforming and classifying (Primi, Ferrao, & Almeida, 2010). In sport, these cognitive abilities are considered essential to optimal performance (Voss, Kramer, Basak, Prakash, & Roberts, 2010). A study by Kasahara et alsa .Van Bese ea. j Research In Developmental Disab 53 (2016) 377-390 (2008) demonstrated that elite rugby players score higher on Block Design task than non-athletes. As would be expected because of their impairment, the majority of athletes with ID in our investigation, performed in the lowest ranges of fluid reasoning measures. High correlations between fluid reasoning and the g factor have been commonly reported (Bark, Porter, & Ginns, 2012). Apparently the underlying impairment accounts for more to the variance in fluid reasoning ability than the sport expertise ofthe individual. 4.3.3, Executive functioning (Tower of London) \Vestberg et al. (2012) recently showed that executive functioning (EF) has the potential to predict success in soccer. More specifically, they used the subtest design fluency, a standardized test that measures multiprocessing such as creativity, response inhibition, and cognitive flexibility. Vestberg et al. used design fluency for their main analysis, because they believed it was the major EF factor relevant in soccer (fast creativity and problem solving ability) and at the same time it did not contain a verbal aspect that may be affected by education/schooling. For the purpose of our investigation, exactly the same line of reasoning was applied for incorporating a test of EF. We used a computerized version of the Tower of London for this purpose because itis a relatively simple, non-verbal task. The TOL subtest requires the ability to conceptualize change (anticipate or look ahead), generate and select alternatives, and sustain attention (Culbertson & Zillmer, 1998). This subtest simulates the executive chain of decision making in a way that applies in alive sport situation. Only a few previous studies have conducted TOL tests in the population of persons with ID. Shallice (1982) examined the validity of an adapted TOL version and the results indicated it was a valid test to use in this population. Bishop, Aamodt-Leeper, Creswell, McGurk, and ‘Skuse (2001) found impaired functioning on Tower tasks in various clinical groups, including people with ID. As such, TOL is generally described as higher-order planning task because successful completion requires the participant to look ahead and solve the problem cognitively before actually moving the balls or disks. Persons with ID generally do not demonstrate overt behaviors that are considered ‘planful (‘e., implementing systematic move sequences) but deploy more of atrial and error approach (Hartman, Houwen, Scherder, & Visscher, 2010), 44, Strengths and limitations Our study is one of the first of its kind situated in a sport context and a major strength is the unique sample of 468 lite athletes with intellectual impairments from around the world. Given the field based nature of the work, the study is not without its limitations. While standardized to the fullest extent possible, testing conditions were not identical because the athletes were tested at various sanctioned competition events, in different locations, and by different testers. Detailed data on training history and volume data were not available for all [D-athletes and as such, status as elite athletes was attributed to their inclusion in international competition (¢.g., world championship or INAS Global Games), which is the preeminent stage for these athletes. From previous sport-specific investigations we retrieved average data on training history and training volume from the 1D-athletes coaches. The comparison sample was selected according to these ranges ‘on training volume. This was necessary as ID-athletes and sport opportunities are not presently on the same level as, world class non-ID standards—although since reinclusion of 1D-athletes in the 2012 Paralympic Games, the opportunities and performance levels have improved significantly (Einarsson, Cisic, Van Biesen, & Daly, 2015; Van Biesen, Mactavish, Pattyn, & Vanlandewijck, 2012), Although the subtests selected for this study were chosen on the basis of their relevance to sport, they assess cognitive abilities in a generic (=non sport-specific) way and are, therefore, not specifically trainable. Assuming that elite athletes require specific cognitive abilities to make it to the top, the subtests used in this study might have the potential to help 1D athletes to find a sport they can excel in. For the speed-based abilities such as reaction time, the question remains whether the fast reaction times of some 1D-athletes is a product of their experience or an artifact of individuals with naturally high processing speed being attracted to, and excelling in sport. ‘The final drawback of this study (and many other studies involving large samples of individuals with ID) is the large inter-individual variability causing the violation of the assumption of homogeneity of variance. It is important to take this into account when interpreting the results, 45, Future perspectives The outcomes of this study provided new insights about the cognitive profiles of well-trained athletes with ID, how they compare to a non-ID reference group, and the usefulness of the cognitive test. Future research is needed to enhance understanding of variations in performance and the reasons for those. Longitudinal data on the trainability of cognitive abilities within a sport context also is needed. Finally, integrating the cognitive data, sport specific proficiency data, and amore comprehensive assessment of training volume is required as we seek greater clarity about the impact of impaired cognitive functioning on sport specific proficiency. 5. Conclusion This study examined the cognitive profiles of young well-trained athletes with and without ID with the intention of identifying the relevant cognitive determinants of sport proficiency. Clearly evident from the results, ID-athletes score. Van Bese ea. Research In Developmental Disabiiies 53 (2016) 377-390 389 significantly below their non-ID counterparts on cognitive ability measures relevant to sport (eg. Fluid Reasoning, Short- term Memory, Reaction and Decision Speed, Visual Processing) and executive functioning, As cognitiveabilities and executive functioning contribute toetite sport proficiency, the performance of 1D-athletes will likely remainaffected by their underlying impairment, no matter how hard they train, Coaches need clear guidelines on how to effectively navigate these disadvantages to optimize athlete training and development. The findings of this study also substantiate that the ID class fits within the IPC Classification Code, and the Paralympic Games. ‘Acknowledgements. ‘The authors thank INAS and IPC for their support to conduct this study, and all members of the INAS-IPC Research Group (Prof. Jan Burns from the University of Canterbury, Dr. Peter Van de Vliet, medical and scientific director of IPC, and Nick Parr, executive INAS member) for their valuable input. References ‘Allard, Graham, 8. & Paasalu, M.L.(1980), Perception in spor: basketball Journal f Sport Psychology 2, 14-21. ‘Ardila, A Pineda, D. & Rosselli, M (2000). Corelation between intelligence test scores and executive function measures. Archives of Clinical Neuropsycoogy 15, 31-36. Bar Porte, 8 Ginns (2012), Cognitive traning fr children: fects on inductive reasoning, deductive reasoning ad mathematics achievement in an ‘usraian school setting Psychology nthe Schools #9, 828-842, Beiloc, SL Wireaga, . A & Cart, T-H, (2003) Memory and Expertise: wiat do experienced athletes remember? In Stakes, &Eresson (Eds) Expert, performance sports advances in research on sport expertise (pp. 295-320). Champaign IL: Human Kinetics, Bishop, D.V. M, Aamo Leeper, ., Creswell C, MeGutk, R, & Skuse, D.H. (2001). ndivdal differences in cognitive planning on the Tower of Hanoi task: neuropsychologica maturity or measurement reo? june! of Cid Psychology and Psychiatry, 42, 581-556, Burns.) (2015). The impact of intellectual disabilities on elite Sports performance. nternationl Review of Spar and Eeercise Psychology, (1) 1-17 (Chatbis,C, 8 Simons, D, (2010). The iavisible gorilla: and oer ways our intuition deceives us. New York: Crown, ‘Chase, W.C.,8 Simon, H.A, (1973) Perception in chess, Cogntive Psychology. 4, 85-81 Coen, (1988), tarsal pow analysts forthe behavioral sclonces (2nd ed) Hillsdale, NJ: Lawrence Ealbaum Associates {Corsi B M.(1072). Human memory and the medical Cemporal region of the brain, Disetarion Abstracts Intemational, 24(02), 8978, University Micros No AAIOS-77717. Culbertson, W.C. &Zillmer, EA (1998). The Tower of London: a standa ‘Neuropsyeoagy 13, 285-301 Deaty. LJ. Der, G. 8 Ford 6. (2001) Reaction times and intelligence diferences: a population-based coor stu. neligene, 28, 389-308, Der, 6. Deay, [J (2005) 10: reaction tine and the diffetentation hypothesis. ntetigence, 31, 41-503, insion,L, Csi. Van Biesen. D.& Daly. (2015, October). Performance evolution of athletes with ifelectualimpaitments in athetcs and ‘swimming over the lst decade: Paper presented atte VISTA meeting securing the future for young para-athletes of the Inremationl Paralympic Committe. Girona, Spain, George, D8 Maller. M. (2010), SPS Jor Windows step by step: a simple guide and reference. 170 update (1a ed). Boston: Pearson, Hartman, Houwen,S,Scherder _ & Visscher, (2010), On the relationship between motor performance and executive functioning in children with intelleciual disabilities. Journal of Inelecual Disability Research, 54, 463-477, Henry A, (2001) How does the severity ofa learning sail affect working memory performance? Memory, 4-0), 233-247, ‘nt doi. or! 010807096582 10042000085 International Paralympic Committe, (2007) IPC clssfiarion code and iternotional standards IPC: Bonn, Germany. 82 pp. Jobling, A (2012), The paalympic games, Interationalfournal of Disabil, Development and Education, 99, 225-228, Kasahara, 5, Mashiko, H & Niwa, 5-1 (2008), Superior pecformance in WAIS-R block design among top-level rugby players. Brits uma of Sports ‘Medicine 42, 932-533 Kaufinan, 5. B, DeYoung. Reis, D.L, Gray, R.(2011). General intelligence predicts reasoning ability even for evolutionarily familar content. Intelligence, 39, 311-322. Kioumourtzogiou, Deri, V, Tze, G, & Theodorakis,V. (1998) Cognitive, perceptual, and motor abilities in skilled basketball performance. Perceptual ‘and Motor Sls, 86, 71-786, lot.) M. Johnson, M’D. Wu, SW, Isaacs, K-M, & Gilbert. (201). Relationship between reaction time variability and motor skill developmeat in ‘ADHD. child Neuropsychology, 1-10, Kosinsk .J.(2013). literature review on Reaction time hitp:biae.clemson.edubpfbp/lb/110|reaction. Nem Retrieved 01.07.15 Kwon, . & Block, M(2012). Athletes with intellectual disabilities andthe Paralympics, Plaestra, 25. Le J. deChabris C.F (2013). General cognitive ability and the psychological refractory period individual differences in the mines bottleneck Dsychaogical Science, 24, 1226-1233. Lemay, S. Hear, M. Role. Temblay ,G, (2004), Practice elect an test-retest reliability of attentional and executive tests in micdle-aged ta elieriy subjects ihe Clinical Neuropsychoagit, 18, 284-302, Lezak M, (1905) Neuropsyholagca assessment (3d ed). New York: Oxford University Press. Mann, D-T.¥. William, AM, Ward P & Janelle, CM, (2007), Perceptual-cognitive expertise in sport: a meta-analysis fournalo port & Eerese Psychology, 29, 457-478, MeGirew, KS (2009) CHC theory and che human coat Inteligence, 37, 1-10, Nissan, |-Liewald.D_& Deary. 1} 2013) Reaction cime and intligence: comparing associations based on wo response modes. Intligence. 41622-0630. Pina), Peree-Tejero,). Van Biesen, D. & Vanladewigck ¥. (2015) Performance variabihty in basketball players with iatellectul impsitment: Ankara ‘World Championships 2013 analysis. Revista De Pscologia Del Deporte. 24(Suppl. 1), 77-83. ISSN 1132-239K Primi R. Ferro. M.E. & Almeida. L (2010) Fluid intelligence asa predictor of learning fongituinal mullevel approach applied to mathematics. ‘earng and Individual Dferences, 20, 446-451. hp aslo. ovy10.1016 ini.2010.05 001 Rainville, C. Amieva,H. Loot S. Dati. JF. Orgogozo | M.& FabrigouleC. (2002), Executive function in patients with dementia of the Alzheimer's type: 2 study witha Tower of London ask Archives of linia! Neuropsychology, 17, 513-530, Roy, M, Retz. A, &Sikabofot, T-(2013)- Personality development and intellectual disability. Current Opinion in Psychiatry, 28, 35-3, ‘Salthouse, T- (2008). Relations between cognitive abilities and measures of executive functioning Neuropsychology, 19,332-545, Schaleck RL, Borthwick-Dufly S.A. Bradley, V. J. Buntinx, W.H.E, Colter, D.L, Craig. P. Ma etal (2010) Inelectual disability, definition, cassifcaion ‘and syste of support (11th ed.) Washington, DC: AAIDD. ie approach to assessing executive functioning in children Archives of Clinical ve ables project: standing on the shoulders ofthe slants of psychometrie intelligence research,390 .Van Bese ea. j Research In Developmental Disab 53 (2016) 377-390 ‘Schneider, W.], & McGrew, K S.(2012). The Catell-Hoen-Carroll (CHC) mae of inteligence. In DP, Flanagan, & PL Harrison Eds), Contemporary Intellectual assessment Sa edn: roves, fess and ise (pp. 73-98) New York: Gulford Press, ‘Schrwetze.K: (20011 reattentive processing ad cognitive ability. imetigence. 22), 168. ‘Shale, . (1882). Spectc impairments of planning. Pilosophical Transactions ofthe Roya Society, Series B 298, 199-208. “Tweedy, SM, & Vanlandevifck¥. (2009), International Paralympic Committe postion stand—background and scientific rationale for classification in ?atalympic sport. Brits Journal of Sports Medicine, 43, 1067-1072 ‘Van Biesea,D. Mactavish,, Patty, N, & Vanlandewijck, (2012) Technical proficiency among table tenis players with and without intellectual ‘isaiities, Homan Movement Scene, 31, 1517-1528 ‘Van Besen,D. Mactavish. |. & Vanlandewijck, ¥.(2014).Tatcal proficiency among table tennis players with and without intellectual disabiites, European jourel of Spore Science, 14, 403-408 \Van de Fels, L MJ, te Wierik, S.C. M, Hartman, E, Elerik Gemser, M.T.E, Smith]. 8 Visscher, C (2014), The relationship between motor skills and ‘cognitive sls in 4-16 yen old typically developing children: s systematic review Journal af Science and Medicine n Spor, tpi doi or! 10.10%6))jsame2014,09007 \Vestberg, TM. Gustafson, R, Maurex,L, Ingvar, M.& Petrovi, P(2012) Executive functions predict the success of top-soecer players. PLoS Oe, 74), 24731. hip: /axado.ong/10.137 journal pone 0034731 ‘Voss, MW, Kramer, AF, Basak, C. Prakash, RS, & Roberts B(2010} Are exper athletes ‘expert in the cognitive laboratory? A meta-analytic review of Cognition and sport expertise Applied Cognitive Psychology, 24. 812-826. Wechsler, D.(2011} Wechsier abbreviated scle of inteligence® second eition (WAST) San Antonio, USA: Harcourt Assessment, Inc