You are on page 1of 16

Archives of Clinical Neuropsychology 00 (2020) 1–16

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


How Good Is the Phoneme Elision Test in Assessing Reading, Spelling
and Arithmetic-Related Abilities?
Drielle Barbosa-Pereira1, *, Pedro S. R. Martins1 , Amanda P. L. Guimarães2,3 , Emanuelle de O. Silva3 ,
Luana T. Batista2,3 , Vitor G. Haase1,2,3,4 , Júlia B. Lopes-Silva3,4
1
Postgraduate Program in Cognition and Behavior, Federal University of Minas Gerais, 31270-901 Belo Horizonte, Minas Gerais, Brazil
2
Postgraduate Program in Neuroscience, Federal University of Minas Gerais, 31270-901 Belo Horizonte, Minas Gerais, Brazil
3
Developmental Neuropsychology Laboratory, Department of Psychology, University of Minas Gerais, 31270-901 Belo Horizonte, Minas Gerais, Brazil
4
Department of Psychology, University of Minas Gerais, 31270-901 Belo Horizonte, Minas Gerais, Brazil
*Corresponding author at: Laboratory of Health Assessment and Intervention, Department of Psychology, Universidade Federal de
Minas Gerais, Avenida Antônio Carlos, 6627, 31270-901 Belo Horizonte, Minas Gerais, Brazil. Tel/Fax: +55-31-3409-3817.
E-mail address: dribarbosa20@gmail.com (D. Barbosa-Pereira)
Received 29 April 2019; revised 12 December 2019; Accepted 22 December 2019

Abstract
Objective: The aim of this study was to investigate the psychometric properties and diagnostic accuracy of phoneme elision
task (PET).
Method: We assessed cross-sectionally 470 Brazilian children (54.3% girls) aged between 7 and 11 years (mean age = 8.83,
sd = 0.85), from the 2nd to 4th grades. Children were assessed in their phonemic awareness ability, as well as intelligence,
general school achievement, both verbal and visuospatial working memory, single-word reading, and nonsymbolic magnitude
comparison. Beyond the psychometric properties and diagnostic accuracy of PET, we also provided reference values.
Results: Our data suggest that PET is composed mainly of one single construct, with high item reliability and precision (KR-20
above 0.90). In general, items have acceptable discriminability, considering item-total correlations. Overall PET is generally a
good screening tool for reading and spelling difficulties (SD), as well as to identify children with learning difficulties in the early
grades. However, it is not a reliable measure for screening math learning difficulties. Finally, PET shows good convergent and
divergent validity.
Conclusions: We provide evidence about the psychometric properties and diagnostic accuracy of a PET. Results contribute to
the assessment of phonemic awareness in Brazilian children, in both clinical and research contexts. The PET can be used as a
screening tool for reading and SD, which could lead to early interventions.

Keywords: Phonemic awareness; Phoneme elision; Learning skills; Spelling; Reading; Arithmetics

Introduction

Phonological processing abilities have been implicated in school learning in several ways. The term phonological processing
refers to a heterogeneous set of abilities related to accessing, discriminating, and manipulating phonological forms in short-term
memory (Wagner & Torgesen, 1987). Initially, research focused on phonological processing abilities as a correlate of visual word
decoding in alphabetic orthographies (Wagner &Torgesen, 1987). Evidence indicates that speed of access to the phonological
forms (Logan, Schatschneider, & Wagner, 2011), phonological working memory (Knoop-van Campen, Segers, & Verhoeven,

© The Author(s) 2020. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
doi:10.1093/arclin/acz085
2 Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16

2018), and phonemic awareness (Melby-Lervåg, Lyster, & Hulme, 2012; Hulme & Snowling, 2015) are important correlates,
and sometimes predictors, of learning to read words.
The phonemic level of representation has been implicated as crucial to visual word decoding. Processing at the phonemic
level is usually assessed with tasks of reading pronounceable nonexistent words (pseudowords) and phoneme manipulation tasks

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


(Wagner &Torgesen, 1987; Castles & Coltheart, 2004; Melby-Lervåg et al., 2012). One widely used phonemic awareness task
is the phoneme elision task (PET). In the PET, the participant is asked to pronounce a word after removing one of its constituent
phonemes. For example, deleting /k/ from “Crush” results in “rush.” The PET is a quite complex task. Performance on this
task requires the ability to analyze the word in the constituent phonemes, temporarily represent the information in short-term
memory, remove the target phoneme, and resynthesize the resulting phonological form.
Although some questions remain open, the importance of phonemic awareness for reading is well established. Some points
have been raised in recent decades: (a) the relevance of phonemic awareness is tied to the regularity or transparency of the
orthography, which is more important in highly irregular languages such as English than in more regular languages such as
German (Landerl et al., 2013); (b) phonemic awareness is more important in the early phases of learning to read in irregular
orthographies; later on, and in more regular orthographies, speed of phonological lexical access is more important (Bergmann &
Wimmer, 2008); (c) in nonalphabetic orthographies, morphemic awareness seems to be more important than phonemic awareness
(McBride-Chang, Shu, Zhou, Wat, & Wagner, 2003); (d) the relationship between phonemic awareness and learning to read
seems to be bidirectional, being both a prerequisite and a consequence (Castles &Coltheart, 2004); and (e) it is also difficult
to distinguish between the effects of conscious representations of phonemes (phonemic awareness) and their manipulation in
working memory (Lopes-Silva, Moura, Julio-Costa, Haase, & Wood,2014). Some shortcomings notwithstanding, phonemic
awareness tasks have been established as an important correlate and/or predictor of learning to read words and marker of
developmental dyslexia (Melby-Lervåg et al., 2012).
In recent years, researchers’ attention has been captured by the hypothesis that phonemic awareness could also play a role in
learning some aspects of arithmetic (De Smedt, Taylor, Archibald, & Ansari, 2010). Arithmetic is a complex domain comprising
both processing and operations with nonsymbolic (e.g., visual representations of set sizes) and symbolic (e.g., verbal and Arabic
numerals) (Dehaene, 1992, 2011) numerical representations. Phonological representations of number are involved in several
numerical processing and arithmetic tasks such as dictation of Arabic numbers (Barrouillet, Camos, Perruchet, & Seron, 2004;
Lopes-Silva et al., 2014), learning and rehearsing of arithmetic facts (De Smedt et al., 2010), and word problem solving (Vukovic
& Lesaux, 2013). Additionally, Lopes-Silva et al. (2016) observed that phonemic awareness is a cognitive ability shared between
learning to read and write both words and numbers.
This evidence suggests that phonemic awareness could also be an important correlate and/or predictor of arithmetic
achievement. In a longitudinal study, Hecht, Torgesen, Wagner, and Rashotte (2001) identified phonemic awareness as a predictor
of standardized math achievement. Additionally, arithmetic impairments in individuals with dyslexia are common in those tasks
requiring phonological processing such as numerical transcoding, arithmetic facts learning, and word problem solving (Jordan,
Hanich, & Kaplan, 2003). These considerations led Simmons and Singleton (2008) to propose the hypothesis that arithmetic
learning difficulties in individuals with dyslexia could be, at least partially, explained by phonemic representational deficits.
If this were the case, arithmetic learning difficulties in dyslexia could be related to at least two mechanisms: (a) phonemic
processing impairments (dyslexia-associated arithmetic difficulties) and (b) random co-occurrence of arithmetic learning
difficulties related to other factors, such as number sense impairments (real comorbidity between dyslexia and dyscalculia).
A possible role of phonemic awareness in math learning remains a relatively unexplored topic. Additionally, studies in Brazil
and English-speaking countries using PET have tested hypotheses regarding its role in literacy acquisition, focusing less on its
psychometric properties, such as item-level structural validity. The extant data indicate the need for more studies investigating
the role of phonemic awareness in arithmetic learning and, foremost, studies simultaneously comparing the role of phonemic
awareness in word reading and arithmetic learning. For this article, we investigated the validity and role of phonemic awareness,
assessed by a PET used in previous studies (Lopes-Silva et al., 2014, 2016), in learning word reading, word spelling, and
arithmetic. We investigated a large sample of 2nd to 4th graders, characterizing the structural validity and reliability of the PET,
its association with other sociodemographic and cognitive variables, and its accuracy as a single marker of word reading, word
spelling, and arithmetic learning difficulties. We hypothesized that our PET task will be composed by mainly one single latent
variable, with high reliability index. For diagnostic accuracy, we expect that PET will be better at identifying reading and spelling
than math difficulties. Regarding the correlations, we hypothesized that the linear association between PET and the verbal tasks
(reading and spelling) will be the highest. On the other hand, the correlation between PET and nonsymbolic numerical accuracy
is hypothesized to be the lowest. Finally, we expect that PET will be correlated with both Digit Span and Corsiblocks, and that
the latter correlation will be lower.
Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16 3

Materials and Methods

Participants

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


The initial sample was constituted by 583 children attending 2nd to 4th grades recruited from 10public primary schools in
Belo Horizonte, Brazil, assessed cross-sectionally between 2012 and 2017. Schools were invited, in a nonprobabilistic way, to
participate in a larger study whose objective was mapping abilities related to math and school achievement. The participation
in the study was voluntary, and it was conditioned to obtaining informed consent in written form from parents and orally from
children. In addition to consent, parents responded a sociodemographic questionnaire about their child. Twelve children were
excluded from the sample due to their performance on the Raven’s Coloured Progressive Matrices (CPM) less than 1sd below the
mean. Three children were older than 11 years, the CPM’s upper age range for which published norms are available. Ninety-eight
children did not complete the entire battery and were further excluded.

Procedure

All study procedures complied with the Helsinki principles of research for human subjects and were approved by the local
research ethics board (COEP-UFMG). The instruments were administered by psychology undergraduate and graduate students.
The PET was developed to assess phonemic awareness in the context of reading/writing and arithmetic learning disabilities
(Lopes-Silva et al., 2014, 2016). It was associated with both reading and writing of words and numbers on these comparable
samples. Nevertheless, it was not previously analyzed in terms of its psychometric properties.
Due to the large period of data collection, changes in the assessment protocol were made. These changes included updating
some norms and replacing the reading measure to a more comprehensive one. Therefore, as will be described in detail below, we
stratified our sample according to the reading test they performed. The initial protocol used the Brazilian School Achievement
Test (Teste do Desempenho Escolar—TDE) reading subtest during 2 years. Data collected between 2014 and 2017 used the
Single-Word Reading test (Leitura de PalavrasIsoladas—LPI), which was further included in the protocol due to its nonword
items that could be more informative regarding the subtypes of reading difficulties.

Instruments

Children were assessed at their schools. The tasks were administered in two steps: group assessment of school achievement
(math and spelling) and intelligence, followed by an individual neuropsychological assessment using the subsequent tasks. First,
we describe the Phoneme Elision Test. Then, we discuss the other tasks used.

Phoneme elision task. Phoneme elision tests are a widely accepted measure of phonemic awareness, considered to be one of
the best cognitive markers of single-word reading (Wagner & Torgesen, 1987; Castles & Coltheart, 2004; Melby-Lervåg et al.,
2012). The child hears a word pronounced by the examiner and then states which word would result if a specific phoneme was
deleted. The test comprises 28 items: in eight of them, the child must delete a vowel, and in the other 20, a consonant. The
consonants to be suppressed varied by place and manner of articulation. The phoneme to be suppressed could be in different
positions within the words, which ranged from two to three syllables. After the exclusion of the phoneme, the item became
another real word. For example: in Portuguese, “atLas” without /l/ gives “atas,”“perUa” without /u/ gives “pera,” etc. Similar
examples in English would be “Farm” without /f/ giving “arm” and “Cup” without /k/ giving “up.” The PET’s reliability is
presented in the results section.

Raven’s coloured progressive matrices. The CPM is a nonverbal test used to assess fluid intelligence (Carpenter, Just, & Shell,
1990, Raven, 2000). The Brazilian validated version was used (Angelini, Alves, Custódio, Duarte, & Duarte, 1999), and the
analyses were based on Z-scores calculated from the manual’s norms (Cronbach’s α = 0.82).
Brazilian School Achievement Test (Stein, 1994; Oliveira-Ferreira et al., 2012). The TDE is the most widely used standardized
test of school achievement in Brazil. Norms are available from the 1st to 6th grades. It comprises three subtests: Mathematics
(measuring arithmetic abilities), single-word Spelling, and single word Reading. The Mathematics subtest is composed of three
simple orally presented word problems (e.g., “which number is larger, 28 or 42?”) and 35 written arithmetic calculations
of increasing complexity (e.g., easy: “4–1 = ?”; intermediate: “1230 + 150 + 1620 = ?”; and hard: “823 × 96 = ?”;
“3/4 + 2/8 = ?”). The Mathematics subtest exclusively assesses arithmetic calculation abilities. The Spelling subtest consists
4 Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16

of dictation of 34 single words of increasing syllabic complexity (e.g., “toca,”“Balanço,” and “cristalização”). The single-word
Reading subtest of the TDE consists of 75 single-word stimuli, which must be read aloud by the participant. Only the Reading
subtest was assessed individually. Reliability coefficients (Cronbach’s α) of TDE subtests in our samples are 0.87 or higher.
Children are instructed to work on the problems to the best of their capacity, without time limits.

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


Digit span. This test requires that the child orally repeats a series of numbers, in forward and backward order. The Digit
Span task was used according to the Brazilian WISC-III subtest (Figueiredo, 2002). The forward order assesses phonological
short-term memory (Cronbach’s α = 0.57). And, the backward order (Cronbach’s α = 0.50) was used to measure phonological
working memory (Figueiredo & Nascimento, 2007). We calculated the total score (correct trials × span) for both orders of
application.

Corsi blocks. This test requires that children tap wood blocks in the same order as the administrator, in forward and backward
order. The forward order is used to assess visuospatial short-term memory (Cronbach’s α = 0.62) and the backward order
to assess visuospatial working memory (Cronbach’s α = 0.69), according to the procedures systematized by Kessels, van
Zandvoort, Postma, Kappelle, and de Haan (2000). We also calculated the total score (correct trials × span) for both orders
of application.
Single-Word Reading test (Salles, Piccolo, Zamo, & Toazza, 2013). The LPI was used to assess child single-word reading
ability. In the LPI task, the child must read a list of 60 single-presented stimuli, equally distributed into regular, irregular, and
pseudowords. Stimuli are presented individually over a blank background, using black Arial 24 font in a computer screen.
Real words vary according to psycholinguistic characteristics of regularity, frequency, and length. Words shorter than five
letters are considered disyllabic and those with six–eight letters are considered polysyllabic. Stimuli were selected according
to the frequency of occurrence of words in Brazilian early school textbooks (Pinheiro, 1996). Pseudowords are constructed
combining graphemes to form letter strings with no meaning, which obey phonotactic constraints of Brazilian Portuguese.
Internal consistency in our sample was good (α = 0.88).
Nonsymbolic magnitude comparison task (Pinheiro-Chagas et al., 2014). The nonsymbolic numerical magnitude comparison
task was used to examine the divergent validity of the PET. The nonsymbolic numerical magnitude comparison task assesses
the internal Weber fraction (w), a measure of the accuracy of nonsymbolic number representations. Internal Weber fraction
(w) has been associated with math achievement but is independent from symbolic forms of processing (Pinheiro-Chagas
et al., 2014, Schneider et al., 2017). In this task, the participants are instructed to compare two simultaneously presented sets of
dots, indicating which one contains the larger number. Black dots are presented on a white circle over a black background in
a computer screen. Stimuli were designed to avoid confusion between discrete and continuous dimensions of numerosity (see
Pinheiro-Chagas et al., 2014, for details). The task comprises 8 learning trials and 64 experimental trials. Maximum stimulus
presentation time is 4,000 ms, and intertrial interval is 700 ms. Before each trial, a fixation point appears on the screen—a cross,
printed in white, with 30 mm in each line. If the child judges that the right circle presents more dots, a predefined key on the right
side of the keyboard should be pressed with the right hand. On the contrary, if the child judges that the left circle contains more
dots, then a predefined key on the left side should be pressed with the left hand (Costa et al., 2011). As a measure of approximate
number system (ANS) acuity, the internal Weber fraction (w) is calculated for each child based on the Log-Gaussian model of
number representation (Dehaene & Cohen, 2007) with the methods described by Piazza, Izard, Pinel, Le Bihan, and Dehaene
(2004).

Statistical analyses

Four aspects of PET’s psychometric properties were examined: structural validity, internal consistency, criterion validity,
and convergent/divergent validity. To assess the structural validity of the task, we ran an exploratory factor analysis (EFA)
to determine the dimensionality of PET using Factor Analysis version 10.5.03 (Lorenzo-Seva & Ferrando, 2006, 2013). To
investigate the reliability, we calculated its internal consistency using the Kuder–Richardson Formula 20 (KR-20), since the
items were coded as dichotomous variables. Analyses of structural validity and internal consistency were conducted on the
whole sample of 470 children.
Criterion validity of the PET to identify specific learning difficulties was assessed by examining its association with two
different measures of single-word Reading, one measure of word Spelling and one of Mathematics. We subdivided the samples
according to the reading test they performed. In the TDE subsample, 202 children from the 2nd to 4th grades performed the TDE
Reading, Spelling, and Mathematics subtests. In the other, LPI subsample, 199 children from the 3rd to 4th grades performed LPI,
Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16 5

Table 1. Sociodemographic characteristics of the subsamples, according to analysis type


Analysis Subsample Grade N Sex (%Fem) Age in years Intelligence Z score PET accuracy
Mean (sd)

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


Association with age 2 99 50.50 8.00 (0.50) 0.89 (0.82) 18.55 (7.84)
and intelligence, 3 156 55.12 8.61 (0.76) 0.87 (0.76) 19.83 (6.40)
structural validity, and 4 215 55.34 9.37 (0.65) 0.91 (0.65) 20.62 (6.47)
internal consistency Total 470 54.30 8.83 (0.85) 0.89 (0.72) 19.92 (6.79)
Bivariate criterion TDE 2 99 50.50 8.00 (0.50) 0.89 (0.82) 18.55 (7.84)
validity 3 66 57.57 9.21 (0.51) 0.63 (0.66) 20.44 (6.08)
4 37 62.16 10.08 (0.64) 0.51 (0.61) 19.46 (7.44)
Total 202 55.00 8.78 (0.98) 0.74 (0.75) 19.33 (7.25)
LPI 3 88 52.27 8.17 (0.57) 1.06 (0.78) 19.53 (6.56)
4 111 49.54 9.06 (0.38) 0.96 (0.67) 20.04 (6.68)
Total 199 50.80 8.67 (0.65) 1.01 (0.72) 19.81 (6.61)
Convergent and TDE 2 77 50.64 8.04 (0.49) 0.97 (0.80) 19.47 (7.36)
divergent validity 3 61 55.73 9.23 (0.52) 0.67 (0.65) 20.70 (5.89)
4 34 64.70 10.06 (0.65) 0.48 (0.61) 19.68 (7.13)
Total 172 55.20 8.86 (0.96) 0.76 (0.74) 19.95 (6.81)
LPI 3 36 36.11 8.08 (0.55) 1.10 (0.76) 20.17 (6.82)
4 96 47.91 9.06 (0.31) 0.95 (0.62) 20.24 (6.68)
Total 132 44.69 8.80 (0.58) 0.99 (0.66) 20.22 (6.69)
Note: PET = phoneme elision task; TDE = subsample that responded to the Brazilian School Achievement Test; LPI = subsample that responded to the
Single-Word Reading test.

TDE Spelling, and Mathematics subtests. To assess the diagnostic accuracy of PET, each of the subsamples was subdivided into
two achievement groups: children with performance below the 25th percentile (poor achievers) and children with performance
at or above the 25th percentile (good achievers) on the school achievement measures. The accuracy of PET in discriminating
pairwise between the groups of poor and good achievers on each dependent variable was assessed using Receiver Operating
Characteristic (ROC) analyses, utilizing MedCalc version 18.11.
Convergent and divergent validities were assessed by exploring the patterns of association between the PET scores and other
variables using Pearson’s correlations. Sixty-seven children did not complete the following tasks: digit span, Corsi blocks, and
nonsymbolic magnitude comparison. The Weber fraction exceeded the limit of discrimination (w > 0.6 and R2 < 0.2) for five
other participants, and their data were excluded from the analyses. Data from the more comprehensive cognitive assessment
were available for 171 children who performed the TDE Reading and 132 children who performed the LPI as measures of
single-word Reading. With the exception of the EFA and ROC, all other analyses were conducted using SPSS 20.0.

Results

We first assessed associations between PET and sex, age, and intelligence. Results are then presented for each phase
of the validity assessment of PET, in the following order: structural validity, internal consistency, criterion validity, and
convergent/divergent validity. Sociodemographic characteristics of each subsample are presented in Table 1.
Four hundred and seventy children (54.3% girls) aged between 7 and 11 years that answered all items from the PET were
included in the analyses of association with age and intelligence and in the assessment of the structural validity and internal
consistency.

Association with sex, intelligence, and age/grade

There was no between sex difference in PET score t(468) = −0.87, p = 0.38, d = −0.08. PET had significant correlations
with intelligence (r = 0.36, p < 0.001), and small but significant correlations with age (r = 0.09, p < 0.05). In order to investigate
the effect of school grade in PET accuracy rate, we conducted an one-way between subjects ANOVA. There was a small but
significant effect of grade on PET accuracy rate, F(2, 467) = 3.209, p = 0.041, η2 = 0.014. Post hoc tests using Bonferroni’s
correction revealed significant differences in PET accuracy rate only between the 2nd and 4th grades (p < .05). Finally, there
was no significant difference of intelligence across school grades F(2, 467) = 0.144, p = 0.866, η2 = 0.00.
6 Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16

Table 2. Internal consistency of PET, item analysis, and factorial loading with one factor
Item number Stimulus Item-total correlation Cronbach’s alpha Phoneme to be Phoneme position Error rate Factor 1 Communality
item deleted suppressed

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


7 Molho 0.63 0.91 Consonant Beginning 0.20 0.85 0.91
12 Novo 0.62 0.91 Consonant Beginning 0.21 0.83 1.00
10 Gavião 0.61 0.91 Consonant Beginning 0.24 0.82 1.00
6 Filha 0.61 0.91 Consonant Beginning 0.25 0.81 1.00
20 tiPo 0.62 0.91 Consonant Middle 0.28 0.81 1.00
22 Vida 0.63 0.91 Consonant Beginning 0.28 0.81 0.93
25 Lema 0.63 0.91 Consonant Beginning 0.31 0.81 0.96
21 leGal 0.63 0.91 Consonant Middle 0.33 0.81 0.85
28 Dano 0.61 0.91 Consonant Beginning 0.28 0.80 1.00
17 cadeiRa 0.59 0.91 Consonant Middle 0.29 0.77 0.89
26 CHave 0.59 0.91 Consonant Beginning 0.30 0.77 0.94
5 Régua 0.59 0.91 Consonant Beginning 0.30 0.77 0.91
15 triBo 0.59 0.91 Consonant Middle 0.35 0.77 0.93
4 suJa 0.52 0.91 Consonant Middle 0.31 0.71 0.96
3 luTa 0.51 0.91 Consonant Middle 0.27 0.70 1.00
24 tEia 0.52 0.91 Vowel Middle 0.36 0.70 0.95
14 maRca 0.49 0.91 Consonant Middle 0.21 0.68 1.00
19 pLuma 0.45 0.91 Consonant Middle 0.50 0.62 0.81
23 viOla 0.41 0.91 Vowel Middle 0.16 0.61 0.96
9 magRo 0.46 0.91 Consonant Middle 0.39 0.61 0.78
13 cópIa 0.43 0.91 Vowel Middle 0.23 0.60 0.76
18 fEio 0.44 0.91 Vowel Middle 0.31 0.60 0.76
8 atLas 0.39 0.91 Consonant Middle 0.64 0.58 0.97
11 caUsa 0.37 0.91 Vowel Middle 0.17 0.54 0.92
2 boAte 0.36 0.91 Vowel Middle 0.20 0.51 0.67
1 perUa 0.37 0.92 Vowel Middle 0.45 0.50 0.64
27 Apreço 0.18 0.92 Vowel Beginning 0.12 0.32 0.85
16 cruZ 0.20 0.92 Consonant End 0.16 0.31 0.92
Note: PET = phoneme elision task.

Structural validity

An EFA was conducted to investigate the task internal structure. At first, we tested for sampling adequacy. The Kaiser-Meyer-
Olkin (KMO) test was high (0.945) and the Bartlett’s sphericity test was significant (p < 0.001). Since data were binary (0 or 1),
we used a tetrachoric correlation matrix. As the data did not follow a normal distribution, the extraction method
applied was Minimum Rank Factor Analysis. We decided to retain one factor, based on the parallel analysis (Timmerman &
Lorenzo-Seva, 2011). The employed software also provides indices for unistructural validity assessment (Ferrando & Lorenzo–
Seva, 2017). The UniCo (Unidimensional Congruence) was 0.952 (values should be higher than 0.95), ECV (Explained Common
Variance) was 0.882 (this should be larger than 0.85), and MIREAL (Mean of Item REsidual Absolute Loadings) was 0.208
(values should be lower than 0.300). This suggests that PET can be treated as an unidimensional task. Total variance explained
by one factor was 53.5%. The latent ability measured by this factor was labeled as “Phonemic Awareness.” Factorial loadings
were acceptable, varying from 0.311 to 0.845. Table 2 shows factorial loading and communalities for each item.

Reliability

A high internal consistency was revealed by the KR-20 formula (r = 0.915), when examining the whole sample. The high
internal consistency was further confirmed by a split-half analysis (r = 0.884). Items were separated according to the error rates
in the sample, in a way that each half had the same number of items and similar difficulty level (Table 2). Mean error rate for
consonants was 0.304, and mean error rate for vowels was 0.250. Phonemes in the middle of the word had a higher mean error
rate (0.320) than phonemes in the beginning of the word (0.249). Item 16 (“cruZ” without /s/ giving “cru”) was the only item
suppressing phonemes in the end of the word, and the error rate was relatively low (0.155). In general, item-total correlations
were acceptable, varying from 0.359 to 0.633. The exceptions were Item 27 (“Apreço” without /a/ giving “preço”) and Item 16
(“cruZ” without /s/ giving “cru”) with correlations of, respectively, 0.180 and 0.201 (Table 2).
Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16 7

Table 3. Mean scores and percentile ranks in PET according to school grade
Mean (sd) scores for PET

2nd grade 3rd grade 4th grade

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


Sample size 18.55 (7.83) 19.83 (6.40) 20.62 (6.47)
99 156 215

Percentile Total score


1 0 5 4
5 2 7 8
10 4 10 9
15 8 11 13
20 12 13 15
25 14 15 17
30 17 17 19
35 18 19 20
40 19 20 21
45 20 20 21
50 21 22 22
55 22 22 23
60 23 23 24
65 24 24 25
70 24 24 25
75 24 25 26
80 25 26 26
85 26 26 27
90 27 27 27
95 27 27 28
99 — 28 28
Note: PET = phoneme elision task.

Reference values

Table 3 shows PET percentiles relative to grades. As can be seen in Table 3, the rate of correct items increased along with
grade. Values for the 75th PR increased steadily at one point per grade from the 2nd to the 4th grade, approaching ceiling effect.
Even though the higher percentiles are no longer discriminative, the quantiles accurately differentiate among 2nd–4th grades.

Bivariate criterion validity

Accuracy. Criterion validity analyses were based on data obtained from 401 children (see Table 1). The dependent variable
for the diagnosis of word reading difficulties was the performance on the TDE Reading in 202 children from the 2nd to 4th
grades and the performance on the LPI in 199 children from the 3rd to 4th grades. Math and spelling achievement were assessed
with the TDE, and both were the dependent variable for the diagnostic accuracy of math and spelling learning difficulties in 401
children from 2nd to 4th grades.
To investigate in deeper detail the influence of PET on poor school achievement, a comparative analysis between good and
poor achievers was performed. Groups were divided using the 25th percentile cutoff for each school achievement measure.
Results of between-group comparisons regarding sociodemographic, as well as intelligence and memory measures, are reported
in Table 4.
To guide our interpretations of AUC values, we relied on the lower limit of the confidence interval. Taking this into account
could be a more cautious interpretation of the ROC values. As can be seen on Table 5, PET accuracy in identifying children
with reading learning difficulties (using the TDE 25th percentile cutoff) was moderate in 2nd grade and in 3rd grade. However,
using the 0.7 cutoff criterion (Swets, 1988), in the 4th grade, PET was less effective. In general, considering all grades, accuracy
was also moderate. Using the same cutoff criteria for LPI, accuracy was moderate for 3rd grade. Furthermore, it is possible to
observe that PET was more accurate to discriminate children with difficulties in irregular word than in regular or pseudoword
reading. In summary, PET is a good task to identify children with reading difficulties, but accuracy decreases over the years.
In addition, PET’s accuracy to identify children with mathematical difficulties (MD) was also tested through ROC analysis.
In addition, PET’s accuracy to identify children with MD was also tested through ROC analysis. The overall results suggest
8 Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16

Table 4. Sociodemographic characteristics and cognitive performance in subgroups according to reading, spelling, and mathematical abilities, and between
groups
LPI Subsample TDE reading subsample
Variables CG (N = 170) RD (N = 29) χ 2 df p CG (N = 156) RD (N = 46) χ 2 df p

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


Sex (females) 50% 55% 0.26 1.00 0.60 55% 55% 0.01 1.00 0.93
Grade—2nd - - 0.22 1.00 0.63 49% 50% 0.15 2.00 0.93
3rd 44% 48% 33% 30%
4th 56% 52% 18% 20%

Mean (sd) t df p Cohen’s d Mean (sd) t df p Cohen’s d

Age (years) 8.68 (0.64) 8.62 (0.67) 0.66 200.58 0.06 0.09 8.83 (1.02) 8.61 (0.77) −1.34 200.00 0.18 0.24
Intelligence (Zscore) 1.07 (0.69) 0.66 (0.82) 2.34 200.47 0.53 0.54 0.83 (0.72) 0.42 (0.76) −3.36 200.00 <0.00 0.56
Digit Span forward 31.16 (13.07) 26.93 (8.98) 0.55 200.41 0.76 0.38 31.29 (10.79) 28.70 (13.26) −1.36 200.00 0.18 0.21
Digit Span backward 13.49 (7.62) 9.24 (5.01) 3.44 200.92 <0.00 0.66 13.63 (7.32) 9.78 (4.56) −4.31 119.43 <0.00 0.63
F p η2 p F p η2 p
PET 20.87 (6.12) 13.62 (6.04) 38.72 <0.00 0.16 21.29 (6.32) 12.67 (6.19) 46.30 <0.001 0.19
TDE spelling subsample TDE mathematics subsample
Variables CG (N = 307) sd (N = 94) χ2 df p CG (N = 310) MD (N = 91) χ 2 df p
Sex (females) 54% 50% 0.41 1.00 0.52 53% 52% 0.07 1.00 0.79
Grade—2nd 25% 25% 0.00 2.00 1.00 25% 25% 0.19 2.00 0.89
3rd 38% 38% 38% 38%
4th 37% 37% 37% 37%

Mean (sd) t df p Cohen’s d Mean (sd) t df p Cohen’s d

Age (years) 8.76 (0.86) 8.62 (0.7) −1.42 399.00 0.16 0.18 8.79 (0.83) 8.48 (0.79) −3.16 399.00 <0.00 0.38
Intelligence (Z score) 0.97 (0.72) 0.56 (0.75) −4.81 399.00 <0.00 0.56 0.93 (0.73) 0.68 (0.79) −2.81 399.00 <0.01 0.33
Digit Span forward 31.78 (12.87) 26.85 (7.42) −4.64 272.99 <0.00 0.47 31.96 (12.64) 26.07 (7.98) −4.21 399.00 <0.00 0.56
Digit Span backward 13.71 (7.55) 9.86 (4.90) −5.80 239.14 <0.00 0.61 13.42 (7.10) 10.74 (7.20) −3.16 399.00 <0.01 0.38
F p η2 p F p η2 p
PET 21.52 (5.7) 13.22 (6.86) 91.15 <0.00 0.19 20.78 (6.16) 15.46 (7.85) 24.59 <0.00 0.06
Note: PET = phoneme elision task; CG = control group; RD = reading difficulties; MD = mathematical difficulties; SD = spelling difficulties. Digit Span
forward and backward: total score; TDE = subsample that responded to the Brazilian School Achievement Test; LPI = subsample that responded to the Single-
Word Reading test.

that PET was not accurate for identifying mathematics difficulties in 2nd–4th grades. Finally, diagnostic power for Spelling
difficulties (SD) was inspected. Analyzing specificity and sensibility rates as well as the AUC, PET can be considered efficient
to identify poor achievers in Spelling.

Association with other cognitive variables. To carry out the convergent and divergent validity analysis, we conducted Pearson’s
correlations between PET and the following variables: intelligence, phonological short-term memory, verbal working memory,
visuospatial short-term memory, visuospatial working memory, academic performance, and nonsymbolic numerical accuracy
(Weber fraction). Due to missing data, a pairwise deletion was used. The total n for each correlation is presented in Table 6. PET
correlated weakly with intelligence, verbal and visuospatial short-term memory, and verbal and visuospatial working memory.
The correlations with academic performance were moderate. The correlation between PET and nonsymbolic numerical accuracy
was virtually null. All results are available in Table 6.

Discussion

We investigated the psychometric properties of a phonemic awareness task, the PET, in the assessment of school learning
difficulties for the present study. In total, we investigated 470 children from the 2nd to 4th grades. Our results indicated that
performance did not differ according to sex. Better performance was observed for older children, with a higher degree of
schooling. Regarding structural validity, an EFA indicated that PET is composed mainly of one single construct, with high
item reliability and precision (KR-20 above 0.90). In general, items have acceptable discriminability, considering item-total
correlations. We also presented reference values for PET, which are highly useful considering there are few open access phonemic
awareness tasks. Through ROC analysis, we found that PET is generally a good screening tool for reading and SD. As a single
instrument, PET is not a reliable measure for screening math learning difficulties. Our results also indicate that PET was better
Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16 9

Table 5. PET diagnostic power for each reading measure, math, and spelling achievement
Dependent variable Grade N AUC Std. error p AUC confidence interval (95%) Cutoff Spec. Sens.

Lower Upper

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


LPI 3 74 (14) 0.84 0.05 <0.001 0.75 0.91 ≤20 64.90 92.90
4 96 (15) 0.79 0.05 <0.001 0.70 0.86 ≤18 71.90 73.30
Total 170 (29) 0.81 0.04 <0.001 0.74 0.88 ≤20 63.50 86.20
LPI regular words 3 78 (10) 0.80 0.07 <0.001 0.70 0.88 ≤20 61.50 90.00
4 102 (9) 0.76 0.07 0.011 0.66 0.83 ≤23 44.10 100.00
Total 180 (19) 0.78 0.05 <0.001 0.72 0.84 ≤20 60.56 84.21
LPI irregular words 3 73 (15) 0.80 0.06 <0.001 0.70 0.88 ≤15 79.50 73.30
4 94 (17) 0.86 0.04 <0.001 0.78 0.92 ≤20 66.00 94.10
Total 167 (32) 0.84 0.03 <0.001 0.78 0.88 ≤20 65.27 90.62
LPI pseudowords 3 72 (16) 0.75 0.06 <0.001 0.65 0.84 ≤20 63.90 81.20
4 93 (18) 0.74 0.05 <0.001 0.65 0.82 ≤22 53.80 94.40
Total 167 (32) 0.75 0.04 <0.001 0.68 0.81 ≤22 52.12 88.24
TDE reading 2 76 (23) 0.86 0.04 <0.001 0.78 0.92 ≤20 69.74 95.65
3 52 (14) 0.82 0.05 <0.001 0.71 0.91 ≤18 78.85 85.71
4 28 (9) 0.84 0.07 <0.001 0.68 0.94 ≤18 82.14 88.89
Total 156 (46) 0.85 0.03 <0.001 0.79 0.90 ≤20 68.59 91.30
TDE spelling 2 76 (23) 0.85 0.05 <0.001 0.77 0.92 ≤14 89.47 78.26
3 118 (36) 0.82 0.04 <0.001 0.75 0.87 ≤18 77.97 75.00
4 113 (35) 0.81 0.04 <0.001 0.74 0.87 ≤20 69.03 82.86
Total 307 (94) 0.82 0.02 <0.001 0.78 0.86 ≤18 77.52 74.47
TDE mathematics 2 77 (22) 0.73 0.07 <0.001 0.63 0.81 ≤9 90.91 45.45
3 119 (35) 0.67 0.05 <0.010 0.59 0.74 ≤23 46.22 82.86
4 114 (34) 0.74 0.05 <0.001 0.66 0.81 ≤21 57.89 76.47
Total 310 (91) 0.71 0.03 <0.001 0.66 0.75 ≤23 45.81 84.62
Note: Number in brackets represents children with learning difficulties. AUC = area under the curve; PET = phoneme elision task; Spec. = specificity; Sens. =
sensitivity; TDE = subsample that responded to the Brazilian School Achievement Test; LPI = subsample that responded to the Single-Word Reading test.

to identify children with learning difficulties in the early grades. PET also exhibited good divergent validity, since it had a
very small correlation with markers of presumably unrelated cognitive processes, such as nonsymbolic numerical magnitude
processing accuracy. In addition, PET performance was significantly associated with all cognitive and achievement measures
relevant for literacy acquisition. We discuss these results in further detail in the next sections.

Sex differences

No sex differences were observed regarding PET performance (d = 0.08). This result contrasts with a body of literature
indicating the superiority of girls in tasks related to visual decoding, spelling of words, and associated cognitive markers
(Stoet & Geary, 2013). Several reasons may explain this discrepancy. The phonological segment to be discriminated could
be implicated. Studies differ widely in the measures employed. Some studies investigate sex differences at the phonemic level
(Below, Skinner, Fearrington, & Sorrell, 2010; Chipere, 2014; Lundberg, Larsman, & Strid, 2012), and still others use composite
measures (Wilsenach & Makaure, 2018). Results of this literature are not always consistent (Moura, Mezzomo, & Cielo, 2009).
To the best of our knowledge, there are no meta-analyses of the specific role played by the phonemic level in sex differences in
reading/spelling. Studies also differ widely in scope, sample size, and sampling procedures. Most studies work with small, highly
selected samples, using a quasi-experimental approach. Our approach to sampling was different, as our study is demographically
based. We assessed kids from 10 schools. Although the sample size used is relatively large, effect sizes for sex differences are
usually small. Therefore, sample size could still be insufficient to observe reliable sex differences in the expected direction in a
demographically based sample.

General cognitive abilities and PET

We found a small but significant correlation between PET and general cognitive abilities assessed by the Raven’s CPM (r
∼ 0.30). This is consistent with current knowledge. In general, intelligence is a weak but significant predictor of acquisition
of visual word decoding skills and a stronger predictor of reading comprehension (Shatil & Share, 2003). In their predictive
study, Shatil and Share showed that intelligence played a larger role in explaining reading comprehension (around 44% of
10 Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16

Table 6. Correlations for convergent and divergent validity for each subsample
Task PET
Raven 0.36∗∗

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


n 470
TDE reading 0.57∗∗
n 202
LPI regular 0.39∗∗
n 199
LPI irregular 0.55∗∗
n 199
LPI pseudowords 0.48∗∗
n 199
LPI total 0.55∗∗
n 199
TDE spelling 0.59∗∗
n 470
TDE mathematics 0.42∗∗
n 470
Digit Span forward 0.24∗∗
n 402
Digit Span backward 0.35∗∗
n 402
Corsi blocks forward 0.18∗∗
n 382
Corsi blocks backward 0.29∗∗
n 382
Weber 0.02
n 367
Note: ∗p < 0.05, ∗∗p < 0.01; TDE = Brazilian School Achievement Test; LPI = Single-Word Reading test; PET = phoneme elision task.

variance) than single-word reading (around 5% of variance). The strength of correlations between phonological awareness and
intelligence observed in the literature varies widely (from to 0.20 to 0.50; Colé et al., 2018; Wolff, 2011). These differences
could be attributed to methodological differences such as design, measures, and sampling.

Schooling effects

Schooling experience was an important associate of PET performance. Group difference analyses indicated significant
differences between the 2nd and 4th grades. This difference cannot be attributed merely to age, as the correlation between
age and PET was virtually null (r = 0.09). The schooling effect on phoneme elision is in accordance with the hypotheses
of reciprocal causal relationships between phonological awareness and learning to read in an alphabetic system (Castles &
Coltheart, 2004; Melby-Lervåg et al., 2012). PET was accurate in diagnosing children with reading learning difficulties in the
2nd and 3rd grades, but not in the 4th grade, suggesting that its diagnostic accuracy decreases as children acquire experience
with reading in a regular orthography.
Phonological awareness typically develops very quickly as literacy instruction begins (Anthony & Francis, 2005), especially
due to a reciprocal causality effect (Castles & Coltheart, 2004). It is interesting to note that learning to read has an impact on
the performance of phonological awareness, although less so on the other subcomponents of phonological processing, namely
phonological short-term memory and lexical access (Torgesen, Wagne, & Rashotte, 1994). According to Anthony and Francis
(2005), the transparency of the orthography influences the rate of development of phonological awareness after children enter
primary school. For example, in their first year of schooling, German children develop phoneme awareness more quickly than
English children do.
Reviewing the Brazilian Portuguese spelling code, Scliar-Cabral (2003) states that it can be considered a rather transparent
orthography, even though some argue that its transparency is more pronounced in reading than in spelling (Parente, Silveira, &
Lecours, 1997). Capovilla, Dias, and Montiel (2007) analyzed the development of different phonological awareness components
in Brazilian elementary school children; and consistent with our findings, they reported that children’s performance increased
from the 1st to 2nd grades, and from the 2nd to 3rd grades; however, it did not significantly increase from the 3rd to 4th grades.
Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16 11

Diagnostic accuracy

It was also observed, using a series of ROC analyses, that PET was better at identifying reading learning difficulties in the
earlier grades. Sensitivity (true positive rates) in the earlier grades varied from 73% to 95%, which is acceptable (Glover &

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


Albers, 2007; Johnson, Jenkins, Petscher, & Catts, 2009). Interestingly, PET was better at identifying difficulties in irregular
word reading, suggesting that children were still reading irregular words through grapheme-phoneme decoding, and not from
lexical retrieval, which would be expected for these words.
Greater difficulty with irregular over regular and pseudowords is usually attributed to the characteristics of the orthography.
For example, Landerl et al. (2013) argue that phonemic awareness relevance is higher in orthographies with at least medium
complexity, rather than in orthographies with lower complexity. Spencer and Hanley (2003) also highlight that children whose
first language is regular or transparent, such as Spanish and German, usually have better phonemic awareness-related skills
than children whose first language is opaquer, such as English. In addition, pseudoword reading seems to be more accurate in
more shallow orthographies. Ziegler et al. (2010) suggest that phonological awareness might be a weaker predictor of reading
development in transparent than in opaque orthographies, in which rapid automatized naming might be a stronger predictor.
Even though Brazilian Portuguese can be considered a rather transparent orthography, there are irregular graphemes, such as
“e,” “o,” and “x” that could represent more than one phoneme /e/ / e/, / ε/; / / /u/ / /; /S/ /z / /ks/, creating irregular words in the
reading direction (Parente, Silveira, & Lecours, 1997). Another possibility is that this association of phoneme awareness and
irregular word reading could reflect the lack of reading experience in our participants, i.e., their reading proficiency may not
have reached the level of development that the orthographic lexicon requires to decode irregular words.
PET was also useful in identifying children with SD. Furnes and Samuelsson (2010) observed similar results regarding the
relationship between phonemic awareness and identification of SD, considering children whose first languages were English and
Scandinavian (Norwegian and Swedish). Their longitudinal results suggest that lower scores in phonemic awareness increase
the chance of the child being allocated to the SD group. More specifically, measures of phonemic awareness in Kindergarten
predicted SD in the 1st and 2nd grades. Nevertheless, two considerations should be taken into account: (a) their phonemic
awareness score was a composite of six tasks: syllable and phoneme blending; word, syllable and phoneme elision; sound
matching, from the Comprehensive Test of Phonological Processes (Wagner, Torgesen, & Rashotte, 1999); rhyme and final
phoneme matching; and a phoneme identity training test, requiring children to identify initial and final phonemes; and (b)
the authors did not use ROC analyses to investigate the phonemic awareness’ discrimination power; AUC, specificity, and
sensitivity were not available. It stands out that, at the end of 2nd grade, phonemic awareness was the only significant associate
of the allocation to the SD group for the Scandinavian children. None of the other variables such as letter knowledge, rapid
automatized naming, verbal memory, and syntactic and semantic skills were significant markers in identifying SD.
According to Plaza and Cohen (2004), who also found an association between phonological awareness and spelling in the
2nd grade, a possible explanation for the predictive power of phoneme elision is that this task reflects grapheme-phoneme
correspondence knowledge. In order to perform a PET, one needs to encode and hold phonological information in phonological
working memory, access phonemic units, manipulate them (segmentation, elision, and assembly), and articulate a new word.
This is similar to the process needed to encode a dictated word in order to spell it. In addition, it is important to note that
orthographic information intrudes on the performance of phonological awareness tasks (Landerl, Frith, &Wimmer, 1996) and
spelling level is an indicator of children’s knowledge of orthographic patterns. According to Wimmer and Mayringer (2002),
children with a spelling deficit present poor phonological short-term memory and phonological awareness in the school entrance
assessment.
In contrast, general AUC values were not acceptable for math difficulties. Lack of sensitivity in detecting math learning
difficulties could be expected, as the cognitive correlates of math and reading only partially overlap (Lopes-Silva et al., 2016).
This will be discussed in Phonemic awareness and arithmetic.

Phonemic awareness and arithmetic

According to Dehaene (2011, see also Arsalidou, Pawliw-Levac, Sadeghi, & Pascual-Leone, 2018, Peters & De Smedt,
2018), arithmetic and numerical processing embrace three types of magnitude representation: (a) the analogue system, related
to number sense, notion of numerical quantity, and estimation capacity; (b) the Arabic system, required in the execution of
calculations involving digits; and (c) the verbal system, associated with performance in exact calculations and problems presented
verbally. Tasks involving reading and mathematical skills that rely on the verbal system, such as counting, transcoding, retrieval
of arithmetic facts, and word problems activate largely overlapping regions in the left angular gyrus (De Smedt et al., 2010;
Simmons & Singleton, 2008, Peters & De Smedt, 2018). In previous reports, an association was detected between PET and
verbal to Arabic and vice-versa numerical transcoding tasks (Lopes-Silva et al., 2014, 2016). Thus, phonological processing
12 Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16

should be associated only with the MD profile involving verbal aspects, which require converting the terms into a verbal code,
processing this phonological information and retrieving a long-term memory response. It is important to underscore that the math
achievement task used, the TDE, does not include specific measures of numerical transcoding, relying heavily on calculation
abilities.

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


Despite the large association between reading and math difficulties, they do not always co-occur. This suggests both shared
and nonshared cognitive underpinnings (Butterworth, 2005; Landerl, Bevan, & Butterworth, 2004; Wilson &Dehaene, 2007,
Peters & De Smedt, 2018). Multivariate classification studies have called attention to the heterogeneous nature of math learning
difficulties, which may be associated to different underlying cognitive mechanisms (Salvador, Moura, Wood, & Haase, 2019).
PET could be useful in detecting math difficulties related to impairments in processing the symbolic, but not the nonsymbolic,
numerical code.

Structural validity

To assess the structural validity of the task, we conducted EFA. In the present study, we followed the guidelines proposed
by Izquierdo, Olea, and Abad (2014). We did not base our decision on principal component analysis. The number of factors to
be extracted was based on more than one procedure. PET had two items with relative low factor loadings (items 16 and 27).
However, according to Hair, Black, Babin, and Anderson (2014), the sample size needed to accept a factorial loading of 0.3 is
at least 350. Since our sample for EFA was higher, we could accept items 16 and 27 in the final model. Those items also had
the lower item-total correlation, indicating that they could be somewhat problematic. Item 16 (cruZ) is the only one requiring
a deletion at the end of the word, so the low correlation could indicate that more items with this configuration are needed. The
singularity of Item 27 (Apreço) is that it is the only item requiring a vowel to be suppressed at the beginning of the word. In
addition to that, Item 27 was the easiest item (error-rate = 0.12), so its low difficulty could explain the lower factorial loading.
On the other hand, Item 16 (cruZ) difficulty is similar to Item 23 (viOla). However, Item 23 presented a higher factorial loading
that was almost two times greater than that of Item 16. This could be due to the fact that other items also demand the deletion
of an internal vowel. Even though we found only one factor, we cannot definitely rule out that other confounding factors are
included in the final model.
Phonemic awareness tasks are complex and require other accessory skills, such as working memory and lexical retrieval.
Consequently, to acquire a “true phonemic awareness score,” many other tasks must be included and many other task features
must be controlled for (see Cunningham, Witton, Talcott, Burgess, & Shapiro, 2015 for a complete discussion about the
complexity of phonemic awareness tasks). Both split-half correlation and KR-20 indicated excellent reliability indexes. Other
studies have found that PETs seem to be consistent measures with high reliability (Lervåg, Bråten, & Hulme, 2009; Poulsen,
Nielsen, Juul, & Elbro, 2017).
It is noteworthy to highlight that PET has been overwhelmingly used in experimental and quasi-experimental investigations.
With the exception of a handful of tests available in English (Wagner, Torgesen, Rashotte, & Pearson, 2013, Gibbs & Bodman,
2014; Schrank, Mather, & McGrew, 2014), studies usually do not focus on the psychometric properties of this task. This is
especially true of the few Brazilian Portuguese phonemic awareness tasks (Godoy, Fortunato, & Paiano, 2014 and Godoy &
Cogo-Moreira, 2015 for a complete revision). Therefore, in that sense, the present study is important, since it presents a task with
rigorous psychometric analysis to investigate PET’s structural validity that can be used by Brazilian researchers and clinicians.

Convergent and divergent validity

Our results indicate a significant association between PET and measures of short-term and working memory in the
phonological (Digit Span) and visuospatial (Corsi blocks) domains. Scores in the forward order are considered indexes of short-
term storing, and scores in the backward order are considered the indexes of executive functions. Our data clearly point to the
fact that PET demands both simple storing and more complex executive functioning resources in the phonological domain,
as well as executive functioning in the visuospatial domain. However, the correlations were higher for the working memory
tasks, indicating that the executive function component may have a more important role. This can be explained by the complex
relationships between phonological awareness and working memory (Knoop-van Campen et al., 2018). According to the degree
of automatizing, different composites of those cognitive resources may be required. Demands for executive functioning resources
are reduced as the child acquires experience with word reading (Altemeier, Abbott, & Berninger, 2008). Therefore, at the
beginning of reading development or in dyslexia cases, a task that requires the manipulation of phonemes may demand more of
the central executive, in comparison to tasks requiring only the retention of verbal codes. This could explain the high correlation
with working memory found in our results.
Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16 13

Our results also point to a significant correlation between PET and school achievement tasks such as TDE Reading, Spelling,
and Arithmetic. This indicates that the psychological processes evaluated by PET partially share variance with those constructs,
evaluated by each of these achievement tasks. Phonological awareness is one of the cognitive aspects most related to reading
ability, being considered a strong predictor for the development of this ability (Melby-Lervåg et al., 2012; Ziegler et al., 2010).

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


PET also correlated with TDE Spelling achievement. This also indicates that phonemic awareness and orthographic
performance may share variance. Studies have shown that phonemic awareness is a primordial ability for the development of
orthographic skills and, consequently, literacy (Ziegler et al., 2010; Hulme, Bowyer-Crane, Carroll, Duff, & Snowling, 2012).
Lopes-Silva et al. (2016) investigated the cognitive mechanisms associated with writing and reading words and numbers in 172
Brazilian children, from the 2nd to 4th grades. Results showed that phonemic awareness was the only cognitive variable that
was systematically able to associate with both reading and writing of numbers and words.
Significant associations were observed between PET and TDE Arithmetic performance; PET differed significantly among
groups of school achievement. This is consistent with the hypothesis that phonemic awareness and some aspects of arith-
metic performance share variance. However, the variance overlap between phonemic awareness and arithmetic perfor-
mance is not strong enough to accurately discriminate arithmetic achievement with PET, as indicated by the ROC analysis
results.
There were no significant correlations between a measure of ANS accuracy, the internal Weber fraction (w), and PET.
Therefore, the absence of correlation with the accuracy of nonsymbolic numerical magnitude representations suggests that PET
is more associated with the symbolic aspects of mathematics. This result supports the hypothesis that PET does not evaluate
cognitive domains only indirectly related to reading/spelling acquisition.

Final remarks

The present study provides evidence about the psychometric properties and diagnostic accuracy of PET. Results contribute
to the assessment of phonemic awareness in Brazilian children, in both clinical and research contexts. It is noteworthy that,
regardless of our efforts, some questions remain open.
An aspect that needs to be further addressed is the specific influence of phonemic awareness on numerical cognition. Which
aspects of numerical processing are more related to phonological processing? In earlier research, Lopes-Silva et al. (2016) found
an association between phonemic awareness and transcoding-related abilities. However, in the present study, we did not assess
any measure of more basic number processing, such as number reading or writing. Nevertheless, it is important to note that there
was some statistically significant shared variance between phonemic awareness and mathematical skills. Furthermore, phonemic
awareness can be thought of as a marker for very specific difficulties, such as arithmetical facts (De Smedt et al., 2010; Peters
& De Smedt, 2018) and number transcoding (Lopes-Silva et al., 2014, 2016).
However, three limitations of the study should be considered: at first, the predictive diagnostic power of phonemic awareness
on learning difficulties cannot be fully investigated in a cross-sectional design. Future studies should adopt longitudinal designs
to investigate the predictive power of phonemic awareness on reading and spelling abilities and on basic number processing
skills. Longitudinal studies, as well as controlled intervention studies, are necessary in order to investigate possible causal
mechanisms, especially due to the reciprocal relationship between phonemic awareness and reading performance (Castles &
Coltheart, 2004).
Second, the interplay between working memory and phonemic awareness must be considered. The PET suffers a large
influence from working memory (Lopes-Silva et al., 2014, 2016), and it is difficult to assess phonemic awareness in school-aged
children with a measure that does not also rely on working memory.
At last, another limitation is sample stratification, which reduces the statistical power of the analysis. Besides that, our results
are in line with major theoretical assumptions about the association between phonemic awareness and reading and spelling skills.
Nevertheless, this study is significant, considering the psychometric properties and diagnostic accuracy of the PET. This task
may contribute to the assessment of phonemic awareness, in both the clinical and research contexts. Phonemic awareness is
an important underlying correlates of learning disabilities. There are neither many tasks available nor studies investigating its
structural validity.
This study further contributes to the literature on reading and spelling as well as their cognitive correlates in a relatively
transparent orthography. This is especially relevant due to the Anglocentrism that characterizes reading research (Share, 2008).
Spelling systems other than English should be investigated in order to compare whether English-language findings can be
transposed to transparent orthographies.
Finally, this study provides evidence that phonemic awareness is more strongly associated with learning difficulties in the
earlier grades. Furthermore, our PET can be used as a screening tool for reading and SD, which could lead to early interventions.
14 Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16

Funding

This work was supported by grants from the Fundação de AmparoàPesquisa do Estado de Minas Gerais (FAPEMIG, APQ-
02755-SHA, APQ-03289-10, APQ-02953-14, APQ-03642-12). VGH is supported by a CNPq fellowship (ConselhoNacional de

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


DesenvolvimentoCientífico e Tecnológico, 409624/2006–3, 308157/2011–7, 308267/2014–1) and Programa de Capacitaçãoem-
NeuropsicologiadoDesenvolvimento (FEAPAEs-MG, APAE-BH, PRONAS-Ministério da Saúde, Brasil). VGH participates
in the INCT-ECCE, which is supported by the following grants: FAPESP: 2014/50909–8, CNPQ: 465686/2014–1, CAPES:
88887.136407/2017–00. MRSC is supported by a CNPq fellowship (312068/2015–8).

Conflict of Interest

None declared.

References

Altemeier, L. E., Abbott, R. D., & Berninger, V. W. (2008). Executive functions for reading and writing in typical literacy development and dyslexia. Journal
of Clinical and Experimental Neuropsychology, 30(5), 588–606. doi: 10.1080/13803390701562818.
Angelini, A. L., Alves, I. C. B., Custódio, E. M., Duarte, W. F., &Duarte, J. L. M. (1999). Manual matrizesprogressivascoloridas de Raven: escala
especial[Manual Raven Color Progressive Matrices: Special Scale]. São Paulo: Centro Editor de Testes e PesquisasemPsicologia.
Anthony, J. L., & Francis, D. J. (2005). Development of phonological awareness. Current Directions in Psychological Science, 14(5), 255–259. doi:
10.1111/j.0963-7214.2005.00376.x.
Arsalidou, M., Pawliw-Levac, M., Sadeghi, M., & Pascual-Leone, J. (2018). Brain areas associated with numbers and calculations in children: Meta-analyses
of fMRI studies. Developmental Cognitive Neuroscience, 30, 239–250. doi: 10.1016/j.dcn.2017.08.002.
Barrouillet, P., Camos, V., Perruchet, P., & Seron, X. (2004). ADAPT: A developmental, asemantic, and procedural model for transcoding from verbal to Arabic
numerals. Psychological Review, 111(2), 368–394. doi: 10.1037/0033-295X.111.2.368.
Below, J. L., Skinner, C. H., Fearrington, J. Y., & Sorrell, C. A. (2010). Gender differences in early literacy: Analysis of kindergarten
through fifth-grade dynamic indicators of basic early literacy skills probes. School Psychology Review, 39(2), 240–257. Retrieved from.
https://www.researchgate.net/profile/Christopher_Skinner/publication/282367155_Gender_Differences_in_Early_Literacy_Analysis_of_Kindergarten_
through_Fifth-Grade_Dynamic_Indicators_of_Basic_Early_Literacy_Skills_Probes/links/560eecfa08ae0fc513eeb34d/Gender.
Bergmann, J., & Wimmer, H. (2008). A dual-route perspective on poor reading in a regular orthography: Evidence from phonological and orthographic lexical
decisions. Cognitive Neuropsychology, 25(5), 653–676. doi: 10.1080/02643290802221404.
Butterworth, B. (2005). The development of arithmetical abilities. Journal of Child Psychology and Psychiatry, 46(1), 3–18. doi:
10.1111/j.1469-7610.2004.00374.x.
Capovilla, A. G. S., Dias, N. M., & Montiel, J. M. (2007). Desenvolvimento dos componentes da consciênciafonológica no ensino fundamental e correlação
com nota escolar. Psico-USF, 12(1), 55–64.
Carpenter, P. A., Just, M. A., & Shell, P. (1990). What one intelligence test measures: A theoretical account of the processing in the Raven Progressive Matrices
Test. Psychological Review, 97(3), 404–431. doi: 10.1037/0033-295X.97.3.404.
Castles, A., & Coltheart, M. (2004). Is there a causal link from phonological awareness to success in learning to read? Cognition, 91(1), 77–111. doi:
10.1016/S0010-0277(03)00164-1.
Chipere, N. (2014). Sex differences in phonological awareness and reading ability. Language Awareness, 23(3), 275–289. doi: 10.1080/09658416.2013.774007.
Colé, P., Cavalli, E., Duncan, L. G., Theurel, A., Gentaz, E., Sprenger-Charolles, L. et al. (2018). What is the influence of morphological knowledge in the early
stages of reading acquisition among low SES children?A Graphical Modeling Approach. Frontiers in Psychology, 9, 547. doi: 10.3389/fpsyg.2018.00547.
Costa, A. J., Silva, J. B. L., Pinheiro-Chagas, P., Krinzinger, H., Lonnemann, J., Willmes, K. et al. (2011). A hand full of numbers: A role for offloading in
arithmetics learning? Frontiers in Psychology, 2, 368. doi: 10.3389/fpsyg.2011.00368.
Cunningham, A. J., Witton, C., Talcott, J. B., Burgess, A. P., & Shapiro, L. R. (2015). Deconstructing phonological tasks: The contribution of stimulus and
response type to the prediction of early decoding skills. Cognition, 143, 178–186. doi: 10.1016/J.COGNITION.2015.06.013.
De Smedt, B., Taylor, J., Archibald, L., & Ansari, D. (2010). How is phonological processing related to individual differences in children’s arithmetic skills?
Developmental Science, 13(3), 508–520. doi: 10.1111/j.1467-7687.2009.00897.x.
Dehaene, S. (1992). Varieties of numerical abilities. Cognition, 44(1–2), 1–42. doi: 10.1016/0010-0277(92)90049-N.
Dehaene, S. (2011).The Number Sense: How the Mind Creates Mathematics, Revised andUpdated Edition.New York: Oxford University Press. Retrieved
fromhttps://psycnet.apa.org/record/2011-10610-000
Dehaene, S., & Cohen, L. (2007). Cultural recycling of cortical maps. Neuron, 56(2), 384–398. doi: 10.1016/J.NEURON.2007.10.004.
Ferrando, P. J., & Lorenzo-Seva, U. (2017). Program FACTOR at 10: Origins,development and future directions. Psicothema, 29(2), 236–241. doi:
10.7334/psicothema2016.304.
Figueiredo, V. D. (2002).WISC-III: Escala de Inteligência Wechsler paraCrianças-adaptaçãobrasileira da 3a edição[WISC-III: Wechsler Intelligence Scale for
Children - 3rd Edition Brazilian Adaptation]. São Paulo: Casa do Psicólogo.
Figueiredo, V. L. M. d., &Nascimento, E. d. (2007).Desempenhosnasduastarefas do subtestedígitos do WISC-III e do WAIS-III[Performing on both WISC-III
and WAIS-III digit subtest tasks]. Psicologia: Teoria e Pesquisa, 23(3), 313–318. doi: 10.1590/S0102-37722007000300010.
Furnes, B., & Samuelsson, S. (2010). Predicting reading and spelling difficulties in transparent and opaque orthographies: A comparison between scandinavian
and US/Australian children. Dyslexia, 16(2), 119–142. https://doi.org/10.1002/dys.401.
Gibbs, S., & Bodman, S. (2014). Phonological Assessment Battery (PhAB2 Primary) (2ndPrimar). UK: GL Assessment.
Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16 15

Glover, T. A., & Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45(2), 117–135. doi:
10.1016/J.JSP.2006.05.005.
Godoy, D. M. A., & Cogo-Moreira, H. (2015). Evidences of factorial structure and precision of phonemic awareness tasks (TCFe). Paidéia (RibeirãoPreto),
25(62), 363–372. doi: 10.1590/1982-43272562201510.

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


Godoy, D. M. A., Fortunato, N., &Paiano, A. (2014). Panorama da últimadécada de pesquisas com testes de consciênciafonológica[Panorama of the last decade
of phonological awareness research].TemasEmPsicologia, 22(2), 313–328. doi: 10.9788/TP2014.2-04.
Hair, J. F., Black, W. C., Babin, B. J., &Anderson, R. E. (2014). Multivariate Data Analysis (new int. ed.) Harlow: Pearson Education.
Hecht, S. A., Torgesen, J. K., Wagner, R. K., & Rashotte, C. A. (2001). The relations between phonological processing abilities and emerging individual
differences in mathematical computation skills: Alongitudinal study from second to fifth grades. Journal of Experimental Child Psychology, 79(2),
192–227. doi: 10.1006/jecp.2000.2586.
Hulme, C., Bowyer-Crane, C., Carroll, J. M., Duff, F. J., & Snowling, M. J. (2012). The causal role of phoneme awareness and letter-sound knowledge in
learning to read: Combining intervention studies with mediation analyses. Psychological Science, 23(6), 572–577. doi: 10.1177/0956797611435921.
Hulme, C., & Snowling, M. J. (2015). Learning to read: What we know and what we need to understand better. Child Development Perspectives, 7(1), 1. doi:
10.1111/CDEP.12005.
Izquierdo, A. I., Olea, D. J., & Abad, F. J. (2014). Exploratory factor analysis in validation studies: Uses and recommendations. Psicothema, 26(3), 395–400.
doi: 10.7334/psicothema2013.349.
Johnson, E. S., Jenkins, J. R., Petscher, Y., & Catts, H. W. (2009). How can we improve the accuracy of screening instruments? Learning Disabilities Research
& Practice, 24(4), 174–185. doi: 10.1111/j.1540-5826.2009.00291.x.
Jordan, N. C., Hanich, L. B., & Kaplan, D. (2003). Alongitudinal study of mathematical competencies in children with specific mathematics difficulties versus
children with comorbid mathematics and reading difficulties. Child Development, 74(3), 834–850. doi: 10.1111/1467-8624.00571.
Kessels, R. P. C., van Zandvoort, M. J. E., Postma, A., Kappelle, L. J., & de Haan, E. H. F. (2000). The Corsiblock-tapping task: Standardization and normative
data. Applied Neuropsychology, 7(4), 252–258. doi: 10.1207/S15324826AN0704_8.
Knoop-van Campen, C. A. N., Segers, E., & Verhoeven, L. (2018). How phonological awareness mediates the relation between working memory and word
reading efficiency in children with dyslexia. Dyslexia, 24(2), 156–169. doi: 10.1002/dys.1583.
Landerl, K., Bevan, A., & Butterworth, B. (2004). Developmental dyscalculia and basic numerical capacities: A study of 8–9-year-old students. Cognition,
93(2), 99–125. doi: 10.1016/j.cognition.2003.11.004.
Landerl, K., Frith, U., & Wimmer, H. (1996). Intrusion of orthographic knowledge on phoneme awareness: Strong in normal readers, weak in dyslexic readers.
Applied Psycholinguistics, 17(01), 1. doi: 10.1017/S0142716400009437.
Landerl, K., Ramus, F., Moll, K., Lyytinen, H., Leppänen, P. H. T., Lohvansuu, K. et al. (2013). Predictors of developmental dyslexia in European orthographies
with varying complexity. Journal of Child Psychology and Psychiatry, 54(6), 686–694. doi: 10.1111/jcpp.12029.
Lervåg, A., Bråten, I., & Hulme, C. (2009). The cognitive and linguistic foundations of early reading development: A Norwegian latent variable longitudinal
study. Developmental Psychology, 45(3), 764–781. doi: 10.1037/a0014132.
Logan, J. A. R., Schatschneider, C., & Wagner, R. K. (2011). Rapid serial naming and reading ability: The role of lexical access. Reading and Writing, 24(1),
1. doi: 10.1007/S11145-009-9199-1.
Lopes-Silva, J. B., Moura, R., Julio-Costa, A., Haase, V. G., & Wood, G. (2014). Phonemic awareness as a pathway to number transcoding. Frontiers in
Psychology, 5, 13. doi: 10.3389/fpsyg.2014.00013.
Lopes-Silva, J. B., Moura, R., Júlio-Costa, A., Wood, G., Salles, J. F., & Haase, V. G. (2016). What is specific and what is shared between numbers and words?
Frontiers in Psychology, 7, 22. doi: 10.3389/fpsyg.2016.00022.
Lorenzo-Seva, U., & Ferrando, P. J. (2006). FACTOR: A computer program to fit the exploratory factor analysis model. Behavior Research Methods, 38(1),
88–91. doi: 10.3758/BF03192753.
Lorenzo-Seva, U., & Ferrando, P. J. (2013). Factor 9.2. Applied Psychological Measurement, 37(6), 497–498. doi: 10.1177/0146621613487794.
Lundberg, I., Larsman, P., & Strid, A. (2012). Development of phonological awareness during the preschool year: The influence of gender and socio-economic
status. Reading and Writing, 25(2), 305–320. doi: 10.1007/s11145-010-9269-4.
McBride-Chang, C., Shu, H., Zhou, A., Wat, C. P., & Wagner, R. K. (2003). Morphological awareness uniquely predicts young children’s Chinese character
recognition. Journal of Educational Psychology, 95(4), 743–751. doi: 10.1037/0022-0663.95.4.743.
Melby-Lervåg, M., Lyster, S.-A. H., & Hulme, C. (2012). Phonological skills and their role in learning to read: A meta-analytic review. Psychological Bulletin,
138(2), 322–352. doi: 10.1037/a0026744.
Moura, S. R. S., Mezzomo, C. L., &Cielo, C. A. (2009).Estimulaçãoemconsciênciafonêmica e seusefeitosemrelaçãoàvariávelsexo[Phonemic awareness
stimulation and its effects in relation to gender].Pró-FonoRevista de AtualizaçãoCientífica, 21(1), 51–56.doi: 10.1590/S0104-56872009000100009.
Oliveira-Ferreira, F., Costa, D. S., Micheli, L. R., Sílvia Oliveira, L. d. F., Pinheiro-Chagas, P., & Haase, V. G. (2012). School Achievement Test: Normative
data for a representative sample of elementary school children. Psychology & Neuroscience, 5(2), 157–164. doi: 10.3922/j.psns.2012.2.05.
Parente, M. A. M., Silveira, A. D., &Lecours, A. R. (1997).As palavras do portuguêsescrito[The words of Portuguese written]. In Lecours, A. R., &Parente,
M. A. M. (Eds.), Dislexia: Implicações do Sistema de Escrita do Português[Dyslexia: Implications of the Portuguese Writing System] (pp. 41–55). Porto
Alegre, Brazil: ArtesMédicas.
Peters, L., & De Smedt, B. (2018). Arithmetic in the developing brain: A review of brain imaging studies. Developmental Cognitive Neuroscience, 30, 265–279.
doi: 10.1016/j.dcn.2017.05.002.
Piazza, M., Izard, V., Pinel, P., Le Bihan, D., & Dehaene, S. (2004). Tuning curves for approximate numerosity in the human intraparietalsulcus. Neuron, 44(3),
547–555. doi: 10.1016/J.NEURON.2004.10.014.
Pinheiro, A. M. V. (1996). Contagem de Freqüência de Ocorrência de PalavrasExpostas a criançasnafaixapré-escolar e sériesiniciais do 1o grau[Frequency
count of occurrence of words exposed to children in preschool and early grades]. São Paulo, Brazil: AssociaçãoBrasileira de Dislexia. doi:
10.13140/RG.2.1.3977.5123
Pinheiro-Chagas, P., Wood, G., Knops, A., Krinzinger, H., Lonnemann, J., Starling-Alves, I.,et al. (2014).How many ways is the approximate number system
associated with exact calculation?PLoS ONE, 9(11), e111155.doi: 10.1371/journal.pone.0111155.
16 Pereira et al. / Archives of Clinical Neuropsychology XX (XXXX) XXX–XXX 00 (2020); 1–16

Plaza, M., & Cohen, H. (2004). Predictive influence of phonological processing, morphological/syntactic skill, and naming speed on spelling performance.
Brain and Cognition, 55(2), 368–373. doi: 10.1016/J.BANDC.2004.02.076.
Poulsen, M., Nielsen, A. M. V., Juul, H., & Elbro, C. (2017). Early identification of reading difficulties: Ascreening strategy that adjusts the sensitivity to the
level of prediction accuracy. Dyslexia, 23(3), 251–267. doi: 10.1002/dys.1560.

Downloaded from https://academic.oup.com/acn/advance-article-abstract/doi/10.1093/arclin/acz085/5707549 by Macquarie University user on 22 January 2020


Raven, J. (2000). The Raven’s progressive matrices: Change and stability over culture and time. Cognitive Psychology, 41, 1–48. doi: 10.1006/cogp.1999.0735.
Salles, J. F. de, Piccolo, L. da R., Zamo, R. de S., & Toazza, R. (2013). Developmental standards in a Word/Pseudoword Reading Task for children in Elementary
School. Estudos E Pesquisas Em Psicologia, 13(2), 397–419. Retrieved from http://pepsic.bvsalud.org/pdf/epp/v13n2/v13n2a02.pdf.
Salvador, L. S., Moura, R., Wood, G., & Haase, V. G. (2019). Cognitive heterogeneity of math difficulties: A bottom-up classification approach. Journal of
Numerical Cognition, 5(1), 55–85. doi: 10.5964/jnc.v5i1.60.
Schneider, M., Beeres, K., Coban, L., Merz, S., Susan Schmidt, S., &Stricker, J. (2017). Associations of non-symbolic and symbolic numerical magnitude
processing with mathematical competence: A meta-analysis. Developmental Science, 20(3), e12372.doi: 10.1111/desc.12372.
Schrank, F. A., Mather, N., & McGrew, K. S. (2014). Woodcock-Johnson IV Tests of Oral Language. Rolling Meadows,IL: Riverside.
Scliar-Cabral, L. (2003). Princípios do sistemaalfabético do português do Brasil.EditoraContexto.
Shatil, E., & Share, D. L. (2003). Cognitive antecedents of early reading ability: A test of the modularity hypothesis. Journal of Experimental Child Psychology,
86(1), 1–31. doi: 10.1016/S0022-0965(03)00106-1.
Simmons, F. R., & Singleton, C. (2008). Do weak phonological representations impact on arithmetic development? A review of research into arithmetic and
dyslexia. Dyslexia, 14(2), 77–94. doi: 10.1002/dys.341.
Spencer, L. H., & Hanley, J. R. (2003). Effects of orthographic transparency on reading and phoneme awareness in children learning to read in Wales. British
Journal of Psychology, 94(1), 1–28. doi: 10.1348/000712603762842075.
Stein, L. M. (1994). TDE: Teste de DesempenhoEscolar: manual paraaplicação e interpretação[TDE: School Performance Test: Application and Interpretation
Manual]. São Paulo, Brazil: Casa do Psicólogo.
Stoet, G., &Geary, D. C. (2013).Sex differences in mathematics and reading achievement are inversely related: Within- and across-nation assessment of 10
years of PISA data. PLoS ONE, 8(3), e57988. doi: 10.1371/journal.pone.0057988.
Swets, J. (1988). Measuring the accuracy of diagnostic systems. Science, 240(4857), 1285–1293. doi: 10.1126/science.3287615.
Timmerman, M. E., & Lorenzo-Seva, U. (2011). Dimensionality assessment of ordered polytomous items with parallel analysis. Psychological Methods, 16(2),
209–220. doi: 10.1037/a0023353.
Torgesen, J. K., Wagner, R. K., & Rashotte, C. A. (1994). Longitudinal studies of phonological processing and reading. Journal of Learning Disabilities, 27(5),
276–286. doi: 10.1177/002221949402700503.
Vukovic, R. K., & Lesaux, N. K. (2013). The language of mathematics: Investigating the ways language counts for children’s mathematical development.
Journal of Experimental Child Psychology, 115(2), 227–244. doi: 10.1016/J.JECP.2013.02.002.
Wagner, R. K., & Torgesen, J. K. (1987). The nature of phonological processing and its causal role in the acquisition of reading skills. Psychological Bulletin,
101(2), 192–212. doi: 10.1037/0033-2909.101.2.192.
Wagner, R. K., Torgesen, J. K., & Rashotte, C. A. (1999). Comprehensive Test of Phonological Processing: CTOPP. Austin, TX: Proed.
Wagner, R. K., Torgesen, J. K., Rashotte, C. A., & Pearson, N. A. (2013). Comprehensive test of phonological processing-2: CTOPP-2. Austin, TX: Proed.
Wilsenach, C., & Makaure, P. (2018). Gender effects on phonological processing and reading development in northern Sotho children learning to read in English:
A case study of grade 3 learners. South African Journal of Childhood Education, 8(1), 1–12. doi: 10.4102/sajce.v8i1.546.
Wilson, A. J., & Dehaene, S. (2007). Number sense and developmental dyscalculia. In D. Coch, G. Dawson, & K. W. Fischer (Eds.), Human behavior, learning,
and the developing brain: Atypical development (p. 212–238). New York, NY: The Guilford Press.
Wimmer, H., & Mayringer, H. (2002). Dysfluent reading in the absence of spelling difficulties: A specific disability in regular orthographies. Journal of
Educational Psychology, 94(2), 272–277. doi: 10.1037/0022-0663.94.2.272.
Wolff, U. (2011). Effects of a randomised reading intervention study: An application of structural equation modelling. Dyslexia, 17(4), 295–311. doi:
10.1002/dys.438.
Ziegler, J. C., Bertrand, D., Tóth, D., Csépe, V., Reis, A., Faísca, L. et al. (2010). Orthographic depth and its impact on universal predictors of reading.
Psychological Science, 21(4), 551–559. doi: 10.1177/0956797610363406.

You might also like