Professional Documents
Culture Documents
12148
DIEGO GIROTTO BUSSANELI1, THALITA BOLDIERI1, MICHELE BAFFI DINIZ2, LUCIANA MONTI
LIMA RIVERA3, LOURDES SANTOS-PINTO1 & RITA DE CÁSSIA LOIOLA CORDEIRO1
1
Department of Pediatric Dentistry and Orthodontics, Araraquara School of Dentistry, UNESP-Univ Estadual Paulista,
Araraquara, SP, Brazil, 2Department of Pediatric Dentistry, School of Dentistry, UNICSUL – Cruzeiro do Sul University, São
Paulo, SP, Brazil, and 3Department of Pediatric Dentistry, School of Dentistry, USC – Sagrado Coracßão Univesity, Bauru, SP,
Brazil
International Journal of Paediatric Dentistry 2015; 25: The sensitivity, specificity, accuracy, and area
418–427 under the ROC curve values were calculated for
ICDAS and BW. The associations between ICDAS,
Aim. To evaluate the influence of examiner’s clin- BW, and TD were analyzed by means of contin-
ical experience on detection and treatment deci- gency tables.
sion of caries lesions in primary molars. Results. Interexaminer agreement for ICDAS, BW,
Design. Three experienced dentists (Group A) and and TD were excellent for Group B and moderate
three undergraduate students (Group B) used the for Group A. The two groups presented similar
International Caries Detection and Assessment and satisfactory performance for caries lesion
System (ICDAS) criteria and bitewing radiographs detection using ICDAS and BW. In the treatment
(BW) to perform examinations twice in 77 pri- decision, Group A was shown to have a less inva-
mary molars that presented a sound or carious sive approach than Group B.
occlusal surface. For the treatment decision (TD), Conclusion. The examiner’s experience was not
the examiners attributed scores, analyzing the determinant for the clinical and radiographic
teeth in conjunction with the radiographs. The detection of occlusal lesions in primary teeth but
presence and the depth of lesion were validated influenced the treatment decision of initial
histologically, and reproducibility was evaluated. lesions.
418 © 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd
Detection and treatment of caries lesions 419
the presupposition that the structural differ- presence of caries lesion, such as white spots,
ences between primary and permanent teeth pigmentations, and cavities.
may directly affect the process of evolution of Before analyses, the teeth were cleaned
the lesion, and consequently make it difficult with a Robinson brush coupled to a low-
for the professional to make the treatment speed motor and prophylactic paste. The teeth
decision, the aim of this study was to evalu- were individually stored in a 0.1% thymol
ate the influence of the examiner’s clinical solution. After this, the teeth were numbered
experience on the detection and treatment and photographed under a stereomicroscopic
decision of occlusal caries lesions in primary lens at 109 magnification (Olympus, SZ2-
molars. ILST, Tokyo, Japan). An independent
researcher, who was not involved in the
examinations, selected one occlusal site per
Materials and methods
tooth and recorded it as the ‘test site’ in pho-
tographs of the occlusal surface printed on
Study participants
paper, in order to prevent selection bias and
Three faculty members from the Department to guide lesion location. Thus, sample selec-
of Paediatric Dentistry (Group A), with at tion was randomly performed.
least 10 years of experience in clinical prac- The teeth were radiographed by the inter-
tice and previous experience with ICDAS cri- proximal technique, with the aid of a posi-
teria, and three students (Group B) in the tioner, which allowed the images to be
second year of the Dentistry Course of the standardized. Ultraspeed films (Kodak Insight,
Araraquara Dental School–UNESP, Brazil, 22 9 35 mm, Kodak, Rochester, USA) and an
participated in the study. X-ray appliance (Spectro 70X, Dabi-Atlante,
After theoretical lectures about the clinical Ribeirão Preto, Brazil) were used, operating at
criteria for the detection and evaluation of 70 kVp, 8 mA, and exposure time of 0.3 s. The
caries lesions, each student underwent online radiographs were processed in an automatic
training about the use of the ICDAS criteria processer (Dent-X 9000, Dent-X, Emsford,
(www.icdas.org/icdas-e-learning-course). This USA) and mounted on posters identified for
training, with a duration of 90 min, presents later analysis.
each of the ICDAS criteria in a detailed man-
ner and offers an interactive exercise after
Examination of the teeth
presentation of the theoretical content. After-
ward, practical laboratory training was con- The examiners clinically evaluated each site
ducted, in which the students analyzed 15 selected, independently. For this purpose, the
extracted primary teeth that were not part of teeth were illuminated with a reflector, and
the study sample, with subsequent analysis of initially analyzed wet, then dried with a triple
the results and group discussion. The average syringe. Scores were attributed in accordance
unweighted kappa value for all examiners with the ICDAS criteria17 as follows: (0) sound;
was 0.81, indicating excellent interexaminer (1) first visual change in enamel; (2) distinct
agreement with a reference examiner. Group visual change in enamel; (3) localized enamel
A did not receive any type of training, as breakdown, without visible dentin or shad-
these examiners had previous experience ows; (4) underlying dentin shadow; (5) distinct
with the use of ICDAS. cavity with visible dentin; and (6) extensive
cavity within visible dentin.
After this, the bitewing radiographs (BW)
Sample
were analyzed by the same examiners, with
After receiving approval from the Research the aid of a negatoscope (Imatec R€ ontgen-
Ethics Committee (Process Number 13/09), 77 technik, Switzerland) and a magnifying glass
recently extracted or exfoliated primary (VRX-Fabinject, Taubate, São Paulo, Brazil)
molars were selected. These presented a sound and were classified according to Rodrigues
occlusal surface, or had signs suggesting the et al.18 into as follows: (0) absence of radio-
© 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd
420 D. G. Bussaneli et al.
lucency; (1) radiolucency in enamel; (2) middle third of dentin; and (4) lesion involv-
radiolucency in external half of the dentin; ing the internal third of the dentin. Two
and (3) radiolucency in internal half on the experienced examiners who had participated
dentin. in other evaluations in previous researches
For treatment decision evaluations (TD), examined each section of the teeth indepen-
the examiners attributed scores according to dently. In cases of disagreement, a new
Diniz et al.19 as follows: (0) no treatment; examination was performed and consensus
(1) sealant application; (2) microabrasion and was reached after discussion.
sealant application; (3) invasive sealant with
spherical bur; (4a) restoration with resin
Statistical analysis
composite; and (4b) restoration with silver
amalgam. The intra- and interexaminer reproducibilities
All examinations were performed indepen- of ICDAS, BW, and TD were calculated, using
dently on the same day. The teeth were ran- the unweighted kappa coefficient and classi-
domly numbered and reordered before each fied as follows: >0.75 – good/excellent; 0.5 to
evaluation to prevent bias. First, the examin- 0.75 – moderate/good; 0.25 to 0.5 – weak/
ers performed the visual inspection and after moderate; and <0.25 – absence of correlation.
this, the radiographic examination. The The sensitivity, specificity, accuracy, and
examiners were blinded during the examina- area under the ROC curve (Az) values were
tion of the radiographs, and they did not calculated for ICDAS and BW, at two diag-
have access to the test tooth. Then, they nostic thresholds. D1 – corresponding to all
made decisions about the treatment score lesions (ICDAS scores 0 = sound and 1, 2, 3,
based on visual inspection associated with the 4, 5, and 6 = carious; and BW scores 0 =
radiographic examination. For this procedure, sound and 1, 2, and 3 = carious); and D3 –
the ICDAS and the radiographic examination corresponding to lesions in dentin (ICDAS
(BW) scores for each tooth were available to scores 0, 1, 2, and 3 = sound and 4, 5, and
the examiner when making the treatment 6 = carious; and BW scores 0 and 1 = sound
decisions. and 2 and 3 = carious). The McNemar test
The examinations (ICDAS, BW, and TD) was used to verify the significance of the
were performed twice, with a 1-week interval, results between Groups A and B. The level of
by each examiner. The repeated measure- significance adopted was 5%.
ments were conducted in all teeth (n = 77). The associations between ICDAS, BW, and
TD and between ICDAS codes and histological
scores were verified by means of contingency
Histological validation
tables.
For histological validation, the teeth were
longitudinally sectioned in the center of the
Results
selected site, using a diamond disk with cool-
ing water, in a precision cutting machine Of the 77 teeth in the sample, 28 (36.3%)
(ISOMET 1000, Buehler Ltd., Lake Bluff, IL, were shown to be sound (score 0), 25
USA), resulting in two sections corresponding (32.4%) had caries lesions limited to the
to the test site. The section that presented the external half of enamel (score 1), 13 (16.8%)
most severe lesion was analyzed under a ste- had caries lesions up to the internal half of
reoscopic magnifying glass (SZX7, Olympus the enamel, or external third of dentin (score
Corporation, Tokyo, Japan) at 109 magnifica- 2), 8 (10.3%) had lesions in the middle third
tion. The following criteria proposed by of dentin (score 3), and 3 (3.8%) had caries
Ekstrand et al.20 were used: (0) absence of lesions in the internal third of dentin (score
caries lesion; (1) caries lesion limited to the 4).
outer half of enamel; (2) caries lesion involv- Table 1 shows the unweighted kappa coeffi-
ing the inner half of the enamel or external cient values for intra- and interexaminer
third of dentin; (3) lesion limited to the reproducibility for ICDAS, BW, and TD.
© 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd
Detection and treatment of caries lesions 421
Table 1. Unweighted kappa coefficient for intra- and interexaminer reproducibility for International Caries Detection and
Assessment System (ICDAS), radiographic examination [bitewing radiographs (BW)], and treatment decision (TD).
© 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd
422 D. G. Bussaneli et al.
Table 3. Sensitivity, specificity, accuracy, and Az for International Caries Detection and Assessment System visual criteria at
D1 and D3 thresholds.
Examiners D1 D3 D1 D3 D1 D3 D1 D3
Different letters in the same column indicate statistically significant difference (McNemar test, P < 0.05 for sensitivity, specificity and
accuracy; nonparametric test, P < 0.05 for Az).
Table 4. Sensitivity, specificity, accuracy, and Az for radiographic examination (bitewing radiographs) at D1 and D3
thresholds.
Examiners D1 D3 D1 D3 D1 D3 D1 D3
Different letters in the same column indicate statistically significant difference (McNemar test, P < 0.05 for sensitivity, specificity and
accuracy; nonparametric test, P < 0.05 for Az).
© 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd
Detection and treatment of caries lesions 423
Table 5. Distribution of the absolute frequencies for the Table 6. Distribution of the absolute frequencies for the
treatment decision scores within the International Caries treatment decision scores within the International Caries
Detection and Assessment System (ICDAS) and bitewing Detection and Assessment System (ICDAS) and bitewing
radiographs (BW), considering all the examinations for radiographs (BW), considering all the examinations for
Group A. Group B.
ICDAS BW 0 1 2 3 4a 4b ICDAS BW 0 1 2 3 4a 4b
0 0 105 0 0 50 1
1 8 1 13 2
2 2
3 3
1 0 42 1 1 1 1 0 18 35
1 48 2 1 1 1 31 6
2 1 2 2
3 3 3 3
2 0 58 3 17 9 2 0 9 22 6
1 33 4 6 2 1 1 56 19 15 1 2
2 3 3 12 2 1 19 5
3 3
3 0 4 1 2 3 0 3
1 3 2 9 2 1 7 11 10 3
2 4 8 9 2 12 6 2
3 2 3 3
4 0 4 0 3 3
1 1 1 7 2
2 10 2 8 3
3 4 2 3 1 6 3
5 0 5 0 2 4
1 1
2 5 2 4
3 3 8 3 4 2
6 0 6 0
1 1
2 2 5
3 24 3 10 16
Zandona et al.8, when comparing three dents were due to their similar education and
groups of examiners with different levels of the ICDAS training session. Eight senior den-
clinical experience (faculty, undergraduate, tal students from our research group had pre-
and graduate students), concluded that this viously participated in another study using
previous experience did not contribute to the ICDAS criteria; however, in permanent
learning about use of the ICDAS criteria and teeth, similar reproducibility values to those
attributed the good performance of the stu- of the present study were found after they
dents to the clarity of the criteria in question. had gone through the ICDAS e-learning pro-
Similar to our results, Souza-Zaroni et al.9 gram21. Although the use of visual systems
obtained higher reproducibility values for stu- appears to be logical, the moderate interex-
dents than for professionals in the visual aminer reproducibility value for Group A
examination of the occlusal surface, using could be explained by the differences in the
clinical criteria in accordance with lesion acquisition of knowledge among the examin-
depth. The authors attributed the low values ers. We agree with Gimenez et al.16 when
to the different levels of experience and they considered that more experienced pro-
knowledge acquired and pointed out that as fessionals are accustomed to using their past
they were subjective examinations, they may clinical experience to make diagnoses and
be influenced by various factors. In view of may therefore be more resistant to learning
our findings, we may suggest that the better descriptive methods. The authors observed
interexaminer agreement values of the stu- that this experience did not interfere signifi-
© 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd
424 D. G. Bussaneli et al.
cantly in the examiners’ performance in the In the D3 threshold, higher specificity val-
use of the ICDAS criteria. ues were observed for ICDAS without statisti-
The intraexaminer reproducibility values for cal differences between the groups, a fact
BW examinations for Groups A and B were justified by the high prevalence of sound
similar, whereas the interexaminer values teeth, or those with caries lesions in the outer
were discrepant, being 0.73 for Group B and half of enamel (70%). Bengtson et al.7 found
0.50 for Group A. Diniz et al.23 found low different results from ours, with lower speci-
intraexaminer reproducibility values in exam- ficity values for students when compared
inations performed by students and profes- with specialists, and attributed this to experi-
sionals, pointing out that five factors may be enced dentists having greater capability of
responsible for the difference in results: age, clinical discernment. Souza-Zaroni et al.9 also
training, skill, preferences, and experience, found results that diverged from ours, with
whereas, Firestone et al.14 suggested that indi- sensitivity values of 0.52 for students and
vidual skill associated with adequate didactic 0.61 for professionals, and specificity values
instruction would equate the performance of of 0.93 for students and 0.69 for profession-
students to the capacity of a clinician experi- als, suggesting that experienced examiners
enced in radiographic diagnosis. made more precise diagnoses with regard to
In this study, the intraexaminer agreement the presence of lesions. As far as the radio-
values for TD were good for both groups graphic examination was concerned, this
(0.78 and 0.74), however, the interexaminer showed higher sensitivity values for Group B
agreement values were moderate for Group A and higher specificity values for Group A in
(0.52) and good for Group B (0.71). We D1. The high specificity values found in D3
believe that this disagreement on TD between are in agreement with the findings of previ-
the professionals may be justified by the fact ous studies11,15,23.
that during the course of their profession, In this investigation, the sample distribu-
they acquired their own clinical treatment tion was not homogeneous, with a low
concepts based on their past experience. This prevalence of moderate and advanced caries
did not occur with Group B, made up of stu- lesions in dentin, which might have influ-
dents who had a similar academic education enced the results of the ICDAS and BW
and no clinical experience. performance in both groups of examiners,
International Caries Detection and Assess- especially in terms of sensitivity at the D3
ment System presented statistically different threshold. Thus, it is impossible to deter-
sensitivity values between the groups, being mine the real impact of these examinations
higher for Group B in both D1 and D3. Group on advanced dentin lesions on the occlusal
B presented a lower specificity value in D1. surfaces of primary molars. Cross-tabulation
We believe that this result may be justified by indicated that several teeth classified as hav-
the sample used in this study, which was ing a lesion limited to the middle third of
made up of senile primary teeth with natural dentin in the histological validation were
pigmentations in the region of fossae and fis- wrongly classified as ICDAS codes 0, 1, and
sures. This may have contributed to all the 2, which also might have influenced the
pigmentations being classified as caries lesions, performance results.
and influencing the specificity values in D1. Our results pointed out that professional
Our results are in agreement with those of experience did not influence the visual and
Diniz et al.21 when they observed that the stu- radiographic capacity for detecting occlusal
dents had difficulty in distinguishing between caries lesions in primary teeth, as the accu-
enamel defects, areas of fluorosis, or pigmen- racy and area under the ROC curve (Az)
tations of carious lesions in permanent teeth, values showed no statistically significant dif-
presenting sensitivity values of 0.36. Previous ference between the groups (P > 0.05), in
studies11,16 have pointed out that during diag- both D1 and D3. The lack of students’ experi-
nosis, students are more inclined to classify ence was more relevant for questions related
any alteration in enamel as caries. to the application of clinical knowledge at the
© 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd
Detection and treatment of caries lesions 425
© 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd
426 D. G. Bussaneli et al.
that the examiners’ experience was not deter- surfaces: an in vitro examination with histological
minant for the clinical and radiographic detec- validation. Oper Dent 2009; 34: 598–604.
9 Souza-Zaroni WC, Ciccone JC, Souza-Gabriel AE
tion of occlusal lesions in primary teeth, but it
et al. Validity and reproducibility of different combi-
did interfere in the process of treatment plan- nations of methods for occlusal caries detection: an
ning of initial lesions, in which the students in vitro comparison. Caries Res 2006; 40: 194–201.
were more inclined to perform interventions 10 Fung L, Smales R, Ngo H, Moun G. Diagnostic com-
in this type of lesion. parison of three groups of examiners using visual
and laser fluorescence methods to detect occlusal
caries in vitro. Aust Dent J 2004; 49: 67–71.
11 Mileman PA, van den Hout WB. Comparing the
Why this paper is important to paediatric dentists accuracy of Dutch dentists and dental students in
• The professional experience does not directly influ- the radiographic diagnosis of dentinal caries. Dento-
ence the capacity of visual and radiographic detection maxillofac Radiol 2002; 31: 7–14.
of caries lesions in primary teeth. 12 Diniz MB, Rodrigues JA, Neuhaus KW, Cordeiro
• Dentists with little experience tend to perform more RC, Lussi A. Influence of examiner’s clinical experi-
invasive treatments in primary teeth, or in some cases ence on the reproducibility and accuracy of radio-
even intervene in teeth that do not need any treat- graphic examination in detecting occlusal caries. Clin
ment. Oral Investig 2010; 14: 515–523.
• Because, it warns less experienced clinicians to con-
13 Gowda D, Lamster IB. The diagnostic process. Dent
sider opting for more conservative treatments in initial
lesions in primary teeth.
Clin North Am 2011; 55: 1–14.
14 Firestone AR, Lussi A, Weems RA, Heaven TJ. The
effect of experience and training on the diagnosis of
approximal coronal caries from bitewing radio-
Conflict of interest graphs. A Swiss-American comparison. Schweiz Mo-
natsschr Zahnmed 1994; 104: 719–723.
The authors declare no conflict of interest. 15 Lazarchik DA, Firestone AR, Heaven TJ, Filler SJ,
Lussi A. Radiographic evaluation of occlusal caries:
effect of training and experience. Caries Res 1995;
References 29: 355–358.
16 Gimenez T, Bittar D, Piovesan C et al. Influence of
1 Baelum V, Hintze H, Wenzel A, Danielsen B, Nyvad the examiners’ experience on clinical performance
B. Implications of caries diagnostic strategies for clin- of visual inspection in detecting and assessing the
ical management decisions. Community Dent Oral Epi- activity status of caries lesions. Oper Dent 2013; 38:
demiol 2012; 40: 257–266. 583–590.
2 Bader JD, Shugars DA, Bonito AJ. Systematic 17 Ismail AI, Sohn W, Tellez M et al. The International
reviews of selected dental caries diagnostic and man- Caries Detection and Assessment System (ICDAS): an
agement methods. J Dent Educ 2001; 65: 960–968. integrated system for measuring dental caries. Com-
3 Pitts N. “ICDAS” – an international system for caries munity Dent Oral Epidemiol 2007; 35: 170–178.
detection and assessment being developed to facilitate 18 Rodrigues JA, Hug I, Diniz MB, Lussi A. Perfor-
caries epidemiology, research and appropriate clinical mance of fluorescence methods, radiographic exami-
management. Community Dent Health 2004; 21: 193–198. nation and ICDAS II on occlusal surfaces in vitro.
4 Shoaib L, Deery C, Ricketts DNJ, Nugent ZJ. Validity Caries Res 2008; 42: 297–304.
and reproducibility of ICDAS II in primary teeth. 19 Diniz MB, Lima LM, Eckert G et al. In vitro evalua-
Caries Res 2009; 3: 442–448. tion of ICDAS and radiographic examination of
5 Matos R, Novaes TF, Braga MM, Siqueira WL, Duarte occlusal surfaces and their association with treat-
DA, Mendes FM. Clinical performance of two fluores- ment decisions. Oper Dent 2011; 36: 133–142.
cence-based methods in detecting occlusal caries 20 Ekstrand KR, Ricketts DN, Kidd EA. Reproducibility
lesions in primary teeth. Caries Res 2011; 45: 294–302. and accuracy of three methods for assessment of
6 Mendes FM, Novaes TF, Matos R et al. Radiographic demineralization depth of the occlusal surface: an in
and laser fluorescence methods have no benefits for vitro examination. Caries Res 1997; 31: 224–231.
detecting caries in primary teeth. Caries Res 2012; 46: 21 Diniz MB, Lima LM, Santos-Pinto L, Eckert GJ, Zan-
536–543. doná AG, Cordeiro RCL. Influence of the ICDAS e-
7 Bengtson AL, Gomes AC, Mendes FM, Cichello LR, learning program for occlusal caries detection on
Bengtson NG, Pinheiro SL. Influence of examiner’s dental students. J Dent Educ 2010; 74:
clinical experience in detecting occlusal caries lesions 862–868.
in primary teeth. Pediatr Dent 2005; 27: 238–243. 22 Jablonski-Momeni A, Stachniss V, Ricketts DN,
8 Zandona AG, Al-Shiha S, Eggertsson H, Eckert G. Heinzel-Gutenbrunner M, Pieper K. Reproducibility
Student versus faculty performance using a new and accuracy of the ICDAS-II for detection of
visual criteria for the detection of caries on occlusal occlusal caries in vitro. Caries Res 2008; 42: 79–87.
© 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd
Detection and treatment of caries lesions 427
23 Diniz MB, Rodrigues JA, Hug I, Cordeiro Rde C, 25 Kidd E. The implications of the new paradigm of
Lussi A. Reproducibility and accuracy of the ICDAS- dental caries. J Dent 2011; 39: S3–S8.
II for occlusal caries detection. Community Dent Oral 26 Ekstrand KR, Martignon S, Ricketts DJ, Qvist V.
Epidemiol 2009; 37: 399–404. Detection and activity assessment of primary coronal
24 Elstein AS, Schwartz A. Clinical problem solving caries lesions? A methodologic study Oper Dent 2007;
and diagnostic decision making: selective review of 32: 225–235.
the cognitive literature. BMJ 2002; 324: 729–732.
© 2014 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd