Professional Documents
Culture Documents
https://doi.org/10.1007/s10792-022-02377-4
ORIGINAL PAPER
Received: 12 September 2021 / Accepted: 14 June 2022 / Published online: 23 July 2022
© The Author(s), under exclusive licence to Springer Nature B.V. 2022
Vol.: (0123456789)
13
3934
Int Ophthalmol (2022) 42:3933–3940
Vol:. (1234567890)
13
Int Ophthalmol (2022) 42:3933–3940 3935
Time of examination was standardized to a maximum probability of chance agreement between medical stu-
of 1 min per eye. dent and staff observations. A complete case analysis
Students were instructed to independently report methodology was used for comparison of concord-
each patient’s cup-to-disc ratio (CDR), using the aver- ance of direct ophthalmoscope and iPhone X obser-
age of their vertical and horizontal CDR estimates, to vations with staff observations to account for those
the tenth decimal place, on a standardized question- unable to report findings. Fisher’s exact test was per-
naire (Online Resource 1). Colour of the optic disc formed to evaluate for statistical difference between
(pale or pink), contour of the disc (sharp or blurred comparison groups. The SPSS Statistics Software
margins), and presence of spontaneous venous pulsa- (IBM SPSS Statistics for Windows, Version 22.0,
tions (SVPs) (yes or no) were also reported. Students Armonk, NY, USA, April 2020) was utilized for
were instructed only to make an observation if they analysis.
were truly able to visualize fundus structures, and if
they were not, they would designate the observation
as “not accessible.” Student observations were com- Results
pared to the findings of a masked staff ophthalmolo-
gist, who used a 78D non-contact slit-lamp biomi- A total of 18 medical students conducted 230 reti-
croscope to perform the standard-of-care fundus nal examinations on 38 unique patient eyes. A total
examination using similar reporting parameters. of 117 student-performed fundus examinations were
completed using the iPhone X compared to 113 using
Primary and secondary outcomes the direct ophthalmoscope (Table 1).
The primary outcome of this study was the mean dif- Grading of CDR
ference in CDR between the novice trainees and the
staff ophthalmologist for iPhone X and direct ophthal- Mean CDR (± SD) amongst patients included in the
moscope observations. Secondary outcomes included study was 0.33 ± 0.18 as measured by the staff oph-
the percentage (%) of correct evaluations of optic disc thalmologist (Table 2). A statistically significantly
colour, contour and presence of SVPs by the medi- higher proportion of students were unable to comment
cal students compared to the reference ophthalmolo- on CDR using the iPhone X (81.2%) compared to the
gist, stratified by observation modality. The percent- direct ophthalmoscope (30.1%), p < 0.001 (Table 3).
age of student CDR evaluations within 0.2, 0.1 and Amongst students who were able to provide CDR
0.0 (identical) disc diameter observations of the staff estimates, a greater proportion reported values within
ophthalmologist examination was also recorded. 0.2 disc diameters of staff ophthalmologist findings in
Statistical analysis
Table 1 Demographics of patients included in study analysis
(n = 24)
The difference between medical trainee CDR findings
Characteristics
and the CDR determined by the trained ophthalmolo-
gist was determined for every observation. Difference Age, years (range) 72.1 (52 to 87)
in CDR was averaged for a mean difference with a Number of unique eyes, n 38
representative standard deviation, stratified by modal- Male Sex, n (%) 16 (57.9%)
ity-of-use (iPhone X and direct ophthalmoscope). Mean IOP, mmHg (SD) 13.0 (3.67)
Bland–Altman analysis was performed to evaluate BCVA, LogMAR (SD) 0.11 (0.15)
bias and the limits of agreement between direct oph- Past Ocular history
thalmoscope or iPhone X observations and reference AMD, n 1
standard staff ophthalmologist findings. Pseudophakic, n 25
Secondary outcomes were analysed similarly, Healthy, n 12
comparing the percentage of accurate examinations to
Data are listed as mean (range), mean (SD) or number (%).
the standard-of-care reference. Cohen’s Kappa value IOP intraocular pressure, BCVA best-corrected visual acuity,
was calculated and reported, taking into consideration AMD Age-related macular degeneration
Vol.: (0123456789)
13
3936
Int Ophthalmol (2022) 42:3933–3940
Table 2 Patient optic nerve head findings as determined by observations agreed with the staff ophthalmologist’s
staff ophthalmologist finding; optic disc pallor concordance with the staff
Optic Disc parameter Staff ophthalmologist finding ophthalmologist finding was 89/108 (82.4%) for stu-
dents using the direct ophthalmoscope and 63/71
CDR, n (SD) 0.33 (0.18)
(88.7%) for students using the iPhone X. The pro-
Colour, n Pink disc Pale disc
portion of students reporting disc pallor was 19/108
38 0
(17.6%) and 8/71 (11.3%) in the direct ophthalmo-
Contour, n Crisp margins Blurred margins
scope and iPhone groups, respectively.
38 0
SVPs, n Yes No
Evaluation for optic disc contour
11 27
Data are listed as mean (SD) or number (n). CDR cup-to-disc The staff ophthalmologist classified disc margins
ratio, SVPs spontaneous venous pulsations of all 38 eyes as crisp (Table 2). Of the 230 learner
observations, 92/230 (40.0%) were recorded as ’no
the iPhone group (72.3%) compared to students using response’ (Table 4). A statistically significantly
the direct ophthalmoscope (62.0%) (Table 3). For higher proportion of students were unable to evalu-
students able to visualize the disc, the 95% limits of ate disc contour using the iPhone X (65.0%) com-
agreement (mean bias) was −0.33 to + 0.56 (+ 0.11) pared to direct ophthalmoscope (14.2%), p < 0.001.
(Fig. 1a). When using the iPhone X to assess CDR, Of students who were able to evaluate disc contour,
there was a systematic bias of + 0.16 compared to ref- 100/138 (72.5%) observations agreed with the staff
erence observation, with the 95% limits of agreement ophthalmologist’s finding; optic disc contour con-
being −0.22 to + 0.54 (Fig. 1b). When using the direct cordance with the staff ophthalmologist finding was
ophthalmoscope to assess CDR, there was a system- 72/97 (74.2%) for students using the direct ophthal-
atic bias of + 0.10 compared to reference standard moscope and 28/41 (63.8%) for students using the
observation, with the 95% limits of agreement being iPhone X. The proportion of student observations
−0.36 to + 0.56 (Fig. 1c). reporting blurred disc margins was 25/97 (25.8%)
and 13/41 (26.2%) in the direct ophthalmoscope and
Evaluation for optic disc pallor iPhone groups, respectively.
The staff ophthalmologist classified the disc of all 38 Evaluation for SVPs
eyes as ’pink’ (Table 2). Of the 230 learner observa-
tions, 51/230 (22.2%) were recorded as ’no response’ A total of 11 out of 38 eyes (28.9%) had SVPs as
(Table 4). A statistically significantly higher propor- noted by the staff ophthalmologist (Table 2). Of the
tion of students were unable to evaluate disc pallor 230 learner observations, 132/230 (57.4%) were
using the iPhone X (39.3%) compared to the direct unable to evaluate SVPs (Table 4). A statistically
ophthalmoscope (4.4%), p < 0.001. Of students who significantly higher proportion of students were una-
were able to visualize the disc, 152/179 (84.9%) ble to evaluate presence of SVPs using the iPhone
Vol:. (1234567890)
13
Int Ophthalmol (2022) 42:3933–3940 3937
Fig. 1 Bland–Altman plot for mean difference of cup-to-disc iPhone X or direct ophthalmoscope, b student observations
measurements between 78D slit-lamp biomicroscopy staff oph- with just the iPhone X, and c student observations with just the
thalmologist findings and a students observations with either direct ophthalmoscope
Vol.: (0123456789)
13
3938
Int Ophthalmol (2022) 42:3933–3940
Table 4 Student optic nerve head exam findings using the and 27.7% of direct ophthalmoscope and iPhone X
direct ophthalmoscope and iPhone X observations, respectively. While inter-user variabil-
Modality for direct ophthalmoscopy P value ity is expected, limits of agreement for CDR scoring
using the iPhone X and direct ophthalmoscope were
Direct oph- iPhone X (n = 117)
thalmoscope both too large to suggest agreement between student
(n = 113) and staff observations. Therefore, we cannot infer one
N (%) N (%) modality superior over another with respect to evalu-
ating CDR. Our findings suggest that trainees were
Disc colour not comfortable with DO despite the 3-h training ses-
Correct 89 (82.4) 63 (88.7) sion prior to study initiation, which is in line with the
Incorrect 19 (17.6) 8 (11.3) literature [8].
No response 5 (4.4) 46 (39.3) < 0.001 Gunasekera and Thomas were able to easily per-
Disc contour form iPhone X ophthalmoscopy as demonstrated by
Correct 72 (74.2) 28 (63.8) the embedded video in their publication; however,
Incorrect 25 (25.8) 13 (36.2) it is unclear the level of practice that was required
No response 16 (14.2) 76 (65.0) < 0.001 to become proficient in this technique [5]. Trainees
SVPs enrolled in our study received a 3-h training session
Correct 45 (65.2) 16 (55.2) and did not have extensive training prior to study
Incorrect 24 (34.8) 13 (44.8) enrollment. Despite using the same video parameters
No response 44 (38.9) 88 (75.2) < 0.001 as the previous publication, the training that students
Data are listed as number and percentage of student responses. in this study received may not have been sufficient,
CDR cup-to-disc ratio, SVPs spontaneous venous pulsations thus contributing to poor performance. Gunasekera
and Thomas did not comment on how long they
trained with the iPhone X, but both are trained oph-
population [5]. However, in our study, medical stu- thalmologists who may have better proficiency at
dents demonstrated greater difficulty performing DO finding the optic nerve head at baseline.
using the iPhone X, as indicated by the lower propor- At first glance, it appeared that students were able
tion of those able to make observations in parameters to accurately assess optic disc colour and margin if
such as CDR (iPhone X: 81.2%; direct ophthalmo- able to visualize the disc. Students using the iPhone
scope: 30.1%), optic disc colour (iPhone X: 60.7%; X demonstrated greater concordance with the staff
direct ophthalmoscope: 95.6%) and optic disc contour ophthalmologist’s disc pallor assessment (iPhone
(iPhone X: 35.0%; direct ophthalmoscope 85.8%). X = 88.7%, direct ophthalmoscope 82.4%), but poorer
Students rated CDR higher by an average of 0.11 concordance with the staff ophthalmologist’s disc
compared to the staff ophthalmologist finding. A margin assessment (iPhone X = 63.8%, direct oph-
mean bias of approximately 0.10 is generally con- thalmoscope 74.2%). All patients enrolled in the
sidered clinically acceptable for CDR [6]. This level study had pink discs and crisp margins. Therefore, we
was achieved in the direct ophthalmoscope group were unable to assess students’ ability to distinguish
(bias =
+ 0.10, 95% limits of agreement: −0.36 disc pallor or blurred margins from normal disc col-
to + 0.56) but not the iPhone X cohort (bias = + 0.16, our and contour. The main conclusion is that students
95% limits of agreement: −0.22 to + 0.54). Further- demonstrated less ability to characterize disc colour
more, a greater proportion of students were unable and margins with the iPhone X as indicated by the
to comment on CDR using the iPhone X compared proportion of ’no responses’ in each modality group.
to the direct ophthalmoscope (81.2% vs 30.1%). Unlike disc contour and disc pallor, there were
Amongst trained ophthalmologists, Tielsch et al. patients enrolled in the study who had SVPs as noted
found that CDR estimates varied by over 0.2 disc by the staff ophthalmologist (30.4%). Students expe-
diameters or more in 17–19% of stereoscopic obser- rienced the greatest difficulty in evaluating for SVPs
vations [7]. This is in comparison to medical student compared to other secondary outcomes, as demon-
CDR estimates in our study, which differed from strated by the highest proportion of those unable to
staff findings by over 0.2 disc diameters in 38.0% comment on presence of SVPs (57.4%). This may be
Vol:. (1234567890)
13
Int Ophthalmol (2022) 42:3933–3940 3939
explained by the increased relative difficulty of this smartphones can provide useful clinical information
task in comparison to evaluation of optic nerve pallor without requiring face-to-face patient interaction.
and contour assessment. Concordance was greater in The limitations of this study deserve mention.
the direct ophthalmoscope group (65.2%) compared First, the level of training of the student participant
to the iPhone X group (55.2%). However, only slight sample resulted in a large proportion of incomplete
agreement between students and staff was observed observations, as trainees were often unable to com-
in the direct ophthalmoscope group (Cohen’s ment on optic disc parameters. This limits the ability
kappa = 0.099) and no agreement was observed in the for the authors to derive absolute conclusions about
iPhone X group (Cohen’s kappa = −0.044). the superiority of one DO modality over the other
The use of smartphones for retinal examination in the novice student population. While the large
has been reported by several studies [9–11]; however, proportion of incomplete observations was not ideal,
previously investigated smartphones have required this phenomenon reflected the high level of difficulty
additional equipment. Smartphone attachments such novice students experience performing DO. In addi-
as the “D-Eye” [9–11] and “Peek Retina” [11] are tion, the patient sample did not include those with
available to enhance the camera quality and to pro- optic disc pallor or blurred disc margins. Therefore,
vide a light source for ophthalmic purposes. Using we were unable to reliably assess students’ ability to
indirect ophthalmoscopy as the reference standard, distinguish disc pallor and blurred disc margins from
Dickson et al. found that D-Eye iPhone CDR assess- normal disc colour and contour. Strategic guessing of
ment agreed within a value of 0.1 disc diameters in optic disc parameters amongst students was also an
94% of observations [9]. The proportion of students uncontrollable potential bias. We aimed to eliminate
able to visualize the optic disc using the D-Eye smart- guessing by providing clear instructions to partici-
phone attachment (82.3%) has also been shown to pants and through blinding of student observations to
be greater compared to the direct ophthalmoscope all participants and the staff ophthalmologist.
(48.5%) in a study by Kim and Chao [10]. Bastawarus
et al. reported CDR mean bias using the Peek Retina
to be 0.02 compared with digital fundus camera read-
Conclusions
ings, with 95% limits of agreement of −0.21 to + 0.17
(Kappa = 0.69) [11]. While CDR assessment using
In conclusion, amongst medical trainees, optic disc
the Peek Retina was not compared with slit-lamp
visualization using the iPhone X was inferior in com-
biomicroscopy findings bias, results showed greater
parison to the direct ophthalmoscope. However, stu-
agreement compared to our study. There is poten-
dents demonstrated poor reliability performing fun-
tial for smartphone ophthalmoscopy; however, the
dus examinations using either device. There was no
need for additional attachments makes this method
significant difference in CDR assessment accuracy
inconvenient.
between modalities. Further evaluation of the unmod-
Exciting developments in telemedicine, robust
ified iPhone X as a tool for ophthalmoscopy is nec-
security channels, and smartphone-accessible elec-
essary to provide evidence for implementation into
tronic medical records in combination with smart-
medical education settings.
phone-ophthalmoscope practices may lead to
improved patient care. If proven to be equivalent or Authors’ contributions All authors contributed to the manu-
superior compared to the direct ophthalmoscope, script and have reviewed/approved its contents.
iPhone X ophthalmoscopy can possibly adopt a simi-
lar role to fundus photography, which has become Funding No funding was received by any author for the com-
pletion of this study.
popularized as a referring option for providers wish-
ing to consult ophthalmologists [12]. The possibil- Availability of data and material The data that support the
ity for electronic consults through shared ophthal- findings of this study are available on request from the corre-
moscopy images and videos from smartphones is sponding author.
especially applicable in the present day COVID-19
Code availability The SPSS Statistics Software (IBM SPSS
pandemic. Electronic consults through secured shar- Statistics for Windows, Version 22.0, Armonk, NY, USA, April
ing of ophthalmoscopy images and videos from 2020) was utilized for analysis.
Vol.: (0123456789)
13
3940
Int Ophthalmol (2022) 42:3933–3940
Vol:. (1234567890)
13