You are on page 1of 4

Mobile-platform for Automatic Fever Screening

System based on Infrared Forehead Temperature

Armote Somboonkaew*, Panintorn Prempree, Sirajit Vuttivong, Jutaphet Wetcharungsri, Supanit Porntheeraphat,
Sataporn Chanhorm, Prasit Pongsoon, Ratthasart Amarit, Yuttana Intaravanne, Kosom Chaitavon, Sarun
Sumriddetchkajorn
Photonics Technology Laboratory, National Electronics and Computer Technology Center (NECTEC),
National Science and Technology Development Agency (NSTDA)
Pathum Thani, Thailand
*Email: armote.somboonkaew@nectec.or.th

Abstract— In this paper, automatic fever screening system is Even though using the infrared forehead skin thermometer is
proposed and experimentally implemented using an IR camera convenience, however, it requires a few seconds to complete
and a mobile phone. Our system locates position of patients the measurement. Furthermore, number of measurement is
automatically using face detection algorithm on RGB image and strictly limited to one person at a time. Therefore, this scheme
obtains temperature from IR image at detected location.
is not suitable for massive human temperature screening in
Advantages are fast, portable, non-contacting and simultaneously
temperature measurement. Furthermore, face detection large public area, which needs faster screening rate to avoid
algorithm allows the system to track patient’s face position. congestion. According to [4][5], high-throughput and non-
Hence, robust and non-contacting temperature measurement can contact human temperature screening system can be achieved
be properly done even patients are not stand still. Our system has by using 2D thermal imaging device, so called IR camera, and
been field-tested to measure temperature and screen ill patients human flow management. Nevertheless, this system cannot be
at a children medical clinic. In this experiment, the system is used with ease due to size of 2D thermal imaging device and
calibrated to measure temperature of patients at 1 meter away installation cost.
and gives an alarm sound when the measured temperature is Because of an improvement of 2D thermal imaging
above the desired setting threshold. According to experimental
technology, size and price of IR camera is reduced
results, the correlation coefficient between temperature obtained
from our system and commercial infrared forehead skin considerably. Therefore, it is possible to design a mobile,
thermometer [2] is more than 0.80. In addition, our system high-throughput and non-contact human temperature
achieves a 100% sensitivity and 70% specificity. Although our screening system based on 2D thermal imaging device.
approach loses specificity, all fever patients are identified
correctly. Thus, they are significantly correlated. Therefore, this II.   METHODOLOGY
system can reliably estimate body temperature of patients and Our approach is a parallel image processing of an RGB image
can be used for effectively pre-screening fever patients. from visible camera and a thermal image from IR camera.
The RGB image is used for targeting area of measurement.
Keyword- Infrared, non-contact temperature measurement,
automatic fever screening measurement, mobile device, face Then, maximum temperature in corresponding area is obtained
detection from the thermal image. Even though this procedure seems to
be simple, however, mapping position between two images
from difference cameras is quite complicated due to different
I.   INTRODUCTION hardware characteristics such as field of view (FOV) and
Medical service in most hospital starts with patients’ image resolution in pixels. Therefore, it is necessary to do
temperature measurement and then screening fever patients. image alignment between images from each camera to avoid
Core temperature can be accurately estimated by measuring incorrect mapping.
axillary or oral temperature using stick type, or glass
thermometers. However, these methods are not convenient due
to uncooperative patients, especially for young children, and
time-consuming. Therefore, some hospitals start using an
infrared forehead skin thermometer instead. This thermometer
measures intensity infrared, which emits from skin, and
converts it to temperature. According to [1], the axillary
temperature and infrared forehead skin temperature are
strongly correlated. Thus, body temperature can also be
estimated by using emission of infrared from the forehead
e
Fig.1 Flowchart of image processing in locating human face Fig. 3 Resulted mage after processing
and temperature measurement
A.   Image alignment
An image alignment consists of two procedures; image C.   Temperature measurement
cropping and image scaling. Cropped image’s position and In order to measure core temperature of human, besides oral
area depends on FOV of each camera and distance between temperature, temperature is usually measured where skin is
imaging device and target. At same distance, camera with thin, for example, neck, forehead or ears [ref?]. In previous
larger FOV can capture wider area than camera with smaller section, human face’s information is obtained from face
FOV as shown in Fig.2. Therefore, in order to precisely crop detection algorithm. So, it is simply to locate forehead’s
and align two images, measurement space and distance from position in thermal image since area and position of face are
two camera need to be carefully considered. Next, cropped already known. Our approach does not only obtain
images might have different pixel density if the resolution of temperature at forehead but it will search for position in face’s
each original image is not the same. This leads to incorrect area where temperature is highest and then gets temperature at
coordinates mapping between two image. Thus, image scaling that position from thermal image.
is required to guarantee correctness of coordinate mapping.
After processing, the measured temperature of each target will
B.   Target localization
be shown near the forehead of corresponding targets as shown
The objective of our system is to automatically do human in Fig. 3
temperature screening. Thus, our target is limited to human
only. There are various methods to detect and track human III.   FIELD TEST STUDY
position [6][7][8]. In our approach, build-in face detection
algorithm for RGB image is used. This algorithm does not Our field test takes place at medical service center’s pediatrics
only give position of human face in image but also provide section in Bangkok as shown in Fig.4a and National
other useful information of human face such as estimate face’s Electronics and Computer Technology Center (NECTEC) as
area, face’s orientation and eye’s position. Then, the shown in Fig. 4b . A thermal imaging camera in this set-up is a
information from this algorithm is used for obtaining 160x120-pixel FLIRONE™ [3] with maximum frame rate of 8
temperature from thermal image. Since RGB and thermal fps. A 2D temperature sensor of this thermal imaging camera
image is already aligned in previous section, the information has dynamic range of -20˚C to 120˚C with ±3˚C accuracy. Our
obtained from RGB image can be easily and precisely mapped mobile device is a tablet having 2.16-GHz Apple A97 dual
to thermal image. core with 2GB RAM. Visible and thermal image are processed
and updated on tablet’s screen at an average speed of 7 fps. In
addition, during our testing (6-h), surrounding temperature and
humidity are measured to observe its effect on system’s
performance. According to result, if environment is not greatly
changed, there is no significant effect on the accuracy of our
system. The field-test at NECTEC aims to verify accuracy of
our system compare with commercial infrared forehead
thermomerr. For field-test at medical service center,
performance of temperature screening is examined.

Fig.2 Comparison capture area of two different field of view


(FOV) at same distanc
(a) (b)
Fig.4 Field-test set up at medical service center’s pediatric
section

A.   Accuracy of temperature measurement


In the field-test at NECTEC, patient’s body temperature has Fig.6 Relationship between our system and forehead skin
been measured using both commercial forehead skin infrared infrared thermometer at NECTEC
thermometer and our system. The forehead skin infrared
thermometer used in this field-test is NC150, Micolife™ [2],
B.   Study of human fever identification
which has measurement accuracy of ±0.2˚C between 36˚C and
39˚C. The field-test begins with preparation our system. Besides good accuracy of measurement, sensitivity and
Firstly, our system is operated and left idle for 5 minutes. specificity in identifying unhealthy patients are also important
During idle state, it will self-calibrate and adjust measured parameters for evaluating system’s performance. In our study,
values in accord with surrounding temperature and humidity. the sensitivity is defined as a probability of the test gives
Next, certain offset value (usually within ±2˚C) is set in order positive in a febrile patient population. In the other hand, the
to make measured temperature close to inner body specificity is defined as probability of the test gives negatives
temperature. Exact inner body temperature is obtained by in population of patients who have no fever. In our study, we
measuring aural or axillary temperature using glass consider patient whose body temperature above 37.5˚C as
thermometer. Finally, after complete preparing our system, we febrile patients. Then, we follow the same procedure as the
follow procedure shown in Fig.5. Each step of measurement is field-test at NECTEC. During one-day field test at medical
repeated three times to ensure correctness of recorded service center, there are 14 patients with fever out of 62
temperatures. According to results, temperature measured patients. The measured sensitivity and specificity of our
from our system and forehead skin infrared thermometer are system is 100% and 70% when temperature threshold is
correlated with correlation coefficient 0.63. The average error 37.5˚C, respectively. Even though our system has lost
is 0.32˚C with standard deviation of 0.27˚C. In addition, specificity, all febrile patients are identified correctly. In, a 2-
relationship between our system and forehead skin infrared by-2 contingency table is shown in Table 1. In addition,
thermometer are shown in Fig.6. Even though correlation temperature measured from our system and forehead skin
between our approach and commercial device is a bit low, the infrared thermometer are significantly correlated with
average error is still in acceptable range. correlation coefficient 0.80. The average error is 0.66˚C with
standard deviation of 0.51˚C. In addition, relationship between
our system and forehead skin infrared thermometer are shown
in Fig.7.

Fig.5 Measurement procedure

Fig.7 Relationship between our system and forehead skin


infrared thermometer at medical service center
    Fever   No  Fever   Test Study of Our Non-Invasive Thermal Image Analyzer for
Deceptive Detection," in Biophotonics 2007: Optics in Life
Positive     14   14   Science, J. Popp and G. von Bally, eds., Vol. 6633 of
Negative   0   34   Proceedings of SPIE-OSA Biomedical Optics (Optical Society
of America, 2007), paper 6633_50.
Table 1 Contingency table of human fever screening
[6] L. Li and W. Hu, "New moving human detecting and
tracking algorithm," 2010 3rd International Congress on
IV.   CONLCUSION Image and Signal Processing, Yantai, 2010, pp. 345-348.
Instead of usual procedure for human fever screening, we [7] P. M. Maurer, "A universal symmetry detection
introduce a mobile-platform for automatic forehead fever algorithm," 2014 Design, Automation & Test in Europe
screening using 2D thermal imaging device and normal Conference & Exhibition (DATE), Dresden, 2014, pp. 1-4.
imaging device. Our approach consists of three main [8] Songyan Ma and Lu Bai, "A face detection algorithm
procedures; image alignment, target localization and based on Adaboost and new Haar-Like feature," 2016 7th
temperature measurement. Our system can achieve maximum IEEE International Conference on Software Engineering and
of 7 frames per second for processing 3 – 5 faces at a time. Service Science (ICSESS), Beijing, 2016, pp. 651-654.
However, this depends on performance of main processing
device. According to field test result, our system can achieve
100% sensitivity and 70% specificity for screening high
temperature patients. In addition, the accuracy of 2D thermal
imaging camera depends on surrounding temperature and also
device temperature. During our field test, we found that
accuracy of our system is significantly dropped when
surrounding temperature is considerably changed or
temperature of thermal imaging device is higher.
V.   ACKNOWLEDGEMENT

Author would like to thank 1) National Electronics and


Computer Technology Center (NECTEC) for supporting
funding and location for field-test 2) Medical service center in
Bangkok for arranging the measurement area

REFERENCES
[1] Rossuakon Charoensatsiri, Kanitsorn Keawdang,
Petcharat Denan, “Accuracy of infrared forehead skin
thermometer in acutely ill children at out-patient department,
Prapokklao Hospital”, The Journal of Prapokklao Hospital
Clinical Medical Education), [S.l.], v. 31, n. 1, p. 43-51, Oct.
2016. ISSN 0857-0914. Available at: <https://www.tci-
thaijo.org/index.php/ppkjournal/article/view/68153/55528>.
Date accessed: 11 Jan. 2017.
[2] Non-contact thermometer, “The Microlife NC150”,
Available at <http://www.microlife.com/consumer-
products/fever/infrared-thermometer/nc-150>, Date accessed:
12 January 2017.
[3] Thermal imaging camera, “FLIRONE™”. Available
at< http://www.flir.com/flirone/>, Date accessed: 6 February
2017.
[4] Sarun Sumriddetchkajorn, Kosom Chaitavon, Field
test studies of our infrared-based human temperature screening
system embedded with a parallel measurement approach,
Infrared Physics & Technology, Volume 52, Issue 4, July
2009, Pages 119-123, ISSN 1350-449
[5] S. Sumriddetchkajorn, A. Somboonkaew, T.
Sodsong, I. Promduang, and N. Sumriddetchkajorn, "A Field

You might also like