Professional Documents
Culture Documents
2017 Opto-Electronics and Communications Conference (OECC) and Photonics Global Conference (PGC)
2017 Opto-Electronics and Communications Conference (OECC) and Photonics Global Conference (PGC)
Armote Somboonkaew*, Panintorn Prempree, Sirajit Vuttivong, Jutaphet Wetcharungsri, Supanit Porntheeraphat,
Sataporn Chanhorm, Prasit Pongsoon, Ratthasart Amarit, Yuttana Intaravanne, Kosom Chaitavon, Sarun
Sumriddetchkajorn
Photonics Technology Laboratory, National Electronics and Computer Technology Center (NECTEC),
National Science and Technology Development Agency (NSTDA)
Pathum Thani, Thailand
*Email: armote.somboonkaew@nectec.or.th
Abstract— In this paper, automatic fever screening system is Even though using the infrared forehead skin thermometer is
proposed and experimentally implemented using an IR camera convenience, however, it requires a few seconds to complete
and a mobile phone. Our system locates position of patients the measurement. Furthermore, number of measurement is
automatically using face detection algorithm on RGB image and strictly limited to one person at a time. Therefore, this scheme
obtains temperature from IR image at detected location.
is not suitable for massive human temperature screening in
Advantages are fast, portable, non-contacting and simultaneously
temperature measurement. Furthermore, face detection large public area, which needs faster screening rate to avoid
algorithm allows the system to track patient’s face position. congestion. According to [4][5], high-throughput and non-
Hence, robust and non-contacting temperature measurement can contact human temperature screening system can be achieved
be properly done even patients are not stand still. Our system has by using 2D thermal imaging device, so called IR camera, and
been field-tested to measure temperature and screen ill patients human flow management. Nevertheless, this system cannot be
at a children medical clinic. In this experiment, the system is used with ease due to size of 2D thermal imaging device and
calibrated to measure temperature of patients at 1 meter away installation cost.
and gives an alarm sound when the measured temperature is Because of an improvement of 2D thermal imaging
above the desired setting threshold. According to experimental
technology, size and price of IR camera is reduced
results, the correlation coefficient between temperature obtained
from our system and commercial infrared forehead skin considerably. Therefore, it is possible to design a mobile,
thermometer [2] is more than 0.80. In addition, our system high-throughput and non-contact human temperature
achieves a 100% sensitivity and 70% specificity. Although our screening system based on 2D thermal imaging device.
approach loses specificity, all fever patients are identified
correctly. Thus, they are significantly correlated. Therefore, this II. METHODOLOGY
system can reliably estimate body temperature of patients and Our approach is a parallel image processing of an RGB image
can be used for effectively pre-screening fever patients. from visible camera and a thermal image from IR camera.
The RGB image is used for targeting area of measurement.
Keyword- Infrared, non-contact temperature measurement,
automatic fever screening measurement, mobile device, face Then, maximum temperature in corresponding area is obtained
detection from the thermal image. Even though this procedure seems to
be simple, however, mapping position between two images
from difference cameras is quite complicated due to different
I. INTRODUCTION hardware characteristics such as field of view (FOV) and
Medical service in most hospital starts with patients’ image resolution in pixels. Therefore, it is necessary to do
temperature measurement and then screening fever patients. image alignment between images from each camera to avoid
Core temperature can be accurately estimated by measuring incorrect mapping.
axillary or oral temperature using stick type, or glass
thermometers. However, these methods are not convenient due
to uncooperative patients, especially for young children, and
time-consuming. Therefore, some hospitals start using an
infrared forehead skin thermometer instead. This thermometer
measures intensity infrared, which emits from skin, and
converts it to temperature. According to [1], the axillary
temperature and infrared forehead skin temperature are
strongly correlated. Thus, body temperature can also be
estimated by using emission of infrared from the forehead
e
Fig.1 Flowchart of image processing in locating human face Fig. 3 Resulted mage after processing
and temperature measurement
A. Image alignment
An image alignment consists of two procedures; image C. Temperature measurement
cropping and image scaling. Cropped image’s position and In order to measure core temperature of human, besides oral
area depends on FOV of each camera and distance between temperature, temperature is usually measured where skin is
imaging device and target. At same distance, camera with thin, for example, neck, forehead or ears [ref?]. In previous
larger FOV can capture wider area than camera with smaller section, human face’s information is obtained from face
FOV as shown in Fig.2. Therefore, in order to precisely crop detection algorithm. So, it is simply to locate forehead’s
and align two images, measurement space and distance from position in thermal image since area and position of face are
two camera need to be carefully considered. Next, cropped already known. Our approach does not only obtain
images might have different pixel density if the resolution of temperature at forehead but it will search for position in face’s
each original image is not the same. This leads to incorrect area where temperature is highest and then gets temperature at
coordinates mapping between two image. Thus, image scaling that position from thermal image.
is required to guarantee correctness of coordinate mapping.
After processing, the measured temperature of each target will
B. Target localization
be shown near the forehead of corresponding targets as shown
The objective of our system is to automatically do human in Fig. 3
temperature screening. Thus, our target is limited to human
only. There are various methods to detect and track human III. FIELD TEST STUDY
position [6][7][8]. In our approach, build-in face detection
algorithm for RGB image is used. This algorithm does not Our field test takes place at medical service center’s pediatrics
only give position of human face in image but also provide section in Bangkok as shown in Fig.4a and National
other useful information of human face such as estimate face’s Electronics and Computer Technology Center (NECTEC) as
area, face’s orientation and eye’s position. Then, the shown in Fig. 4b . A thermal imaging camera in this set-up is a
information from this algorithm is used for obtaining 160x120-pixel FLIRONE™ [3] with maximum frame rate of 8
temperature from thermal image. Since RGB and thermal fps. A 2D temperature sensor of this thermal imaging camera
image is already aligned in previous section, the information has dynamic range of -20˚C to 120˚C with ±3˚C accuracy. Our
obtained from RGB image can be easily and precisely mapped mobile device is a tablet having 2.16-GHz Apple A97 dual
to thermal image. core with 2GB RAM. Visible and thermal image are processed
and updated on tablet’s screen at an average speed of 7 fps. In
addition, during our testing (6-h), surrounding temperature and
humidity are measured to observe its effect on system’s
performance. According to result, if environment is not greatly
changed, there is no significant effect on the accuracy of our
system. The field-test at NECTEC aims to verify accuracy of
our system compare with commercial infrared forehead
thermomerr. For field-test at medical service center,
performance of temperature screening is examined.
REFERENCES
[1] Rossuakon Charoensatsiri, Kanitsorn Keawdang,
Petcharat Denan, “Accuracy of infrared forehead skin
thermometer in acutely ill children at out-patient department,
Prapokklao Hospital”, The Journal of Prapokklao Hospital
Clinical Medical Education), [S.l.], v. 31, n. 1, p. 43-51, Oct.
2016. ISSN 0857-0914. Available at: <https://www.tci-
thaijo.org/index.php/ppkjournal/article/view/68153/55528>.
Date accessed: 11 Jan. 2017.
[2] Non-contact thermometer, “The Microlife NC150”,
Available at <http://www.microlife.com/consumer-
products/fever/infrared-thermometer/nc-150>, Date accessed:
12 January 2017.
[3] Thermal imaging camera, “FLIRONE™”. Available
at< http://www.flir.com/flirone/>, Date accessed: 6 February
2017.
[4] Sarun Sumriddetchkajorn, Kosom Chaitavon, Field
test studies of our infrared-based human temperature screening
system embedded with a parallel measurement approach,
Infrared Physics & Technology, Volume 52, Issue 4, July
2009, Pages 119-123, ISSN 1350-449
[5] S. Sumriddetchkajorn, A. Somboonkaew, T.
Sodsong, I. Promduang, and N. Sumriddetchkajorn, "A Field