Professional Documents
Culture Documents
ISBN: 978-1-4799-8283-7
Abstract — Obesity is prevalent worldwide including UK and monitoring applications. For these applications, users must
Ireland, affecting all demographics. Obesity can have a remember exact portion sizes to obtain nutritional content. This
detrimental affect on an individual’s health, which can lead to method can cause several issues in regards to accuracy. The user
chronic conditions. Different digital interventions have enabled can miscalculate food portion size. To tackle this issue, image
users to photograph food items to be identified using different calorie and food identification techniques have been employed
feature extraction methods. In this research, we proposed a system to determine food items and content in images.
that allows users to draw a polygon around a food item for
segmentation. After segmented, the region is then classified using II. RELATED WORK
an automated voting system. Different features will then be
extracted from the specified area. Support Vector Machines will Different methods were employed to identify food. In [5],
be issued for each feature type. This system is a proof-of-concept SURF is incorporated with BoFs and colour histogram
and is designed to research the effectiveness of employing multiple extraction is used to identify foods within an image. To extract
feature detection algorithms to classify food images. To classify separate food items for classification, Grubcut [5] was used.
food regions a Bag-of-features (BoFs) approach will be used for Results in [5] research show an 81.55% accuracy result using
each. Speeded Up Robust Features point detection and descriptors these methods. In [6], SURF and colour features were used to
was used along with colour spatial features, and also MSER region determine different food types and results show 86% precision
detection with SURF. Each of these methods will have their own and 83% recall. In [7], a food recognition system that utilised an
BoF to train an SVM. The aim of this research was to create a optimised version of bag-of-words was created. This research
voting classification system that utilises each feature detection involved collating and organising a visual dataset of 5000
algorithm to ultimately identify the segmented food region images into categories. Local features were collated to build a
through plurality (or majority) vote. Testing showed that the visual dictionary. The system achieves 78% accuracy. In other
system achieved 75% accuracy when combining each feature SVM research [8], colour segmentation, texture segmentation, and K-
to create a voting system. The system outperforms two of the means clustering were utilised to segment foods and feature
feature classifiers (SURF and MSER with SURF). LAB colour extraction used to classify foods with SVM. In [8] using all
classifier slightly outperformed the voting mechanism within the
feature extraction methods achieved accuracy of 92.21. In this
developed system. In regards to future work, further development
research, we offer a method in which users are able to manually
and testing would be completed through increasing the variety of
food items used in the training phase and a larger test dataset draw around a food item segmentation and identification.
would also be used.
In [9], SIFT was investigated in combination with colour
Keywords— Bag-of-features; classification; SURF; features; descriptors. Accuracy rate combining different feature
predict; semi-automated; voting; descriptors, including SIFT, was 82.8%. Other research [10]
utilises SIFT descriptors along with colour histograms in order
I. INTRODUCTION to identify food items, this research utilises a SVM approach for
Obesity is prevalent worldwide throughout UK and Ireland each method (colour histogram and SIFT features) to classify
[1, 2]. Obesity affects all age groups and brings with it various major food types. In [11] SURF was used along with other
chronic conditions such as diabetes, hypertension, heart disease, interest and blob detectors such as MSER and STAR to extract
and certain types of cancers [3]. Research has shown that information from videos using a bag-of-words model. The
children who are obese have a greater chance of being obese system aims to identify food portions and estimate calorie
when they are adults [4]. Digital interventions are becoming content. Results show in [11] that SURF achieved 95%
more and more ubiquitous. There has been an increase of calorie accuracy rating. The aim of this research is to combine different
ACKNOWLEDGEMENTS
This system would also include methods to detect the Acknowledgement to DELNI for funding this research.
portion area measured in cm2 by including a predetermined
reference point in future test images as described in previous REFERENCES
work [22]. The reference point will be an object of known area [1] National Obesity Awareness Week, “State of the Nation’s Waistline”,
e.g. coin, thumb, or a square. The system will detect the pixels Obesity in the UK, 2014.
in the ROI specified by the user and the reference point would [2] Keane, E., Kearney, P. M., Perry, I. J., Kelleher, C. C., & Harrington,
be used to calculate the portion area in cm2. The food portion J. M. (2014). Trends and prevalence of overweight and obesity in
can then be calculated and the region classified for accurate primary school aged children in the Republic of Ireland from 2002-
2012: a systematic review. BMC Public Health, 14(1), 974.
food logging. For further accuracy measurements depth sensor http://doi.org/10.1186/1471-2458-14-974
methods could be employed to accurately determine food [3] NHLBI Obesity Education Initiative Expert Panel on the Identification,
portion size along with this classification system for food E. and T. of O. in A. (US). (n.d.). Overweight and Obesity:
logging. Instead of using SVM to identify the ROI, other Background. National Heart, Lung, and Blood Institute. Retrieved from
supervised classification techniques could be employed such http://www.ncbi.nlm.nih.gov/books/NBK1995/
[4] Ebbeling, C. B., Pawlak, D. B., & Ludwig, D. S. (2002). Childhood
as Neural Networks (NN) within this system to investigate obesity: public-health crisis, common sense cure. Lancet, 360(9331),
changes or improvements, if any in regards to accuracy. A 473–82. http://doi.org/10.1016/S0140-6736(02)09678-2
combination of such supervised techniques could be used [5] Kawano, Y., & Yanai, K. (2013). Real-Time Mobile Food Recognition
along with feature detection algorithms to garner more results System. In Computer Vision and Pattern Recognition Workshops
for further analysis. (CVPRW), 2013 IEEE Conference on (pp. 1–7).
http://doi.org/10.1109/CVPRW.2013.5
[6] Pham, C., Thi, N., & Thuy, T. (2014). Fresh Food Recognition Using
Feature Fusion, 298–302.