Team Member’s Details - :

1. Name - Sumiksha Gupta

Roll No - 17EIACS075
Signature -
Present Address - Inside Delhi Gate, Alwar
E-mail - sumikshagupta3008@gmail.com
Contact No. - 8000918702
Department - Computer Science
Proposed Topic - Calorimeter
Name of Guide - Dr. Rohit Kr. Singhal
 INTRODUCTION
Due to the improvement in people’s standards of living, obesity rates are increasing at an alarming
speed, and this is reflective to the risks in people’s health. People need to control their daily calorie
intake by eating healthier foods, which is the most basic method to avoid obesity. However, although
food packaging comes with nutrition (and calorie) labels, it’s still not very convenient for people to
reference. When people’s Body Mass Index (BMI) is over 30 (kg/m2), they are generally considered to
be obese. High BMI can increase the risk of illnesses like heart disease. The main reason of obesity is
due to the imbalance between the amount of caloric intake (consumption) and energy output
(expenditure). Because of unwillingness to record and track, lack of related nutritional information or
other reasons, patients often experience trouble in controlling the amount of calories they consume.
Earlier the users used to track their calories intake with the help of charts or timetable. Or they used to
maintain a strict diet where the food item which has to be consumed was fixed along with its quantity.
These methods are a bit tedious and difficult for the user to follow judiciously. We have come up with
a project to help the user track the number of calories which it takes in with the help of simple images
of the food item. There are already many different apps and products available to do the same. In
these apps, the user inputs the ingredients and their amount which they are consuming. The apps then
search them in their database and calculate the calories present in them with values present in the
database. Computer vision is also used to estimate the amount of calories present. The accuracy of
these projects is determined by two factors, the accuracy of the object detection algorithm and the
method to calculate the volume.

Requirement and Productivity

 Problem Identification and Formulation

Obesity in the world has spread to epidemic proportions. Obesity treatment requires constant
monitoring and a rigorous control and diet to measure daily calorie intake. These controls are expensive for
the health care system, and the patient regularly rejects the treatment because of the excessive control over
the user. Recently, studies have suggested that the usage of technology such as smartphones may
enhance the treatments of obesity and overweight patients; this will generate a degree of comfort for the
patient, while the dietitian can count on a better option to record the food intake for the patient. In this
paper we propose a smart system that takes advantage of the technologies available for the
Smartphones, to build an application to measure and monitor the daily calorie intake for obese and
overweight patients. Via a special technique, the system records a photo of the food before and after
eating in order to estimate the consumption calorie of the selected food and its nutrient components.
Our system presents a new instrument in food intake measuring which can be more usefuland effective.

Objective
To propose a method for measuring food nutritional value, this method can be used as a personal assistive
application on smartphones. The system analyses food images using a set of image processing and analysis
procedures, and makes use of a database of images to extract the information needed like color, shape and
size properties from the images. It then uses an SVM to suggest the food portion types.

Methodology
 Dataset – Our dataset is made from manually clicking pictures of a food item by the members of
this project. We have also used the dataset from GitHub. The dataset contains images of food items
along with the XML file of that image. The XML file is used for obtaining the coordinates of the
food item in the particular image. The dataset contains images of ten different food items.
 Image Detection - For image detection, we use Faster R-CNN algorithm. In this algorithm, we
provide the image to the convolution network as an input and we get a convolution feature map as
output. The algorithm uses a separate network to predict the region proposals. The ROI pooling
layer is used for reshaping the predicted region proposals. The offset values for the bounding boxes
are predicted with their help and the images are also classified within the proposed region. Faster R-
CNN is used for image detection because it is the fastest among all the other detection algorithms
such as R-CNN and Fast R-CNN.
 Image Segmentation - Image Segmentation using the grab cut algorithm. In the grab cut algorithm,
we mark the object with the help of a box. The box is used to distinguish the object from the
background. The outer part of the rectangle is the background and the inner part of the algorithm is
the combination of some background and the object. After that, we use an iterative method which
assigns each pixel as a background or foreground pixel. The initial labelling is done by the
computer according to the data provided by the user. Then we use the Gaussian mixture model to
model the foreground and the background. Then we mark the probable foreground or probable
background pixels to unknown pixels. It depends on their relationship with other hard-labelled
pixels in terms of colour statistics. This is very similar to clustering. Every node in the graph is a
 pixel additional nodes such as source and sink nodes are added. The source node is connected to the
foreground pixel and sink node are connected background pixel. The probability of a pixel whether
it is foreground/background determines the weight of the edges which are connecting the pixels to
the source node or end node. The information on the edge or the similarity between pixels is used to
determine the weights between the pixels. Low weight will be assigned to the edge between the
pixel if the difference in pixel colour is very large. Then the Segmentation of the graph is done
using mincut. The graph is cut into two separating source node and sink node with a minimum cost
function. The sum of all weights of the edges that are cut is known as the cost function. After the
cut, all the pixels connected to the Source node become foreground and those connected to Sink
node become background. The process is continued until the classification converges.
 Calorie Estimation –

Proposed place of work - College

Weekly Hours - 15 – 20 hours

References
[1] W. Jia, H. C. Chen, Y. Yue, Z. Li, J. Fernstrom, Y. Bai, C. Li, M. Sun, Accuracy of food portion size
estimation from digital pictures acquired by a chest-worn camera., Public Health Nutrition 17 (8) (2014).
[2] Z. Guodong, Q. Longhua, Z. Qiaoming, Determination of food portion size by image processing,
[3] Y. Bai, C. Li, Y. Yue, W. Jia, J. Li, Z. H. Mao, M. Sun, Designing a wearable computer for lifestyle
evaluation., in: Bioengineering Conference, 2012, pp. 93–94.
[4] P. Pouladzadeh, P. Kuhad, S. V. B. Peddi, A. Yassine, S. Shirmohammadi, Mobile cloud based food
calorie measurement (2014) 1–6.
[5] S. Ren, K. He, R. Girshick, J. Sun, Faster r-cnn: Towards real-time object detection with region proposal
networks, in: Advances in neural information processing systems, 2015, pp. 91–99.

Project Completion and Submission Date