Critical Review

Fareena 19L-1804 Talha 19L-1871

December 6, 2020

Sentiment Prediction by Merging Hand-Craft and

CNN Features

1
1. Citation
[1] . Wang Fengjiao and Masaki Aono Toyohashi University of Tech-nology
Toyohashi, JAPAN

2. Area
Visual Sentiment Analysis

3. Keywords
Visual Sentiment; Convolutional Neural Networks; Hand-craft Fea-tures;
Data Augmentation; Transfer Learning

4. Problem Statement / Hypothesis

How to predict visual sentiment by merging hand-craft and CNN features

5. Propsed Solution
They plan to merge CNN which has shown remarkable achievements in
Computer Vision recently, with handcraft features like Color His-togram (CH)
and Bag-ofVisual Words (BoVW) with some local fea-tures like SURF and
SIFT to predict sentiment of images. The results of experiments demonstrate
that our proposed visual sentimental pre-diction framework outperforms the
present state-of-the-art methods Proposed a novel framework considering
both hand-craft and CNN features to predict sentiment of images

6. Major results
By merging hand-craft and CNN features can improve performance of visual
sentiment prediction. Smart approaches to data augmenta-tion can increase
the size of the training set 10 times or more

Method : DA : NDA

3 Agree Accuracy : 0.744 : 0.720

4 Agree Accuracy : 0.866 : 0.828

= 5 Agree Accuracy : 0.921 : 0.853

7. Significance

2
 1. Sentiment analysis of image data and Convolutional Neural Net-work
(CNN) features

2. Both hand-craft and CNN features to predict sentiment of images

3. Employ both data augmentation and transfer learning from a pre-trained

CNN such as VGG16 trained with ImageNet dataset.

4. proposed visual sentimental prediction framework outperforms the

current state-of-the-art methods

8. Shortcomings
1. Polarity sentiment classification was limited

2. Experimental details are not defined

3. Hardware specification details are not defined

4. The research on sentiment analysis of visual contents has not been

deeply investigated yet

5. select only a 64-bin color histogram feature

9. Future Directions
1. Only focused on polarity sentiment classification, while there is
potentially more sentiment such as anger, sad, and surprise.

2. Each image may have multiple sentiment, which reduces to “multi-label

multi-class” problems.

3. Finally, even one emotion may have several intensity levels such as
“strong positive” and “weak positive”, where we might need “fine grained”
sentiment analysis with more sophisticated framework

10. Any cited reference to follow up

1. C. Szegedy, W. Liu, Y. Jia and P Sermanet, “Going deeper with
convolutions,” Proceedings of the IEEE conference on computer vi-sion and
pattern recognition, 2015, pp. 1-9.

11. Any comments

NA