2019 International Conference on Information Technology (ICIT)
Classification of Airline Tweet using Naïve-Bayes classifier for Sentiment Analysis
Nand Kishore Sharma Prof. (Dr.) Surendra
Ph.D. Scholar, Amity School of Rahamatkar
Engineering & Technology Amity School of Engineering &
Amity University Chhattisgarh Technology
Raipur, India Amity University Chhattisgarh
er.nksharma.mtechcs@gmail.com Raipur, India
srahamatkar@rpr.amity.edu
Abstract—Wide range of customers like family persons,
business man, sportsman and youth are traveling via Airline.
Hence feedback of persons matters a lot if they are involved.
Direct feedbacks of customer may be positive or negative but
analyzing their Tweets is important for the betterment i.e.
how the Tweets is? Analysis of individual tweet is so much
critical if the volume is high. Most of the times Tweets are
ambiguous, which depends on the nature of customers i.e.
positive person will always give positive Tweets and in other
side negative tweets come from negative person. So
ultimately, our work is to find the sentiments of descriptive
Tweets as a result via their words and their expression in
quantities format whether they are happy or not. The novel
factor inside this work is to examine ambiguous Tweets and
neutralize them according to proposed algorithm.
The complete work is based on twitter dataset, here we
are using US airline and performs different level of mining
and processing for getting most accurate results. Here,
improved sentiment analysis model has been proposed based
on naïve Bayes classifier to classify tweets based on
sentiments and neutralized tweets from ambiguous to
positive or negative.
Keywords—Sentimental analysis; Ambiguous
words; Airline dataset; Naïve-Bayes classifier
I. INTRODUCTION
Sentiment analysis is the only innovative technique that
facilitates to investigate the thinking and thoughts of the any
kind of user. It can be defined as: “Sentiment analysis, also
called opinion mining, is the field of study that analyzes
people’s opinions, sentiments, evaluations, appraisals,
attitudes, and emotions towards entities such as products,
services, organizations, individuals, issues, events, topics,
and their attributes.”
Twitter data or social networking sites are to know about
behavior and opinion of users. It may help to track the
interest and connectivity of user with respective of their
viewpoint. Let’s consider example of feedback system,
where opinion and different viewpoint of users can observe
from their feedback. Feedback system lies on the concept of
marking leads to calculate the relationship on basis of
various points, despite descriptive feedback can also plays
important role to understand best way of opinion.
Descriptive or subjective feedback can help to understand
the demand and need. It can be written as subjective form of
feedback to express thought or user view. Thus, it may be
considered as the great source for analysis.
978-1-7281-6052-8/19/$31.00 ©2019 IEEE 70
DOI 10.1109/ICIT48102.2019.00019
Authorized licensed use limited to: Somaiya University. Downloaded on December 28,2023 at 13:29:24 UTC from IEEE Xplore. Restrictions apply.
Sachin Sharma
Department of Information
Technology
Chameli Devi Group of
Institutions, Indore (M.P.) India
sachindav12@gmail.com
This work examined different existing solutions with
observing data classification algorithm, these approaches
are the major approach for feature extraction deriving
sentiments and opinions of different users. Here, Naïve
Byes Classifier is considered to classify user opinion
[tweets].
Sentiment based approach is presented in this paper for
calculating polarity of ambiguous data. NLP is the Natural
Language Processing whose important task are Sentimental
Analysis or Opinion mining. It has gained a wide attention
in the modern period. Sentimental polarity categorization
problem is tackled in this paper, and it is the fundamental
issue of sentimental analysis. Experimental approach for
sentimental polarity categorization is proposed in
descriptive way.
Based on contextual ambiguity issue arises of polarity
calculation for sentimental analysis. Different polarity is
calculated for different context using opinion keywords, it is
a big challenge for researchers in the area of sentimental
analysis. This issue of polarity is resolved ineffectively
from term-level features.
Earlier, opinion mining effectively deals in progressive way
with different scenario by developing document level
analysis [1][2][3]. In sentimental analysis many issues arise
with subjective detection and sentiment classification.
In general, way sentimental analysis focuses on determining
writer’s attitude with respect to complete context of
document with calculating polarity. This attitude of speaker
and writer evaluates user’s judgment in a state of emotions
of writer when writing with emotional communication.
Important task of sentimental analysis is the classification of
polarity of text in a document and also feature level is
expressed through opinion of document either it’s positive
or negative or neutral. Sentiment classification for polarity
in an emotional state can be as sad, happy, or angry.
II. LITERATURE SURVEY
A. Existing Work
Trupthi et al. [1] described about sentimental analysis and
opinion mining, which explores about users’ sentiments and
thinking. Author uses Naive Bayes classifier for
examination of real data twitter data and for the
classification of data and feature extraction, unigram
approach is used.
• For user thinking and eventual sentiments, opinion
mining and sentimental analysis is used.
• Twitter data is considered as the main source for
examining real data using unigram for data
classification and feature extraction and also by using
Naive Bayes.
• Sentiment of word and its polarity is calculated in
this work by considering positive tweets, degree of
positive words, positive words and complete tweets
are observed.
B. Related Work
Cambria E, Olsher D, Schuller B et al. In[2][3][4]
introduces an effective progress in opinion mining which is
deals better earlier. Many different scenarios are developed
to deal with it in recent year with achieving document level
sentimental analysis. Sentimental analysis faces many
issues for subjective detection and classification. Turney et
al. [5] worked on method called as bag-of-word method,
where relationships among words in a sentence are not
considered for sentimental analysis. Sentence is a collection
of words, sentiment of the complete sentence is described as
determining sentiment of every single word, and using some
functions, values are aggregated.
Divya Sehgal et al. In[6] researched about data analytics for
twitter data and sentiment analysis is used here broadly.
Some of the useful aspects are covered by author like large
amount of twitter data used for business and social purpose
on the basis of requirements data processing. Size of this
data is very large which is increasing every second and this
large data is handled using Hadoop. Large sized tweet data
is analyzed using Hadoop. Data efficiency and
improvement in data analysis regulates data values. On the
basis of Tweets, comments, blogs of social media, project is
expanded. Its accuracy totally depends on values.
M. Mazhar Rathore et al. In[7] introduces about Geosocial
Networks which is government liability in terms of safety
from any kind of disasters. Providing with proper facility
from management and decrease in risk of the spread of
infection. Common citizens are recommended by system
and also provided with recommended system, healthcare
system etc. And also new products can be launched in
different fields by monitoring geosocial data of specific
location. For better analysis benefits are provided for
employing significant data generation from geosocial
network. A high computing capabilities with better analysis
and advanced technology is possible. That is why, a system
is proposed by author with better planning, provided with
proper management and safety from disasters. This system
provides with high speed data in geosocial networks and
71
Authorized licensed use limited to: Somaiya University. Downloaded on December 28,2023 at 13:29:24 UTC from IEEE Xplore. Restrictions apply.
also process and analyze and make decisions. Author used
twitter data and worked it on Hadoop using spark.
Amit Gupte et al. [8] comparison is made by author with
using Random Forest, Maximum Entropy, Boosted tree and
Naive Bayes approaches. Random forest classifier shows
greater performance and accuracy in sentimental
classification. It provides benefit of ease to understand with
the improvement in time. Decision tree provides with high
rate of accuracy improvement. More power is required with
processing and training time.
If only considered with accuracy, then Random Forest
classifier is taken as priority. With less processing and
small memory, Naive Bayes classifier is used. Maximum
Entropy classifier is used with large processing time, small
training time and large memory. SVM is concluded as
better by author because of its higher accuracy output.
Suchita V Wawre et al. [9] proposed comparison between
SVM and Naive Bayes classifier. These classifiers are the
supervised machine-learning algorithm for sentimental
analysis. There is no comparison with each other if they
have less Tweets. Alessia D’Andrea et al. [10] introduce
different tools and approaches with sentimental analysis
for classification. Using machine learning with lexicon
based, author uses an approach called as Hybrid approach
and is used for higher classification and performance. An
exact design is provided for the capabilities of machine
learning as a fundamental part. Hailong Zhang et al. [11]
compared machine-learning approach with lexicon based
for sentimental analysis. For comparative analysis cross-
domain and cross, lingual method based on sentimental
analysis is used. Both methods provides with different
benefits and are competing in their own way. High
accuracy is provided by machine learning technique. For
labeling document, manually Lexicon-based approach is
required. Turney et al. [12] explains about word polarity
disambiguation with the sentiment words in ambiguous to
eliminate easily from real world application. Author
designed an algorithm called PMI (point wise mutual
information algorithm) with Tweets and calculates
sentiments for sentiment word.
III. PROBLEM DOMAIN
Citizen’s behavior and opinion is one of the important
part in the field of sentiment analysis. It can help to
establish strong association between user desire and
viewpoint. It is a good way to explore fine or minute scope
of improvement. Tweets can helps in knowing the view of
user against any incidence or events. Strong sentiment
analysis can lead to improvement of current trend
scenarios. For such reasons, sentiment analysis of user
viewpoint becomes mandatory for all citizens.
 Although, Existing system provides good way to
explore user sentiments but still suffer with certain
limitations:
• It considers words as individual effort and
tokenize sentence in form of words.
• They state, “Future enhancement to this work
might be to use n-gram classification rather than
limiting to uni-gram” to overcome this issue.
• Existing solution has used Uni-gram Naïve
classifier, which considers word probabilities for
training, and testing purposed both.
• Sentiment analysis of whole sentence can help to
reach more close to user viewpoint.
• At time of classification, they consider individual
word rather actual sentence. They also suggest to
use on n-gram Naïve classifier rather uni-gram.
• Authors do not consider ambiguity as serious
problem and only concentrate to improve
performance of sentiment analysis.
• Existing solution may be compromised for
taunting tweets or indirect comments which
comes with positive words but used in negative
purpose.
With using different algorithms, different phrases can
be identified with positive or negative annotation based on
frequency of occurrence of phrase and through it; its
weight can be calculated based on phrases. Tweets are the
online data of social site, which contains variety of flaws
with the probability to hinder sentiment analysis.
Limitations arises here is quality of opinion because of
the right to freely post, meaningless contents due to online
spammers. Another one is truth; only opinions are taken as
truth, which can be as positive, negative or neutral.
Sentimental polarity is classified as sentence-level and
Tweets-level, where sentence level define sentiments
through positive and negative terms. Data required for
sentence-level needs truth facts to convey sentence, and
this the significant which arises as the truth.
IV. PROPOSED METHODOLOGY
Proposed work includes some modules in which flow
of the work is explained through proposed architecture.
Step involved in proposed methodology are as:
Functionality and Design:
• Data Acquisition
• Human labelling
• Feature Extraction
• Classification
Step 1: Data Collection and Preparation:
Data can be collected either directly from the user or
from the existing system. In proposed work, we have used
72
Authorized licensed use limited to: Somaiya University. Downloaded on December 28,2023 at 13:29:24 UTC from IEEE Xplore. Restrictions apply.
Airline Tweet Dataset from Kaggle data repository. A link
to detail description is cited below;
https://www.kaggle.com/crowdflower/twitter-airline-
sentiment#Tweets.csv
Step 2: Data Pre-processing:
a. Data Cleaning: Data cleaning is done to remove
redundant data, irrelevant tweets, image short path &
unwanted link.
b. Lemmatization: Stanford Lemmatize Library is used.
Lemmatization refers to vocabulary and morphological
words. It removes infected word and concentrate on
words involved in dictionary.
c. Tokenization: Here, sensitive data is replaced with
non-sensitive equivalent data and are represented as
tokens.
Step 3: Proposed Estimation:
a. Ambiguity based polarity estimation: To check polarity
of ambiguity word. Whether the word is positive,
negative, partial positive, partial negative or neutral.
b. This work will initially classify Tweets in three
categories which are positive, negative and ambiguous.
Example of ambiguous Tweets is cited below;
Ambiguous tweet: “This is good airline service but
comes with high tariff. They do not provide good
service. Best part of this airline is they are always
available. “
Positive tweet: “This one is the best airline comes with
awesome services and facility. 100 % recommendation
for new once”
Negative tweet: “Worst services experience. Air
hostess don’t know about their responsibilities”
c. This work will investigate ambiguous tweets and
observe sentiments of every word. After observing
sentiment for every individual, it also checks sentiment
of previous and next word. In case of ambiguous word,
it fixes the word polarity based on occurrence of
previous and next whether they are positive or
negative.
d. The complete Tweets will be forwarded to Naïve
Bayes classifier.
Step 4: Classifier:
a. Naïve Bayes classifier: It is used for large volume of
dataset. Naïve Bayes classifier supposes that features
are independent with values of given class labels. It
will apply unigram and n-gram technique and
concludes results based on both techniques.
Step 5: Tweets Classification:
a. Sentiment calculation: polarity of sentiments is
calculated.
 12. set threshold value & Naive Bayse's Classification
and run unigram
13. set threshold value & Naive Byse's Classification
and run n-gram
14. Calculate average of 12 & 13 and classify tweets.
15. Classification of positive & Negative Tweets

V. EXPERIMENT ANALYSIS
The complete result examination has been performed for
five different data sample. Proposed solution has been
examine and compared with previous results to justify that
proposed solution perform better than existing solutions.
Here, size of different data samples has been shown in
table 1.

TABLE I. DATASET

To observe the accuracy of proposed solution precision

and recall has been examined. Here, total tweets,
recommended and retrieved tweets have been calculated
Fig 1: Proposed Architecture to estimate precision and recall parameters of proposed
solution. Following formulas are used to estimate
The complete work has been represented into Pseudo code precision, recall and f-score.
formation which is shown below;
Precision = Total Recommended Tweets
1. Consider AirLine Dataset as Source of Input Total Number of Tweets Retrieved
2. Input: Set variables tweet_id,airline_sentiment
Recall/Accuracy = Total Recommended Tweets
airline_sentiment_confidence,negativereason,nega
Total Number of Relevant Tweets Retrieved
tvereason_confidence
airline,airline_sentiment_gold,name,negativereason
_gold, F-Score = 2 * ((Precision * Recall)/ (Precision + Recall))
Title Size Total Number of Tweets
retweet_count,text,tweet_coord,tweet_created,tweet
_location, user_timezone Input 1 100 KB 1325
2859
3. Define Array Stopwords[]= {is, am, are, an, this} Input 2 200 KB
Input 3 300 KB 4256
4. Remove Stop words
Input 4 500 KB 7256
5. Perform Lemmatization
Input 5 1 MB 13569
6. Perform Tokenization
7. Set variable pre_word, post_word, curr_word The complete performance observation are shown in
8. Check if(polarity[curr_word]==ambigious ) Table 2,3,4 and relevant graphs.
9. Recheck if (polarity[pre_word]==positive ) TABLE II. PRECISION

{ set: curr_word = positive }

Title Recall
else
Input 1 0.74
{ set: curr_word = negative }
Input 2 0.75
10. Replace word by polarity and estimate weight by Input 3 0.77
individual Tweets for ambiguous Tweets
classification Input 4 0.84

11. If (positive Tweets weight > negative Tweets Input 5 0.87

weight)
{Tweets positive } else {Tweets negative}

73

Authorized licensed use limited to: Somaiya University. Downloaded on December 28,2023 at 13:29:24 UTC from IEEE Xplore. Restrictions apply.
 TABLE V. COMPUTATION TIME

Title Computation Time (ms)

Input 1 1568

Input 2 2459

Input 3 3569

Input 4 4963

Input 5 8050

Fig. 2. Precision Comparison graph

TABLE III. RECALL / ACCURACY F-SCORE

Title Recall
Input 1 0.89
Input 2 0.91
Input 3 0.92
Input 4 0.93
Input 5 0.96

Fig. 5. Computation Time Comparison graph

VI. CONCLUSION & FUTURE WORK

The Complete work is based on Twitter Dataset for
Airline Sentiments, where Airline dataset is used as
source input with analyzing and preprocessing the data to
find sentiments of words. This work proposed sentiment
Fig. 3. Recall Comparison graph analysis model to observe positive and negative viewpoint
of different users based on sentimental analysis approach.
TABLE IV. F-SCORE
The complete work perform pre-processing and cleaning
Title F-Score
of data using Naïve Bayes classifier, the sentiments of
Input 1 0.79 airline tweets are estimated on this basis. With overcome
Input 2 0.81 the unigram issue of existing work where single word
Input 3 0.82 tweet is taken, Naïve Bayes is used in proposed work and
Input 4 0.88 takes overall tweet to find number of words in tweet and
their polarity.
Input 5 0.90
Following conclusions has been drawn from complete
experimental analysis.
1. Different size input gives different precision and
recall but all can be scale into single frame and
shows growing nature.
2. Proposed algorithm performs better for high
volume tweets in comparison with less number’s
dataset.
3. Proposed solution is capable to classify
ambiguous tweets and neutralize them according
to their weight.
4. It implements unigram and n-gram technique to
classify positive and negative tweets based on
Fig. 4. F-Score Comparison graph
average value.

74

Authorized licensed use limited to: Somaiya University. Downloaded on December 28,2023 at 13:29:24 UTC from IEEE Xplore. Restrictions apply.
 5.0.79 as worst and 0.90 as best f-score has been
observed which denotes a great performance for
ambiguous tweets
VII. FUTURE WORK
Following future word is predicted for proposed solution.
1. Proposed solution can be implemented using big
data technology for large dataset.
2. Proposed algorithm can be used to classify
different category tweets except airlines.
3. Proposed algorithm can be implemented with other
classification techniques such as SVM and KNN to
achieve better performance.
[9] Suchita V Wawre1, Sachin N Deshmukh2 , “Sentiment
Classification using Machine Learning Techniques”, International
Journal of Science and Research (IJSR) Volume 5 Issue 4, April
2016.
[10] Alessia D’Andrea, Fernando Ferri, Patrizia Grifoni, Tiziana
Guzzo,“Approaches, Tools and Applications for Sentiment
Analysis Implementation”,International Journal of Computer
Applications (0975– 8887) Volume 125 – No.3, September 2015.
[11] Hailong Zhang, Wenyan Gan, Bo Jiang, “Machine Learning and
Lexicon based Methods for Sentiment Classification: A Survey”,
978-1-4799-5727-9/14 $31.00 © 2014 IEEE DOI
10.1109/WISA.2014.55.
[12] Turney PD, Littman ML. Measuring praise and criticism: inference
of semantic orientation from association. ACM Trans Inf Syst.
2003;21(4):315–46.

REFERENCES

[1] Trupti Dange, Pankaj Bhalerao, “A Novel Approach for

Interpreting Public Sentiment Variations on Twitter: A Tweets”,
International Journal of Science and Research (IJSR), ISSN
(Online): 2319-7064. Volume 3 Issue 12, December 2014.
[2] Cambria E, Hussain A. Sentic computing: techniques, tools, and
applications. Dordrecht: Springer; 2012.
[3] Cambria E, Olsher D, Rajagopal D. SenticNet 3: a common and
common sense knowledge base for cognition-driven sentiment
analysis. In: AAAI. Quebec City; 2014. p. 1515–21.
[4] Cambria E, Schuller B, Xia Y, Havasi C. New avenues in opinion
mining and sentiment analysis. IEEE Intell Syst. 2013;28(2):15–
21.
[5] P. D. Turney, “Thumbs up or thumbs down?: semantic orientation
applied to unsupervised classification of Tweetss,” in Proceedings
of the 40th annual meeting on association for computational
linguistics, pp. 417–424, Association for Computational
Linguistics, 2002.
[6] Divya Sehgal and Dr. Ambuj Kumar Agarwal, “Sentiment
Analysis of Big Data Applications using Twitter Data with the
Help of HADOOP Framework”. 5th International Conference on
System Modeling & Advancement in Research Trends, 2016,
IEEE.
[7] M. Mazhar Rathore, Anand Paul, Awais Ahmad, “Big Data
Analytics of Geosocial Media for Planning and Real-Time
Decisions”. IEEE ICC 2017 SAC Symposium Big Data
Networking Track.
[8] Amit Gupte, Sourabh Joshi, Pratik Gadgul, Akshay Kadam,
“Comparative Study of Classification Algorithms used in
Sentiment Analysis”, International Journal of Computer Science
and Information Technologies, Vol. 5 (5) , 2014, 6261-6264.

75

Authorized licensed use limited to: Somaiya University. Downloaded on December 28,2023 at 13:29:24 UTC from IEEE Xplore. Restrictions apply.