Twitter Sentiment Analysis
Mirza Babar Barlas
Department of Master in Data Science
Shaheed Zulfikar Ali Bhutto Institute of
Science and Technology
Karachi, Pakistan
mbhbarlas@gmail.com
Abstract— Analysis of sentiments is the approach of
figuring out whether or not the sentiments in the textual
content are positive, negative or neutral. It's otherwise
called supposition mining, inferring the sentiment or
frame of mind of a user or material polarity or mining of
opinions. The growth and advancement in social media
platforms engaged a huge number of users. Social
networking sites like twitter have millions of people
share their thoughts day by day as tweets. Because of the
constrained variety of characters in tweets, it turns into
easy for the sentiment analysis. On Twitter 550 million
approx. of tweets are posted daily. Twitter also
represents all age group people and also a fair
representation of gender. Therefore, the sentiment
analysis of twitter data becomes somewhat general
sentiments of society. This paper aim to build a model
that perform a sentiment analysis of people’s opinion
related to the ongoing trend. To analyze the sentiments
of people's Machine Learning tools and techniques are
used. To classify each tweet as positive, negative, or
neutral using Text blob in Python based on the polarity
of sentiments. A sentiment polarity is the emotions of
user such as angry, sad, happy and joy. The proposed
mechanism has been implemented in Python. This paper
will also show sentiment analysis types and techniques
used to perform extraction of sentiment from tweets and
visualize it on a tableau
Keywords— Social media analytics, Sentiment analysis,
twitter, tableau
I. INTRODUCTION
Microblogging sites like WhatsApp, Instagram, twitter,
Facebook and YouTube are rich in source for a varied kind
of information. It is a place where people usually post their
opinion, feedbacks, comments etc. based on their
experience, it can be negative, positive and neutral. Many
upcoming organizations require feedback on their products
to improve further or build some good features or addons.
Most of the time organization analysis their feedback from
social media and answer them so there is a challenge to
analyze or detect the sentiments of people globally and then
act as per there feedbacks. Twitter is one of the most famous
platforms for users to communicate with people. Sentiment
analysis, known as opinion mining, for classifying specific
words into positive or negative and neutral.
Most of the data that available in social networks is
unstructured. Such unstructured data is almost 80% of the
data all over the world. This makes it difficult to analyze
Salman Sadruddin
Department of Master in Data Science
Shaheed Zulfikar Ali Bhutto Institute of
Science and Technology
Karachi, Pakistan
salmanvadsarya@gmail.com
and gain valuable judgment from such data. Sentiment
analysis or opinion mining is the important technique, which
help in detecting opinions of people on social media data.
Visualization this data is the most difficult task of this
unstructured data
The main focus of this project is to build a
classifier or some analysis based on tweets from the live
APIs of available for twitter. In this paper, sentiments are
classified as three different categories such as positive,
negative, and neutral based on the polarity of the sentiments.
The polarity of each tweet has been calculated using the
Text Blob Tool. It is a very powerful tool in the python
programming language to calculate the polarity of sentiment
and analyze the sentiments of tweets. This research work
has been done to determine that which hashtag have
negative, positive and neutral feedback of the people around
the globe.
Based on the data source and upcoming output of
machine algorithm, will visualize the data on tableau and
power BI, the most powerful data visualization tools. This
all are very important to analysis that what word game is
going now days a world and people discussing most.
II. LITERATURE REVIEW
Our project is the sentiments analysis and its visualization
on twitter data based on real time twitter API. Before the
development of this project, we have the review papers
which are designed on the analysis of twitter post based on
different algorithms and libraries.
Most of the authors and expertise in this field state
and discuss those opinions and attitude expressed in social
media platform is growing in abundance nowadays and
people decide everything based on these views fellow users
make. This leads to the creation of enormous amount of
data. Gleaning 3rd IEEE International Conference on
Computational Systems and Information Technology for
Sustainable Solutions 2018 ISBN: 978-1-5386-6078-2 ©
2018 IEEE 30 information from huge storage of data is a big
challenge for the companies nowadays. Here comes the area
for analyzing data mostly on popular platforms such as
twitter.[1]
In paper [2] the author discusses about the systems
are designed to retrieve information using twitter data and
then classify them based on the semantics of knowledge
contained. Authors Lokmanyathilak Govindan Sankar
Selvan and Teng-Sheng Moh have developed the framework
in paper [3] which makes use of real-time Twitter data
stream, that are cleaned and analyzed and then fast feedback
is acquired through opinion mining.
In paper [4] Web-based tool named SWAB (Social
Web Analysis Buddy) which is integrating qualitative
analysis and large-scale data mining techniques together is
proposed here. Prototype of this tool is demonstrated by
analyzing matter posted by student on Twitter is
demonstrated.
In paper [5] author give details about usage of
StanfordcoreNLP libraries and twitter4j libraries to
construct an application that can obtain data in the form of
tweets and perform the sentimental analysis to display
positive or negative tweet on any particular topic using its
associated hash tag.
Authors M.Trupthi and others focus on the short
sentences and entity level sentiment analysis in paper
[6].The streamed tweets collected using the interface Twitter
API which as well stores tweet scores along with its
timestamp being classified as positive, neutral and negative
using standard classifier.
Authors of [7] used Textblob for pre-processing,
polarity, the polarity confidence calculation, and they
validated the obtained results by SVM and Naïve Bayes
using Weka; they reported the highest accuracy of Naïve
Bayes with a 65.2% rate, which was 5.1% more than the
SVM accuracy rate.
Kaur and Sharma [8] analyze the sentiments
regarding coronavirus disease (COVID-19), so analyze
the sentiments of different people’s opinion for this disease.
For this purpose, twitter API used for collecting related
tweets to the coronavirus, then positive, negative and
neutral emotion analyzed by using machine learning
approaches and tools. In addition, for preprocessing of
fetched tweets NLTK library is used and Textblob dataset
for analyzing tweets is used, after that show the interesting
results in positive, negative, neutral sentiments through
different visualizations.
As a comparison, the results of this study are also
compared to the TextBlob sentiment analysis, a sentiment
analyzer that has a Natural Language Toolkit (NLTK) and
Pattern processing basis [9]. TextBlob can also be used for
text mining, text processing modules for python winners,
and even text analysis. TextBlob also provides simple APIs
for general Natural Language Processing (NLP) processing
such as part-of-speech tagging, tokenizing sentences, noun
phrase extraction, sentiment analysis, classification,
translation [10].
Adi Laksono all [11] extracted customer reviews
on TripAdvisor using Naive Bayes and TextBlob to
determine the sentiment of each comment. The result of the
experiment shown Naive Bayes have better data accuracy
with 72.06% while TextBlob only obtained an accuracy of
69.12%.
Hasan[12] and Clavel[12] used machine learning
techniques for sentiment analysis. Jianqiang[13] compared
the sentiment analysis and data mining techniques. Abraham
and Putra [14] [15] analyzed the people's review of mobile
applications using various machine learning techniques.
Neethu et al. [16] and, Groot [17] used machine learning
techniques for sentiment analysis
Prabhsimran Singh, Ravindra Singh and Karanjeeet
Singh Kalhon, [18] they've examined the authority’s policy
the demonetization from the everyday character’s viewpoint
with using the technique of sentiment analysis and the use of
Twitters facts, Tweets are amassed using sure hashtag
(#demonetization). Analysis based totally on geo-vicinity
(State clever tweets are accrued). The sentiment evaluation
API used from which means cloud and classified the states
into six categories, they're satisfied, sad, very sad, very
happy, impartial, and no information.
III. METHODOLOGY
In this paper the live twitter data is classified based on the
sentiments. This can be done in 7 phases as in figure 1.1.
Figure 1.1
Tweet Mining:
In phase I tweets are collected by taking the input
in the form of hashtags, the number of tweets is mentioned
in the code and to be considered is restricted in between the
given range. The tweets are collected online from the
developer APIs of twitter using consumer key. In Python we
have a library of tweepy which allow us to collect or
gathered the information from the live API.
Data Cleaning:
In the second phase, we have performed the
cleaning process on gathered information or collected data.
Like null or empty locations are filled with NaN to further
process with next phase.
Tweet Processing:
In the 3rd Phase, to reach the ultimate goal, there
was a need to clean up the individual tweets. To make this
easy, I created a function "cleantext" in Python program
which I further applied to the "Tweets" to produce the
desired results. This user-defined function was used to
remove punctuations, links, emojis, and stop words from the
tweets in a single run. Additionally, we used a concept
known as "Tokenization" in NLP. It is a method of splitting
a sentence into smaller units called "tokens" to remove
unnecessary elements. Another technique worthy of mention
is "Lemmatization". This is a process of returning words to
their "base" form. A simple illustration is shown below.
Data Exploration:
In the 4th Phase, we explore the data using Word
Cloud and MatPlotlib library and see which common word
are frequently used in the tweets by people.

Location Geocoding:
In the 5th Phase, for final dashboard, we wanted to
add a map that shows the number of tweets per country. To
do that, Tableau needs basic geographic information that it
can recognize. For that we have used the HERE Developer
API to return Longitude, Latitude & Country names for each
tweet.

Sentiments Analysis:
In the 6th Phase, this is the most important stage
where we are extracting the sentiments on the processed
tweet data by applying text blob model.
Figure 1.4
Dashboard Design:
In the last phase we have design the dashboard on tableau Figure 1.5 shows the polarity of the processed or clean tweet
and power bi based on the analyze dataset. of the people by using the text blob model. It shows how the
tweet of the people is subjective and whats its polarity.
Figure 1.2 shows the collecting data from tweets based on
given hasgtag in the program. It shows the columns which
extracted from the live APIs of twitter.

Figure 1.2
Figure 1.3 shows the location geocoding based on the given
location mentioned in the collected data. Here we used the
API for the location geocoding.
Figure 1.5
Figure 1.6 shows the count of the positive, negative and
neutral sentiment of the tweets based on polarity

Figure 1.3

In Figure 1.4 shows the word cloud of the text data based on
given hashtag. The figure shows the most frequent words
extracted from the people opinion
Figure 1.6

Figure 1.7 shows the final dashboard based on the processed

tweets and extracted sentiments from the tweets and twitter
data.

Figure 1.7
IV. CONCLUSION
In this paper we have analysis the sentiment of tweets based
on negative, positive or neutral. This paper also shows the
visualization of the data on tableau to get its insights. In the
proposed algorithm, twitter dataset is fetched from twitter
API/ data source for analysis of sentiments emotions of
different users. Here we check sentiment polarity of each
tweet. The sentiment polarity is emotions of users like joy,
happy, sad and angry. If the sentiment polarity is equal to
zero then tweet is neutral and if polarity is greater than zero
then tweet is positive otherwise, tweet is negative. In this
manner proposed algorithm distinguish tweets based on
sentiment polarity of each tweet of users.
Future work: In future it is intended to continue
working on it and propose a new sentiments analysis
method for analyzing image and video sentiments of twitter
data based on different ML and python algorithms
REFERENCES
[1] Prakruthi V, Sindhu D and Dr S Anupama Kumar. Real
Time Sentiment Analysis of Twitter Post 3rd IEEE
International Conference on Computational Systems and
Information Technology for Sustainable Solutions 2018
[2] Asad Masood Khattak, Rabia Batool, Jahanzeb Maqbool
and Sungyoung Lee “Precise Tweet Classification and
Sentiment Analysis”, Computer and Information Science
(ICIS), 2013 IEEE 12th International Conference, 16-20
June 2013, Page: 461 – 466
[3] Lokmanyathilak Govindan Sankar Selvan, Teng-Sheng
Moh “A Framework for Fast-Feedback Opinion Mining
on Twitter Data Streams”, Collaboration Technologies
and Systems (CTS), 2015 International Conference, 1-5
June 2015, Page: 314 – 318
[4] Xin Chen, Krishna Madhavan, Mihaela Vorvoreanu, “A
Web-Based Tool for Collaborative Social Media Data
Analysis” Published in Cloud and Green Computing
(CGC), Third International Conference on 30 Sept.-2 Oct.
2013 Germany, Page: 383 – 388
[5] Hase Sudeep Kisan, Hase Anand Kisan, Aher Priyanka
Suresh, “Collective Intelligence & Sentimental Analysis
of Twitter Data by Using StandfordNLP Libraries with
Software as a Service (SaaS)”, Computational Intelligence
and Computing Research (ICCIC), IEEE International
Conference, 15-17 December. 2016
[6] M.Trupthi, Suresh Pabboju, G.Narasimha, “Sentiment
Analysis on Twitter using Streaming API”, Advance
Computing Conference (IACC), and 2017 IEEE 7th
International Conference, Jan 2017, Page: 915 – 919
[7] Saha, S.; Yadav, J.; Ranjan, P. Proposed approach for
sarcasm detection in twitter. Indian J. Sci. Technol. 2017,
10. [CrossRef]
[8] C.Kaur and A. Sharma,"Twitter Sentiment Analysis on
Coronavirus using Textblob," Easy Chair2516-2314,
2020.
[9] B. Agarwal, N. Mittal, P. Bansal, and S. Garg,
"Sentiment analysis using common-sense and context
information," Computational intelligence and neuroscience,
vol. 2015, p. 30, 2015.
[10] S. Vijayarani, R. Janani, and others, "Text mining:
open source tokenization tools-an analysis, " Advanced
Computational Intelligence: An International Journal
(ACI/), vol. 3, no. I, pp. 37- 47,2016.
[11] R. A. Laksono, K. R. Sungkono, R. Sarno, and C. S.
Wahyuni, “Sentiment Analysis of Restaurant Customer
Reviews on TripAdvisor using Naive Bayes,” in 2019
12th International Conference on Information &
Communication Technology and System (ICTS), Surabaya,
Indonesia, Jul. 2019, pp. 49-54, doi:
10'1109/ICTS'2019'8850982'
[11] A. Hasan, S. Moin, A. Karim, and S. Shamshirband,
“Machine Learning-Based Sentiment Analysis for
Twitter Accounts,” Math. Comput. Appl., vol. 23, no. 1, p.
11, 2018.
[12] C. Clavel and Z. Callejas, “Sentiment Analysis: From
Opinion Mining to Human-Agent Interaction,” IEEE
Trans. Affect. Comput., vol. 7, no. 1, pp. 74–93, 2016, doi:
10.1109/TAFFC.2015.2444846.
[13] Z. Jianqiang and G. Xiaolin, “Comparison research
on text pre-processing methods on twitter sentiment
analysis,” IEEE Access, vol. 5, pp. 2870–2879, 2017.
[14] M. P. Abraham and K. R. Udaya Kumar Reddy,
“Feature-based sentiment analysis of mobile product
reviews using machine learning techniques,” Int. J. Adv.
Trends Comput. Sci. Eng., vol. 9, no. 2, pp.
10.30534/ijatcse/2020/210922020.
[15] R. R. Putra, M. E. Johan, and E. R. Kaburuan, “A
Naïve Bayes Sentiment Analysis for Fintech Mobile
Application User Review in Indonesia,” Int. J. Adv.
Trends Comput. Sci. Eng., vol. 8, no. 5, pp. 1856–1860,
2019.
[16] Neethu M S, Rajasree R, “Sentiment Analysis in
Twitter using Machine Learning Techniques,” 4th Int.
Conf. Comput. Commun. Netw. Technol., 2013.

[17] R. De Groot, “Data Mining for Tweet Sentiment

Classification” pp. 1- 63, 2012.

[18] Singh, Prabhsimran, Ravinder Singh Sawhney, and

Karanjeet Singh Kahlon. "Sentiment analysis of
demonetization of 500- & 1000-rupee banknotes by
Indian government." ICT Express (2017).