Fundamentals of Programming

Assignment no 01
Text extraction and sentimental
analysis
1st SEMESTER

Submitted to: Engr. Ali Hassan

Session: ME-14 Section: B
SUBMITTED BY
Name CMS Objecti Lab Lab
Theory
ve(1) Work(3) Task Total
(3)
(3)
Mashood ahmad 42808
7
 School of Mechanical and Manufacturing
Engineering

History of pdf
The Portable Document Format (PDF) was created by Adobe Systems,
introduced at the Windows and OS|2 Conference in January 1993 and
remained a proprietary format until it was released as an open standard in
2008.

Text extraction of pdf

One of the most dependable and widely used file types for storing data is
PDF, or Portable Document Format. The process of taking raw data out of
PDF documents is known as PDF extraction.

Text, images, and occasionally text that is truly an image, can all be found in
PDF files. PDFscanned PDF is the first of two possible forms.

Methods for extraction:-

1. Open the PDF in Acrobat.
2. Choose “Organize Pages” > “Split.”
3. Choose how you want to split a single file or multiple files.
4. Name and save: Click “Output Options” to decide where to save, what to name,
and how to split your file.
5. Split your PDF: Click “OK” and then “Split” to finish.
Some other ways are listed below:-

• UiPath PDF Data Extraction

• PDF Data Extraction Using Python

• Data Extraction Using Website

➢ UiPath Data Extraction of pdf:-

With the use of the tool UiPath PDF Data Extraction, users may take data from PDF
files and store it in Excel, XML, CSV, and JSON, among other formats. The
programme has a simple user interface that enables users to choose data fields and
describe Rule of extraction. It is the perfect option for digitising paper documents
because it can also be used to extract data from scanned papers. The tool is also
equipped with cutting-edge capabilities like OCR and fuzzy logic, making it a strong
and adaptable tool for extracting data from PDF documents.

Process for this purpose are explained below:-

Step 1: Click on the Screen Scraping icon, and select the section in the PDF
Document you want to extract.

Step 2: Then you will be redirected to the Screen Scraper Wizard that you
can see below, with the extracted text.

Now, over here you have an option for the Scraping Method (Native/ Full
Text/ OCR)

Open UiPath Studio, then start a new project.

The project should have a file action added. Choose "PDF" as the document
type, then navigate to the PDF file you want to analyse.

Include the activity "Invoke Workflow File" in the project. To analyse the PDF
file, navigate to the workflow file you want to employ.
Include a "For Each" loop in your project. Set the loop to iterate through each
PDF page.

Add a "Invoke Workflow File" activity inside the loop to call the workflow file
you want to utilise to analyse the PDF page.

Include a "Write Line" task in the project.

➢ PDF Data Extraction Using Python

Working with huge volumes of data can be time- and money-efficient when
using Python to extract data from PDFs. Python includes a number of strong
libraries, such as PDF plumber, PDF miner, and tabula-py, that can assist
with data extraction from PDFs. all libraries Understanding the many
characteristics and capabilities of each one is vital because each one has
different benefits and drawbacks. For instance, whereas tabula-Py is better
suited for extracting tabular data from PDFs, PDF plumber is wonderful for
extracting text from PDFs. Once the data has been extracted, it can be
modified and examined with the help of other Python packages like pandas
or NumPy.

Process for this purpose:-

. Install the packages:-

The most popular python package for working with PDFs is the PyPDF2 library. It can be installed using
the command: pip install Py PDF.

2. Load the PDF

Once the PyPDF2 library is installed, you can load a PDF document using the
following code: import PyPDF2 pdf_file = open('path/to/your/pdf.pdf', 'rb')
pdf_reader = PyPDF2.PdfFileReader(pdf_file)

3. Extract the text

You can extract the text from a PDF document by looping through its
pages and extracting the text from each page. Here is an example: for
page_num in range(pdf_reader.numPages): page =
pdf_reader.getPage(page_num) print(page.extractText())

4. Split the text

Once you have extracted the text from the PDF, you can split it into individual
words or sentences using the split() method. For example: words = text.split()
sentences = text.split('.')

5.Analyze the text

Now that you have the text split into individual words or sentences, you can
analyze it using a variety of methods. For example, you can use the NLTK library to
find the most frequently used words or to identify the sentiment of the text.

➢ Extraction of pdf using websites

The process of extracting data from PDF documents for usage on a website
is known as PDF data extraction. It is an effective method for removing data
from PDFs and transforming it into a format that a website can utilise. This
procedure is feasible.
with the aid of automated software or manually.

Automated software makes the procedure considerably quicker and more

effective. Text, tables, photos, and other data can be extracted from PDFs
with this tool. The data can then be shown using this to build an interactive
webpage. Additionally, reports and other papers can be produced using PDF
data extraction.

The process of extracting data from PDF files is not always simple and
necessitates.

Process for this purpose:-

The process of data extraction by using websites is simple. We just need to open
website and upload file on it. Press data extraction button and it will make sections
of components of PDF. Links of some websites are given below that I used to extract
data from PDF as practice.

1. https://tools.pdf24.org/en/extract-pdf-pages
2. https://products.groupdocs.app/parser/pdf
3. https://www.extractpdf.com/
4. http://pdf-analyser.edpsciences.org/
5. https://analyze-pdf.pdffiller.com/

Sentiments
Your opinion that most comedies are terrible and that you'd rather watch
any other kind of movie could be described as your sentiment, or your
attitude, about films. Sentiment means a view or opinion, but it can also
 mean an emotion. Maybe you prefer tragic movies because you enjoy the
sentiment of sadness. Your mood or attitude toward movies could be
summed up as your belief that the majority of comedies are horrible and
that you'd prefer to watch any other genre. Sentiment can refer to a feeling
as well as a point of view or viewpoint. Maybe you favour sad movies
because you like the way they make you feel.

Sentiment analysis
Sentiment analysis, also referred to as opinion mining, is an approach to
natural language processing (NLP) that identifies the emotional tone behind
a body of text. This is a popular way for organizations to determine and
categorize opinions about a product, service, or idea. Sentiment Analysis is the
process of computationally identifying and categorizing opinions expressed in a
piece of text, especially to determine whether the writer's attitude towards a
particular topic, product, etc. is positive, negative, or neutral. Sentiment analysis is
used to automatically identify and extract subjective information in source
materials and analyzing the sentiment of a text can help understand customers’
opinions, emotions, and attitudes.
Ways of sentimental analysis:-
There are several ways to do sentiment analysis. But some are listed below :
• Sentiment Analysis Using Excel
• Sentiment Analysis Using Python
• Sentiment Analysis Using Website
➢ Sentiment Analysis Using Excel
Microsoft Excel may be used to perform simple sentiment analysis on text. You will
see tendencies in the results that are buried in the data. Sentiment analysis has a
plethora of potential applications: To comprehend an author's intention, a
historian can employ sentiment analysis.writing from several centuries ago. A
marketing manager can also keep track of how a brand's reputation has changed
over time. The Sentiment Analysis technique covered in this article will evaluate
your text using machine learning to determine whether it expresses positive,
negative, or neutral emotions. Microsoft Excel and the Azure Machine Learning
Add-in are required.Excel's built-in functions and add-ins can be used to perform
sent.
Process for this purpose:-
To do sentiment analysis using excel, first you need to have excel 2013 or 2016
installed on your computer. Go to insert box, click on store and search for azure
machine learning. Click on add. Two different tools will appear :
▪ Titanic survivor predictor
▪ Text sentiment analysis
We will use text sentiment analysis. There are a couple things that will trip you up.
Your heading needs to match the schema of the feature. You have two choices: a
few rows at a time or in a batch. Whatever works for you. This is how you do
sentiment analysis by using excel.it is not perfect but it will give you a quick way to
know how many responses are positive and negative. We can also use pivot table
for this task.
➢ Sentiment Analysis Using Python
We just saw how sentiment analysis can empower organizations with
insights that can help them make data-driven decisions. Now, let’s peep into
some more use cases of sentiment analysis.

1. Social Media Monitoring for Brand Management: Brands can use

sentiment analysis to gauge their Brand’s public outlook. For example,
a company can gather all Tweets with the company’s mention or tag
and perform sentiment analysis to learn the company’s public outlook.
2. Product/Service Analysis: Brands/Organizations can perform
sentiment analysis on customer reviews to see how well a product or
service is doing in the market and make future decisions accordingly.
3. Stock Price Prediction: Predicting whether the stocks of a company will
go up or down is crucial for investors. One can determine the same by
performing sentiment analysis on News Headlines of articles
containing the company’s name. If the news headlines pertaining to a
particular organization happen to have a positive sentiment — its stock
prices should go up and vice-versa.

Ways to Perform Sentiment Analysis in Python

Python is one of the most powerful tools when it comes to performing data
science tasks — it offers a multitude of ways to perform sentiment analysis.
The most popular ones are enlisted here:

1. Using Text Blob

2. Using Vader
3. Using Bag of Words Vectorization-based Models
4. Using LSTM-based Models
5. Using Transformer-based Models

Let’s dive deep into them one by one.

Note: For the purpose of demonstrations of methods 3 & 4 (Using Bag of

Words Vectorization-based Models and Using LSTM-based Models)
sentimental analysis has been used. It comprises more than 5000 text
excrepts labelled as positive, negative or neutal. The dataset lies under the
Creative Commons licence.

Process for this purpose:-

1. Import the necessary packages: To perform sentiment analysis using Python, you
will need to import the appropriate packages. This includes packages such as
newspaper, NLTK and TextBlob, which are both natural language processing
toolkits.

2. Pre-process the text data: Before beginning the sentiment analysis process, it is
important to pre-process the text data. This includes tasks such as tokenizing the text,
removing stop words, and lemmatizing words.
3. Create sentiment scores :Once the text data has been pre-processed, you can use
various sentiment analysis tools to generate sentiment scores. These scores can range
from -1 (very negative) to +1 (very positive).

4. Visualize the results Once the sentiment scores have been generated, it is helpful
to visualize the results. This can be done using various charts and graphs. This will
help to identify any trends or patterns in the sentiment data.

5. Interpret the results: Finally, you should interpret the results of the sentiment
analysis. This will involve looking at the overall sentiment score as well as any
trends or patterns that were identified in the visualization step.

➢ Sentiment Analysis Using Website

using Web Scraping, we are able to gather information from a website and
use the text data for sentiment analysis. The whole process is simple and
easy. Web scraping and NLP have many applications. The vast amount of
text data at our disposal is so large, that the potential is immense. Sentiment
analysis using websites involves using natural language processing techniques to
classify and analyze the emotional tone of text data from online sources such as
blogs, forums, and social media. This can be done by extracting keywords,
determining the polarity of words, and analyzing the overall sentiment of the text.
For example, if a website is writing about a specific product, sentiment analysis can
be used to determine if the overall sentiment of the text is positive or negative.

Process used for this purpose:-

It is a very easy process. Add text on website and click on go. That website will do
sentiment analysis for you and give you results. There are several websites that
perform this task for you. Some of them are listed below.

1. https://www.googleadservices.com/pagead/aclk?sa=L&ai=DChcSEwiozdfP
mN77AhXxCwYAHb5nAScYABADGgJ3cw&ohost=www.google.com&ci
d=CAESbOD24qic_874oUfA3WYTOYnlIoTCWhDizKOlzdafLANqWLV
TBfKnMRYxkvGajZbY-
zNC5SOgTyQ_3G1rlBRycdNQHfSynzDPX2duO4zvAoPXP0I3es4TMdHE
dKwp8FaWV2hid81aWsuwzj5FFg&sig=AOD64_2LraiAKjsQjUCZ73ka7K
hseHwjyg&q&adurl&ved=2ahUKEwj_mdDPmN77AhV4SfEDHbmQBLM
Q0Qx6BAgEEAE
2. https://monkeylearn.com/sentiment-analysis-online/
3. https://www.danielsoper.com/sentimentanalysis/default.aspx
4. https://nocodefunctions.com/umigon/sentiment_analysis_tool.html
5. https://www.textrics.ai/solutions/sentiment-analysis
6. https://clientzen.io/sentiment-analysis-tool

Google drive link

Google drive link is shared below which contains github links,youtube links
and websites used for this purpose:-

https://drive.google.com/drive/folders/1IhVHh5PHotXW1ruyll1oKtGExX9
q57Ge?usp=share_link
.THE END.