AI and Data Science in Management - Class Notes

and Assignment 3
Class date: 9/04/2022

Class Notes

What is Natural Language?

A natural language or ordinary language is any language that
has evolved naturally in humans through use and repetition without
conscious planning. Natural languages can take different forms, such
as speech or signing.

They are distinguished from constructed and formal languages such

as those used to program computers or to study logic.

What is Natural Language Processing (NLP)?

NLP is a subfield of linguistics, computer science, information
engineering, and artificial intelligence. It is Concerned with the
interactions between computers and human (natural) languages, in
particular how to program computers to process and analyze large
amounts of natural language data.

Examples of questions for NLP system:

Q: Are you going there? --> Grammatically correct

Q: You are going there? --> Grammatically incorrect

A well designed system will be able to understand that both the

questions are the same.

Look at Mozilla Common Voice project which is being used to get a large
number of voice data set from people all around the world.

Challenges in natural language processing frequently involve speech

recognition, natural language understanding, and natural language
generation.
Top Use Cases of Natural Language Processing (NLP)
– Creditworthiness assessment
– Chatbots
– Neural machine translation of languages
– Translation of old text and scriptures
– Sentiment analysis
– Hiring and recruitment
– Targeted advertisement
– Market intelligence
– Improvement in clinical documentation
– Computer-assisted coding
– Retraining after speech impairment due to a trauma

Here are some of the NLP use cases we use every day:
– Autocomplete features
– Google’s Predictive Typing
– Spell checkers and grammar checkers
– Spam detection
– Personal assistants like Siri, Alexa, Amazon Echo, and Google
Home
– Voice to text messaging

Metadata

Metadata is Data that provides information about other data, or simply

“data about data”.

Following are the classification of Metadata:

Structural Metadata
Descriptive Metadata
Administrative Metadata
Reference Metadata
Statistical Metadata
Some of the examples of metadata around us are:
– Catalogue
– Restaurant menu
– Digital album cover
– Book cover
– Properties dialog of a media file
– Details on the packaging of a product or packaged food
Structural metadata is
metadata about containers of
data and indicates how
compound objects are put
together, for example, how
pages are ordered to form
chapters. It describes the types,
versions, relationships and
other characteristics of digital
materials.
Descriptive metadata is
descriptive information about a
resource. It is used for
discovery and identification. It
includes elements such as title,
abstract, author, and keywords.
Administrative metadata is
information to help manage a
resource, like resource type,
permissions, and when and how
it was created.
Reference metadata is
information about the contents
and quality of statistical data.
Statistical metadata, also
called process data, may
describe processes that collect,
process, or produce statistical
data.
Sentiment Analysis and Voice of Customer
Sentiment analysis (also known as opinion mining or emotion AI) refers
to the use of natural language processing, text analysis, computational
linguistics, and biometrics to systematically identify, extract, quantify,
and study affective states and subjective information.

Sentiment analysis is widely used for the analysis of voice of customer

materials, review and survey responses, and online media and social
media monitoring.

Some of the ways Sentiment Analysis can be used as as follows:

– Social media monitoring
– Brand monitoring
– Improving customer support
– Tracking your customer feedback
– Market research
– Providing better product analytics
– Keeping an eye on your competition
– Tracking user generated content
– Uncovering brand influencers
– Managing a crisis in a better way

Examples of sentiment analysis

– Let’s look at how the tone and structure changes everything:
– I love how they make it so easy to seamlessly integrate with
3rd party APIs. [Positive]
– I found the integration with 3rd party APIs little confusing,
but I was able to figure it out at the end. [Neutral]
– The integration with 3rd party API is very confusing.
[Negative]
– I won’t recommend this product if integration with 3rd party
API is your main concern. [Very Negative]
– And little complex ones
– The older version of the API was much simpler. [Negative]
– I don’t think I really dislike anything about this product, but
 –
your experience may be different. [Neutral]
– What is the use of a customer service like this which is not
technical enough to solve the problems of developers?
[Negative, Tending towards Anger]

Example of sentiment analysis where an untrained human may not be

able to figure out the sentiment:
– I like to buy only black colour devices, black laptops, black cell
phones, black tablets. Since they don’t have black laptop in this
model in their stock, I guess I’ll have to wait. [Neutral]
– I like to buy only black colour devices, black laptops, black cell
phones, black tablets. The last time I tried they didn’t have black
laptop as well. I guess I’ll go to a different site and buy it.
[Negative]

Assignments

Guidelines
– All of them need to be done as individual study/work and not in
groups.
– All the assignments are mandatory.
– Students can be chosen in random to present their work or
answer questions in the next class.
– A portion of internal marks will be decided based on the
completion of these assignments.

Assignments to be done individually

. You are given the task to classify all the documents in a very
large company spanned across many cities in India. Explain with
example, how will you use Metadata to achieve this task.

. Explain with the help of examples the type of interesting AI

application you can create using the following metadata:
– Restaurant menus from 100s of restaurants across the city
– Travel brochures from many travel agencies in the city