Introduction to Natural Language Processing

Pemrosesan Bahasa Alami (PBA)

Presented by: Rosni Lumbantoruan

Introduction to NLP 1
 What will I learn?
NLP Packages Python
How NLP Works?
Main approaches
NLP Challenges
NLP Applications
What is NLP

Introduction to NLP
source: www.eureka.co
Human Language

2
 What will I learn?
NLP Packages Python
How NLP Works?
Main approaches
NLP Challenges
NLP Applications
What is NLP

Introduction to NLP
source: www.eureka.co
Human Language

3
 What will I learn?
NLP Packages Python
How NLP Works?
Main approaches
NLP Challenges
NLP Applications
What is NLP

Introduction to NLP
DATA
STRUCTURED
21st Century

DATA
UNSTRUCTURED

4
 NLP
or Natural Language Processing,
also known as computational linguistics,
is a part of computer science and artificial intelligence (AI)
which deals with human languages.
NLP Packages Python

NLP Applications
What will I learn?

NLP Challenges
Main approaches
How NLP Works?

What is NLP
5
Introduction to NLP
 NLP Applications
A few years ago, we used to Today, we have the comfort
type keywords into Google of vocally seeking help with
search to get effective results. this technology assistant.
NLP Packages Python

NLP Applications
What will I learn?

NLP Challenges
Main approaches
How NLP Works?

What is NLP
6
Introduction to NLP
 NLP Applications
Sentiment Analysis Speech recognition

Discovering people opinions, emotions

NLP Packages Python

and feelings about a product or service

NLP Applications
What will I learn?

NLP Challenges
Main approaches
How NLP Works?

What is NLP
Chatbot Machine translation

Simulating the way a human would behave as a

conversational partner in an online-chat conversation.

7
Introduction to NLP
 NLP Applications
Spell checking Information extraction
NLP Packages Python

NLP Applications
What will I learn?

NLP Challenges
Main approaches
How NLP Works?

What is NLP
Keyword search Advertisement matching

8
Introduction to NLP
 NLP Components
NLP Packages Python

Natural Language Understanding

1

NLP Applications
NLP Challenges
What will I learn?

Main approaches
How NLP Works?

• Understanding the context

What is NLP
• Mapping input into useful representations
• Analysing different aspects of the language

Natural Language Generation

2 • Generating the sensible response to the context

• Text planning
• Sentence planning
• Text realisation

9
Introduction to NLP
 Ambiguity

Lexical ambiguity
She is looking for a match.
01 Sungguh hati wanita itu sangat putih.
NLP Packages Python

NLP Applications
NLP Challenges
What will I learn?

Main approaches
How NLP Works?

What is NLP
YOURThe chicken
HEADLINE is ready to eat.
Syntactic ambiguity
02 Lorem ipsum Budi ayah
dolor sit amet, ibu pergi.
consectetuer
adipiscing elit. Maecenas porttitor congue massa.

The boy told his father the theft. He was

03 Referential ambiguity
very upset.
Budi meninggalkan adiknya. Dia sangat
marah.
10
Introduction to NLP
 NLP Main Approaches
Traditional Approaches Deep Learning Approaches
Rule based methods, such as:
NLP Packages Python

• Regular expressions Attention mechanism, such as:

NLP Applications
Main approaches
NLP Challenges
What will I learn?

How NLP Works?

• Context-free grammar

What is NLP
• Self-attention networks: Transformer
Classification and vector spaces
Neural networks, such as:
• Typical examples:
• naïve bayes
• Recurrent Neural Network (RNN)
• logistic regression
• Convolutional Neural Network (CNN)
Probabilistic modelling, including:

• Minimum edit distance

• Viterbi algorithm
• Markov chains
• N-Grams

11
Introduction to NLP
 Why do we study both?
Traditional Approaches Deep Learning Approaches
Perform good enough in many Provide state-of-the-art
task performance in many task
NLP Packages Python

NLP Applications
Main approaches
NLP Challenges
What will I learn?

How NLP Works?

What is NLP
Allow us not to be blind with the Most research in NLP in
hype currently happening around DL

Help to further improve deep Look fancy and everyone wants

learning to know them

12
Introduction to NLP
 What will I learn?
NLP Packages Python

Introduction to NLP
110011..
How NLP Works?

How NLP Works?

Main approaches
NLP Challenges
NLP Applications
13

What is NLP
 How NLP Works?
1) SEGMENTATION 2) TOKENIZATION 3) STOP WORDS
Cricket was invented in England, supposedly
by shepherds who herded their flock. Cricket was invented in England Cricket was invented in England
Cricket was invented in England
NLP Packages Python

NLP Applications
NLP Challenges
What will I learn?

Main approaches
are and the

How NLP Works?

supposedly by shepherds who herded their flock. Cricket was invented in England

What is NLP
4) STEMMING 5) LEMMATIZATION 6) SPEECH TAGGING

invent + ed
Am  NOUN VERB
PREPOSITION
VERB NOUN
invent + ing Are Be
invent + s Lemma
Is Cricket was invented in England

7) NAMED ENTITY TAGGING

14
Introduction to NLP
 What will I learn?
NLP Packages Python

Cricket was invented in England

Introduction to NLP
model
How NLP Works?

naïve bayes

How NLP Works?

Main approaches
NLP Challenges
NLP Applications
15

What is NLP
 Popular NLP Packages in Python

NLTK is the natural language toolkit

library that is heavily used for all NLP
and text analysis.

NLP Packages Python

NLP Applications
NLP Challenges
What will I learn?

Main approaches
How NLP Works?

What is NLP
Gensim is a library that specializes in
identifying semantic similarity between
two documents through vector space
modelling and topic modelling toolkit.

spaCy a library for advanced NLP, built on

the very latest research, and designed to
be used in real products.

16
Introduction to NLP
 What will I learn?
In this class, you will learn:
1. The core tasks of NLP, such as preparing and
pre-processing text (mostly unstructured).

NLP Packages Python

NLP Applications
What will I learn?

NLP Challenges
Main approaches
How NLP Works?

What is NLP
2. NLP model and algorithm including traditional
and deep learning models.

3. Building NLP applications

17
Introduction to NLP
 What will I learn?
NLP Packages Python
How NLP Works?
Main approaches
NLP Challenges
NLP Applications
What is NLP

Introduction to NLP
18