Vector Space Model BOW

The bag-of-words model is a vector space representation used in NLP.

In this model, a text is represented as the bag of its words, disregarding grammar
and even word order but keeping multiplicity.

BOW It is puppy cat pen a this

It is a puppy 1 1 1 0 0 1 0

It is a kitten 1 1 0 0 0 1 0

It is a cat 1 1 0 1 0 1 0

That is a dog
and this is a 0 2 0 0 1 2 1
pen
It is a matrix 1 1 0 0 0 1 0
Vector Space Model TF-IDF
TF (Term frequency) of a word is the
frequency of a word in a document.
For example, when in a document containing
100 words the term 'cat' appears 12 times, the
TF for the word 'cat' is
TFcat = 12/100
TFcat = 0.12
∴ Wcat =(TF*IDF) cat = 0.12*1.52 = 0.182
IDF (Inverse document frequency) of a word is a
measure of how significant that term is throughout the
corpus.
For example, say the term 'cat' appears 10 million times in
the whole corpus If there are 0.3 million documents that
contain such a huge number of 'cat',
Then
IDF (i.e. log {DF}) is given by the total number of
documents divided by the number of documents
containing the term 'cat'.
IDF (cat) = log (10.000.000/300.000) = 1.52
 BOW VS TF-IDF
BOW bed cat dog face my on sat the

the cat sat on my face 1 0 1 0 1 1 1 1 1

the dog sat on my bed 2 1 0 1 0 1 1 1 1

TF-ID bed cat dog face my on sat the

F

the cat sat on my face 1 0.00000 0.11552 0.00000 0.11552 0.0 0.0 0.0 0.0

the dog sat on my bed 2 0.11552 0.00000 0.11552 0.00000 0.0 0.0 0.0 0.0