NLP & Text Mining
Given recommendation text for analysis:
To reduce the risk of improper payments (either over- or under-reimbursing
subrecipients due to error or fraud), the Commissioner should ensure the Interim
Director of Community Services establishes a preventative control to ensure the
accuracy of subrecipients’ meal reimbursement claims before the department remits
payments. If the department cannot establish a preventative control, in order to
recoup the federal funds and address any fraud risks timely, the department should
increase its focus on EPR monitoring to ensure it is robust and extensive enough to
detect when a subrecipient was paid in error. To increase the likelihood of detecting
overpayments, EPR monitors should expand their monitoring activities when they
find claim errors during their limited reviews. These expanded activities should
include analytical tools to identify claim errors or anomalies. When expanded
monitoring activities identify pervasive compliance and control deficiencies, EPR
monitors and program management must take appropriate follow-up action to ensure
subrecipients implement correct controls.
Underpayments to subrecipients do not give rise to federal questioned costs;
however the department should ensure that subrecipients are not underpaid as this
can negatively impact the financial condition of the subrecipients the department
relies on to provide meals to eligible individuals.
The Commissioner, the Interim Inspector General, and the Interim Director of
Community Services should ensure that the department recovers $13,688 from the
subrecipients for the issues noted in the finding.
The Commissioner should assess all significant risks, including the risks noted in this
finding, in the department’s annual risk assessment. The risk assessment and the
mitigating controls should be adequately documented and approved by the
Commissioner. The Commissioner should implement effective controls to ensure
compliance with applicable requirements; assign employees to be responsible for
ongoing monitoring of the risks and any mitigating controls; and take immediate
action if deficiencies occur.
1.Text Summarization
1.1. Abstractive Text Summarization
“Abstractive methods select words based on semantic understanding, even those words did not
appear in the source documents.
It aims at producing important material in a new way.
They interpret and examine the text using advanced natural language techniques in order to
generate a new shorter text that conveys the most critical information from the original text.
It can be correlated to the way humans read a text article or blog post and then summarizes in
their own words.
Input document → understand context → semantics → create own summary”
Abstractive summarized text:
- 'To reduce the risk of improper payments, the Commissioner should
ensure the Interim Director of Community Services establishes a preventative
control to ensure accuracy of subrecipients’ meal reimbursement claims before
the department remits payments . EPR monitors should expand their monitoring
activities when they find claim errors’
1.2. Extractive Text Summarization
“Extractive methods attempt to summarize articles by selecting a subset of words that retain the
most important points.
This approach weights the important part of sentences and uses the same to form the summary.
Different algorithms and techniques are used to define weights for the sentences and further rank
them based on importance and similarity among each other.
Input document → sentences similarity → weight sentences → select sentences with higher
rank.”
Extractive summarized text:
- 'Underpayments to subrecipients do not give rise to federal questioned
costs; however the department should ensure that subrecipients are not
underpaid as this can negatively impact the financial condition of the
subrecipients the department relies on to provide meals to eligible individuals. If
the department cannot establish a preventative control, in order to recoup the
federal funds and address any fraud risks timely, the department should increase
its focus on EPR monitoring to ensure it is robust and extensive enough to detect
when a subrecipient was paid in error.'
2.Topic Modeling
Displaying optimal number of topics found on the given text with their keywords
Topic: 1
Keywords: include, risk, note, find, annual, assess, analytical, claim_error, anomaly, tool
Topic: 2
Keywords: ensure, department, note, recover, issue, find, interim, implement,
mitigating_control, action
Topic: 3
Keywords: department, federal, ensure, subrecipient, establish, recoup, risk, monitoring,
address, timely
Topic: 4
Keywords: subrecipient, ensure, department, payment, meal, control, risk, compliance,
deficiency, monitoring
Topic: 5
Keywords: control, implement, follow, action, expand, management, identify, activity,
monitoring, appropriate
Topic: 6
Keywords: detect, increase, monitoring, find, expand, limited, claim_error, activity, review,
likelihood
3. Sentiment Analysis
“Sentiment analysis or sentiment classification is supposed to tell whether a given phrase or
sentence is positive, negative or neutral.
Polarity is a float value within the range [-1.0 to 1.0]:
* 0 indicates neutral
* +1 indicates a very positive sentiment
* -1 represents a very negative sentiment
The subjective sentence expresses some personal feelings, views, beliefs, opinions, allegations,
desires, beliefs, suspicions, and speculations. Objective sentences are factual.
Subjectivity is a float value within the range [0.0 to 1.0]
* 0.0 is very objective
* 1.0 is very subjective.”
Displaying Polarity and Subjectivity of three most positive(+) and three most
negative(-) sentences
Sentence:
The Commissioner should assess all significant risks, including the risks noted in this finding, in
the department’s annual risk assessment.
Polarity:
37.5%
Subjectivity:
87.5%
----------------------------------------------------------
Sentence:
The risk assessment and the mitigating controls should be adequately documented and
approved by the Commissioner.
Polarity:
33.33%
Subjectivity:
33.33%
----------------------------------------------------------
Sentence:
When expanded monitoring activities identify pervasive compliance and control deficiencies,
EPR monitors and program management must take appropriate follow-up action to ensure
subrecipients implement correct controls.
Polarity:
30.0%
Subjectivity:
30.0%
----------------------------------------------------------
Sentence:
To increase the likelihood of detecting overpayments, EPR monitors should expand their
monitoring activities when they find claim errors during their limited reviews.
Polarity:
-7.14%
Subjectivity:
14.29%
----------------------------------------------------------
Sentence:
To reduce the risk of improper payments (either over- or under-reimbursing subrecipients due to
error or fraud), the Commissioner should ensure the Interim Director of Community Services
establishes a preventative control to ensure the accuracy of subrecipients’ meal reimbursement
claims before the department remits payments.
Polarity:
-12.5%
Subjectivity:
37.5%
----------------------------------------------------------
Sentence:
Underpayments to subrecipients do not give rise to federal questioned costs; however the
department should ensure that subrecipients are not underpaid as this can negatively impact the
financial condition of the subrecipients the department relies on to provide meals to eligible
individuals.
Polarity:
-15.0%
Subjectivity:
20.0%
4. Top 10 Words
Displaying the most frequent top 10 words and their percentage over all the words.
Note! Excluding all the stop words(a, in, the, etc) and all the punctuations
5. Top Phrases
Displaying Top Phrases found in the text and their frequency
6. Top Entities
Displaying Entities found in the text with their label, description and frequency
7. Top Adverbs
Displaying Top Adverbs found in the text with their frequency
7. Top Adjectives
Displaying Top Adjectives found in the text with their frequency
7. Top Nouns
Displaying Top Nouns found in the text with their frequency
