Professional Documents
Culture Documents
”
CLASS: X
SECTION: ABEF
SUBJECT: ARTIFICIAL INTELLIGENCE
SESSION: 2023-24
UNIT 7: EVALUATION
ASSIGNMENT
1. ___________ is the process of understanding the reliability of any AI model, based on outputs by
feeding test dataset into the model and comparing with actual answers.
a. Evaluation
b. Problem Scoping
c. Data acquisition
d. Data Exploration
Ans. a. Evaluation
2. If model will simply remember the whole training set, and will therefore always predict the correct label
for any point in the training set. This is known as ____________.
a. Overfitting
b. Overriding
c. Over remembering
d. None of the above
Ans a. Overfitting
3. The result of comparison between the prediction and reality can be recorded in what we call the
__________.
a. Overfitting
b. Problem Scoping
c. Confusion Matrix
d. Data acquisition
Ans. c. Confusion Matrix
Ans.a. Recall
8. ___________ can be defined as the measure of balance between precision and recall.
a. Recall
b. Accuracy
c. Precision
d. F1 Score
Ans.d. F1 Score
9. Aman want to make an Artificially Intelligent system which can predict the salary of any employee
based on his previous salaries. He has to feed the data of his previous salaries. This is the data with which
the machine can be trained. The previous salary data here is known as ____________ while the next salary
prediction data set is known as the ___________.
Ans. b. last
Q11. A lot of times people faces the problem of sudden downpour. People was clothes and put them out to
dry but due to unexpected rain, their work gets wasted. Thus, an AI model has been created which predicts
if there will be rain or not. The confusion matrix for the same is:
Reality
Confusion Matrix
TRUE FALSE
TRUE 5 0
Prediction
FALSE 45 50
a. How many total tests have been performed in the above scenario?
=5+0+45+50
=100
b. Calculate Precision, Recall and F1 Score.
PRECISION
𝑇𝑃
= *100%
𝑇𝑃+𝐹𝑃
5
= *100%
5+0
=100% or 1
RECALL
𝑇𝑃
=
𝑇𝑃 + 𝐹𝑁
5
=
5 + 45
=0.1
F1 SCORE
𝑃𝑅𝐸𝐶𝐼𝑆𝐼𝑂𝑁 ∗ 𝑅𝐸𝐶𝐴𝐿𝐿
=2∗
𝑃𝑅𝐸𝐶𝐼𝑆𝐼𝑂𝑁 + 𝑅𝐸𝐶𝐴𝐿𝐿
1 ∗ 0.1
=2∗
1 + 0.1
0.1
=2∗
1.1
= 0.1818
Note: Substitute only decimal value of precision and recall while calculating F1 Score.
Let’s Practice!!
Q. In society, a lot of times it happens that there is no water to drink. In a few places, cases of water shortage
in society are very common and prominent. Hence, an AI model is designed to predict if there is going to be
water shortage in the society soon or not. The confusion matrix for the same is:
Reality
Confusion Matrix
TRUE FALSE
TRUE 15 5
Prediction
FALSE 40 40