APL745 Lab 1

Release date: January 19, 2022 Deadline: February 2, 2022

1. Observation with different training configurations

As changed the training configurations, I observed that accuracy increases with decreasing learning
rate and weight decay. However, this additional accuracy do increases the total time required to
train a model. See the graphs

2. Page 39, Q1(d)

According to definition, a non-empty subset W of Rn is that is closed under both vector addition
and scalar multiplication, is a subspace of Rn . Now, to prove whether a subset is subspace we have
to show the two property follows. Else, we just need to provide a counterexample. Following is
the counterexample to prove the this subset of Rn is not a subspace. Consider these two elements
of subset (1, 0, a13 , a14 , ..., a1n ) and (0, 1, a23 , a24 , ..., a2n ). Now, after adding both of them, we can
easily see the sum of these two vectors doesn’t exist in the subset. Hence, this particular subset is
not a subspace.

3. Page 39, Q1(e)

Following is the counterexample to prove the this subset of Rn is not a subspace. Consider these
two elements of subset (a1 , r, a3 , a4 , ..., an )(Here, r is a rational number). Now, after multiplying
π to the vector(scalar multiplication), we can easily see that the a2 afterwards doesn’t remained
rational(π ∗ r which is ans irrational). Hence, the above defined subset is not a subspace.

4. Page 48, Q5

In this question, we just have to find three vectors such that, three of them re linearly dependent
while any two of them are linearly independent. Consider the following vectors, v1 = 1, 1, 0,
v2 = 0, 1, 1 and v3 = 1, 2, 1. All three of them are linearly dependent as v1 + v2 − v3 = 0. However,
taking any two as a pair will be independent as, let’s suppose we take {vi , vj } then every vi or vj
should have some coordinate k such that (vik = 0 and vjk ̸= 0) or (vik ̸= 0 and vjk = 0). Hence,
every pair is independent.