# Objectives

4

Perceptron Learning Rule
Objectives Theory and Examples Learning Rules Perceptron Architecture Single-Neuron Perceptron Multiple-Neuron Perceptron Perceptron Learning Rule Test Problem Constructing Learning Rules Unified Learning Rule Training Multiple-Neuron Perceptrons Proof of Convergence Notation Proof Limitations Summary of Results Solved Problems Epilogue Further Reading Exercises 4-1 4-2 4-2 4-3 4-5 4-8 4-8 4-9 4-10 4-12 4-13 4-15 4-15 4-16 4-18 4-20 4-21 4-33 4-34 4-36

4

Objectives
One of the questions we raised in Chapter 3 was: ÒHow do we determine the weight matrix and bias for perceptron networks with many inputs, where it is impossible to visualize the decision boundaries?Ó In this chapter we will describe an algorithm for training perceptron networks, so that they can learn to solve classification problems. We will begin by explaining what a learning rule is and will then develop the perceptron learning rule. We will conclude by discussing the advantages and limitations of the singlelayer perceptron network. This discussion will lead us into future chapters.

4-1

4 Perceptron Learning Rule

Theory and Examples
In 1943, Warren McCulloch and Walter Pitts introduced one of the first artificial neurons [McPi43]. The main feature of their neuron model is that a weighted sum of input signals is compared to a threshold to determine the neuron output. When the sum is greater than or equal to the threshold, the output is 1. When the sum is less than the threshold, the output is 0. They went on to show that networks of these neurons could, in principle, compute any arithmetic or logical function. Unlike biological networks, the parameters of their networks had to be designed, as no training method was available. However, the perceived connection between biology and digital computers generated a great deal of interest. In the late 1950s, Frank Rosenblatt and several other researchers developed a class of neural networks called perceptrons. The neurons in these networks were similar to those of McCulloch and Pitts. RosenblattÕs key contribution was the introduction of a learning rule for training perceptron networks to solve pattern recognition problems [Rose58]. He proved that his learning rule will always converge to the correct network weights, if weights exist that solve the problem. Learning was simple and automatic. Examples of proper behavior were presented to the network, which learned from its mistakes. The perceptron could even learn when initialized with random values for its weights and biases. Unfortunately, the perceptron network is inherently limited. These limitations were widely publicized in the book Perceptrons [MiPa69] by Marvin Minsky and Seymour Papert. They demonstrated that the perceptron networks were incapable of implementing certain elementary functions. It was not until the 1980s that these limitations were overcome with improved (multilayer) perceptron networks and associated learning rules. We will discuss these improvements in Chapters 11 and 12. Today the perceptron is still viewed as an important network. It remains a fast and reliable network for the class of problems that it can solve. In addition, an understanding of the operations of the perceptron provides a good basis for understanding more complex networks. Thus, the perceptron network, and its associated learning rule, are well worth discussion here. In the remainder of this chapter we will define what we mean by a learning rule, explain the perceptron network and learning rule, and discuss the limitations of the perceptron network.

Learning Rules
Learning Rule As we begin our discussion of the perceptron learning rule, we want to discuss learning rules in general. By learning rule we mean a procedure for modifying the weights and biases of a network. (This procedure may also

4-2

Perceptron Architecture

be referred to as a training algorithm.) The purpose of the learning rule is to train the network to perform some task. There are many types of neural network learning rules. They fall into three broad categories: supervised learning, unsupervised learning and reinforcement (or graded) learning. Supervised Learning Training Set In supervised learning, the learning rule is provided with a set of examples (the training set) of proper network behavior: {p1, t 1} , {p2, t 2} , … , {pQ, tQ} , Target (4.1)

where p q is an input to the network and t q is the corresponding correct (target) output. As the inputs are applied to the network, the network outputs are compared to the targets. The learning rule is then used to adjust the weights and biases of the network in order to move the network outputs closer to the targets. The perceptron learning rule falls in this supervised learning category. We will also investigate supervised learning algorithms in Chapters 7Ð12. Reinforcement learning is similar to supervised learning, except that, instead of being provided with the correct output for each network input, the algorithm is only given a grade. The grade (or score) is a measure of the network performance over some sequence of inputs. This type of learning is currently much less common than supervised learning. It appears to be most suited to control system applications (see [BaSu83], [WhSo92]). In unsupervised learning, the weights and biases are modified in response to network inputs only. There are no target outputs available. At first glance this might seem to be impractical. How can you train a network if you donÕt know what it is supposed to do? Most of these algorithms perform some kind of clustering operation. They learn to categorize the input patterns into a finite number of classes. This is especially useful in such applications as vector quantization. We will see in Chapters 13Ð16 that there are a number of unsupervised learning algorithms.

4

Reinforcement Learning

Unsupervised Learning

Perceptron Architecture
Before we present the perceptron learning rule, letÕs expand our investigation of the perceptron network, which we began in Chapter 3. The general perceptron network is shown in Figure 4.1. The output of the network is given by a = hardlim ( Wp + b ) . (4.2)

(Note that in Chapter 3 we used the hardlims transfer function, instead of hardlim. This does not affect the capabilities of the network. See Exercise E4.6.)

4-3

(4. (4. R . First. consider the network weight matrix: w 1. 1 w 1. R We will define a vector composed of the elements of the ith row of W : w i. 2 … w 2. R … … w S. 2 … w S.4 Perceptron Learning Rule Input p Rx1 Hard Limit Layer a W SxR n Sx1 Sx1 1 R b Sx1 S a = hardlim (Wp + b) Figure 4. R W = w 2. 2 w i. 1 … iw = w i.3) (4. 1 w S. 2 … w 1. 1 w 2. … . LetÕs see how this can be done.5) T Sw This allows us to write the ith element of the network output vector as … 4-4 .1 Perceptron Network It will be useful in our development of the perceptron learning rule to be able to conveniently reference individual elements of the network output.4) Now we can partition the weight matrix: T 1w W = T 2w .

1 w1.9) To make the example more concrete. We will begin with the simple case of a single-neuron perceptron with two inputs. as shown in Figure 4. T (4. a = hardlim (n) T (4.Perceptron Architecture a i = hardlim ( n i ) = hardlim ( iw p + b i ) . 1 p 1 + w 1.2.2 Two-Input/Single-Output Perceptron The output of this network is determined by a = hardlim ( n ) = hardlim ( Wp + b ) = hardlim ( 1w p + b ) = hardlim ( w 1. letÕs assign the following values for the weights and bias: 4-5 . Thus each neuron in the network divides the input space into two regions. 1 p 1 + w 1. the output will be 1.8) The decision boundary is determined by the input vectors for which the net input n is zero: n = 1w p + b = w 1. n = Wp + b (4.7) Therefore. 2 p 2 + b ) Decision Boundary T (4. 4 Single-Neuron Perceptron LetÕs consider a two-input perceptron with one neuron. otherwise the output will be 0.6) Recall that the hardlim transfer function (shown at left) is defined as:  a = hardlim ( n ) =  1 if n ≥ 0  0 otherwise. if the inner product of the ith row of the weight matrix with the input vector is greater than or equal to – b i . Inputs Two-Input Neuron p1 p2 w1. 2 p 2 + b = 0 .2 Σ b n a 1 a = hardlim (Wp + b) Figure 4. It is useful to investigate the boundaries between these regions.

3.4 Perceptron Learning Rule w 1. 2 1 To find the p 1 intercept. This region is indicated by the shaded area in Figure 4. we T just need to test one point. On one side of the line the network output will be 0.= 1 w 1.3 Decision Boundary for Two-Input Perceptron 4-6 . the network output will be   T a = hardlim ( 1w p + b ) = hardlim  1 1 2 – 1 = 1 .12) The resulting decision boundary is illustrated in Figure 4. on the line and on the other side of the line the output will be 1.= 1 w 1. 1 p 1 + w 1. (4. 1 = 1 . T (4. p2 a=1 1 w Tp + b = 0 1 1 w p1 a=0 1 Figure 4.= – ----.   0 (4. To find the p 2 intercept set p 1 = 0 : b –1 p 2 = – --------. For the input p = 2 0 .14) Therefore. set p 2 = 0 : b –1 p 1 = – --------.= – ----.11) This defines a line in the input space. b = – 1 .10) (4. the network output will be 1 for the region above and to the right of the decision boundary. 1 1 if p 2 = 0 . To draw the line.13) if p 1 = 0 . 2 p 2 + b = p 1 + p 2 – 1 = 0 . w 1. (4.3. To find out which side of the boundary corresponds to an output of 1. 2 = 1 . we can find the points where it intersects the p 1 and p 2 axes. The decision boundary is then n = 1w p + b = w 1.

The dark circles indicate that the target is 1. It displays the input space. We want to have a line that separates the dark circles and the light circles. (These concepts will be covered in more detail in Chapter 5. There are an infinite number of solutions to this problem. The boundary is defined by T 1w p + b = 0.  p1 =   2   3   4  1 2 3 4 0 1 0 1         The figure to the left illustrates the problem graphically. t = 0  p = 1 . (4. t = 1  . One choice is 1 w 1w AND = 2 . It seems reasonable to choose the line that falls ÒhalfwayÓ between the two categories of inputs. the inner product of the input vector with the weight vector is the same. with each input vector labeled according to its target. This implies that these input vectors will all have the same projection onto the weight vector. t = 0  p = 0 . t = 0  p = 1 .16) as displayed in the figure to the left. After we have selected a weight vector with the correct angular orientation. The first step is to note that the boundary is always orthogonal to 1w . and vectors in the unshaded region will have inner products less than – b . The input/target pairs for the AND gate are  0 .) In addition. any vector in the shaded region of Figure 4.Perceptron Architecture 1 w We can also find the decision boundary graphically. 2 (4. The first step of the design is to select a decision boundary.15). so there are infinite possibilities. and the light circles indicate that the target is 0.3 will have an inner product greater than – b . 2 +2 4 LetÕs apply some of these concepts to the design of a perceptron network to implement a simple logic function: the AND gate.15) 1 w For all points on the boundary. The weight vector can be any length. (4. Next we want to choose a weight vector that is orthogonal to the decision boundary. so they must lie on a line orthogonal to the weight vector. as shown in the adjacent figure. the bias value can be computed by selecting a point on the boundary and satisfying Eq. Therefore the weight vector 1w will always point toward the region where the neuron output is 1. 4-7 . as illustrated in the adjacent figures.

20) 4-8 . { p 2. {p Q. in which the learning rule is provided with a set of examples of proper network behavior: {p 1. t 2} . To experiment with decision boundaries. Each category is represented by a different output vector.5 0 we find T 1w p + b = 2 2 1.15).17) We can now test the network on one of the input/target pairs. …. (4. Since each element of the output vector can be either 0 S or 1. use the Neural Network Design Demonstration Decision Boundaries (nnd4db). as in Figure 4. since its output can be either 0 or 1.18) which is equal to the target output t 2 . We can do this by picking a point on T the decision boundary and satisfying Eq. there will be one decision boundary for each neuron. (4. there are a total of 2 possible categories. Verify for yourself that all inputs are correctly classified. This learning rule is an example of supervised training. where S is the number of neurons. t 1} . Perceptron Learning Rule Now that we have examined the performance of perceptron networks.1. (4. we are in a position to introduce the perceptron learning rule. tQ} . (4. If we apply p 2 to the network.5 + b = 3 + b = 0 0 ⇒ b = –3 . The decision boundary for neuron i will be defined by iw T p + bi = 0 . A multiple-neuron perceptron can classify inputs into many categories. b . If we use p = 1. we need to find the bias.4 Perceptron Learning Rule Finally. Multiple-Neuron Perceptron Note that for perceptrons with multiple neurons. the output will be   T a = hardlim ( 1w p 2 + b ) = hardlim  2 2 0 – 3   1 a = hardlim ( – 1 ) = 0.19) A single-neuron perceptron can classify input vectors into two categories. (4.

1 and w 1. 4-9 .Perceptron Learning Rule where p q is an input to the network and t q is the corresponding target output. as shown in Figure 4. t = 0  . The input/target pairs for our test problem are  1 . and we could almost obtain a solution by inspection. t = 0   p = 0 . the network output is compared to the target. This simplicity will help us gain some intuitive understanding of the basic concepts of the perceptron learning rule. and the vector whose target is 1 is represented with a dark circle . There must be an allowable decision boundary that can separate the vectors p 2 and p 3 from the vector p 1 . We need to be sure that this network is still able to solve the test problem. The figure to the left illustrates that there are indeed an infinite number of such boundaries. As each input is applied to the network. we will begin with a network without a bias.2 Σ n a a = hardlim(Wp) Figure 4.4 Test Problem Network 1 2 3 By removing the bias we are left with a network whose decision boundary must pass through the origin. t = 1   p = –1 . The network for this problem should have two-inputs and one output. Test Problem In our presentation of the perceptron learning rule we will begin with a simple test problem and will experiment with possible rules to develop some intuition about how the rule should work.4. The learning rule then adjusts the weights and biases of the network in order to move the network output closer to the target. 2 . To simplify our development of the learning rule. where the two input vectors whose target is 0 are represented with a light circle . This is a very simple problem. w 1.  3  p1 =  2  1 2 3 2 2 –1     The problem is displayed graphically in the adjacent figure. Inputs No-Bias Neuron 4 1 2 3 p1 p2 w1. The network will then have just two parameters.1 w1.

23) 4-10 . One approach would be to set 1w equal to p 1 . (4.4 Perceptron Learning Rule 1 2 The adjacent figure shows the weight vectors that correspond to the allowable decision boundaries. while the target response. is 1. 1 2 3 1 w We can see what happened by looking at the adjacent diagram. Repeated presentations of p 1 would cause the direction of 1w to asymptotically approach the direction of p 1 .0 – 0.0 – 0.8 1   2 a = hardlim ( – 0. The diagram to the lower left shows a problem that cannot be solved with the weight vector pointing directly at either of the two class 1 vectors. Unfortunately. We begin with p 1 :   T a = hardlim ( 1w p 1 ) = hardlim  1. only its direction is important. This is simple and would ensure that p 1 was classified properly in the future. Remember that the length of the weight vector does not matter. If we apply the rule 1w = p every time one of these vectors is misclassified. so that in the future it has a better chance of classifying it correctly.8 . t 1 . so we only have to initialize its two weights.6 ) = 0 . In this case we are training a two-input/single-output network without a bias. Adding p 1 to 1w would make 1w point more in the direction of p 1 . to the following randomly generated values: T 1w = 1. Constructing Learning Rules 3 Training begins by assigning some initial values for the network parameters.) We would like a learning rule that will find a weight vector that points in one of these directions. 1w . it is easy to construct a problem for which this rule cannot find a solution. (4. Another possibility would be to add p 1 to 1w . We need to alter the weight vector so that it points more toward p 1 . the networkÕs weights will simply oscillate back and forth and will never find a solution. then 1w new = 1w old +p. The network output is 0. (Recall that the weight vector is orthogonal to the decision boundary. The initial weight vector results in a decision boundary that incorrectly classifies the vector p 1 . This rule can be stated: If t = 1 and a = 0.21) We will now begin presenting the input vectors to the network. Here we set the elements of the weight vector.22) The network has not returned the correct value. (4.

0 .25) 4 The target t 2 associated with p 2 is 0 and the output a is 1.28) The current 1w results in a decision boundary that misclassifies p 3 .8 –1 0.0 – 0 = 3.0 + 1 = 2. we can simply change the addition in Eq.26) If we apply this to the test problem we find: 1w new 1 2 = 1w old – p 2 = 2. When it is presented to the network we find:   T a = hardlim ( 1w p 2 ) = hardlim  2. (4.29) 4-11 . – 0. 3 1 w Now we present the third vector p 3 :   T a = hardlim ( 1w p 3 ) = hardlim  3.2 2 – 0.0 – 0. We now move on to the next input vector and will continue making changes to the weights and cycling through the inputs until they are all classified correctly. A class 0 vector was misclassified as a 1. – 0. so 1w will be updated again. according to Eq.0 1. The next input vector is p 2 .0 .8 2 1.0 – – 1 = 3.23) to subtraction: If t = 0 and a = 1.4 ) = 1 .8 0   –1  = hardlim ( 0. 3 (4. 1.Perceptron Learning Rule Applying this rule to our test problem results in new values for 1w : 1w new = 1w old + p1 = 1.27) which is illustrated in the adjacent figure. (4. (4. (4.2 (4.24) 1 2 1 w This operation is illustrated in the adjacent figure. This is a situation for which we already have a rule.8 ) = 1 .2 – 1   2  = hardlim ( 0.8 (4.0 . then 1w new = 1w old –p. Since we would now like to move the weight vector 1w away from the input.26): 1w new = 1w old – p3 = 3.2 (4.

35) 4-12 . The result is the perceptron rule for a bias: b new = b old +e.33) we can see that the sign of p is the same as the sign on the error. (4.33) If e = – 1. (4. then 1w new (4. e. it will output the correct class for that input vector. (4. the absence of p in the third rule corresponds to an e of 0.31) can be rewritten as a single expression.34) This rule can be extended to train the bias by noting that a bias is simply a weight whose input is always 1. which cover all possible combinations of output and target values: If t = 1 and a = 0. First we will define a new variable.34) with the input to the bias.31) as: If e = 1. then 1w new = 1w old If e = 0. then 1w new new new = 1w = 1w old old old + p. Furthermore. donÕt fix it. then 1w If t = a. which is 1. w This brings us to our third and final rule: if it works.32) = 1w old +p. – p. (4. then 1w new = 1w old Looking carefully at the first two rules in Eq. If t = a. (4. the perceptron error e: e = t –a. If we present any of the input vectors to the neuron. then 1w If t = 0 and a = 1. Unified Learning Rule The three rules in Eq. .31) = 1w . (4. Thus.30) 3 Here are the three rules. – p. (4. We can now rewrite the three rules of Eq. then 1w new = 1w old . (4. we can unify the three rules into a single expression: 1w new = 1w old + ep = 1w old + ( t – a )p . We can thus replace the input p in Eq. (4.4 Perceptron Learning Rule 1 2 1 The diagram to the left shows that the perceptron has finally learned to classify the three vectors properly.

  –1   (4. instead of -1. 2 +2 To test the perceptron learning rule. (4. The first step is to apply the first input vector. To update the ith row of the weight matrix use: iw new = iw old + ei p . We can generalize this rule for the multiple-neuron perceptron of Figure 4.1 as follows.5 – 1 – 0.38) (4.5 – 1 – 0. t 2 = 1  .5 . b = 0.37) The perceptron rule can be written conveniently in matrix notation: W and b new new 4 (4.41) (4. T = b old +e. updates the weight vector of a single neuron perceptron. instead of hardlims .5 . consider again the apple/orange recognition problem of Chapter 3. as was used in Chapter 3.5   –1   = hardlim ( 2.36) To update the ith element of the bias vector use: bi Perceptron Rule new = bi old + ei . This is because we are using the hardlim transfer function.34) and Eq.Perceptron Learning Rule Training Multiple-Neuron Perceptrons The perceptron rule. as given by Eq.5 – 1 + 0.) Typically the weights and biases are initialized to small random numbers. (4. (4. t 1 = 0    –1     1    p2 = 1 . p 1 .39) = W old + ep . Suppose that here we start with the initial weight matrix and bias: W = 0.40) (Note that we are using 0 as the target output for the orange pattern. p 1 .35).42) 4-13 . The input/output prototype vectors will be   1    p1 = –1 .5 ) = 1 (4. (4. to the network:   1   a = hardlim ( Wp 1 + b ) = hardlim  0.

5 2 0.5 + ( – 1 ) 1 – 1 – 1 T = – 0.5 – 1 – 0.5 + ( – 1 ) = – 0.51) (4.49) = W old + ep = – 0.5 1 – 0.5 (4.5 + 1 = 0.43) = W old + ep = 0.5 b new T = b old + e = – 0.5 + ( – 1 ) 1 – 1 – 1 T (4.47) (4.5 .46) = hardlim (– 0. The second iteration of the perceptron rule is: 1 1 + ( – 0.5 . The bias update is b new = b old + e = 0.5 0 0.5 1 – 0.50) (4. (4.5 0 0. The weight update is W new (4.48) (4.4 Perceptron Learning Rule Then we calculate the error: e = t 1 – a = 0 – 1 = –1 .5) –1 = hardlim (0.5 1 – 0.44) = – 0.52) = W old + ep = 0.5 The third iteration begins again with the first input vector: 1 a = hardlim (Wp 1 + b) = hardlim ( 0.5) = 0 e = t2 – a = 1 – 0 = 1 W new (4.5) = 1 e = t 1 – a = 0 – 1 = –1 W new (4.5 4-14 .5 )) –1 a = hardlim (Wp 2 + b) = hardlim ( – 0.45) This completes the first iteration.5 0 0.5 + 1 1 1 – 1 = 0.5 – 1 + 0.

In this section we will present a proof of convergence for the perceptron learning rule for the single-neuron perceptron shown in Figure 4. it can be shown that the rule will always converge to weights that accomplish the desired classification (assuming that such weights exist).54) The network is provided with the following examples of proper network behavior: {p 1.5 .5 Single-Neuron Perceptron The output of this perceptron is obtained from a = hardlim ( 1w p + b ) . In fact. {p Q.53) If you continue with the iterations you will find that both input vectors will now be correctly classified. t 2} .R b n a 1 a = hardlim (1wTp + b) Figure 4. T (4.Proof of Convergence b new = b old + e = 0.5 + ( – 1 ) = – 0. (4. t Q} . We will combine the weight matrix and the bias into a single vector: 4-15 . is either 0 or 1 .55) Notation To conveniently present the proof we will first introduce some new notation.1 Σ w1. Note that the final decision boundary is not the same as the one we developed in Chapter 3. {p 2.5. The algorithm has converged to a solution. (4. To experiment with the perceptron learning rule. it is quite powerful. Proof of Convergence Although the perceptron learning rule is simple. although both boundaries correctly classify the two input vectors. Inputs Hard Limit Neuron 4 p1 p2 p3 pR w1. t 1} . …. use the Neural Network Design Demonstration Perceptron Rule (nnd4pr). t q . where each target output.

(4.58) The perceptron learning rule for a single-neuron perceptron (Eq.62) and x∗ z q < – δ < 0 if t q = 0 . T (4. 4-16 .60) We will assume that a weight vector exists that can correctly categorize all Q input vectors. (4. then the input vector is added to the weight vector. This solution will be denoted x∗ . T (4. where z' ( k – 1 ) is the appropriate member of the set { z 1. If we count only those iterations for which the weight vector is changed. …. corresponding to the bias input: zq = pq 1 .34) and Eq.4 Perceptron Learning Rule x = 1w .59) The error e can be either 1 . The objective of the proof is to find upper and lower bounds on the length of the weight vector at each stage of the algorithm.35)) can now be written x new = x old + ez . – z 1. (4. If e = 1 . then no change is made to the weights. z 2. (4. – z 2. – z Q } . T T (4. ….61) (4. – 1 or 0 .57) Now we can express the net input to the neuron as follows: n = 1w p + b = x z .63) Proof We are now ready to begin the proof of the perceptron convergence theorem. then the negative of the input vector is added to the weight vector. If e = 0 . If e = – 1 . (4. (4. For this weight vector we will assume that x∗ z q > δ > 0 if t q = 1 .56) b We will also augment the input vectors with a 1. the learning rule becomes x ( k ) = x ( k – 1 ) + z' ( k – 1 ) . z Q.

60): x ( k ) = z' ( 0 ) + z' ( 1 ) + … + z' ( k – 1 ) .61)ÐEq. We begin by finding the change in the length at iteration k : x(k ) 2 = x ( k )x ( k ) = [ x ( k – 1 ) + z' ( k – 1 ) ] [ x ( k – 1 ) + z' ( k – 1 ) ] = x ( k – 1 )x ( k – 1 ) + 2x ( k – 1 )z' ( k – 1 ) + z' ( k – 1 )z' ( k – 1 ) T T T T T (4. T (4.67) From the Cauchy-Schwartz inequality (see [Brog91]) ( x∗ x ( k ) ) ≤ x∗ T 2 2 x(k ) 2 . after k iterations (changes to the weight vector). (4.70) Next we want to find an upper bound for the length of the weight vector. (4. (4.) Then.68) where x 2 = x x.67) and Eq. (4.69) If we combine Eq.64) If we take the inner product of the solution weight vector with the weight vector at iteration k we obtain x∗ x ( k ) = x∗ z' ( 0 ) + x∗ z' ( 1 ) + … + x∗ z' ( k – 1 ) . (4. T 4 (4.68) we can put a lower bound on the squared length of the weight vector at iteration k : x(k ) 2 ( x∗ x ( k ) ) ( kδ ) ≥ -------------------------. (4. (4. T (4. T T T T (4.Proof of Convergence Assume that the algorithm is initialized with the zero weight vector: x ( 0 ) = 0 .63) we can show that x∗ z' ( i ) > δ . we find from Eq..71) Note that 4-17 .66) Therefore x∗ x ( k ) > kδ . 2 2 x∗ x∗ T 2 2 (4.65) From Eq. (This does not affect the generality of our argument.> -----------.

3.4 Perceptron Learning Rule x ( k – 1 )z' ( k – 1 ) ≤ 0 . the perceptron learning rule will converge in a finite number of iterations. 2 2 δ x∗ (4. there are many variations of the perceptron learning rule that can also be shown to converge. 2 (4. An upper bound. (4. Now Eq.74) We can repeat this process for x ( k – 1 ) x(k ) 2 2 .. x(k – 2) 2 ≤ z' ( 0 ) 2 + … + z' ( k – 1 ) If Π = max { z' ( i ) } .76) Because k has an upper bound.71) can be simplified to x(k ) 2 ≤ x(k – 1) 2 + z' ( k – 1 ) 2 2 . so long as a solution exists. T (4. exists for the length of the input vectors. (4.or k < ----------------. A solution to the problem exists. 2. therefore Eq. to obtain . (4. The maximum number of iterations (changes to the weight vector) is inversely related to the square of δ . This parameter is a measure of how close the solution decision boundary is to the input patterns. If we combine the two inequalities we find kΠ ≥ x ( k ) 2 2 2 ( kδ ) Π x∗ > -----------. Because of the generality of the proof. (4. The weights are only updated when the input vector is misclassified.75)) and a lower bound (Eq.. (See Exercise E4. This means that if the input classes are difficult to separate (are close to the decision boundary) it will take many iterations for the algorithm to converge.) Limitations The perceptron learning rule is guaranteed to converge to a solution in a finite number of steps.73) . so that Eq.75) We now have an upper bound (Eq. This brings us to an im4-18 .9. (4.70)) on the squared length of the weight vector at iteration k . (4. (4.72) is satisfied. Π . Therefore.72) since the weights would not be updated unless the previous input vector had been misclassified.66) is satisfied. Note that there are only three key assumptions required for the proof: 1. this means that the weights will only be changed a finite number of times. etc. this upper bound can be simplified to x(k ) 2 ≤ kΠ .

which can solve arbitrary classification problems. The boundary between the regions is defined by the equation T 1w p + b = 0. What problems can a perceptron solve? Recall that a single-neuron perceptron is able to divide the input space into two regions. t = 0  . Unfortunately. We call such vectors linearly separable. t = 1  p = 1 . t = 1  p = 1 . (4. t = 0  p = 0 . which can be used to train them. The classic example is the XOR gate. The logical AND gate example on page 4-7 illustrates a two-dimensional example of a linearly separable problem. many problems are not linearly separable. and will describe the backpropagation algorithm. Try drawing a straight line between the vectors with targets of 1 and those with targets of 0 in any of the diagrams of Figure 4.6. in part. The apple/orange recognition problem of Chapter 3 was a three-dimensional example. to a reduction in interest in neural network research during the 1970s. In Chapter 11 we will introduce multilayer perceptrons. which also shows two other linearly inseparable problems. The input/target pairs for the XOR gate are  0 . but he was never able to effectively extend the perceptron rule to such networks. Rosenblatt had investigated more complex networks. 4 Figure 4.6 Linearly Inseparable Problems It was the inability of the basic perceptron to solve such simple problems that led.  p1 =   2   3   4  1 2 3 4 0 1 0 1         This problem is illustrated graphically on the left side of Figure 4. The perceptron can be used to classify input vectors that can be separated by a linear boundary. 4-19 .6. which he felt would overcome the limitations of the basic perceptron.Proof of Convergence portant question.77) Linear Separability This is a linear boundary (hyperplane).

Single-layer perceptrons can only classify linearly separable vectors.4 Perceptron Learning Rule Summary of Results Perceptron Architecture Input p Rx1 Hard Limit Layer a W SxR n Sx1 Sx1 1 R b Sx1 S a = hardlim (Wp + b) T 1w a = hardlim ( Wp + b ) W = T 2w T Sw … a i = hardlim ( n i ) = hardlim ( iw p + b i ) T Decision Boundary T iw p + bi = 0 . The decision boundary is always orthogonal to the weight vector. Perceptron Learning Rule W new = W old + ep b new T = b old +e where e = t – a . 4-20 .

1 by drawing a decision boundary. (a) (b) (c) The next step is to find the weights and biases. and pointing in the direction of points to be classified as 1 (the dark points).1 Simple Classification Problems First we draw a line between each set of dark and light data points.1 Solve the three simple classification problems shown in Figure P4. 1w 1w 1w (a) (b) (c) Here is one set of choices for the weight vectors: (a) 1w = – 2 1 . (c) 1w = 2 – 2 . T T T 4-21 . (b) 1w = 0 – 2 . Find weight and bias values that result in single-neuron perceptrons with the chosen decision boundaries. (a) (b) (c) 4 Figure P4.Solved Problems Solved Problems P4. The weight vectors must be orthogonal to the decision boundaries. The weight vectors can have any length we like.

since t 1 is 1. a = hardlim(w*[1. t = 1  p = 0 . Here we test the T first network on the input vector p = – 2 2 . a = hardlim ( 1w p + b )   = hardlim  – 2 1 – 2 + 0   2 = hardlim ( 6 ) = 1 »2+2 ans = 4 T We can use MATLAB to automate the testing process and to try new points. (b) b = – 0 – 2 0 = – 2 . w=[-2 1]. or greater than or equal to 0.4 Perceptron Learning Rule Now we find the bias values for each perceptron by picking a point on the decision boundary and satisfying Eq. Here the first network is used to classify a point that was not in the original problem. b = 0.15). t = 0  p = 2 . (4. T 1w p +b = 0 T b = – 1w p This gives us the following three biases: (a) b = – – 2 1 0 = 0 . (c) b = – 2 – 2 – 2 = 6 0 –1 1 We can now check our solution against the original points. For example. t = 0   p1 =   2   3   4  1 2 3 4 2 0 –2 0         Each target t i indicates whether or not the net input in response to p i must be less than 0.  0 . t = 1  p = 1 . we 4-22 .1]+b) a = 0 P4.2 Convert the classification problem defined below into an equivalent problem definition consisting of inequalities constraining weight and bias values.

Applying the same procedure to the input/target pairs for { p 2. 1 + b < 0 ( iv ) Solving a set of inequalities is more difficult than solving a set of equalities. 2 + b ≥ 0 w 1. 2 only appears in inequalities (i) and (iii). t 3 } and { p 4. 2 + b ≥ 0. t 4 } results in the following set of inequalities. w1. One added complexity is that there are often an infinite number of solutions (just as there are often an infinite number of linear decision boundaries that can solve a linearly separable classification problem). 2 + b ≥ 0 2w 1. because of the simplicity of this problem. Thus we get the following inequality: Wp 1 + b ≥ 0 0w 1. 4-23 . 1 only appears in inequalities (ii) and (iv). { p 3.1 ii iv b iii i b w1.Solved Problems know that the net input corresponding to p 1 must be greater than or equal to 0. and w 1. However. We can plot each pair of inequalities with two graphs. 1 + 2w 1. Here is one such solution: W = –2 3 b = 3. Note that w 1. 2w 1. t 2 }. 2 + b < 0 ( iii ) 2w 1. 1 + b ≥ 0 (i) ( ii ) – 2w 1.2 4 Any weight and bias values that fall in both dark gray regions will solve the classification problem. we can solve it by graphing the solution spaces defined by the inequalities.

4. The remaining boundary must then isolate each class. 2 1  –1 –2    Design a perceptron network to solve this problem. we need to have one decision boundary divide the four classes into two sets of two. p 4 = 2  . since an S -neuron perceptron can categorize S 2 classes. Two such boundaries are illustrated in Figure P4. Therefore. The four classes are     class 1:  p 1 = 1 .2. The light circles indicate class 1 vectors. p 2 = 1  . We now know that our patterns are linearly separable. class 4:  p 7 = – 1 .3 We have a classification problem with four classes of input vector.4 Perceptron Learning Rule P4. 1 2  –1 0        class 3:  p 5 = – 1 . as in Figure P4. the dark circles indicate class 3 vectors. p 6 = – 2  . The two-neuron perceptron is shown in Figure P4. 4-24 .3. To solve a problem with four classes of input vector we will need a perceptron with at least two neurons. p 8 = – 2  . and the dark squares indicate class 4 vectors. Input p 2x1 Hard Limit Layer a W 2x2 n 2x1 2x1 1 2 b 2x1 2 a = hardlim (Wp + b) Figure P4. class 2:  p 3 = 2 . to divide the input space into the four categories. A two-neuron perceptron creates two decision boundaries.2 Two-Neuron Perceptron LetÕs begin by displaying the input vectors. the light squares indicate class 2 vectors.

The darkest shading indicates that both neuron outputs are 1.3 The weight vectors should be orthogonal to the decision boundaries and should point toward the regions where the neuron outputs are 1. t 8 = 1  .4 Tentative Decision Boundaries for Problem P4. 0 0  1 1    We can now select the weight vectors: 4-25 . 0 0  1 1        class 3:  t 5 = 1 . where the shaded areas represent outputs of 1.Solved Problems 3 1 2 4 Figure P4. t 2 = 0  . class 2:  t 3 = 0 . Note that this solution corresponds to target values of     class 1:  t 1 = 0 .3 Input Vectors for Problem P4. class 4:  t 7 = 1 .3 4 3 1 2 4 Figure P4. t 6 = 1  . The next step is to decide which side of each boundary should produce a 1. t 4 = 0  .5. One choice is illustrated in Figure P4.

4 Perceptron Learning Rule 1w = – 3 and 2w = 1 .4 Solve the following classification problem with the perceptron rule. only their directions. for as many repetitions as it takes to ensure that the problem is solved. (4. Draw a graph of the problem only after you have found a solution. 4-26 .15): T b 1 = – 1w p = – – 3 – 1 0 = 1 . They must be orthogonal to the decision boundaries. 1 T b 2 = – 2w p = – 1 – 2 0 = 0 . Apply each input vector in order. Now we can calculate the bias by picking a point on a boundary and satisfying Eq. P4. –1 –2 Note that the lengths of the weight vectors is not important. 0 3 1 2 4 Figure P4. 1 –2 0 which completes our design.3 In matrix form we have T 1w 2w T W = = – 3 – 1 and b = 1 .5 Decision Regions for Problem P4.

t = 0   p = –1 . so we use the perceptron rule to find new weights and biases based on the error. e = t 1 – a = 0 – 1 = –1 W ( 1 ) = W ( 0 ) + ep 1 = 0 0 + ( – 1 ) 2 2 = – 2 – 2 b ( 1 ) = b ( 0 ) + e = 0 + ( –1 ) = –1 We now apply the second input vector p 2 . We start by calculating the perceptronÕs output a for the first input vector p 1 .Solved Problems  2 . W(2) = W(1) b(2) = b(1) We now apply the third input vector. using the updated weights and bias. a = hardlim ( W ( 0 )p 1 + b ( 0 ) )   = hardlim  0 0 2 + 0 = hardlim ( 0 ) = 1   2 The output a does not equal the target value t 1 . Application of the perceptron rule will not result in any changes. a = hardlim ( W ( 1 )p 2 + b ( 1 ) )   = hardlim  – 2 – 2 1 – 1 = hardlim ( 1 ) = 1   –2 This time the output a is equal to the target t 2 . using the initial weights and bias. T 4 4-27 . t = 1   p = –2 . t = 1   p1 =   2   3   4  1 2 3 4 2 –2 2 1         Use the initial weights and bias: W(0) = 0 0 b(0) = 0 . t = 0   p = 1 .

a = hardlim ( W ( 3 )p 4 + b ( 3 ) )   = hardlim  – 2 – 2 – 1 – 1 = hardlim ( – 1 ) = 0   1 This time the output a does not equal the appropriate target t 4 . W(3) = W(2) b(3) = b(2) We now move on to the last input vector p 4 . W(5) = W(4) b(5) = b(4) The second presentation of p 2 results in an error and therefore a new set of weight and bias values. a = hardlim ( W ( 4 )p 1 + b ( 4 ) )   = hardlim  – 3 – 1 2 + 0 = hardlim ( – 8 ) = 0   2 Therefore there are no changes. 4-28 T . The perceptron rule will result in a new set of values for W and b . e = t4 – a = 1 – 0 = 1 W ( 4 ) = W ( 3 ) + ep 4 = – 2 – 2 + ( 1 ) – 1 1 = – 3 – 1 b(4) = b(3) + e = – 1 + 1 = 0 We now must check the first vector p 1 again. This time the output a is equal to the associated target t 1 . so there will be no changes.4 Perceptron Learning Rule a = hardlim ( W ( 2 )p 3 + b ( 2 ) )   = hardlim  – 2 – 2 – 2 – 1 = hardlim ( – 1 ) = 0   2 The output in response to input vector p 3 is equal to the target t 3 .

T 4 Now we can graph the training data and the decision boundary of the solution. 1 p 1 + w 1. set p 2 = 0 : b 1 1 p 1 = – --------.= – ----. The decision boundary is given by n = Wp + b = w 1. To find the p 2 intercept of the decision boundary. if p 1 = 0 .   a = hardlim ( W ( 6 )p 3 + b ( 6 ) ) = hardlim  – 2 – 3 – 2 + 1 = 0 = t 3   2   a = hardlim ( W ( 6 )p 4 + b ( 6 ) ) = hardlim  – 2 – 3 – 1 + 1 = 1 = t 4   1   a = hardlim ( W ( 6 )p 1 + b ( 6 ) ) = hardlim  – 2 – 3 2 + 1 = 0 = t 1   2   a = hardlim ( W ( 6 )p 2 + b ( 6 ) ) = hardlim  – 2 – 3 1 + 1 = 1 = t 2   –2 Therefore the algorithm has converged.= -w 1.= – ----. set p 1 = 0 : b 1 1 p 2 = – --------. 2 –3 3 To find the p 1 intercept. 4-29 .= -w 1. The final solution is: W = –2 –3 b = 1. 1 –2 2 if p 2 = 0 .Solved Problems a = hardlim ( W ( 5 )p 2 + b ( 5 ) )   = hardlim  – 3 – 1 1 + 0 = hardlim ( – 1 ) = 0   –2 Here are those new values: e = t2 – a = 1 – 0 = 1 W ( 6 ) = W ( 5 ) + ep 2 = – 3 – 1 + ( 1 ) 1 – 2 = – 2 – 3 b ( 6 ) = b ( 5 ) + e = 0 + 1 = 1. Cycling through each input vector once more results in no errors. 2 p 2 + b = – 2 p 1 – 3 p 2 + 1 = 0 .

3. t = 0  p = 2 . 0 1 1 1 1 4-30 .6. P4.5 Consider again the four-class decision problem that we introduced in Problem P4. t = 0   p = –1 . t = 1   p = –2 . the training set will be:  1 .  p7 =   8  7 8 –1 1   –2 1   LetÕs begin the algorithm with the following initial weights and biases: W(0) = 1 0 . t = 0   p1 =   2   3  1 2 3 1 0   2 0   –1 1    2 . since the hard limit function returns 1 when given an input of 0. This is acceptable.3. and the target for the vector in question is indeed 1. If we use the same target vectors that we introduced in Problem P4. t = 1   p = –2 .4 Perceptron Learning Rule The resulting decision boundary is illustrated in Figure P4. W Figure P4. t = 1  .4 Note that the decision boundary falls across one of the training vectors. t = 1   p4 =   5   6  4 5 6 0 1   2 0   1 0    –1 . given the problem definition. t = 0  p = 1 . b(0) = 1 . Train a perceptron network to solve this problem using the perceptron learning rule.6 Decision Boundary for Problem P4. 0 1 1 The first iteration is a = hardlim (W ( 0 )p 1 + b ( 0 )) = hardlim ( 1 0 1 + 1 ) = 1 .

Solved Problems e = t1 – a = 0 – 1 = –1 . 0 1 –1 T W ( 1 ) = W ( 0 ) + ep 1 = 1 0 + – 1 1 1 = 0 – 1 . 4-31 . 1 –1 0 The second iteration is a = hardlim (W ( 1 )p 2 + b ( 1 )) = hardlim ( 0 – 1 1 + 0 ) = 0 . b(2) = b(1) + e = 0 + 0 = 0 . 0 0 0 The third iteration is a = hardlim (W ( 2 )p 3 + b ( 2 )) = hardlim ( 0 – 1 2 + 0 ) = 1 . 0 1 –1 –1 0 b ( 1 ) = b ( 0 ) + e = 1 + –1 = 0 . 1 0 1 W ( 3 ) = W ( 2 ) + ep 3 = T 0 –1 + –1 –2 0 2 –1 = –1 0 1 1 –1 . –1 0 –1 0 0 e = t3 – a = 0 – 1 = –1 . 0 0 0 W ( 2 ) = W ( 1 ) + ep 2 = T 4 0 –1 + 0 0 –1 1 2 = –1 0 0 –1 0 . –1 0 2 0 0 e = t2 – a = 0 – 0 = 0 .

4 Perceptron Learning Rule b ( 3 ) = b ( 2 ) + e = 0 + –1 = –1 .7. b ( 9 ) = b ( 8 ) + e = –1 + 0 = –1 . 0 1 –1 T W ( 9 ) = W ( 8 ) + ep 1 = – 2 0 + 0 1 1 = – 2 0 1 –1 –1 0 –2 .5 4-32 . W(8) = W(7) = W(6) = W(5) = W(4) = W(3) b(8) = b(7) = b(6) = b(5) = b(4) = b(3) The ninth iteration produces a = hardlim (W ( 8 )p 1 + b ( 8 )) = hardlim ( – 2 0 1 + – 1 ) = 0 . 1 –1 0 At this point the algorithm has converged. 3 1 2 4 Figure P4. Compare this result with the network we designed in Problem P4. since all input patterns will be correctly classified.3. 0 1 1 Iterations four through eight produce no changes in the weights.7 Final Decision Boundaries for Problem P4. 1 –1 1 1 1 e = t1 – a = 0 – 0 = 0 . The final decision boundaries are displayed in Figure P4.

The standard perceptron is only able to classify vectors that are linearly separable. which can solve arbitrary classification problems. It is a type of learning called supervised learning. which is introduced in Chapter 11. The backpropagation learning rule. distance (norm). can be used to train these networks. but it is also quite powerful. but with the structure of the network.Epilogue Epilogue In this chapter we have introduced our first learning rule Ñ the perceptron learning rule. etc. The perceptron learning rule is very simple. We will see in Chapter 11 that the perceptron architecture can be generalized to mutlilayer perceptrons. Our objective will be to obtain a fundamental understanding of how neural networks work. projection. We will find in later chapters that a good foundation in linear algebra is essential to our understanding of all neural networks. As each input is applied to the network. In Chapters 5 and 6 we will review some of the key concepts from linear algebra that will be most important in our study of neural networks. the learning rule adjusts the network parameters so that the network output will move closer to the target. We have shown that the rule will always converge to a correct solution. such as inner product. in which the learning rule is provided with a set of examples of proper network behavior. if such a solution exists. 4 4-33 . In Chapters 3 and 4 we have used many concepts from the field of linear algebra. The weakness of the perceptron network lies not with the learning rule.

5. Anderson. The first half of the book is devoted to linear algebra. A formal treatment of the perceptron was needed both to explain the perceptronÕs limitations and to indicate directions for overcoming them. 1991. 386Ð408. [MiPa69] M. A classic paper in which a reinforcement learning algorithm is used to train a neural network to balance an inverted pendulum. ÒNeuron-like adaptive elements can solve difficult learning control problems. 5. 115Ð133. Barto. pp.Ó IEEE Transactions on Systems. 1969. Modern Control Theory. it temporarily cooled research and funding for research for several years. [Brog91] W. McCulloch and W. 13. L. 1983. Perceptrons. MA: MIT Press. Pitts. NJ: Prentice-Hall. Sutton and C. 1958. Unfortunately. Rosenblatt. in which a weighted sum of input signals is compared to a threshold to determine whether or not the neuron fires. Vol. A landmark book that contains the first rigorous study devoted to determining what a perceptron network is capable of learning. Englewood Cliffs. pp. Papert. Man and Cybernetics. 1943. Vol. A well-written book on the subject of linear systems. This article introduces the first mathematical model of a neuron. Minsky and S.4 Perceptron Learning Rule Further Reading [BaSu83] A. Vol. 65.. 834Ð846. 3rd Ed. It also has good sections on the solution of linear differential equations and the stability of linear and nonlinear systems. It has many worked problems. ÒA logical calculus of the ideas immanent in nervous activity. [Rose58] F. Cambridge. This paper presents the first practical artificial neural network Ñ the perceptron. Although this was not true. [McPi43] W. R.Ó Bulletin of Mathematical Biophysics. 4-34 . Brogan. No. pp. ÒThe perceptron: A probabilistic model for information storage and organization in the brain. the book pessimistically predicted that the limitations of perceptrons indicated that the field of neural networks was a dead end.Ó Psychological Review.

Further Reading [Rose61] F. 1992. 4 4-35 . [WhSo92] D. Collection of articles describing current research and applications of neural networks and fuzzy logic to control systems. Sofge (Eds. White and D. 1961. New York: Van Nostrand Reinhold.). Rosenblatt. Principles of Neurodynamics. Handbook of Intelligent Control. One of the first books on neurocomputing. Washington DC: Spartan Press.

p5 = –2 0 p6 = 1 1 p7 = 0 1 p8 = –1 –2 iv. Draw a graph of the data points.4 Perceptron Learning Rule Exercises E4.) 4-36 . Design a single-neuron perceptron to solve this problem. (The solution is more difficult than Problem P4. by choosing weight vectors that are orthogonal to the decision boundaries. t = 0  . labeled according to their targets. since you canÕt isolate the weights and biases in a pairwise manner. t = 1   p = –1 . t = 1   p = 1 .2).2 Consider the classification problem defined below. t = 1   p = 1 . Classify the following input vectors with your solution. and repeat parts (ii) and (iii) with the new solution. ii. t = 0   p = 1 . You can either perform the calculations manually or with MATLAB. t = 0   p1 =   2   3   4  1 2 3 4 1 0 –1 0          0 . regardless of the solution values for W and b ? Which may vary depending on the solution? Why? E4.  p1 =   2   3   4  1 2 3 4 1 –1 0 0         i. How many inputs are required? ii.2. Design the network graphically.  –1 . t = 1   p = 0 .2 by solving inequalities (as in Problem P4. Test your solution with all four input vectors. t = 1   p = 0 .1 Consider the classification problem defined below:  –1 .3 Solve the classification problem in Exercise E4. Which of the vectors in part (iii) will always be classified the same way.  p5 =  5 1   i. Draw a diagram of the single-neuron perceptron you would use to solve this problem. Is this problem solvable with the network you defined in part (i)? Why or why not? E4. t = 0 . »2+2 ans = 4 iii.

4 Solve the classification problem in Exercise E4. and repeat parts (ii) and (iii) with the new solution. The target values indicate whether the respective input vector was taken from a rabbit (0) or a bear (1).7 The vectors in the ordered set defined below were obtained by measuring the weight and ear lengths of toy rabbits and bears in the Fuzzy Wuzzy Animal Factory. t = 1   p = –1 . and the second element is the ear length. how do they differ? Why? iv. 1]. Given initial weight and bias values for a standard hard limit perceptron.  –1 .  1 . instead of the hard limit function. If the two networks are given the same input p . i. t = 0   p1 =   2   3   4  1 2 3 4 1 –1 –1 1         (Hint: start by rewriting the input/target requirements as inequalities that constrain the weight and bias values.2 by applying the perceptron rule to the following initial parameters.5 Prove mathematically (not graphically) that the following problem is unsolvable for a two-input/single-neuron perceptron. create a method for initializing a symmetric hard limit perceptron so that the two neurons will always respond identically when trained on identical data. 1].) E4. t = 0  p = 2 . t = 0  p = 1 . t = 0   p1 =   2   3   4  1 2 3 4 4 5 4 5         4-37 4 a = hardlims (n) »2+2 ans = 4 . The first element of the input vector is the weight of the toy. and updated with the perceptron learning rule. n = Wp + b ii. Write a simple expression that maps numbers in the ordered set [0. Write the expression that performs the inverse mapping. E4. and the second network uses the symmetric hard limit function. Target values are then taken from the set [-1.Exercises E4. The first network uses the hard limit function ([0. will their weights continue to have the same value? iii. t = 1   p = 1 . If the changes to the weights of the two neurons are different. 1] instead of [0. t = 0  p = 2 . Consider two single-neuron perceptrons with the same weight and bias values. t = 0   p = 1 . 1] into the ordered set [-1. W(0) = 0 0 b(0) = 0 E4. 1] values).6 The symmetric hard limit function is sometimes used in perceptron networks.

iii. With the p 3 from (iii). E4. Use MATLAB to test the resulting weight and bias values against the input vectors. t = 1  p = 3 . t = 1  p = 4 .5 is the problem linearly separable? iv. Use MATLAB to initialize and train a network to solve this ÒpracticalÓ problem.e.8 Consider again the four-category classification problem described in Problems P4. Use MATLAB and to initialize and train a network to solve this problem. to ensure only robust solutions are found). Is the problem still linearly separable? Demonstrate your answer graphically.9 One variation of the perceptron learning rule is W new = W old + αep + αe T b new = b old where α is called the learning rate. iii. Prove convergence of this algorithm. Suppose that we change the input vector p 3 to p3 = 2 . Alter the input vectors to ensure that the decision boundary of any solution will not intersect one of the original input vectors (i.4 Perceptron Learning Rule  3 . ii. Then retrain the network.5. use MATLAB to initialize and train a network to solve this problem. If p 3 is changed to p3 = 2 1. »2+2 ans = 4 ii. Explain your results. 2 i.3 and P4. E4. t = 1   p5 =   6   7   8  5 6 7 8 1 2 1 2         i.. Explain your results. 4-38 . t = 1  p = 4 . Does the proof require a limit on the learning rate? Explain.