Professional Documents
Culture Documents
8: Lagrange Multipliers
Learning Objectives
Use the method of Lagrange multipliers to solve optimization problems with one constraint.
Use the method of Lagrange multipliers to solve optimization problems with two constraints.
Solving optimization problems for functions of two or more variables can be similar to solving such problems in single-variable
calculus. However, techniques for dealing with multiple variables allow us to solve more varied optimization problems for which
we need to deal with additional conditions or constraints. In this section, we examine one of the more common and useful methods
for solving optimization problems with constraints.
Lagrange Multipliers
In the previous section, an applied situation was explored involving maximizing a profit function, subject to certain constraints. In
that example, the constraints involved a maximum number of golf balls that could be produced and sold in 1 month (x), and a
maximum number of advertising hours that could be purchased per month (y). Suppose these were combined into a single
budgetary constraint, such as 20x + 4y ≤ 216, that took into account both the cost of producing the golf balls and the number of
advertising hours purchased per month. The goal is still to maximize profit, but now there is a different type of constraint on the
values of x and y . This constraint and the corresponding profit function
2 2
f (x, y) = 48x + 96y − x − 2xy − 9 y
is an example of an optimization problem, and the function f (x, y) is called the objective function. A graph of various level
curves of the function f (x, y) follows.
Figure 14.8.1 : Graph showing level curves of the function f (x, y) = 48x + 96y − x
2
− 2xy − 9y
2
corresponding to
c = 150, 250, 350, and 400.
In Figure 14.8.1, the value c represents different profit levels (i.e., values of the function f ). As the value of c increases, the curve
shifts to the right. Since our goal is to maximize profit, we want to choose a curve as far to the right as possible. If there were no
restrictions on the number of golf balls the company could produce or the number of units of advertising available, then we could
produce as many golf balls as we want, and advertise as much as we want, and there would be not be a maximum profit for the
company. Unfortunately, we have a budgetary constraint that is modeled by the inequality 20x + 4y ≤ 216. To see how this
constraint interacts with the profit function, Figure 14.8.2 shows the graph of the line 20x + 4y = 216 superimposed on the
previous graph.
Theorem 14.8.1: Let f and g be functions of two variables with continuous partial derivatives at every point of some open set
containing the smooth curve g(x, y) = 0. Suppose that f , when restricted to points on the curve g(x, y) = 0 , has a local
⇀
extremum at the point (x 0, y0 ) and that ∇g(x 0, y0 ) ≠ 0 . Then there is a number λ called a Lagrange multiplier, for which
⇀ ⇀
∇f (x0 , y0 ) = λ ∇g(x0 , y0 ).
Proof
Assume that a constrained extremum occurs at the point (x0 , y0 ). Furthermore, we assume that the equation g(x, y) = 0 can
be smoothly parameterized as
x = x(s) and y = y(s)
where s is an arc length parameter with reference point (x0 , y0 ) at s =0 . Therefore, the quantity z = f (x(s), y(s)) has a
dz
relative maximum or relative minimum at s = 0 , and this implies that =0 at that point. From the chain rule,
ds
dz ∂f ∂x ∂f ∂y
= ⋅ + ⋅
ds ∂x ∂s ∂y ∂s
∂f ∂f ∂x ∂y
^ ^ ^ ^
=( i + j) ⋅ ( i + j)
∂x ∂y ∂s ∂s
= 0,
where the derivatives are all evaluated at s = 0 . However, the first factor in the dot product is the gradient of f , and the second
factor is the unit tangent vector T⃗ (0) to the constraint curve. Since the point (x , y ) corresponds to s = 0 , it follows from
0 0
To apply Theorem 14.8.1 to an optimization problem similar to that for the golf ball manufacturer, we need a problem-solving
strategy.
4. The largest of the values of f at the solutions found in step 3 maximizes f ; the smallest of those values minimizes f .
Use the method of Lagrange multipliers to find the minimum value of f (x, y) = x 2
+ 4y
2
− 2x + 8y subject to the constraint
x + 2y = 7.
Solution
Let’s follow the problem-solving strategy:
1. The objective function is f (x, y) = x + 4y − 2x + 8y. To determine the constraint function, we must first subtract 7
2 2
from both sides of the constraint. This gives x + 2y − 7 = 0. The constraint function is equal to the left-hand side, so
g(x, y) = x + 2y − 7 . The problem asks us to solve for the minimum value of f , subject to the constraint (Figure 14.8.3).
⇀ ⇀
The equation ∇f (x 0, y0 ) = λ ∇g (x0 , y0 ) becomes
2 x0 − 2 = λ
8 y0 + 8 = 2λ.
The equation g (x 0, y0 ) = 0 becomes x 0 + 2 y0 − 7 = 0 . Therefore, the system of equations that needs to be solved is
2 x0 − 2 = λ
8 y0 + 8 = 2λ
x0 + 2 y0 − 7 = 0.
3. This is a linear system of three equations in three variables. We start by solving the second equation for λ and substituting it
into the first equation. This gives λ = 4y + 4 , so substituting this into the first equation gives
0
2 x0 − 2 = 4 y0 + 4.
4 y0 − 4 = 0
y0 = 1.
To ensure this corresponds to a minimum value on the constraint function, let’s try some other points on the constraint from
either side of the point (5, 1), such as the intercepts of g(x, y) = 0 , Which are (7, 0) and (0, 3.5).
We get f (7, 0) = 35 > 27 and f (0, 3.5) = 77 > 27.
So it appears that f has a relative minimum of 27 at (5, 1), subject to the given constraint.
Exercise 14.8.1
Hint
Use the problem-solving strategy for the method of Lagrange multipliers.
Answer
Subject to the given constraint, f has a maximum value of 976 at the point (8, 2).
Let’s now return to the problem posed at the beginning of the section.
The golf ball manufacturer, Pro-T, has developed a profit model that depends on the number x of golf balls sold per month
(measured in thousands), and the number of hours per month of advertising y, according to the function
2 2
z = f (x, y) = 48x + 96y − x − 2xy − 9 y ,
where z is measured in thousands of dollars. The budgetary constraint function relating the cost of the production of thousands
golf balls and advertising units is given by 20x + 4y = 216. Find the values of x and y that maximize profit, and find the
maximum profit.
Solution:
Again, we follow the problem-solving strategy:
1. The objective function is f (x, y) = 48x + 96y − x − 2xy − 9y . To determine the constraint function, we first subtract
2 2
216 from both sides of the constraint, then divide both sides by 4 , which gives 5x + y − 54 = 0. The constraint function is
equal to the left-hand side, so g(x, y) = 5x + y − 54. The problem asks us to solve for the maximum value of f , subject to
this constraint.
2. So, we calculate the gradients of both f and g :
⇀
^ ^
∇f (x, y) = (48 − 2x − 2y) i + (96 − 2x − 18y) j
⇀
^ ^
∇g(x, y) = 5 i + j .
⇀ ⇀
The equation ∇f (x 0, y0 ) = λ ∇g(x0 , y0 ) becomes
^ ^ ^ ^
(48 − 2 x0 − 2 y0 ) i + (96 − 2 x0 − 18 y0 ) j = λ(5 i + j ),
96 − 2 x0 − 18 y0 = λ.
The equation g(x 0, y0 ) = 0 becomes 5x 0 + y0 − 54 = 0 . Therefore, the system of equations that needs to be solved is
48 − 2 x0 − 2 y0 = 5λ
96 − 2 x0 − 18 y0 = λ
5 x0 + y0 − 54 = 0.
3. We use the left-hand side of the second equation to replace λ in the first equation:
48 − 2 x0 − 2 y0 = 5(96 − 2 x0 − 18 y0 )
48 − 2 x0 − 2 y0 = 480 − 10 x0 − 90 y0
x0 = 54 − 11 y0 .
270 − 55 y0 + y0 − 54 =0
216 − 54y0 = 0
y0 = 4.
= 540.
Therefore the maximum profit that can be attained, subject to budgetary constraints, is $540, 000with a production level of
10, 000 golf balls and 4 hours of advertising bought per month. Let’s check to make sure this truly is a maximum. The
endpoints of the line that defines the constraint are (10.8, 0) and (0, 54) Let’s evaluate f at both of these points:
2 2
f (10.8, 0) = 48(10.8) + 96(0) − 10.8 − 2(10.8)(0) − 9(0 )
= 401.76
2 2
f (0, 54) = 48(0) + 96(54) − 0 − 2(0)(54) − 9(54 )
= −21, 060.
The second value represents a loss, since no golf balls are produced. Neither of these values exceed 540, so it seems that
our extremum is a maximum value of f , subject to the given constraint.
A company has determined that its production level is given by the Cobb-Douglas function f (x, y) = 2.5x y where x 0.45 0.55
represents the total number of labor hours in 1 year and y represents the total capital input for the company. Suppose 1 unit of
labor costs $40 and 1 unit of capital costs $50. Use the method of Lagrange multipliers to find the maximum value of
f (x, y) = 2.5x
0.45
y subject to a budgetary constraint of $500, 000per year.
0.55
Hint
Use the problem-solving strategy for the method of Lagrange multipliers.
Answer
Subject to the given constraint, a maximum production level of 13890 occurs with 5625 labor hours and $5500 of total
capital input.
In the case of an objective function with three variables and a single constraint function, it is possible to use the method of
Lagrange multipliers to solve an optimization problem as well. An example of an objective function with three variables could be
the Cobb-Douglas function in Exercise 14.8.2: f (x, y, z) = x y z , where x represents the cost of labor, y represents capital
0.2 0.4 0.4
input, and z represents the cost of advertising. The method is the same as for the method with a function of two variables; the
equations to be solved are
⇀ ⇀
∇f (x, y, z) = λ ∇g(x, y, z)
g(x, y, z) = 0.
⇀
∇g(x, y, z) = ⟨1, 1, 1⟩.
x0 + y0 + z0 − 1 =0
2y0 = λ
2z0 = λ
x0 + y0 + z0 − 1 = 0.
3. Since each of the first three equations has λ on the right-hand side, we know that 2x = 2y = 2z and all three variables 0 0 0
are equal to each other. Substituting y = x and z = x into the last equation yields 3x − 1 = 0, so x = and y =
0 0 0 0 0 0
1
3
0
1
3
,
1
3
,
1
3
) :
2 2 2
1 1 1 1 1 1 3 1
f ( , , ) =( ) +( ) +( ) = =
3 3 3 3 3 3 9 3
Therefore, a possible extremum of the function is . To verify it is a minimum, choose other points that satisfy the constraint
1
from either side of the point we obtained above and calculate f at those points. For example,
2 2 2
f (1, 0, 0) = 1 +0 +0 =1
2 2 2
f (0, −2, 3) = 0 + (−2 ) +3 = 13.
3
, leading us to believe the extremum is a minimum, subject to the given constraint.
Exercise 14.8.3
Use the method of Lagrange multipliers to find the minimum value of the function
f (x, y, z) = x + y + z
Hint
Use the problem-solving strategy for the method of Lagrange multipliers with an objective function of three variables.
Answer
Evaluating f at both points we obtained, gives us,
– – – – – –
√3 √3 √3 √3 √3 √3 –
f ( , , ) = + + = √3
3 3 3 3 3 3
– – – – – –
√3 √3 √3 √3 √3 √3 –
f (− ,− ,− ) =− − − = −√3
3 3 3 3 3 3
–
Since the constraint is continuous, we compare these values and conclude that f has a relative minimum of −√3 at the
– – –
√3 √3 √3
point (− ,− ,− ) , subject to the given constraint.
3 3 3
There are two Lagrange multipliers, λ and λ , and the system of equations becomes
1 2
⇀ ⇀ ⇀
∇f (x0 , y0 , z0 ) = λ1 ∇g(x0 , y0 , z0 ) + λ2 ∇h(x0 , y0 , z0 )
g(x0 , y0 , z0 ) = 0
h(x0 , y0 , z0 ) = 0
sides of the first constraint, which gives x + y − z = 0 , so g(x, y, z) = x + y − z . The second constraint function
2 2 2 2 2 2
is h(x, y, z) = x + y − z + 1.
2. We then calculate the gradients of f , g, and h :
⇀
^ ^ ^
∇f (x, y, z) = 2x i + 2y j + 2zk
⇀
^ ^ ^
∇g(x, y, z) = 2x i + 2y j − 2zk
⇀
^ ^ ^
∇h(x, y, z) = i + j − k.
⇀ ⇀ ⇀
The equation ∇f (x 0, y0 , z0 ) = λ1 ∇g(x0 , y0 , z0 ) + λ2 ∇h(x0 , y0 , z0 ) becomes
^ ^ ^ ^ ^ ^ ^ ^ ^
2 x0 i + 2 y0 j + 2 z0 k = λ1 (2 x0 i + 2 y0 j − 2 z0 k) + λ2 ( i + j − k),
2y0 = 2 λ1 y0 + λ2
2z0 = −2 λ1 z0 − λ2 .
2y0 = 2 λ1 y0 + λ2
2z0 = −2 λ1 z0 − λ2
2 2 2
z =x +y
0 0 0
x0 + y0 − z0 + 1 = 0.
3. The first three equations contain the variable λ . Solving the third equation for λ and replacing into the first and second
2 2
2y0 = 2 λ1 y0 − 2 λ1 z0 − 2 z0
2 2 2
z =x +y
0 0 0
x0 + y0 − z0 + 1 = 0.
x0 + z0
Next, we solve the first and second equation for λ . The first equation gives λ
1 1 = , the second equation gives
x0 − z0
y0 + z0
λ1 = . We set the right-hand side of each equation equal to each other and cross-multiply:
y0 − z0
x0 + z0 y0 + z0
=
x0 − z0 y0 − z0
2 2
x0 y0 − x0 z0 + y0 z0 − z = x0 y0 + x0 z0 − y0 z0 − z
0 0
2 y0 z0 − 2 x0 z0 = 0
2 z0 (y0 − x0 ) = 0.
Therefore, either z = 0 or y = x . If z = 0 , then the first constraint becomes 0 = x + y . The only real solution to
0 0 0 0
2
0
2
0
this equation is x = 0 and y = 0 , which gives the ordered triple (0, 0, 0). This point does not satisfy the second
0 0
constraint, so it is not a solution. Next, we consider y = x , which reduces the number of equations to three:
0 0
y0 = x0
2 2 2
z =x +y
0 0 0
x0 + y0 − z0 + 1 = 0.
We substitute the first equation into the second and third equations:
2 2 2
z =x +x
0 0 0
= x0 + x0 − z0 + 1 = 0.
2 2 2
(2 x + 1) = 2x
0 0
2 2
4x + 4 x0 + 1 = 2x
0 0
2
2x + 4 x0 + 1 = 0,
0
−−−−−−−−−−
2
−4 ± √ 4 − 4(2)(1) – – –
−4 ± √8 −4 ± 2 √2 √2
x0 = = = = −1 ± .
2(2) 4 4 2
– –
√2 √2 –
4. We substitute (−1 + , −1 + , −1 + √2) into f (x, y, z) = x 2
+y
2
+z
2
, which gives
2 2
– 1 – 1 –
= (1 − √2 + ) + (1 − √2 + ) + (1 − 2 √2 + 2)
2 2
–
= 6 − 4 √2.
– –
√2 √2 –
Then, we substitute (−1 − , −1 + , −1 + √2) into f (x, y, z) = x 2
+y
2
+z
2
, which gives
2 2
– – – 2 – 2
√2 √2 – √2 √2 – 2
f (−1 − , −1 + , −1 + √2) = (−1 − ) + (−1 − ) + (−1 − √2)
2 2 2 2
– 1 – 1 –
= (1 + √2 + ) + (1 + √2 + ) + (1 + 2 √2 + 2)
2 2
–
= 6 + 4 √2.
– –
6 + 4 √2 is the maximum value and 6 − 4√2 is the minimum value of f (x, y, z), subject to the given constraints.
Exercise 14.8.4
Use the method of Lagrange multipliers to find the minimum value of the function
2 2 2
f (x, y, z) = x +y +z
Hint
Use the problem-solving strategy for the method of Lagrange multipliers with two constraints.
Answer
f (2, 1, 2) = 9 is a minimum value of f , subject to the given constraints.
Key Concepts
An objective function combined with one or more constraints is an example of an optimization problem.
To solve optimization problems, we apply the method of Lagrange multipliers using a four-step problem-solving strategy.
Key Equations
Method of Lagrange multipliers, one constraint
⇀ ⇀
∇f (x0 , y0 ) = λ ∇g(x0 , y0 )
g(x0 , y0 ) = 0
g(x0 , y0 , z0 ) = 0
h(x0 , y0 , z0 ) = 0
Glossary
constraint
an inequality or equation involving one or more variables that is used in an optimization problem; the constraint enforces a limit
on the possible solutions for the problem
Lagrange multiplier
objective function
the function that is to be maximized or minimized in an optimization problem
optimization problem
calculation of a maximum or minimum value of a function of several variables, often using Lagrange multipliers
This page titled 14.8: Lagrange Multipliers is shared under a CC BY-NC-SA 4.0 license and was authored, remixed, and/or curated by Gilbert
Strang & Edwin “Jed” Herman (OpenStax) via source content that was edited to the style and standards of the LibreTexts platform; a detailed edit
history is available upon request.