6.2 Exercises on optimization with equality constraints: n variables, m constraints
- Solve the problem
maxx,y,z (x + y) subject to x2 + 2y2 + z2 = 1 and x + y + z = 1(assuming, without checking, that the "nondegeneracy condition" is satisfied).By the extreme value theorem the problem has a solution. (The objective function is continuous because it is a polynomial (in fact, it is a linear function), and the constraint set is compact because it is the intersection of a plane and the surface of a sphere.)
The first-order conditions are
1−2λ1x − λ2 = 0 1−4λ1y − λ2 = 0 −2λ1z − λ2 = 0 1 − 2λ1[2x + y − 1] = 0 1 − 2λ1[x + 3y − 1] = 0 2x2 + 3y2 − 2y + 2xy − 2x = 0 Thus there are two solutions of the first-order conditions and the constraints, namely (0, 0, 1) with λ1 = −1/2 and λ2 = 1, and (4/5, 2/5,−1/5) with λ1 = 1/2 and λ2 = 1/5.
Now, the objective function x + y is concave and each constraint is convex, so that λjgj is convex for each j for the second solution. Thus the second solution is the solution of the problem. [Alternatively, you can check that the value of the function is higher at the second solution.]
- Consider the problem
maxxf(x) subject to p·x = cwhere x = (x1, ..., xn), f is concave, p = (p1, ..., pn), pi > 0 for i = 1, ..., n, and c is a number.
- Write down the first-order conditions for a solution of this problem.
- What is the relation (if any) between an interior solution of the first-order conditions and a solution of the problem?
- Solve the problem in the case n = 2 and f(x1, x2) = −x2
1 − 2x2
2 (which is concave).
- f'i(x) − λpi = 0 for some λ, for i = 1, ..., n.
- Since pi > 0 for all i, there is no point at which the gradient of the constraint function is zero. Thus if x* solves the problem then there exists λ such that (x*, λ) solve the first-order conditions. Since f is concave and g is linear, if (x*, λ) solves the first-order conditions, then x* solves the problem. Thus x* solves the problem if and only if there exists λ such that (x*,λ) solves the first-order conditions.
- The first-order conditions are
−2x1 − λp1 = 0 −4x2 − λp2 = 0 (x1, x2) = (2p1c/(2p2
1 + p2
2), p2c/(2p2
1 + p2
2)).
- Consider the problem
maxtW(t)−c(t) subject to g(t) = k,where t = (t1, ..., tn), W is differentiable and concave, and c is differentiable and convex, g is differentiable and increasing (for every i, g'i(t) > 0 for all t), and k is a constant.
- Write down the first-order conditions for a solution of this problem.
- What is the relation (if any) between a solution of the first-order conditions and a solution of the problem?
- Solve the problem for n = 2, W(t1, t2) = −(t1 − 1)2 − t2
2, c(t1, t2) = t1 + t2, g(t1, t2) = t1 + t2, and an arbitrary value of k. Give an interpretation to the value of the Lagrange multiplier you find.
- W'i(t) − c'i(t) − λg'i(t) = 0 for some λ for i = 1, ..., n.
- If t* solves the problem then g(t*) = k and there exists λ such that the first-order conditions are satisfied. (Note that there is no value of t for which ∇g(t) = (0, ..., 0).) If (t*,λ) solves the first-order conditions, g(t*) = k, and λg is convex, then t* is a solution of the problem (given the concavity of W(t) − c(t) and the convexity of g).
- The first-order conditions are
−2(t1 − 1) − 1 − λ = 0 −2t2 − 1 − λ = 0.