没有合适的资源?快使用搜索试试~ 我知道了~
首页最优化理论KKT.pdf
资源详情
资源评论
资源推荐

Lagrange Multipliers and the
Karush-Kuhn-Tucker conditions
March 20, 2012

Optimization
Goal:
Want to find the maximum or minimum of a function subject to
some constraints.
Formal Statement of Problem:
Given functions f , g
1
, . . . , g
m
and h
1
, . . . , h
l
defined on some
domain Ω ⊂ R
n
the optimization problem has the form
min
x∈Ω
f(x) subject to g
i
(x) ≤ 0 ∀i and h
j
(x) = 0 ∀j

In these notes..
We will derive/state sufficient and necessary for (local) optimality
when there are
1 no constraints,
2 only equality constraints,
3 only inequality constraints,
4 equality and inequality constraints.

Unconstrained Optimization

Unconstrained Minimization
Assume:
Let f : Ω → R be a continuously differentiable function.
Necessary and sufficient conditions for a local minimum:
x
∗
is a local minimum of f (x) if and only if
1 f has zero gradient at x
∗
:
∇
x
f(x
∗
) = 0
2 and the Hessian of f at w
∗
is positive semi-definite:
v
t
(∇
2
f(x
∗
)) v ≥ 0, ∀v ∈ R
n
where
∇
2
f(x) =
∂
2
f(x)
∂x
2
1
· · ·
∂
2
f(x)
∂x
1
∂x
n
.
.
.
.
.
.
.
.
.
∂
2
f(x)
∂x
n
∂x
1
· · ·
∂
2
f(x)
∂x
2
n
剩余44页未读,继续阅读















安全验证
文档复制为VIP权益,开通VIP直接复制

评论0