LP is optimized at BFS
Dependencies:
- Basic feasible solutions
- Extreme directions of a convex set
- Rank of a matrix
- Condition for existence of BFS in a polyhedron
- Representing point in full-rank polyhedron
- min linear over sum=1 constraint
$\newcommand{\xhat}{\widehat{x}}$ $\newcommand{\rank}{\operatorname{rank}}$ $\newcommand{\argmin}{\operatorname{argmin}}$ Let $P = \{x \in \mathbb{R}^n: (a_i^Tx \ge b_i, \forall i \in I) \textrm{ and } (a_i^Tx = b_i, \forall i \in E)\}$ be a non-empty polyhedron. Let $c \in \mathbb{R}^n$. Let $A$ be the matrix whose rows are $\{a_i: i \in I \cup E\}$. Suppose $\rank(A) = n$. Then exactly one of the following hold for the linear program $\min_{x \in P} c^Tx$:
- The LP has an optimal solution at a BFS of $P$, and $c^Td \ge 0$ for each extreme direction $d$ of $P$.
- The LP has optimal objective value $-\infty$, and there is a non-zero extreme direction $d$ of $P$ such that $c^Td < 0$.
Proof
Since $\rank(A) = n$, $P$ has at least one BFS. If $c = 0$, then every point in $P$ is an optimal solution, so we can pick the BFS. Now assume $c \neq 0$.
Let $x^{(1)}, x^{(2)}, \ldots, x^{(p)}$ be the BFSes of $P$ and let $d^{(1)}, d^{(2)}, \ldots, d^{(q)}$ be the extreme directions of $P$. Any point $\xhat \in P$ can be represented as $\sum_{i=1}^p \lambda_ix^{(i)} + \sum_{j=1}^q \mu_jd^{(j)}$, where $\lambda_i \ge 0$, $\mu_j \ge 0$ and $\sum_{i=1}^p \lambda_i = 1$. Hence, the LP reduces to \begin{align} & \min_{\lambda, \mu} \sum_{i=1}^p (c^Tx^{(i)})\lambda_i + \sum_{j=1}^q (c^Td^{(j)})\mu_j \\ &\textrm{where } \sum_{i=1}^p \lambda_i = 1 \\ &\textrm{and } (\lambda_i \ge 0, \forall i) \textrm{ and } (\mu_j \ge 0, \forall j) \end{align}
If $c^Td^{(j)} < 0$ for some $j$, then by making $\mu_j$ arbitrarily large, we can make the objective value arbitrarily negative. Hence, if $c^Td^{(j)} < 0$ for some $j$, then the optimal objective is $-\infty$. Now assume $c^Td^{(j)} \ge 0$ for all $j$. Then we can assume without loss of generality that $\mu_j = 0$ for all $j$.
The LP now reduces to \begin{align} & \min_{\lambda} \sum_{i=1}^p (c^Tx^{(i)})\lambda_i \\ &\textrm{where } \sum_{i=1}^p \lambda_i = 1 \\ &\textrm{and } (\lambda_i \ge 0, \forall i) \end{align} Let $k = \argmin_{i=1}^p c^Tx^{(i)}$. Then the optimal solution is $\lambda_k = 1$ and $\lambda_i = 0$ for $i \neq k$, and the optimal objective value is $c^Tx^{(k)}$. Hence, the optimal solution to $\min_{x \in P} c^Tx$ is given by $x^{(k)}$, which is a BFS of $P$.
Hence, either the optimal objective value is $-\infty$, or the optimal solution occurs at a BFS of $P$.
Dependency for: None
Info:
- Depth: 15
- Number of transitive dependencies: 62
Transitive dependencies:
- /linear-algebra/vector-spaces/condition-for-subspace
- /linear-algebra/matrices/gauss-jordan-algo
- /complex-numbers/conjugation-is-homomorphic
- /sets-and-relations/equivalence-relation
- Group
- Ring
- Polynomial
- Integral Domain
- Comparing coefficients of a polynomial with disjoint variables
- Field
- Vector Space
- Linear independence
- Span
- Inner product space
- Inner product is anti-linear in second argument
- Semiring
- Matrix
- Stacking
- System of linear equations
- Product of stacked matrices
- Matrix multiplication is associative
- Reduced Row Echelon Form (RREF)
- Matrices over a field form a vector space
- Row space
- Elementary row operation
- Every elementary row operation has a unique inverse
- Row equivalence of matrices
- Row equivalent matrices have the same row space
- RREF is unique
- Identity matrix
- Inverse of a matrix
- Inverse of product
- Elementary row operation is matrix pre-multiplication
- Row equivalence matrix
- Equations with row equivalent matrices have the same solution set
- Rank of a matrix
- Basis of a vector space
- Linearly independent set is not bigger than a span
- Homogeneous linear equations with more variables than equations
- Rank of a homogenous system of linear equations
- min linear over sum=1 constraint
- Cone
- Convex combination and convex hull
- Transitivity of convexity
- Convex set
- Polyhedral set and polyhedral cone
- Basic feasible solutions
- Condition for existence of BFS in a polyhedron
- Point in polytope is convex combination of BFS
- Convex hull of a finite number of points in Euclidean space is bounded
- Extreme point of a convex set
- Extreme point iff BFS
- Condition for a point to be extreme
- Condition for polyhedral cone to be pointed
- Direction of a convex set and Recession cone
- Recession cone of a polyhedron
- Polyhedron is unbounded iff it has direction
- Bounded section of pointed cone
- Extreme directions of a convex set
- Extreme direction of convex cone as extreme point of intersection with hyperplane
- Representing point in pointed polyhedral cone
- Representing point in full-rank polyhedron