LP is optimized at BFS

Dependencies:

  1. Basic feasible solutions
  2. Extreme directions of a convex set
  3. Rank of a matrix
  4. Condition for existence of BFS in a polyhedron
  5. Representing point in full-rank polyhedron
  6. min linear over sum=1 constraint

Let $P = \{x \in \mathbb{R}^n: (a_i^Tx \ge b_i, \forall i \in I) \textrm{ and } (a_i^Tx = b_i, \forall i \in E)\}$ be a non-empty polyhedron. Let $c \in \mathbb{R}^n$. Let $A$ be the matrix whose rows are $\{a_i: i \in I \cup E\}$. Suppose $\rank(A) = n$. Then exactly one of the following hold for the linear program $\min_{x \in P} c^Tx$:

  1. The LP has an optimal solution at a BFS of $P$, and $c^Td \ge 0$ for each extreme direction $d$ of $P$.
  2. The LP has optimal objective value $-\infty$, and there is a non-zero extreme direction $d$ of $P$ such that $c^Td < 0$.

Proof

Since $\rank(A) = n$, $P$ has at least one BFS. If $c = 0$, then every point in $P$ is an optimal solution, so we can pick the BFS. Now assume $c \neq 0$.

Let $x^{(1)}, x^{(2)}, \ldots, x^{(p)}$ be the BFSes of $P$ and let $d^{(1)}, d^{(2)}, \ldots, d^{(q)}$ be the extreme directions of $P$. Any point $\xhat \in P$ can be represented as $\sum_{i=1}^p \lambda_ix^{(i)} + \sum_{j=1}^q \mu_jd^{(j)}$, where $\lambda_i \ge 0$, $\mu_j \ge 0$ and $\sum_{i=1}^p \lambda_i = 1$. Hence, the LP reduces to \begin{align} & \min_{\lambda, \mu} \sum_{i=1}^p (c^Tx^{(i)})\lambda_i + \sum_{j=1}^q (c^Td^{(j)})\mu_j \\ &\textrm{where } \sum_{i=1}^p \lambda_i = 1 \\ &\textrm{and } (\lambda_i \ge 0, \forall i) \textrm{ and } (\mu_j \ge 0, \forall j) \end{align}

If $c^Td^{(j)} < 0$ for some $j$, then by making $\mu_j$ arbitrarily large, we can make the objective value arbitrarily negative. Hence, if $c^Td^{(j)} < 0$ for some $j$, then the optimal objective is $-\infty$. Now assume $c^Td^{(j)} \ge 0$ for all $j$. Then we can assume without loss of generality that $\mu_j = 0$ for all $j$.

The LP now reduces to \begin{align} & \min_{\lambda} \sum_{i=1}^p (c^Tx^{(i)})\lambda_i \\ &\textrm{where } \sum_{i=1}^p \lambda_i = 1 \\ &\textrm{and } (\lambda_i \ge 0, \forall i) \end{align} Let $k = \argmin_{i=1}^p c^Tx^{(i)}$. Then the optimal solution is $\lambda_k = 1$ and $\lambda_i = 0$ for $i \neq k$, and the optimal objective value is $c^Tx^{(k)}$. Hence, the optimal solution to $\min_{x \in P} c^Tx$ is given by $x^{(k)}$, which is a BFS of $P$.

Hence, either the optimal objective value is $-\infty$, or the optimal solution occurs at a BFS of $P$.

Dependency for: None

Info:

Transitive dependencies:

  1. /linear-algebra/matrices/gauss-jordan-algo
  2. /linear-algebra/vector-spaces/condition-for-subspace
  3. /complex-numbers/conjugation-is-homomorphic
  4. /sets-and-relations/equivalence-relation
  5. min linear over sum=1 constraint
  6. Group
  7. Ring
  8. Polynomial
  9. Field
  10. Vector Space
  11. Cone
  12. Convex combination and convex hull
  13. Convex set
  14. Convex hull of a finite number of points in Euclidean space is bounded
  15. Direction of a convex set and Recession cone
  16. Extreme directions of a convex set
  17. Extreme point of a convex set
  18. Condition for a point to be extreme
  19. Transitivity of convexity
  20. Inner product space
  21. Inner product is anti-linear in second argument
  22. Extreme direction of convex cone as extreme point of intersection with hyperplane
  23. Linear independence
  24. Span
  25. Integral Domain
  26. Comparing coefficients of a polynomial with disjoint variables
  27. Semiring
  28. Matrix
  29. Polyhedral set and polyhedral cone
  30. Basic feasible solutions
  31. Recession cone of a polyhedron
  32. Stacking
  33. System of linear equations
  34. Product of stacked matrices
  35. Matrix multiplication is associative
  36. Reduced Row Echelon Form (RREF)
  37. Elementary row operation
  38. Every elementary row operation has a unique inverse
  39. Row equivalence of matrices
  40. Matrices over a field form a vector space
  41. Row space
  42. Row equivalent matrices have the same row space
  43. RREF is unique
  44. Identity matrix
  45. Inverse of a matrix
  46. Inverse of product
  47. Elementary row operation is matrix pre-multiplication
  48. Row equivalence matrix
  49. Equations with row equivalent matrices have the same solution set
  50. Rank of a matrix
  51. Basis of a vector space
  52. Linearly independent set is not bigger than a span
  53. Homogeneous linear equations with more variables than equations
  54. Rank of a homogenous system of linear equations
  55. Extreme point iff BFS
  56. Condition for existence of BFS in a polyhedron
  57. Point in polytope is convex combination of BFS
  58. Polyhedron is unbounded iff it has direction
  59. Condition for polyhedral cone to be pointed
  60. Bounded section of pointed cone
  61. Representing point in pointed polyhedral cone
  62. Representing point in full-rank polyhedron