LP is optimized at BFS

Dependencies:

  1. Basic feasible solutions
  2. Extreme directions of a convex set
  3. Rank of a matrix
  4. Condition for existence of BFS in a polyhedron
  5. Representing point in full-rank polyhedron
  6. min linear over sum=1 constraint

Let $P = \{x \in \mathbb{R}^n: (a_i^Tx \ge b_i, \forall i \in I) \textrm{ and } (a_i^Tx = b_i, \forall i \in E)\}$ be a non-empty polyhedron. Let $c \in \mathbb{R}^n$. Let $A$ be the matrix whose rows are $\{a_i: i \in I \cup E\}$. Suppose $\rank(A) = n$. Then exactly one of the following hold for the linear program $\min_{x \in P} c^Tx$:

  1. The LP has an optimal solution at a BFS of $P$, and $c^Td \ge 0$ for each extreme direction $d$ of $P$.
  2. The LP has optimal objective value $-\infty$, and there is a non-zero extreme direction $d$ of $P$ such that $c^Td < 0$.

Proof

Since $\rank(A) = n$, $P$ has at least one BFS. If $c = 0$, then every point in $P$ is an optimal solution, so we can pick the BFS. Now assume $c \neq 0$.

Let $x^{(1)}, x^{(2)}, \ldots, x^{(p)}$ be the BFSes of $P$ and let $d^{(1)}, d^{(2)}, \ldots, d^{(q)}$ be the extreme directions of $P$. Any point $\xhat \in P$ can be represented as $\sum_{i=1}^p \lambda_ix^{(i)} + \sum_{j=1}^q \mu_jd^{(j)}$, where $\lambda_i \ge 0$, $\mu_j \ge 0$ and $\sum_{i=1}^p \lambda_i = 1$. Hence, the LP reduces to \begin{align} & \min_{\lambda, \mu} \sum_{i=1}^p (c^Tx^{(i)})\lambda_i + \sum_{j=1}^q (c^Td^{(j)})\mu_j \\ &\textrm{where } \sum_{i=1}^p \lambda_i = 1 \\ &\textrm{and } (\lambda_i \ge 0, \forall i) \textrm{ and } (\mu_j \ge 0, \forall j) \end{align}

If $c^Td^{(j)} < 0$ for some $j$, then by making $\mu_j$ arbitrarily large, we can make the objective value arbitrarily negative. Hence, if $c^Td^{(j)} < 0$ for some $j$, then the optimal objective is $-\infty$. Now assume $c^Td^{(j)} \ge 0$ for all $j$. Then we can assume without loss of generality that $\mu_j = 0$ for all $j$.

The LP now reduces to \begin{align} & \min_{\lambda} \sum_{i=1}^p (c^Tx^{(i)})\lambda_i \\ &\textrm{where } \sum_{i=1}^p \lambda_i = 1 \\ &\textrm{and } (\lambda_i \ge 0, \forall i) \end{align} Let $k = \argmin_{i=1}^p c^Tx^{(i)}$. Then the optimal solution is $\lambda_k = 1$ and $\lambda_i = 0$ for $i \neq k$, and the optimal objective value is $c^Tx^{(k)}$. Hence, the optimal solution to $\min_{x \in P} c^Tx$ is given by $x^{(k)}$, which is a BFS of $P$.

Hence, either the optimal objective value is $-\infty$, or the optimal solution occurs at a BFS of $P$.

Dependency for: None

Info:

Transitive dependencies:

  1. /linear-algebra/vector-spaces/condition-for-subspace
  2. /linear-algebra/matrices/gauss-jordan-algo
  3. /complex-numbers/conjugation-is-homomorphic
  4. /sets-and-relations/equivalence-relation
  5. Group
  6. Ring
  7. Polynomial
  8. Integral Domain
  9. Comparing coefficients of a polynomial with disjoint variables
  10. Field
  11. Vector Space
  12. Linear independence
  13. Span
  14. Inner product space
  15. Inner product is anti-linear in second argument
  16. Semiring
  17. Matrix
  18. Stacking
  19. System of linear equations
  20. Product of stacked matrices
  21. Matrix multiplication is associative
  22. Reduced Row Echelon Form (RREF)
  23. Matrices over a field form a vector space
  24. Row space
  25. Elementary row operation
  26. Every elementary row operation has a unique inverse
  27. Row equivalence of matrices
  28. Row equivalent matrices have the same row space
  29. RREF is unique
  30. Identity matrix
  31. Inverse of a matrix
  32. Inverse of product
  33. Elementary row operation is matrix pre-multiplication
  34. Row equivalence matrix
  35. Equations with row equivalent matrices have the same solution set
  36. Rank of a matrix
  37. Basis of a vector space
  38. Linearly independent set is not bigger than a span
  39. Homogeneous linear equations with more variables than equations
  40. Rank of a homogenous system of linear equations
  41. min linear over sum=1 constraint
  42. Cone
  43. Convex combination and convex hull
  44. Transitivity of convexity
  45. Convex set
  46. Polyhedral set and polyhedral cone
  47. Basic feasible solutions
  48. Condition for existence of BFS in a polyhedron
  49. Point in polytope is convex combination of BFS
  50. Convex hull of a finite number of points in Euclidean space is bounded
  51. Extreme point of a convex set
  52. Extreme point iff BFS
  53. Condition for a point to be extreme
  54. Condition for polyhedral cone to be pointed
  55. Direction of a convex set and Recession cone
  56. Recession cone of a polyhedron
  57. Polyhedron is unbounded iff it has direction
  58. Bounded section of pointed cone
  59. Extreme directions of a convex set
  60. Extreme direction of convex cone as extreme point of intersection with hyperplane
  61. Representing point in pointed polyhedral cone
  62. Representing point in full-rank polyhedron