the Knapsack Olivier Pirson Presentation for the oral exam of INFO-F424 Combinatorial optimization Computer Science Department Université Libre de Bruxelles June 1st, 2017 (Cosmetic correction November 26, 2017) Last version: https://bitbucket.org/OPiMedia/ brief-journey-in-the-big-world-of-integer-programming-with-the/
dual bounds Branch and Bound References 0 − 1 Knapsack Problem formulation Let a set of n items, for each i ∈ {1, 2, . . . , n} a weight ai a value ci a knapsack of capacity b Find the subset of {1, 2, . . . , n} that it may be contained in the knapsack and maximizes the value. The canonical Binary Integer Program formulation: Variables: xi ∈ {0, 1}, xi = 1 if item i is selected 0 otherwise Constraint: n i=1 ai xi ≤ b Objective function: max n i=1 ci xi Brief journey. . . with the Knapsack 3 / 13
dual bounds Branch and Bound References Greedy heuristic algorithm – primal/lower bound Sort variables by decreasing order of density value weight : ci ai In this order, pick each possible item. That fill the knapsack with the best independent choice. For example: max 45x1 + 48x2 + 9x3 subject to 5x1 + 12x2 + 3x3 ≤ 16 density 9 4 3 Give the solution: (1, 0, 1) with value 45 + 9 = 54. 54 is a lower bound of the problem. Indeed (0, 1, 1) is a better solution (in fact the optimal solution 1) of value 48 + 9 = 57. 1In simple example like this it is very easy to perform an exhaustive search. Brief journey. . . with the Knapsack 5 / 13
dual bounds Branch and Bound References Linear relaxation – dual/upper bound The idea is to permit piece of item, and then fill completely the knapsack. Of course the relaxed problem is an other problem and its solution is not a solution of the initial problem. But this solution is an upper bound for the initial problem. With the same example: max 45x1 + 48x2 + 9x3 subject to 5x1 + 12x2 + 3x3 ≤ 16 and now xi ∈ [0, 1] instead ∈ {0, 1} 5 + α12 = 16 =⇒ α = 11 12 Give (1, 11 12 , 0) with value 45 + 11 12 48 = 89. We known now that the optimal solution x⋆ of the initial problem is such that: 54 ≤ x⋆ ≤ 89 We obtained theses two bound in O(n). Brief journey. . . with the Knapsack 6 / 13
dual bounds Branch and Bound References General principle of relaxation For the Integer Programming z = max{c(x) | x ∈ X ⊆ Rn} zR = max{f (x) | x ∈ T ⊆ Rn} is a relaxation if X ⊆ T c(x) ≤ f (x) ∀x ∈ X So zR is an upper bound for the initial problem. Brief journey. . . with the Knapsack 7 / 13
dual bounds Branch and Bound References Exhaustive search We can break the problem into two subproblems, and so forth. That give this kind of binary tree representation: Figure: Discrete Optimization Brief journey. . . with the Knapsack 9 / 13
dual bounds Branch and Bound References Contain the Exponential Explosion There is 2n possibilities, so an exhaustive search is quickly impossible. In fact, it is a NP-hard problem. (The decision problem is already NP-complete.) The goal is to push as far as possible the exponential curve. Figure: Discrete Optimization How avoid the impossible (in practice) exhaustive search? Brief journey. . . with the Knapsack 10 / 13
dual bounds Branch and Bound References Depth-First Branch and Bound Pruning. . . Figure: Discrete Optimization We have the optimal solution 80 with only 7 nodes visited, instead 24 − 1 = 15. Brief journey. . . with the Knapsack 11 / 13
dual bounds Branch and Bound References 1 Problem 2 Primal and dual bounds 3 Branch and Bound 4 References Brief journey. . . with the Knapsack 12 / 13
opimedia
.jpg){kind=avatar}
ktatsuya
rmaruy
hachama
tagtag
wemeet
kanojikajino
scientia
ykamit
02hattori11sat03
zchenry
taisso
linyows
maltzj
chrislema
samanthasiow
eileencodes
62gerente
afnizarnur
smashingmag
chriscoyier
pauljervisheath
reverentgeek
michaelherold
bkeepers
