K-approximation of k-hitting set

In computer science, k-approximation of k-hitting set is an approximation algorithm for weighted hitting set. The input is a collection "S" of subsets of some universe "T" and a mapping "W" from "S" to non-negative numbers called the weights of the elements of "S". In k-hitting set the size of the sets in "S" cannot be larger than "k". That is, $forall\; i\; in\; S:\; |i|\; leq\; k$. The problem is now to pick some subset "T"' of "T" such that every set in "S" contains some element of "T"', and such that the total weight of all elements in "T"' is as small as possible.

The algorithm

For each set $j$ in "S" is maintained a "price", $p\_j$, which is initially 0. For an element "a" in "T", let "S"("a") be the collection of sets from "S" containing "a". During the algorithm the following invariant is kept

:$forall\; a\; in\; T:\; sum\_\{j\; in\; S(a)\}\; p\_j\; leq\; W(a).,$

We say that an element a from "T" is "tight" if $Sigma\_\{j\; in\; S(a)\}\; p\_j\; =\; W(a)$. The main part of the algorithm consists of a loop: As long as there is a set in "S" that contains an element from "T" which is not tight, the price of this set is increased as much as possible without violating the invariant above. When this loop exits, all sets contain some tight element. Pick all the tight elements to be the hitting set.

Correctness

The algorithm always terminates because in each iteration of the loop the price of some set in "S" is increased enough to make one more element from "T" tight. If it cannot increase any price, it exits. It runs in polynomial time because the loop will not make more iterations than the number of elements in the union of all the sets of "S". It returns a hitting set, because when the loop exits, all sets in "S" contain a tight element from "T", and the set of these tight elements are returned.

Note that for any hitting set "T*" and any prices $p\_1,\; ldots,\; p\_$ where the invariant from the algorithm is true, the total weight of the hitting set is an upper limit to the sum over all members of "T*" of the sum of the prices of sets containing this element, that is: $Sigma\_\{a\; in\; T^*\}\; Sigma\_\{j\; in\; S(a)\}\; p\_j\; leq\; Sigma\_\{a\; in\; T^*\}\; W(a)$. This follows from the invariant property. Further, since the price of every set must occur at least once on the left hand side, we get $Sigma\_\{j\; in\; S\}\; p\_j\; leq\; Sigma\_\{a\; in\; T^*\}\; W(a)$. Especially, this property is true for the optimal hitting set.

Further, for the hitting set "H" returned from the algorithm above, we have $Sigma\_\{a\; in\; H\}\; Sigma\_\{j\; in\; S(a)\}\; p\_j\; =\; Sigma\_\{a\; in\; H\}\; W(a)$. Since any price $p\_j$ can appear at most "k" times in the left-hand side (since subsets of "S" can contain no more than "k" element from "T") we get $Sigma\_\{a\; in\; H\}\; W(a)\; leq\; k\; cdot\; Sigma\_\{j\; in\; S\}\; p\_j$ Combined with the previous paragraph we get $Sigma\_\{a\; in\; H\}\; W(a)\; leq\; k\; cdot\; Sigma\_\{a\; in\; T^*\}\; W(a)$, where "T*" is the optimal hitting set. This is exactly the guarantee that it is a k-approximation algorithm.

Relation to linear programming

This algorithm is an instance of the primal-dual method, also called the pricing method. The intutition is that it is dual to a linear programming algorithm. For an explanation see http://algo.inria.fr/seminars/sem00-01/vazirani.html.

References

* J. Kleinberg and E. Tardos, "Algorithm Design", 2006. ISBN 0-321-295358.
* cite journal
author = S. Even
authorlink= Shimon Even
coauthors = R. Bar-Yehuda
title = A Linear-Time Approximation Algorithm for the Weighted Vertex Cover Problem
journal = J. Algorithms
volume = 2
number = 2
date = 1981
publisher =
pages = 198–203
doi = 10.1016/0196-6774(81)90020-1
* M.X. Goemans and D. P. Williamson. "The primal-dual method for approximation algorithms and its application to network design problems". In "Approximation Algorithms for NP-Hard problems, Dorit H. Hochbaum, ed. ,PWS Publishing Company, 1997. ISBN 0-534-94968-1.