Group testing

From Wikipedia, the free encyclopedia
Jump to: navigation, search

In combinatorial mathematics, group testing refers to any procedure which breaks up the task of locating elements of a set which have certain properties into tests on subsets ("groups") rather than on individual elements. A familiar example of this type of technique is the false coin problem of recreational mathematics. In this problem there are n coins and one of them is false, weighing less than a real coin. The objective is to find the false coin, using a balance scale, in the fewest number of weighings. By repeatedly dividing the coins in half and comparing the two halves, the false coin can be found quickly as it is always in the lighter half.[1]

Schemes for carrying out such group testing can be simple or complex and the tests involved at each stage may be different. Schemes in which the tests for the next stage depend on the results of the previous stages are called adaptive procedures, while schemes designed so that all the tests are known beforehand are called non-adaptive procedures. The structure of the scheme of the tests involved in a non-adaptive procedure is known as a pooling design.

Background[edit]

Robert Dorfman's paper in 1943 introduced the field of (Combinatorial) Group Testing. The motivation arose during the Second World War when the United States Public Health Service and the Selective service embarked upon a large scale project. The objective was to weed out all syphilitic men called up for induction. However, syphilis testing back then was expensive and testing every soldier individually would have been very cost heavy and inefficient. A basic breakdown of a test is:

  • Draw sample from a given individual
  • Perform required tests
  • Determine presence or absence of syphilis

Say we have soldiers, then this method of testing leads to tests. If we have 70-75% of the people infected then the method of individual testing would be reasonable. Our goal however, is to achieve effective testing in the more likely scenario where it does not make sense to test 100,000 people to get (say) 10 positives.

The feasibility of a more effective testing scheme hinges on the following property. We can combine blood samples and test a combined sample together to check if at least one soldier has syphilis.

Modern interest in these testing schemes has been rekindled by the Human Genome Project.[2]

Formalization of the problem[edit]

We now formalize the group testing problem abstractly.

The total number of soldiers , an upper bound on the number of infected soldiers . The (unknown) information about which soldier is infected described as a vector where if the item is infected else .

The Hamming Weight of is defined as the number of in . Hence, where is the Hamming weight. The vector is an implicit input since we do not know the positions of in the input. The only way to find out is to run the tests.

Formal notion of a test[edit]

A query/test is a subset of . The answer to the query is defined as follows:

Note that the addition operation used by the summation is the logical-, i.e.

.

Goal[edit]

Compute and minimize the number of tests required to determine .

The question boils down to one of Combinatorial Searching. Combinatorial searching in general can be explained as follows: Say you have a set of variables and each of these can take on possible values. So, finding possible solutions that match a certain constraint is a problem of combinatorial searching. The major problem with such questions is that the solution can grow exponentially in the size of the input. Here, we have no direct questions or answers. Any piece of information can only be obtained using an indirect query.

Definition[edit]

Given a set of items with defects, the minimum number of tests that one would have to make to detect all the defective items is defined as .

Consider the case when only one person in the group will test positive. Then if we tested in the naive way, in the best case we would at least have to test the first person to find out if he/she is infected. However, in the worst case one might have to end up testing the entire group and only the last person we test will turn out to really be the one who was infected. Hence, .

Testing methods[edit]

There are two basic principles via which the testing may be carried out:

  1. Adaptive Group Testing is where we test a given subset of items and, we get the answer from the test. We then base the next test on the outcome of the current test.
  2. Non-adaptive Group Testing on the other hand is when all the tests to be performed are decided a priori.[3]

Definition[edit]

Given a set of items with defects, is defined as the number of adaptive tests that one would have to make to detect all the defective items.

One should note that in the case of group testing for the Syphilis problem, non-adaptive group testing is crucial. This is because the soldiers might be spread out geographically and adaptive group testing will need a lot of co-ordination.

Mathematical representation of the set of non-adaptive tests[edit]

For, , define such that . is a matrix of . is the input vector transposed and is the resultant. The construction is based on the grounds that for non-adaptive testing with tests is represented by a subset . for a given is the test. test matrix where is one if for the test, . Note that here multiplication is logical AND () and addition is logical OR (). Then, where is the resultant of the matrix multiplication. To think of this in terms of testing, it is helpful to visualize matrix multiplication. Here, will have a 1 in position if and only if there was a in that position in both and i.e. if that person was tested with that particular group and if he tested out to be positive.

Bounds for testing on and [edit]

The reason for is due to the fact that any non-adaptive test can be performed by an adaptive test by running all of the tests in the first step of the adaptive test. Adaptive tests can be more efficient than non-adaptive tests since the test can be changed after certain things are discovered.

Lower bound on [edit]

Fix a valid group testing scheme with tests. Now, for two distinct vectors and where , the resulting vectors will not be the same i.e. . Here is the resultant vector when . This is because, two valid inputs will never give us the same result. If this ever happened, then we would always have an error in finding both and . This gives us that the total number of distinct results is the volume of a Hamming Ball of radius , centered about i.e. . However, for bits, the total number of possible distinct vectors is . Hence, . Taking the on both sides gives us .

Now, . Therefore, we will end up having to perform a minimum of tests.

Thus we have proved,

Upper bound on [edit]

.

Since we know that the upper bound on the number of positives is , we run a binary search at most times or until there are no more values to be found. To simplify the problem we try to give a testing sccheme that uses adaptive tests to figure out a such that . The related problem is solved by splitting in two halves and querying to find a in one of those and then proceeding recursively to find the exact position in the half where the query returned a . This will take time or if the first query is performed on the whole set, it will take . Once a is found, the search is then repeated after removing the co-ordinate. This can be done at most times. This justifies the running time of . For a full proof and an algorithm for the problem refer to: CSE545 at the University at Buffalo

Upper bound on [edit]

This upper bound is for the special case where i.e. there is a maximum of 1 positive. In this case, the matrix multiplication gets simplified and the resultant represents the binary representation of for test . This gives a lower bound of . Note that decoding becomes trivial because the binary representation of gives us the location directly. The group test matrix here is just the parity check matrix for the Hamming code.

Thus as the upper and lower bounds are the same, we have a tight bound for when . Such tight bounds are not known for general .

Upper Bounds for Non-Adaptive Group Testing[edit]

For non-adaptive group testing upper bounds we shift focus toward disjunct matrices. Disjunct matrices have been used for many of the bounds because of their nice properties. It has been shown that . Also for upper bounds we currently have with a strongly explicit construction. It is good to note that the current known lower bound for is already a factor larger than the upper bound for . Another thing to note is that give the smallest upper bound and biggest lower bound they are only off by a factor of which is fairly small.

See also[edit]

Notes[edit]

  1. ^ A bit more precisely – if there are an odd number of coins to be weighed, pick one to put aside and divide the rest into two equal piles. If the two piles have equal weight, the bad coin is the one put aside, otherwise the one put aside was good and no longer has to be tested.
  2. ^ Colbourn & Dinitz 2007, pg. 574, Section 46: Pooling Designs
  3. ^ Colbourn & Dinitz 2007, pg. 631, Section 56.4
  4. ^ Kagan E. and Ben-Gal I. (2014). "A Group-Testing Algorithm with Online Informational Learning" (PDF). IIE Transactions, 46:2, 164-184,. 

References[edit]

  • Atri Rudra's course on Error Correcting Codes: Combinatorics, Algorithms, and Applications (Spring 2007), Lectures 7.
  • Atri Rudra's course on Error Correcting Codes: Combinatorics, Algorithms, and Applications (Spring 2010), Lectures 10, 11, 28, 29
  • Colbourn, Charles J.; Dinitz, Jeffrey H. (2007), Handbook of Combinatorial Designs (2nd ed.), Boca Raton: Chapman & Hall/ CRC, ISBN 1-58488-506-8 
  • Dorfman, R. The Detection of Defective Members of Large Populations. The Annals of Mathematical Statistics, 14(4), 436-440. Retrieved from [1]
  • Du, D., & Hwang, F. (2006). Pooling Designs and Nonadaptive Group Testing. Boston: Twayne Publishers.
  • Ely Porat, Amir Rothschild: Explicit Non-adaptive Combinatorial Group Testing Schemes. ICALP (1) 2008: 748-759