Shapley value

From Wikipedia, the free encyclopedia
Jump to: navigation, search

In game theory, the Shapley value, named in honour of Lloyd Shapley, who introduced it in 1953, is a solution concept in cooperative game theory. To each cooperative game it assigns a unique distribution (among the players) of a total surplus generated by the coalition of all players. Shapley value is characterized by a collection of desirable properties or axioms described below.

The setup is as follows: a coalition of players cooperates, and obtains a certain overall gain from that cooperation. Since some players may contribute more to the coalition than others or may possess different bargaining power (for example threatening to destroy the whole surplus), what final distribution of generated surplus among the players should we expect to arise in any particular game? Or phrased differently: how important is each player to the overall cooperation, and what payoff can he or she reasonably expect? Shapley value provides one possible answer to this question.

Contents

[edit] Formal definition

To formalize this situation, we use the notion of a coalitional game: we start out with a set N (of n players) and a function  v \; : \; \mathcal{P}(N) \; \to \mathbb{R} with  v(\emptyset)=0, where \emptyset denotes the empty set. The function  v that maps subsets of players to reals is called a characteristic function.

The function v has the following meaning: if S is a coalition of players, then v(S), called the worth of coalition S, describes the total expected sum of payoffs the members of S can obtain by cooperation.

The Shapley value is one way to distribute the total gains to the players, assuming that they all collaborate. It is a "fair" distribution in the sense that it is the only distribution with certain desirable properties to be listed below. According to Shapley value the amount that player i gets given a coalitional game ( v, N) is

\phi_i(v)=\sum_{S \subseteq N \setminus
\{i\}} \frac{|S|!\; (n-|S|-1)!}{n!}(v(S\cup\{i\})-v(S))

where n is the total number of players and the sum extends over all subsets S of N not containing player i. The formula can be interpreted as follows. Imagine the coalition being formed one actor at a time, with each actor demanding their contribution v(S∪{i}) − v(S) as a fair compensation, and then averaging over the possible different permutations in which the coalition can be formed.

An alternative equivalent formula for the Shapley value is:

\phi_i(v)= \frac{1}{|N|!}\sum_R\left [ v(P_i^R \cup \left \{ i \right \}) - v(P_i^R) \right ]\,\!

where the sum ranges over all |N|! orders R\,\! of the players and P_i^R\,\! is the set of players in N\,\! which precede i\,\! in the order R\,\!.

[edit] Example

Consider a simplified description of a business. We have an owner o, who does not work but provides the crucial capital, meaning that without him no gains can be obtained. Then we have k workers w1,...,wk, each of whom contributes an amount p to the total profit. So N = {o, w1,...,wk} and v(S) = 0 if o is not a member of S and v(S) = mp if S contains the owner and m workers. Computing the Shapley value for this coalition game leads to a value of mp/2 for the owner and p/2 for each worker.

[edit] Glove game

The glove game is a coalitional game where the players have left and right hand gloves and the goal is to form pairs.

N = \{1, 2, 3\}\,\!

where players 1 and 2 have right hand gloves and player 3 has a left hand glove

The value function for this coalitional game is


v(S) = 
\begin{cases} 
  1,  & \text{if }S \in \left\{ \{1,3\},\{2,3\},\{1,2,3\} \right\}\\
  0, & \text{otherwise}\\
\end{cases}

Where the formula for calculating the Shapley value is:

\phi_i(v)= \frac{1}{|N|!}\sum_R\left [ v(P_i^R \cup \left \{ i \right \}) - v(P_i^R) \right ]\,\!

Where R\,\! is an ordering of the players and P_i^R\,\! is the set of players in N\,\! which precede i\,\! in the order R\,\!

The following table displays the marginal contributions of Player 1

Order R\,\! MC_1
{1,2,3}\,\! v(\{1\}) - v(\varnothing) = 0 - 0 = 0\,\!
{1,3,2}\,\! v(\{1\}) - v(\varnothing) = 0 - 0 = 0\,\!
{2,1,3}\,\! v(\{1,2\}) - v(\{2\}) = 0 - 0 = 0\,\!
{2,3,1}\,\! v(\{1,2,3\}) - v(\{2,3\}) = 1 - 1 = 0\,\!
{3,1,2}\,\! v(\{1,3\}) - v(\{3\}) = 1 - 0 =1\,\!
{3,2,1}\,\! v(\{1,2,3\}) - v(\{2,3\}) = 1 - 1 = 0\,\!
\phi_1(v)=(1)(\frac{1}{6})=\frac{1}{6}\,\!

By a symmetry argument it can be shown that

\phi_2(v)=\phi_1(v)=\frac{1}{6}\,\!

Due to the efficiency axiom we know that the sum of all the Shapley values is equal to 1, which means that

\phi_3(v) = \frac{4}{6} = \frac{2}{3}.\,

[edit] Properties

The Shapley value has the following desirable properties:

1. Efficiency: The total gain is distributed:

\sum_{i\in N}\phi_i(v) = v(N)

2. Symmetry: If i and j are two actors who are equivalent in the sense that

v(S\cup\{i\}) = v(S\cup\{j\})

for every subset S of N which contains neither i nor j, then φi(v) = φj(v).

3. Additivity: if we combine two coalition games described by gain functions v and w, then the distributed gains should correspond to the gains derived from v and the gains derived from w:

\phi_i(v+w) = \phi_i(v) + \phi_i(w)

for every i in N.

4. Zero Player (Null player): The Shapley value \phi_i(v) of a null player i in a game v is zero. A player i is null in v if v(S\cup \{i\}) = v(S) for all coalitions S.

In fact, given a player set N, the Shapley value is the only map from the set of all games to payoff vectors that satisfies all four properties 1, 2, 3, and 4 from above.

[edit] Addendum definitions

1. Anonymous: If i and j are two actors, and w is the gain function that acts just like v except that the roles of i and j have been exchanged, then φi(v) = φj(w). In essence, this means that the labeling of the actors doesn't play a role in the assignment of their gains. Such a function is said to be anonymous.

2. Marginalism: the Shapley value can be defined as a function which uses only the marginal contributions of player i as the arguments.

[edit] Aumann–Shapley value

In their 1974 book, Shapley and Robert Aumann extended the concept of the Shapley value to infinite games (defined with respect to a non-atomic measure), creating the diagonal formula. This was later extended by Jean-François Mertens and Abraham Neyman.

Let us see intuitively how to think of a value in this set up, for this we rely heavily on Jean-François Mertens's reference below. As seen above, the value of an n-person game associates to each player the expectation of his contribution to the worth or the coalition or players before him in a random ordering of all the players. When there are many players and each individual plays only a minor role, the set of all players preceding a given one is heuristically thought as a good sample of of the players so that the value of a given infinitesimal player ds around as "his" contribution to the worth of a "perfect" sample of the population of all players.

Symbolically, if v is the coalitionnal worth function associating to each coalition c measured subset of a measurable set I that can be thought as I=[0,1] without loss of generality.


(Sv)(ds) = \int_0^1 (v(tI + ds)- v(tI))dt.

where (Sv)(ds)denotes the Shapley value of the infinitesimal player ds in the game, tI is a perfect sample of the all-player set I containing a proportion t of all the players, and tI+ ds is the coalition obtained after ds joins tI. This is the heuristic form of the diagonal formula.

Assuming some regularity of the worth function, for example assuming v can be represented as differentiable function of a non-atomic measure on I, \mu, v(c)=f(\mu(c)) with density function \phi, with \mu(c)=\int 1_c(u)\phi(u)du, (  1_c() the characteristic function of c). Under such conditions

\mu(tI)=t\mu(I)
,

as can be shown by approximating the density by a step function and keeping the proportion t for each level of the density function, and


v(tI + ds)=f(t\mu(I))+f'(t\mu(I))\mu(ds)
.

The diagonal formula has then the form developed by Aumann and Shapley (1974)


(Sv)(ds) = \int_0^1 f'_{t\mu(I)}(\mu(ds))dt

Above \mu can be vector valued (as long as the function is defined and differentiable on the range of \mu, the above formula makes sense).

In the argument above if the measure contains atoms \mu(tI)=t\mu(I) is no longer true - this is why the diagonal formula mostly applies to non-atomic games.


Two approaches were deployed to extend this diagonal formula when the function f is no longer differentiable. Mertens goes back to the original formula and takes the derivative after the integrale thereby benefiting from the smoothing effect. Neyman took a different approach.

[edit] See also

[edit] References

  • Robert J. Aumann, Lloyd S. Shapley. Values of non-atomic games, Princeton Univ. Press, Pinceton, 1974.
  • Sergiu Hart, Shapley Value, The New Palgrave: Game Theory, J. Eatwell, M. Milgate and P. Newman (Editors), Norton, pp.210–216, 1989.
  • Mertens, Jean-François, 1980. "Values and Derivatives," Mathematics of Operations Research, 5: 523-552. [1]
  • Mertens, Jean-François, 1988. The Shapley Value in the Non Differentiable Case," International Journal of Game Theory, 17: 1-65. [2]
  • Lloyd S. Shapley. "A Value for n-person Games". In Contributions to the Theory of Games, volume II, by H.W. Kuhn and A.W. Tucker, editors. Annals of Mathematical Studies v. 28, pp. 307–317. Princeton University Press, 1953.
  • Alvin E. Roth (editor). The Shapley value, essays in honor of Lloyd S. Shapley. Cambridge University Press, Cambridge, 1988.


[edit] External links

  • [3]A Bibliography of Cooperative Games: Value Theory by Sergiu Hart
Personal tools
Namespaces

Variants
Actions
Navigation
Interaction
Toolbox
Print/export
Languages