Correlated equilibrium

Correlated equilibrium
Correlated equilibrium
A solution concept in game theory
Relationships
Superset of Nash equilibrium
Significance
Proposed by Robert Aumann
Example Chicken

In game theory, a correlated equilibrium is a solution concept that is more general than the well known Nash equilibrium. It was first discussed by mathematician Robert Aumann (1974). The idea is that each player chooses his/her action according to his/her observation of the value of the same public signal. A strategy assigns an action to every possible observation a player can make. If no player would want to deviate from the recommended strategy (assuming the others don't deviate), the distribution is called a correlated equilibrium.


Contents

Formal definition

An N-player strategic game \displaystyle (N,A_i,u_i) is characterized by an action set \displaystyle A_i and utility function ui for each player i. When player i chooses strategy a \in A_i and the remaining players choose a strategy profile described by the N − 1-tuple \displaystyle a_{-i}, then player i's utility is \displaystyle u_i(a_i,a_{-i}).

A "strategy modification" for player i is a function \displaystyle \phi : A_i \to A_i. That is, \displaystyle \phi tells player i to modify his behavior by playing action \displaystyle \phi(a_i) when instructed to play \displaystyle a_i.

Let \displaystyle(\Omega, \pi) be a countable probability space. For each player \displaystyle i, let \displaystyle P_i be his information partition, \displaystyle q_i be \displaystyle i's posterior and let \displaystyle s_i:\Omega\rightarrow A_i, assigning the same value to states in the same cell of \displaystyle i's information partition. Then \displaystyle((\Omega, \pi),P_i) is a correlated equilibrium of the strategic game \displaystyle (N,A_i,u_i) if for every player i and for every strategy modification ϕ:

\displaystyle\sum_{\omega \in \Omega} q(\omega)u_i(s_i, s_{-i}) \geq \sum_{\omega \in \Omega} q(\omega)u_i(\phi(s_i), s_{-i})

In other words, \displaystyle((\Omega, \pi),P_i) is a correlated equilibrium if no player can improve his expected utility via a strategy modification.

An example

Dare Chicken out
Dare 0, 0 7, 2
Chicken out 2, 7 6, 6
A game of Chicken

Consider the game of chicken pictured to the right. In this game two individuals are challenging each other to a contest where each can either dare or chicken out. If one is going to Dare, it is better for the other to chicken out. But if one is going to chicken out it is better for the other to Dare. This leads to an interesting situation where each wants to dare, but only if the other might chicken out.

In this game, there are three Nash equilibria. The two pure strategy Nash equilibria are (D, C) and (C, D). There is also a mixed strategy equilibrium where each player Dares with probability 1/3.

Now consider a third party (or some natural event) that draws one of three cards labeled: (C, C), (D, C), and (C, D), with the same probability, i.e. probability 1/3 for each card. After drawing the card the third party informs the players of the strategy assigned to them on the card (but not the strategy assigned to their opponent). Suppose a player is assigned D, he would not want to deviate supposing the other player played their assigned strategy since he will get 7 (the highest payoff possible). Suppose a player is assigned C. Then the other player will play C with probability 1/2 and D with probability 1/2. The expected utility of Daring is 0(1/2) + 7(1/2) = 3.5 and the expected utility of chickening out is 2(1/2) + 6(1/2) = 4. So, the player would prefer to Chicken out.

Since neither player has an incentive to deviate, this is a correlated equilibrium. Interestingly, the expected payoff for this equilibrium is 7(1/3) + 2(1/3) + 6(1/3) = 5 which is higher than the expected payoff of the mixed strategy Nash equilibrium.

Learning correlated equilibria

One of the advantages of correlated equilibria is that they are computationally less expensive than are Nash equilibria. This can be captured by the fact that computing a correlated equilibrium only requires solving a linear program whereas solving a Nash equilibrium requires finding its fixed point completely. [1] Another way of seeing this is that it is possible for two players to respond to each other's historical plays of a game and end up converging to a correlated equilibrium.[2].

References

  1. ^ Paul W. Goldberg and Christos H. Papadimitriou, "Reducibility Among Equilibrium Problems", ELECTRONIC COLLOQUIUM ON COMPUTATIONAL COMPLEXITY, 2005.
  2. ^ Foster, Dean P and Rakesh V. Vohra, "Calibrated Learning and Correlated Equilibrium" Games and Economic Behaviour (1996)

Wikimedia Foundation. 2010.

Игры ⚽ Поможем решить контрольную работу

Look at other dictionaries:

  • Equilibrium — is the condition of a system in which competing influences are balanced and it may refer to:cienceBiology* Equilibrioception, the sense of balance present in humans and animals * Homeostasis, the ability of an open system, especially living… …   Wikipedia

  • correlated state — dynamic equilibrium …   Medical dictionary

  • Nash equilibrium — A solution concept in game theory Relationships Subset of Rationalizability, Epsilon equilibrium, Correlated equilibrium Superset of Evolutionarily stable strategy …   Wikipedia

  • Coalition-proof Nash equilibrium — The concept of coalition proof Nash equilibrium applies to certain noncooperative environments in which players can freely discuss their strategies but cannot make binding commitments [1]. It emphasizes the immunization to deviations that are… …   Wikipedia

  • Manipulated Nash equilibrium — MAPNASH A solution concept in game theory Relationships Subset of Nash equilibrium, Subgame perfect equilibrium Significance …   Wikipedia

  • Epsilon-equilibrium — A solution concept in game theory Relationships Superset of Nash Equilibrium Significance Used for …   Wikipedia

  • Markov perfect equilibrium — A solution concept in game theory Relationships Subset of Subgame perfect equilibrium Significance Proposed by …   Wikipedia

  • Determination of equilibrium constants — Equilibrium constants are determined in order to quantify chemical equilibria. When an equilibrium constant is expressed as a concentration quotient, it is implied that the activity quotient is constant. In order for this assumption to be valid… …   Wikipedia

  • Vapor-liquid equilibrium — Vapor liquid equilibrium, abbreviated as VLE by some, is a condition where a liquid and its vapor (gas phase) are in equilibrium with each other, a condition or state where the rate of evaporation (liquid changing to vapor) equals the rate of… …   Wikipedia

  • Chicken (game) — For other uses, see Chicken (disambiguation). The game of chicken, also known as the hawk dove or snowdrift[1] game, is an influential model of conflict for two players in game theory. The principle of the game is that while each player prefers… …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”