Markov strategy

From Wikipedia, the free encyclopedia

Jump to: navigation, search

This article does not cite any references or sources. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed. (December 2009)

In game theory, a Markov strategy is one that does not depend at all on state variables that are functions of the history of the game, except those that affect payoffs.

In other words: a player playing a Markovian strategy, conditions his action of a period t only at his state at this given period. The lack of dependence upon the history is known in the theory of stochastic processes as Markov property.

v t e Topics in game theory

Definitions	Normal-form game Extensive-form game Cooperative game Succinct game Information set Hierarchy of beliefs Preference

Equilibrium concepts	Nash equilibrium Subgame perfection Mertens-stable equilibrium Bayesian-Nash Perfect Bayesian Trembling hand Proper equilibrium Epsilon-equilibrium Correlated equilibrium Sequential equilibrium Quasi-perfect equilibrium Evolutionarily stable strategy Risk dominance Shapley value Pareto efficiency Quantal response equilibrium Self-confirming equilibrium Strong Nash equilibrium Markov perfect equilibrium

Strategies	Dominant strategies Pure strategy Mixed strategy Tit for tat Grim trigger Collusion Backward induction Forward induction Markov strategy

Classes of games	Symmetric game Perfect information Simultaneous game Sequential game Repeated game Signaling game Cheap talk Zero–sum game Mechanism design Bargaining problem Stochastic game Large poisson game Nontransitive game Global games

Games	Prisoner's dilemma Traveler's dilemma Coordination game Chicken Centipede game Volunteer's dilemma Dollar auction Battle of the sexes Stag hunt Matching pennies Ultimatum game Rock-paper-scissors Pirate game Dictator game Public goods game Blotto games War of attrition El Farol Bar problem Cake cutting Cournot game Deadlock Diner's dilemma Guess 2/3 of the average Kuhn poker Nash bargaining game Screening game Prisoners and hats puzzle Trust game Princess and monster game Monty Hall problem

Theorems	Minimax theorem Nash's theorem Purification theorem Folk theorem Revelation principle Arrow's impossibility theorem

See also	Tragedy of the commons Tyranny of small decisions All-pay auction List of games in game theory Confrontation Analysis

This economics-related article is a stub. You can help Wikipedia by expanding it.

Retrieved from "http://en.wikipedia.org/w/index.php?title=Markov_strategy&oldid=411897358"

Categories:

Hidden categories:

Markov strategy

Personal tools

Namespaces

Variants

Views

Actions

Search

Navigation

Interaction

Toolbox

Print/export