Markov Perfect Equilibrium: I. Observable Actions
In this paper and its companion, we develop the concept of Markov strategy and Markov equilibrium for general multi-period games. Markov strategies are simple, i.e., they depend only on variables affecting current and future payoffs. By excluding the influence of all but the "important" variables, the Markov concept formalizes the idea that "minor causes should nave minor effects'.