pipette
ESEspañol

Discrete-Time Zero-Sum Markov Games with Control, Stopping, and State-Dependent Discounting

Guanghui Feng, Xin Guo

Preprint

In the authors' words

We study a discrete-time two-player zero-sum stochastic game with control and stopping, where both players can stop the game, the discount factors depends on the states, and the running and terminal rewards may be unbounded. A contraction argument for the constrained Shapley equation establishes the existence of the value and a Nash equilibrium consisting of stationary controls and stopping times. We further provides algorithms for approximating the value and computing an -Nash equilibrium. A numerical example with state-dependent discount factors illustrates the results.

Main resultThe abstract does not state a limitation.

Appeared: Tuesday, November 10. arXiv. Preprint, not yet peer-reviewed.

Authors' comment: 29pages, 1figure