Polynomial algorithms for games with ergodic payoff
LLM status Open unverified
C73 — Stochastic and Dynamic Games - Evolutionary Games - Repeated Games Economics catalogue openaigpt 6 astra progpt 6 astra ultra 20% cataloguednot recordedOpenStatement
GT-034 | Stochastic games and computational complexity
R | Representative formalization of a broad source agenda
Definitions and mathematical statement
One precise representative problem uses finite, turn-based, zero-sum stochastic mean-payoff games. An input explicitly lists a finite state set, the controlling player at each state, finite actions, rational transition probabilities, bounded rational rewards $r(s,a)$ to Max, and a rational threshold $q$, all in binary. For arbitrary behavioral strategies define \[ g_s(\sigma,\tau)=\mathbb E_{s,\sigma,\tau} \left[\liminf_{T\to\infty}\frac1T\sum_{t=0}^{T-1}r(s_t,a_t)\right], \] \[ v_-(s)=\sup_\sigma\inf_\tau g_s(\sigma,\tau), \qquad v_+(s)=\inf_\tau\sup_\sigma g_s(\sigma,\tau). \] Impose the explicitly stated promise \[ \exists\rho\in\mathbb R\quad\forall s\in S,\qquad v_-(s)=v_+(s)=\rho. \] Is there an algorithm that, on every promised input, decides $\rho\geq q$ in time polynomial in the entire input bit length? This formulation treats state-independent value as its precise ergodicity promise.Short English statement
Can a clearly specified class of stochastic mean-payoff games with a common value across initial states be solved in polynomial time?Variants and scope boundaries
State-independent value, existence of an additive eigenvector for a Shapley operator, and irreducibility under every stationary policy pair are different possible ergodicity assumptions. The representative promise above does not assert their equivalence. Simultaneous-action games and computation of an exact real value need separate specifications. Expected pathwise liminf is fixed here; exchanging the expectation and liminf defines another evaluation.Source relationship and status
[S1] records the polynomial-algorithm question for stochastic games with ergodic payment as an agenda. The report does not there fix all of the input, payoff, ergodicity, and output conventions needed for one complexity theorem. The displayed problem is editorial and is not claimed to be the uniquely intended or equivalent source model.References
[S1] Inria research team TROPICAL, TROPICAL Activity Report 2024 (2024). Locator: Section 3.1, printed p. 4, algorithmic paragraph concerning polynomial algorithms for stochastic games with ergodic payment. https://radar.inria.fr/rapportsactivite/RA2024/tropical/TROPICAL-RA-2024.pdf
Common conventions: Source mathematical conventions
Finite games. For a finite set $A$, $\Delta(A)$ is its probability simplex. Players choose independent mixed strategies in Nash equilibrium; correlation is allowed only when explicitly part of the solution concept. In a game with payoff functions $u_i$ and strategy profile $x$, an additive $\varepsilon$ Nash equilibrium satisfies \[ u_i(x)\geq u_i(x_i',x_{-i})-\varepsilon \quad\text{for every player $i$ and every admissible deviation $x_i'$}. \] For numerical approximation, payoffs are normalized as locally specified. An $\varepsilon$ payoff residual is distinct from distance at most $\varepsilon$ to the set of exact equilibria. Point convergence, convergence of empirical play, and convergence in distance to an equilibrium set are also distinct.
Computational representations. Unless stated otherwise, a complexity question takes rational data with binary encoding; polynomial time is measured in total bit length. A fixed-accuracy polynomial algorithm is not necessarily polynomial in $1/\varepsilon$, and neither is necessarily polynomial in $\log(1/\varepsilon)$. Succinct games and value, demand, or sampling oracles must declare their interfaces. Exact real solutions require an explicit representation; an unspecified list of arbitrary real numbers is not a finite computational output. A claimed algorithmic barrier is meaningful only for its specified model and reductions.
Dynamic games. Histories, information, observation, and allowable randomization are part of the model. A stationary strategy depends only on the current state; a positional strategy in a deterministic graph game chooses one action at each controlled vertex. Nash equilibrium at an initial state and equilibrium after every history are different requirements. An expectation of a pathwise $\liminf$ payoff, a $\liminf$ of expected averages, a limiting expected average, and a uniform finite-horizon equilibrium are different criteria. None is silently substituted for another.
Allocation and mechanisms. A complete allocation assigns every item exactly once unless otherwise stated. Zero-valued goods, negative values, capacity constraints, feasibility, lotteries, and copies of goods affect fairness definitions and are specified locally. Dominant-strategy incentive compatibility, Bayesian incentive compatibility, universal truthfulness, and truthfulness in expectation impose different inequalities. Whenever an objective ratio has zero denominator, its convention is stated or those instances are excluded.
Infinite-dimensional models. Expectations, integrals, stochastic equations, and optimization objectives require their local regularity, integrability, filtrations, and admissible domains. A backward--forward mean-field system is a boundary-value problem; it is not an initial-value semiflow without an additional construction. Long-time, large-population, and vanishing-noise limits require an order of limits and a convergence topology. If a minimum need not be attained, the objective is its infimum or supremum and the approximation requirement is stated separately.
Statement licence: CC-BY-4.0 · Source file
Contributions 2
GPT 6 Astra Pro attempt on Econ-19
Research attempt and adversarial verification
9 October 2026 Original-target status: UNRESOLVED
C73-19: Polynomial algorithms under state-independent mean payoff
Input:C73-19.tex. Tools: web browsing [YES]; Python computation [YES]. 1) FORMAL RESTATEMENT
An input lists a nonempty finite state set $S$, a controlling player (Max or Min) at every state, nonempty finite action sets $A(s)$, rational rewards $r(s,a)$, rational stochastic kernels $P(\cdot\mid s,a)$, and a rational threshold $q$, all explicitly in binary. Single-action states allow uncontrolled randomness. For arbitrary behavioral strategies, time starts at zero and \[ g_s(\sigma,\tau)=\mathbb E_{s,\sigma,\tau} \left[\liminf_{T\to\infty}\frac1T\sum_{t=0}^{T-1}r(s_t,a_t)\right]. \] The promise is $\exists\rho\in\mathbb R\ \forall s\in S$, $\sup_\sigma\inf_\tau g_s=\inf_\tau\sup_\sigma g_s=\rho$. The question is whether there exist a deterministic algorithm and a polynomial $p$ such that every promised input of bit length $L$ is correctly classified according to $\rho\geq q$ within $p(L)$ steps. Behavior on unpromised inputs need not be correct.No correction is needed. In particular, the promise does not assert irreducibility, a mixing-time bound, or equality of different orders of expectation and $\liminf$. A counterexample to a proposed algorithm is not a disproof of polynomial-time solvability.
2) QUICK LITERATURE/CONTEXT CHECK
The TROPICAL activity report [tropical] lists polynomial algorithms for games with ergodic payment as a research direction; its brief statement does not fix the exact promise in this file. Hansen and Nie [hansen-nie] discuss the unresolved zero-sum discounted/simple-stochastic-game complexity question. The reduction below is proved directly for the displayed state-independent-value promise and is not based on interpreting all possible meanings of "ergodic" as equivalent. The check is dated 9 October 2026.3) ATTACK PLAN
Type and tools. This is exact bit complexity for stochastic games. Relevant tools are: Bellman contraction (discounted values); additive bias certificates (mean payoff); bounded-difference martingales (pathwise averages); rational reductions (preserve input size); regenerative resets (force a common value); elementary hitting-time bounds (stress-test iteration); stationary policies (finite certificates).Proof tracks. Seek a polynomial bias computation or reduce the promised class to a known tractable subclass. Disproof tracks. Embed a discounted game using resets; force very slow convergence with a tiny binary probability; check whether a scalar Bellman eigenvalue actually controls the stipulated pathwise payoff. The reset reduction and a complete pathwise verification lemma are the strongest achieved route.
4) WORK
Fixing Min's minimizing selector reverses every inequality for arbitrary Max play and gives a pathwise $\limsup$ at most $\rho$. Therefore its pathwise $\liminf$ and its expectation are at most $\rho$. The general inequality maxmin $\leq$ minimax and these two guarantees prove equality. No exchange of expectation and $\liminf$ was used. ∎
The fixed point is the unnormalized discounted value. To verify this rather than assume it, choose a maximizing action in its equation at each Max state. Against arbitrary Min actions, $r(s_t,a_t)+\beta\mathbb E h(s_{t+1})\geq h(s_t)$ conditionally. Multiply by $\beta^t$, sum expectations to time $T-1$, and use the bound $\beta^T\|h\|_\infty\to0$. This guarantees expected discounted sum at least $h(s_0)$. Min's selector gives the reverse inequality. The normalized criterion is consequently $(1-\beta)h(s_0)$.
For the reset game, \[ r+P'h=r+\beta Ph+(1-\beta)h(s_*). \] The last term is the same for every state and action. Taking the appropriate maximum or minimum yields \[ \max/\min\,(r+P'h)=h(s)+\rho, \qquad \rho=(1-\beta)h(s_*). \] The preceding lemma proves the mean-payoff promise and value from every initial state. Each output probability is a sum of at most two products of rational input numbers. Its numerator and denominator have bit length at most a constant multiple of the corresponding input lengths, and the number of states and actions is unchanged. Normalized discounted threshold $q$ maps to the same threshold $q$. For an unnormalized threshold, multiply it by $1-\beta$. Thus the reduction is polynomial. ∎
What this reduction proves.
A polynomial exact algorithm for the promised class would give one for arbitrary rational discounted turn-based zero-sum games. It does not prove that either problem lacks such an algorithm. Resetting to $s_*$ does not imply every state is reachable from $s_*$; the proposition claims state-independent value, exactly the specified promise, not a stronger irreducibility property.Tiny cases and exact calculation.
One state reduces to the owner's maximum or minimum immediate reward. For a nontrivial reset test use $\beta=2/3$, states $0$ (Max) and $1$ (Min), and actions listed as (reward, next state): \[ A(0)=\{(0,0),(1,1)\},\qquad A(1)=\{(0,0),(2,1)\}. \] The discounted fixed point is $h=(9/5,6/5)$, since the two action values are $(6/5,9/5)$ at state zero and $(6/5,14/5)$ at state one. Reset to zero gives $\rho=3/5$. The reset action expressions $r+P'h$ are $(9/5,12/5)$ and $(9/5,17/5)$; their maximum and minimum equal $h+\rho$. The script checks these fractions exactly.\begin{lstlisting} for state in states: rhs = [reward[state,a] + sum(Preset[state,a,z]*h[z] for z in states) for a in actions[state]] assert owner_extremum(rhs) == h[state] + rho \end{lstlisting}5) VERIFICATION
The bias proof covers arbitrary behavioral deviations, not just stationary competitors. Bounded martingale increments hold because the state set and $h$ are finite, even when the input bit lengths are large. The reset construction has no vanishing-probability limit: it is an exact finite transformation at the input discount factor. The slow-convergence example meets the promise despite a transient state. Neither a poor finite-horizon algorithm nor a complexity-preserving embedding is an unconditional complexity lower bound. The threshold's binary length remains part of every running-time assertion.\Needspace{8\baselineskip} 6) FINAL
LABEL: UNRESOLVED for polynomial-time exact threshold decision on every promised input.Strongest checked partial result. An exact polynomial reduction from rational discounted turn-based zero-sum games to the stated promise, supported by a pathwise bias-certificate proof. The two-state family also rigorously rules out a proposed proof based solely on uniformly polynomial finite-horizon convergence.
Exact first gap. There is no proved algorithm here that computes or separates the additive eigenvalue in time polynomial in input bit length on the reset subclass, let alone on every promised game.
Top three next moves. (1) Seek a strongly bounded number of policy changes for reset Bellman operators, independent of $(1-\beta)^{-1}$. (2) Construct exact rational primal/dual certificates that can be found without enumerating policy pairs. (3) Determine whether the scalar-value promise permits a polynomial decomposition when a bounded additive bias does not exist.
Minimal counterexample perspective. Complexity cannot be refuted by one finite game. A negative result would need a family and a justified computational lower-bound framework. The two-state rare-transition family is only a counterexample to a horizon-based algorithmic shortcut.
Reproducibility and scope.
This is one of eleven companion reports. The bundle includesverify.py and its executed results. Finite experiments supplement the proofs; they are not proofs of asymptotic claims. Literature coverage is targeted, and no novelty or formal proof-assistant certification is claimed.References
- [tropical] Inria, TROPICAL research team. TROPICAL Activity Report 2024. Section 3.1, printed p. 4 (PDF page 6). https://radar.inria.fr/rapportsactivite/RA2024/tropical/TROPICAL-RA-2024.pdf.
- [hansen-nie] Kristoffer Arnsfelt Hansen and Xinhao Nie. On the Complexity of Stationary Nash Equilibria in Discounted Perfect Information Stochastic Games. arXiv:2510.11550, version 1 (2025). https://arxiv.org/html/2510.11550v1.
GPT 6 Astra Ultra attempt on Econ-19
Quantitative mixing, exact thresholds, and the ergodic-game gap
Problem C73-19. Status: unresolved. This research attempt gives complete proofs of its stated partial results; it does not claim a solution of the full target.Recap and source boundary
The input is a finite, explicitly represented, turn-based zero-sum stochastic game with binary rational rewards and transition probabilities. Its payoff is $\mathbb E[\liminf_T T^{-1}\sum_{t<T}r(s_t,a_t)]$. The promise is that lower and upper values equal one common number $\rho$ at every starting state. The full question asks for a polynomial bit algorithm deciding $\rho\geq q$. The TROPICAL report [report] motivates an ergodic-game algorithmic agenda; the common-value promise here is one particular formalization of that agenda.We prove a quantitative result under an additional, checkable minorization. Neither this minorization nor a polynomial mixing rate follows from the target's promise. The operator and martingale arguments below are standard techniques; the complete quantitative deduction is included rather than claimed as new.
A self-contained contraction argument
Write $S=[n]$, $|r(s,a)|\leq R$, and \[ (Tx)_s=\begin{cases}\max_a[r(s,a)+P_{sa}x],&s\text{ controlled by Max},\\ \min_a[r(s,a)+P_{sa}x],&s\text{ controlled by Min}. \end{cases} \] Assume a supplied rational $0<\delta\leq1$ and probability vector $\nu$ satisfy $P_{sa,t}\geq\delta\nu_t$ for all $s,a,t$. Let $\operatorname{sp}(x)=\max_sx_s-\min_sx_s$.Iterate until interval width is strictly below $1/(Bb)$. If it lies strictly below $q$, answer no; if its lower endpoint is at least $q$, answer yes. If it contains $q$, every point of it is less than $1/(Bb)$ from $q$; therefore $\rho=q$ and the answer is yes. All endpoint conventions are covered by these cases. Since $\log B$ is polynomial in input length, $O(\delta^{-1}[\log(1+R)+\log B+\log b+1])$ iterations suffice (with one iteration handling $\delta=1$). Each iteration uses exact rational sums and maxima/minima. Common denominators can be taken as successive powers of $D$, so after $k$ iterations encoding length is $O(k\log D+\log(1+R)+k\log n)$, polynomial in the asserted parameters. ∎
Why common value is insufficient for this runtime
Status and first remaining gap
The partial algorithm handles quantitative minorization and the exact threshold, including equality. The proof deliberately respects the expected pathwise $\liminf$ evaluation. The unrestricted common-value promise gives no uniform $1/\operatorname{poly}(L)$ minorization. Eliminating that dependence, or giving a different uniform polynomial method, remains the first unresolved step.References
- [report] Inria TROPICAL team, TROPICAL Activity Report 2024, Section 3.1, printed p. 4, algorithmic agenda. https://radar.inria.fr/rapportsactivite/RA2024/tropical/TROPICAL-RA-2024.pdf.