SAI
← All ICML 2026 orals

Nash Equilibria in Games with Playerwise Concave Coupling Constraints: Existence and Computation

Philip Jordan, Maryam Kamgarpour

OralReplication not startedPaper PDFOpenReview

Nash Equilibria in Games with Playerwise Concave Coupling Constraints: Existence and Computation

SAI paper + code review · Referee report

Summary

The paper studies constrained Nash equilibria in continuous static games with shared coupling constraints, targeting a specific structural regime: playerwise concave utilities and playerwise concave (rather than jointly concave) constraints, augmented with a playerwise Mangasarian–Fromovitz-type qualification (Assumption 3.1). The conceptual move is to escape the classical Debreu / Rosen dichotomy — non-emptiness of feasible response sets versus joint convexity of the feasible region — both of which are restrictive in the motivating applications (safety-critical multi-agent control, capacity-limited routing, mixed extensions of matrix games). The technical vehicle is a contractibility argument: under playerwise concavity + the MFCQ, each connected component of the feasible region is contractible, so Begle's fixed-point theorem yields an equilibrium via a sequential best-response composition. This is a genuine generalization of Rosen (1965) in scope, and the counterexample in Proposition B.1 motivates the shared-constraint restriction.

The paper then turns to computation and, for potential games with shared coupling constraints, proposes an independent log-barrier regularized ascent method with a data-adaptive stepsize, converging to an ϵ\epsilon-approximate constrained Nash equilibrium in O(ϵ3)O(\epsilon^{-3}) iterations. The key observation is that the log-barrier regularized game remains a potential game (Lemma F.2), so independent updates coincide with centralized ascent on Φη\Phi^\eta; the extra ϵ1\epsilon^{-1} factor over the unconstrained rate of Anagnostides et al. (2022) is charged to the shrinking feasibility margin.

Overall, this is a technically substantive contribution: it clarifies which combination of local convexity + constraint qualification suffices for existence, and it provides the first independent-learning algorithm (to my knowledge) with a rate guarantee for continuous-action constrained potential games. The main conceptual limitation is that the framing sometimes outruns the theorems — the informal contribution drops Assumption 3.1, and the proof of the central contractibility lemma has several under-justified steps (best responses staying inside a chosen component, dimension-counting in the sequential contraction, the terminal point of HH). The empirical section is illustrative rather than confirmatory, with no baselines and no scaling study.

Strengths

  • Conceptual contribution. Bringing Begle's fixed-point theorem to bear via a contractibility argument on connected components of C\mathcal{C} is a genuinely new route around the Debreu/Rosen dichotomy, and Example 3.3 shows the class of feasible regions captured is strictly broader than jointly convex ones.
  • Structural insight into the algorithm. The observation that the log-barrier-regularized game remains a potential game (Lemma F.2) is what turns independent updates into centralized ascent on Φη\Phi^\eta, cleanly handling shared coupling constraints without any inter-player coordination.
  • Feasibility-preserving learning. The interior-point flavor of the algorithm — all iterates stay strictly feasible — is well-suited to settings where the constraints encode safety, and this is more than what a penalty method or dual-primal method would give.
  • Clear placement in the literature. Remark 1 quantifies the extra ϵ1\epsilon^{-1} factor relative to the unconstrained potential-game rate of Anagnostides et al. (2022), and Remark 2 contrasts the single-loop guarantee with the double-loop O(ϵ4)O(\epsilon^{-4}) rate of Jordan et al. (2024) in the constrained Markov setting.
  • Motivating examples and counterexample. Example 3.2 (why MFCQ is needed) and Example 3.3 (why joint convexity can be dropped), together with the non-shared-constraint counterexample in Proposition B.1, make the assumption boundary tangible.

Weaknesses

  • Contribution statement understates the assumptions. The contribution bullet on existence refers only to "playerwise convex feasible regions" and never mentions the MFCQ-type Assumption 3.1, which is genuinely needed (Example 3.2 shows a violation blocks the fixed-point argument). The framing "we resolve this question" further suggests a characterization when only a new sufficient condition is provided.
  • Gaps in the contractibility proof (Lemma 3.7 sketch). The construction H(t,x)H(t,x) writes its second coordinate for t[12,1]t\in[\tfrac12,1] as C2(x1(t))C'_2(x_1(t)) — a set, not a coordinate — and states the terminal point as cˉ(supp(C1))\bar c(\operatorname{supp}(C'_1)), a point in X1\mathcal{X}_1 rather than in CX1×X2C'\subset\mathcal{X}_1\times\mathcal{X}_2. The dimension-counting recursion for C(i)C'^{(i)} is asserted with a single-clause justification and the sum index appears to be mistyped as j=i+1mdi\sum_{j=i+1}^m d_i.
  • Best-response composition may leave the chosen component. The proof of Theorem 3.4 defines Ψ=Ψ1Ψm:CC\Psi=\Psi_1\circ\cdots\circ\Psi_m:C'\to C' but the sketch never argues that each Ψi(x)C\Psi_i(x)\in C' (each player's best response is over Ci(xi)\mathcal{C}_i(x_{-i}), which could touch other components). This is the crucial well-posedness step for applying Fact 3.6.
  • Overreaching topological claim. The proof of Fact 3.6 discharges the local-contractibility hypothesis of Begle's theorem by asserting that local contractibility "holds for any subset of Euclidean space", which is not true in general — the property needs to be argued for the specific CC' produced under Assumptions 2.2, 3.1.
  • Central feasibility claim asserted, not justified. The main text's claim that "independently updated iterates remain in the interior of the joint feasible region" is what makes the algorithm interesting; the actual argument (Lemma F.2 + Lemma F.5) is entirely in the appendix and never previewed in the main text.
  • Assumption/theorem inconsistencies. Assumption 4.5 quantifies over xXx\in\mathcal{X} while Jρ(x)J_\rho(x) was defined only on C\mathcal{C}; Theorem 4.7 promises an ϵ\epsilon-Nash equilibrium while the final line of the proof cites the "2ϵ2\epsilon-KKT strategy" without stating how constants match; Lemma F.9 uses a constant (24L(b+1))(24L(b+1)) that differs from Lemma F.8's cˉ=6L(b+1)\bar c=6L(b\ell+1) both in the numerical prefactor and in the presence of \ell.
  • Acknowledged stepsize typo. Footnote 4 of Appendix F.4 concedes that the stepsize used throughout the appendix proofs (denoted (6)) differs from formula (2) referenced in Theorem 4.7, calling it "a typo … to be fixed in a later version". As currently written, the theorem statement and its proof do not use the same γ(t)\gamma^{(t)}.
  • Formula rendering and notation slips. The main text writes "the first term in (2) ensures … feasibility" without ever displaying (2) in full; Lemma F.5's stepsize bound as printed reads γ(t)2mL2(β+ηb)\gamma^{(t)}\le 2mL^2(\beta+\eta b), which grows with β,η\beta,\eta and is monotonically the wrong direction; the notation table restricts utilities and costs to [0,1][0,1], contradicting Section 2's R\mathbb{R}-valued definitions; property (c) of the contraction map writes "for all xCx\in\mathcal{C}" instead of "xCx\in C'"; Figure 4's caption says cc "remains below the threshold" while the feasibility definition is cαc\ge\alpha.
  • Word/symbol slip in the algorithm description. The paragraph introducing the algorithm calls it "log barrier regularized gradient descent" while the update is unambiguously an ascent on utilities plus barrier.
  • Counterexample in Proposition B.1 is not internally consistent as printed. The proof states C~1(x2)=C~2(x1)=[0.5,1]\widetilde C_1(x_2)=\widetilde C_2(x_1)=[0.5,1] for all (x1,x2)[0,1]2(x_1,x_2)\in[0,1]^2, yet then invokes a deviation to x1=0C~1(x2)x'_1=0\in\widetilde C_1(x_2) (which is outside [0.5,1][0.5,1]) and separately claims emptiness on [0,0.5)2[0,0.5)^2. Since this is the paper's motivation for restricting to shared constraints, the example should be presented so it can actually be checked.
  • Empirical evaluation is illustrative only. Section 5 shows the proposed method converging on two small games (2-player cooperative + 5-player routing) but never (i) compares against any baseline (penalty method, projected gradient with feasibility check, the double-loop proximal method of Jordan et al. 2024, ADMM-type primal-dual), (ii) sweeps the target tolerance ϵ\epsilon to check whether the empirically observed rate is compatible with the O(ϵ3)O(\epsilon^{-3}) statement, or (iii) explores how the constants ρ,\rho,\ell from Assumption 4.5 affect the running-time constants. As a result the experiments demonstrate feasibility of one implementation but do not corroborate either the rate or the qualitative advantage over alternatives.

Reproducibility & code

I read (but did not execute) the algorithmic specification and the accompanying reproducibility artefact linked from the paper. My assessment concerns coverage of the shown experiments, not correctness of the code.

  • Hyperparameters for the cooperative game. The utility parameters a,b>0a,b>0, the log-barrier weight η\eta, and the estimates of the Lipschitz/smoothness constants L,ML,M that feed the adaptive stepsize (2) are not stated numerically in Section 5. Since these choices determine both the visible utility landscape in Figure 3 and the numerical Nash-gap trajectory in Figure 4, a reader working from the paper alone cannot reproduce those figures.
  • Initial iterate for the cooperative game. Only "an initial feasible point" is stated; the exact x(0)x^{(0)} is not given, and the trajectory in Figure 3 depends on it. (The routing game does state xi=12x_i=\tfrac12.)
  • Iteration budget and stopping rule. The horizons T400T\approx 400 (cooperative) and 120\approx 120 (routing) appear only as axis labels; the paper does not state whether the runs stop when Nash-Gap crosses a threshold, when a wall-clock budget expires, or at a fixed TT.
  • Nash-Gap subsolver undocumented. Nash-Gapi_i requires solving a per-player constrained maximization; on the cooperative game's nonconvex feasible region this is itself a small nonconvex problem. The paper reports the resulting curves without indicating how the sub-problem is solved (interior-point subroutine, grid search, warm-started ascent, etc.).
  • Stepsize typo bleeds into reproducibility. With the two stepsize formulas (2) and (6) inconsistent (footnote 4), the paper by itself does not specify a single stepsize policy that is guaranteed to yield the claimed rate.
  • Repository is linked but its coverage is not summarized. The footnote pointing to github.com/philip-jordan/log-barrier-cNE gives no orientation as to which experiments, seeds, or subroutines it contains, so a reader cannot tell without cloning whether the gaps above are filled inside the repository.

Recommended Changes

Essential

  • State both assumptions in the existence contribution. Rewrite the Contribution 1 bullet so that it names Assumption 3.1 alongside playerwise concavity, and revise the "we resolve this question" framing to "we provide a new sufficient condition trading joint concavity against a playerwise MFCQ". (Weaknesses: "Contribution statement understates the assumptions.")
  • Repair the Lemma 3.7 sketch. Clarify that the second coordinate of HH for t[12,1]t\in[\tfrac12,1] is cˉ(C2(x1(t)))\bar c(C'_2(x_1(t))) (a point), state the terminal s0Cs_0\in C' explicitly, prove the dimension-counting recursion for C(i)C'^{(i)} (rather than asserting it), and fix the j=i+1mdij=i+1mdj\sum_{j=i+1}^m d_i \to \sum_{j=i+1}^m d_j index. (Weaknesses: "Gaps in the contractibility proof".)
  • Show Ψ\Psi stays in CC'. Add an argument that each Ψi\Psi_i (and hence the composition) maps CC' into itself under playerwise concavity of constraints. Otherwise the invocation of Fact 3.6 on CC' is unjustified. (Weaknesses: "Best-response composition may leave the chosen component.")
  • Justify local contractibility for CC'. Replace the blanket "any subset of Euclidean space" claim in the proof of Fact 3.6 with an argument specific to the components produced by playerwise concavity + Assumption 3.1. (Weaknesses: "Overreaching topological claim.")
  • Reconcile stepsizes (2) and (6) and preview the feasibility mechanism in the main text. Print the full stepsize formula (2) in Section 4.3, ensure it matches the (6) used throughout the appendix proofs, and add a one-paragraph preview of why Lemma F.2 + Lemma F.5 keep independent iterates in CC^\circ. Remove footnote 4. (Weaknesses: "Acknowledged stepsize typo", "Central feasibility claim asserted, not justified", "Formula rendering and notation slips".)
  • Fix the constant/quantifier issues around Assumption 4.5 and Theorem 4.7. Align the quantifier in Assumption 4.5 with the domain of JρJ_\rho, print the KKT-to-Nash constant conversion explicitly in the proof of Theorem 4.7 (so it is clear how η=ϵ\eta=\epsilon delivers the promised ϵ\epsilon-Nash, not 2ϵ2\epsilon-Nash), and reconcile the constants between Lemma F.8 and Lemma F.9 (presence of \ell, factor 6 vs. 24). (Weaknesses: "Assumption/theorem inconsistencies.")
  • Repair Proposition B.1 so the counterexample can be checked. Restore the full definitions of c1,1,c2,1c_{1,1},c_{2,1} and make the feasible-response computation self-consistent (currently C~1=[0.5,1]\widetilde C_1=[0.5,1] everywhere and x1=0x'_1=0 being feasible are incompatible). (Weaknesses: "Counterexample in Proposition B.1".)

Suggested

  • Add a baseline to Section 5. For at least the routing game, compare against either a projected-gradient method with a shared-constraint feasibility check or the double-loop proximal approach of Jordan et al. (2024). This directly speaks to why the log-barrier method is preferable, beyond feasibility of all iterates. (Weaknesses: "Empirical evaluation is illustrative only.")
  • Run an ϵ\epsilon-sweep to empirically validate the O(ϵ3)O(\epsilon^{-3}) rate. A log–log plot of iterations-to-reach-Nash-Gapϵ\le\epsilon against 1/ϵ1/\epsilon on the routing game would corroborate the theoretical scaling. (Weaknesses: "Empirical evaluation is illustrative only.")
  • List all experimental hyperparameters in a short table. Explicit values of a,b,η,L,M,x(0),Ta,b,\eta,L,M,x^{(0)},T per game, plus the Nash-Gap solver used, so the paper is self-contained without requiring the code. (Reproducibility: cooperative-game constants, hyperparameters, budget/stopping rule, Nash-Gap subsolver.)
  • Briefly describe repository contents in the footnote linking the code. One sentence identifying which figures/seeds/subroutines it covers. (Reproducibility: repository summary.)
  • Small clean-ups. Change "gradient descent" to "gradient ascent" in Section 4.3; correct Figure 4's "remains below the threshold" to "remains above"; fix Figure 6's caption/plot sign convention with the negated cjc_j used by the algorithm; replace CC with CC' in property (c) of the Lemma 3.7 proof; adjust the notation table so ui,cju_i,c_j range over R\mathbb{R} and supp\operatorname{supp} matches the proof's per-component version; delete the duplicated := in the Nash-Gap definition. (Weaknesses: "Word/symbol slip", "Formula rendering and notation slips".)
  • Clarify the routing-game concavity argument. Write out the negated capacity constraints explicitly and verify playerwise concavity from their affine link-load structure rather than from convexity of the congestion costs PlP_l. (Weaknesses: "Formula rendering and notation slips" / routing-game concavity conflation.)