SAI
← All ICML 2026 orals

Optimal and Scalable MAPF via Multi-Marginal Optimal Transport and Schrödinger Bridges

Usman Khan, Joseph W Durham

OralReplication score 38%Paper PDFOpenReview

Optimal and Scalable MAPF via Multi-Marginal Optimal Transport and Schrödinger Bridges

SAI replication review · Referee report

Summary

The paper casts anonymous multi-agent path finding (MAPF) as multi-marginal optimal transport (MMOT) over path space. The core move is to exploit the Markovian factorization of the path-space tensor, which collapses the state space from KT+1K^{T+1} to O(K2T)O(K^2 T) decision variables and yields a linear program P1\mathbf{P1} whose constraint matrix is totally unimodular. TU is established via a Ford–Fulkerson node-splitting construction on the time-expanded graph and delivers integral {0,1}\{0,1\} transports without an explicit integrality constraint — an elegant result that reframes anonymous MAPF as a network-flow object with a clean polyhedral guarantee, and recovers collision-freeness, min-move, and (implicit) min-makespan variants via cost choices. The paper then couples this LP with a Schrödinger-bridge / entropic view P2\mathbf{P2}, whose multi-marginal Sinkhorn iterations produce a fractional 'shadow' concentrating mass on likely paths; the shadow drives a graph-pruning heuristic feeding a smaller integral LP P3\mathbf{P3}. On grid graphs the paper reports P1\mathbf{P1} scaling as O(K1.68)O(K^{1.68}) and the pipeline as O(K1.15)O(K^{1.15}), with 3.6–7.1×\times speedups and cost gaps mostly under 10%. Reimplementing the pipeline and re-solving 96 instances confirmed the two central theoretical results — integrality of every P1/P3 optimum and collision-freeness of the induced trajectories — with zero violations under an independent trajectory-level check.

The contribution is worth publishing: the MMOT framing is fresh, the TU proof is tight, and the entropic-relaxation-plus-pruning pipeline is a natural bridge from exact LP to scalable heuristics. The main limitation is scope. The guarantees lean on Assumption 3.1(ii) — non-crossing edges execute independently — and on the anonymous setting; the extension to labelled MAPF is gestured at with no argument that integrality survives. In P2\mathbf{P2} the vertex-capacity constraint is silently dropped so Sinkhorn applies, so the shadow is not a feasible P1\mathbf{P1} transport; the pruning threshold is hand-tuned and produces 27 infeasible runs out of 260. Experiments are restricted to 4-neighbour grids at a single 5% density, and the only external baseline (CBM, Ma & Koenig 2016) targets a strictly harder multi-team problem, so the headline speed advantage is not like-for-like. Several methodology details — Sinkhorn stopping tolerance, damping, pruning rule, seeds, solver stack — remain qualitatively specified, and a faithful re-implementation had to guess the P3 pruning rule and the P2 cost definition in order to reproduce the reported tables at all.

Strengths

  • Conceptual contribution. Casting anonymous MAPF as a Markovian MMOT is a clean formulation move that unifies assignment, routing, and scheduling into a single tensor object, and connects MAPF cleanly to the entropic-OT / Schrödinger-bridge line of work — a genuinely fresh angle.
  • Total unimodularity via node-splitting. Reducing P1\mathbf{P1}'s constraint matrix to the incidence matrix of a time-expanded node-split network (Appendix B) turns the integrality guarantee into a corollary of a classical Ford–Fulkerson result rather than a hand-designed rounding scheme, and directly yields Theorem 3.4's collision-free trajectories.
  • Integrality and collision-freeness reproduce cleanly. An independent re-implementation solving P1 and P3 as pure continuous LPs on 96 instances — with post-hoc rounding checks and an independent trajectory-level validator (per-timestep vertex collisions, head-on swaps on reciprocal edges, directed flow cycles of length 3\ge 3, and target-set match) — returned zero violations and integrality deviation of exactly zero on every solve, while the non-TU P2 shadow on the same instances came back ~0.5 fractional. Theorem 3.4 is on solid empirical footing.
  • Cost-structure toolkit. The catalogue of cost conditions in Section 3.1 (no-oscillations, temporal urgency, subadditivity, shortest-path costs, Assumption 3.5 for min-makespan) is a useful modular toolkit: users can push desired behaviour into {Ct}t\{C_t\}_t without breaking TU.
  • Entropic-relaxation + shadow pruning. Using the Sinkhorn shadow to drive graph pruning is a well-motivated way to trade exactness for scale while preserving integrality of the smaller LP — the two-stage pipeline is a natural fit to the LP/entropic-OT machinery.
  • Empirical scale. Runs up to K=22,500K = 22{,}500 (~3.4M LP variables), 460+ instances, sensitivity sweep over (ε,λ)(\varepsilon, \lambda), non-uniform cost validation, and per-run integrality verification give the empirical section real breadth for a formulation paper.

Weaknesses

  • Anonymous-only scope. All guarantees (integrality, polynomial size, collision-freeness) sit inside the anonymous setting. The extension to labelled/non-anonymous MAPF is dismissed in a parenthetical; it is not obvious that any of the three properties survive without either a per-agent variable blow-up or additional coupling constraints that break TU. Given how central non-anonymous MAPF is in the literature, this narrows the contribution more than the framing suggests.
  • Assumption 3.1(ii) does much of the collision-avoidance work. Cases (a) and (b) in the Theorem 3.4 proof — intersecting edges and moving-vs-stationary collisions — are ruled out by fiat. On 4-neighbour grids this is defensible, but the paper repeatedly claims 'any finite, connected GG', where the assumption is often violated and the recommended graph-refinement mitigation can inflate V,E|V|, |E| substantially. This is not reflected in the complexity discussion.
  • Vertex-capacity dropped in P2\mathbf{P2}. To make Sinkhorn applicable, the capacity inequality Πt11\Pi_t^\top \mathbf{1} \le \mathbf{1} is dropped, so the shadow is not a feasible P1\mathbf{P1} transport and can concentrate arbitrary mass at intermediate vertices. Using it as a pruning oracle is defensible heuristically but the theoretical linkage to P1\mathbf{P1}'s polyhedron FF is by inspiration, not by projection.
  • P3\mathbf{P3} feasibility is not guaranteed. The pipeline explicitly can produce an infeasible pruned LP, and the sensitivity sweep reports 27 infeasible runs out of 260 at ε\varepsilon extremes. There is no theoretical control on when this happens or on η\eta; the remedy is to relax the threshold by hand rather than an implementable rule.
  • Baseline is not like-for-like. The only external comparison (CBM/ILP from Ma & Koenig 2016) is designed for multi-team TAPF, which the paper itself admits is a strictly harder problem than the single-team anonymous MAPF under study. No modern MAPF baseline (CBS+symmetry breaking, EECBS, PBS, LNS/LNS2, LaCAM) is included. The 300-agent-vs-50-agent headline overstates the demonstrated advantage.
  • Empirical scope is narrow. All experiments use 4-neighbour grids at 5% density. High-density regimes (20–50%) and non-grid graphs (roadmaps, warehouse networks, arbitrary planar graphs with irregular degree) — where shadow pruning is most likely to lose its edge — are not tested despite the general-GG theory.
  • Headline claims exceed the parameter regime they hold in. The abstract's '60–80% edges eliminated, less than 10% cost degradation' is a property of ε0.2\varepsilon \approx 0.2, not of the pipeline in general: rows of Table 1 at ε0.5\varepsilon \ge 0.5 show 11–23% gaps. The 'nearly flat' description of the P2\mathbf{P2}+P3\mathbf{P3} curve is inconsistent with the paper's own O(K1.15)O(K^{1.15}) fit (a ~13×\times increase over the tested range).
  • λ\lambda dependence in Table 1 is not obviously real. A faithful re-implementation of the (ε,λ)(\varepsilon,\lambda) sweep found that λ\lambda had exactly zero effect on the P3 cost gap: p3_cost was bit-identical across all four λ\lambda values at every (ε,instance)(\varepsilon,\text{instance}) pair, because the pruned polyhedron has enough cost-equivalent vertices that the KL-linearised term merely reselects among them without moving the objective. Either the paper's 1–6% λ\lambda effect is a large-KK phenomenon that does not appear at K=900K=900, or the exact form of the P3 objective differs from what the paper writes down. This is the single most surprising discrepancy in the sensitivity table and deserves diagnosis.
  • Assumption 3.5's cost bound is numerically unusable as written. Taken verbatim on the Fig. 12–15 grid, the recommended B433B \approx 433 produces cost entries 2.3×1027\sim 2.3\times 10^{27} at T=10T=10, at which HiGHS returns solver status 'numerical'. A tighter Lemma-3.6-valid bound has to be substituted. The paper flags 'numerical instability' but does not warn readers away from the literal bound.
  • Non-monotonic ε\varepsilon trend unexplained. Table 1 gaps grow monotonically in ε\varepsilon up to ε=1.0\varepsilon=1.0 and then decrease at ε=5.0\varepsilon=5.0, contradicting the paper's 'small ε\varepsilon good, large ε\varepsilon bad' narrative. Worth investigating rather than glossing.
  • Inconsistent kept-edge percentages. Four partially overlapping ranges appear (Table 2: 32–43%; Table 3: 40–47%; H.3 body: 40–45%/40–48%; Section 6: 20–40%). Since these should be the same quantity, this is a real internal-consistency issue.
  • Sinkhorn-MAPF convergence is punted. The customised forward/backward consistency projection in Appendix G is not shown to inherit standard multi-marginal Sinkhorn convergence, and the damping exponent ξ\xi is not specified; the paper explicitly defers analysis. The pipeline's scaling claim rests on Sinkhorn actually converging fast, so at least a proof sketch would help.
  • Normalization ambiguity. P\mathbf{P} is defined as summing to 1 with marginals μ,ν\boldsymbol{\mu}, \boldsymbol{\nu}, but Section 3 works with marginals of mass NN. The 1/N1/N scaling that reconciles them is never made explicit.
  • Small proof gaps. The Kornhauser citation is used without invoking the NK/2N \le K/2 hypothesis that makes it apply; Lemma 3.2's proof invokes 'recurrent' and 'probability 1' when only combinatorial reachability is needed; Theorem 3.4(ii) is asserted to follow from (i) without a sentence explaining why. All small, but the paper positions itself on the strength of its guarantees.
  • Fig. 15 makespan claim. '5 steps = minimum makespan' is asserted without ruling out T=4T=4 on that specific grid, and the 101310^{13}-order cost figure is not derivable from the text (no numerical BB is stated).

Reproducibility & code

There is no data or code availability statement. To assess reproducibility, a faithful re-implementation was built from the manuscript alone and executed on a reduced version of every experiment. The two central theoretical results (integrality, collision-freeness) reproduced cleanly on every instance; the empirical headline numbers reproduced only qualitatively, and several table cells and figure interpretations could not be reproduced without guessing details the paper does not specify.

  • Headline aggregates — direction reproduces, magnitudes do not. On a smaller KK-ladder (K=4002025K=400\ldots 2025 vs. the paper's 2,50022,5002{,}500\ldots 22{,}500) with SciPy/HiGHS in place of Gurobi, the pipeline gave per-tier mean cost gaps of 2.6, 2.9, 6.2, 7.3, 8.3, 7.0% (all under 10%, matching the abstract) and speedups spanning 0.46×\times to 12.9×\times (bracketing but not matching the paper's 3.6×\times–7.1×\times band). Fitted exponents came out at O(K3.42)O(K^{3.42}) (R2=0.89R^2=0.89) for P1 and O(K1.66)O(K^{1.66}) (R2=0.80R^2=0.80) for P2+P3, vs. the paper's 1.68 and 1.15. The qualitative ordering (P1 grows faster than P2+P3; speedup rises with KK) reproduced; the numerical exponents did not, and are likely sensitive to the fit range and solver method.
  • Pruning rule mismatch. P3 as written prunes by an absolute shadow threshold η\eta, but in practice the shadow entries tie heavily near zero and this mode is unstable. A rank-based kept-fraction budget (retain the top-kk shadow edges) had to be substituted to reproduce the reported '40–48% retained' band. Once this is done, Table 2's 32–43% kept column is nearly tautological — the retained fraction becomes a configured input rather than an emergent property. Which pruning rule was actually used in the paper is not stated.
  • λ\lambda effect is absent in the reproduction. In the re-implemented 5×45\times 4 sensitivity sweep, p3_cost was bit-identical across λ{0,0.5,1,5}\lambda \in \{0, 0.5, 1, 5\} at every (ε,instance)(\varepsilon,\text{instance}) pair, so the 'lambda adds 1–6% to the gap' story in the paper did not appear at all. The linearised KL term selects among cost-equivalent LP vertices without moving the objective. This is either a scale effect (only visible at K=10,000K = 10{,}000) or a mis-specification in the paper of how λ\lambda enters P3.
  • P2 shadow cost sign is inverted. In the Fig. 2-style illustrative (N=80N=80, T=10T=10, ε=50\varepsilon=50) instance, the re-implementation reports P1=434=434 and shadow cost 117 — the shadow costs less, not more. The paper reports P1=402=402 and P2=3160=3160. The paper never defines what 'P2 cost' actually measures; a plain Π,C\langle \Pi, C\rangle evaluated on the fractional shadow at large ε\varepsilon concentrates mass on zero-cost wait edges and drives this number down.
  • Assumption 3.5 needs a smaller bound in practice. On the 6×86\times 8 Fig. 12–15 grid, the recommended B433B \approx 433 overflows solver precision (largest cost entry 2.3×1027\sim 2.3\times 10^{27}; HiGHS returns 'numerical'). A tighter still-Lemma-3.6-valid bound (B41B \approx 41) has to be used. The 'order of 101310^{13}' cost quoted in Fig. 15 could not be re-derived without additional information about which BB was actually used.
  • Missing seeds / instance layouts. No per-experiment seeds, no repository URL, and the exact obstacle/robot/target layouts for Figs. 12–15 (used to justify the min-cost vs. min-makespan claims) are not published. A fresh seeded draw on the 'same' 6×\times8 setup produced min-cost 91 at T=10/9/8T=10/9/8 and Assumption-3.5 makespan 7, versus the paper's 40/82/132 and 5 — the code was internally consistent (Lemma 3.6 and Lemma 3.7 routes agreed on 7), but the instance was different.
  • Sinkhorn stopping and hardware/solver stack under-specified. No numerical tolerance for 'stabilize', no damping ξ\xi from the Appendix G forward/backward consistency projections, no Gurobi version / thread count / method / presolve / crossover, and '2022 MacBook' spans several very different chips. In the reproduction, the low-ε\varepsilon Sinkhorn runs saturated a 1000-sweep cap without converging (paper reports 132–307), so absolute times, the Sinkhorn column of Table 3, and the fitted exponents can all shift materially with these unspecified choices.
  • Random-pruning baseline undefined. Fig. 3's random-pruning curve — the control the panel uses to argue the shadow is 'much more effective' — is not specified in the text (per-edge Bernoulli? uniform sub-multiset? number of random draws per point?).

Recommended Changes

Essential.

  • Diagnose the λ\lambda effect in Table 1. State the exact form of the P3 objective, the exact linearisation point, and whether the reported 1–6% λ\lambda-dependent gap is expected to disappear on small instances. If the effect is genuinely large-KK only, add a run at K=10,000K=10{,}000 that visibly separates the λ\lambda columns; if not, revisit the wiring — the current sensitivity table cannot be reproduced.
  • Publish the exact P3 pruning rule. Replace the qualitative η\eta-band description in H.3 with the actual algorithm (absolute threshold with tie-breaking, rank-based top-kk, bisect until FF is nonempty, etc.), state its default constants, and specify the feasibility-recovery rule that eliminates the 27/260 infeasibility failure mode without hand-retuning.
  • Add a fair anonymous-MAPF baseline. Report at least one modern MAPF solver (e.g. CBS with symmetry breaking, EECBS, PBS, LNS/LNS2, or LaCAM) and, critically, CBM restricted to a single team on identical instances, replacing the multi-team CBM/ILP framing in Table 4 that overstates the 6×\times-agents advantage.
  • Widen empirical scope beyond 4-neighbour, 5%-density grids. Add non-grid graphs (warehouse roadmaps, arbitrary planar graphs with irregular degree) and higher-density regimes (20–50%) to test the pipeline where the shadow's discriminative power should degrade — this is where 'grid-only, 5% density' obscures behaviour.
  • Release seeds and a reference implementation. Publish a code/data availability paragraph pointing to a repository containing the Sinkhorn implementation, the LP construction, the pruning rule, and the instance generators used for Tables 1–4 and Figs. 2–8, together with per-experiment seeds. Include the exact layouts of Figs. 12–15 in machine-readable form.
  • Specify hardware and solver settings. Report Gurobi version, thread count, LP method (dual simplex vs. barrier), presolve, and crossover alongside '2022 MacBook'. Add a portable summary of scaling (e.g. exponents fit on multiple disjoint KK-windows, or the pP1pP2+P3p_{\mathbf{P1}} - p_{\mathbf{P2+P3}} gap) that is less sensitive to the specific (K-ladder,solver)(K\text{-ladder},\text{solver}) used.
  • Pin down Sinkhorn parameters. State a numerical stopping tolerance and iteration cap, and the damping exponent ξ\xi from the Appendix G forward/backward consistency projections.
  • Fix Assumption 3.5's numerical instability. Either (a) prove Lemma 3.6 under a smaller BB that stays inside solver precision, or (b) explicitly recommend Lemma 3.7's binary search as the default in Section 3.1 and demote the exponential-cost construction to a theoretical device.

Suggested.

  • State clearly that P2\mathbf{P2} drops vertex capacity. Add a sentence to Section 4 or the introduction of P2\mathbf{P2} making explicit that the capacity inequality is dropped for Sinkhorn tractability and that the shadow is a pruning oracle, not a feasible P1 transport.
  • Restrict the '<10% cost degradation' claim to ε0.2\varepsilon \approx 0.2. Reword the abstract/intro sentence so it describes the recommended parameter regime; consider adding a plot of gap vs. ε\varepsilon so the operating regime is visible from the intro.
  • Define 'P2 cost' precisely. State the formula used to compute the P2 numbers in Fig. 2 (entropy-regularised objective? plain Π,C\langle \Pi, C\rangle? εNKL(Π/NG)\varepsilon N\,\mathrm{KL}(\Pi/N \Vert \mathbf{G})?), since a natural implementation gives shadow costs below P1 in the same regime the paper reports them well above.
  • Fix 'nearly flat' phrasing. Replace with 'nearly flat by comparison with P1\mathbf{P1}' or a similar qualifier consistent with the paper's own O(K1.15)O(K^{1.15}) fit.
  • Reconcile the kept-edge percentages in the abstract, Section 6, Table 2, Table 3, and H.3 body so a single band is quoted and the reader can identify the measurement protocol.
  • Investigate and comment on the non-monotonic ε\varepsilon trend at ε=5.0\varepsilon = 5.0 in Table 1.
  • Tighten the Lemma 3.2 proof. Explicitly invoke NK/2N \le K/2 where Kornhauser–Leighton–Rivest connectivity is used, and drop the 'irreducible / recurrent / probability 1' language in favour of the direct combinatorial statement about finite reachability.
  • Prove Theorem 3.4(ii) in one sentence — e.g. that space-time overlap equals the disjunction of collision cases already ruled out.
  • Add a Sinkhorn-MAPF convergence sketch in Appendix G showing that the customised forward/backward consistency projection inherits multi-marginal Sinkhorn convergence, or clearly delineate what is left as future work.
  • Justify Fig. 15's makespan claim with a one-line argument that T=4T = 4 is infeasible on that grid, and state the numerical BB so the 101310^{13}-order cost is checkable.
  • Clarify the normalization. One sentence in Section 2 saying explicitly that P1\mathbf{P1} works with the mass-NN scaling of P\mathbf{P} would prevent the factor-of-NN ambiguity between Sections 2 and 3.
  • Define the random-pruning baseline in Fig. 3 (construction and number of random draws per point).