ECHO: Elastic Speculative Decoding with Sparse Gating for High-Concurrency Scenarios

Xinyi. Hu, Yuhao Shen, Zhang Baolin, Hengxin Zhang, Jun Dai, Shuang Ge, Chen Lei, Yue Li, Mingcheng Wan

SAI review preview

SAI reviewed this ICML 2026 paper and its available research artifacts. Sign in to read the complete referee report, inline feedback, and execution-based verification where available.

28Detailed review comments

CompletePaper and code review

Execution review not startedReplication status