{"id":"aa4e6335-cb6b-4a22-b953-dbaa041a18b6","arxiv_id":"2501.07879","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":7.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"The minimax L2 rate for distributed nonparametric estimation is (Ness)^(-2r/(2r+1)) up to logarithmic factors, where Ness is a single phase-transition formula of m, n, l, and r.","lead":"Many distributed machines, each holding n private samples and allowed l communication bits, cooperate to estimate an unknown smooth function. This paper derives the optimal error rate for every regime, including the phase transitions as samples per machine go from sparse to dense.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Upper bound relies on unproved Lemma 2 from the authors' prior preprint; Theorem 1's claimed rate is contingent on that external result.","rationale":"The paper contributes a plausible and detailed framework: the outer wavelet layer converts nonparametric estimation into parametric distribution estimation, and the five-case characterization of Ness is coherent. The appendices give substantial proofs for the lower bound and for verification of Assumptions 1-3 on five models. However, the upper bound is not self-contained: every invocation of Lemma 2 in the four cases of Theorem 4 replaces a proof with a citation to the authors' own preprint [8]. The reader's weakest-assumption analysis identified exactly this point, and my review agrees. I did not find an independent internal contradiction that would force a stronger verdict; the concern is about verification, not about a specific mathematical step that is demonstrably wrong within the text. A CONDITIONAL verdict is therefore appropriate: the paper should either prove Lemma 2 fully or make the dependence on [8] precise and verifiable. The concrete test above would resolve whether the concern actually lands.","tokens_in":36138,"tokens_out":42208,"duration_ms":362127,"concrete_test":"Obtain the full statement and proof of Theorem 1 of [8] and verify that it implies exactly Lemma 2 items 1-3, including the regime n < k ≤ (2^l − 1)n with error O(log(k/n + 1)/(ml)) and its transition to item 3. If [8] uses a different loss, a different protocol, or has a different regime threshold, the inner-layer rates used in Theorem 4 are unsupported and the upper bound in Theorem 1 fails for the affected cases.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central upper bound, Theorem 4, is built around Lemma 2, which supplies the inner-layer protocol for parametric distribution estimation. Lemma 2 is not proved in this paper: items 1-3 are cited to the authors' own prior preprint [8], and only item 1' is proved in Appendix A-C. Because Lemma 3 multiplies the inner-layer error by K log^2 N, any error in Lemma 2's rates—especially at the regime boundaries between items 2 and 3, where the error changes from logarithmic to exponential in l—propagates directly into the claimed minimax rate. The OCR text renders the thresholds as '(2l − 1)·n', but the matching error rates suggest the intended threshold is (2^l − 1)·n; if the true threshold differs, the application of items 2 and 3 in Cases 1 and 2 may fall outside their domains. Thus the main theorem's upper bound, and hence the claimed full characterization, is not self-contained at its most load-bearing point.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper characterizes the minimax L2 rate of distributed nonparametric estimation when each of m terminals holds n i.i.d. samples and sends l bits, under Sobolev regularity of order r. The main result, Theorem 1, states that the rate is (Ness)^{-2r/(2r+1)} up to polylogarithmic factors, where Ness is an effective sample size depending on m, n, l, and r. The upper bound is obtained by a two-layer protocol: a wavelet outer layer converts the problem into parametric distribution estimation, and an inner layer invokes a protocol for that parametric problem. The lower bound uses a wavelet sieve, information-theoretic inequalities based on strong data processing inequalities, and balls-and-bins estimates. The paper also verifies the required assumptions for density estimation and for Gaussian, binary, Poisson, and heteroskedastic regression models, yielding rate results for those special cases.","tokens_in":36306,"tokens_out":19442,"duration_ms":191529,"significance":"If the proof is correct, this resolves a question left open by prior work that treated only dense samples or only n=1: it covers all relative sizes of m and n and identifies phase transitions in the dependence on the communication budget l. The construction is elegant in principle, and the lower-bound machinery, in particular the extension of strong data processing inequalities to irregular events, is potentially reusable. The paper is also commendably explicit about its assumptions and verifies them on several concrete models. However, the central upper bound depends on an unproved external lemma from the authors' own preprint, and there is a suspected gap in the proof of the main lower-bound lemma for the polynomial regimes; both points are load-bearing and need to be addressed before the characterization can be considered established.","major_comments":[{"comment":"Lemma 2 is the core of the upper bound: items 1)-3) are used in Cases 1-4 of the error analysis, yet only item 1') is proved in this manuscript; items 1)-3) are cited to the authors' own preprint [8]. The claimed minimax characterization is therefore not self-contained at its most load-bearing point. I ask the authors to include a proof of Lemma 2, or at least to state it with a complete proof in an appendix, and to make explicit which regimes depend on [8]. If the paper is meant to rely on a published version of [8], that should be stated clearly.","section":"§III-B, Lemma 2; §IV-B"},{"comment":"The notation '2l' in Lemma 2 items 2)-3), in equation (2), and in the error analyses of Section IV-B is ambiguous; it appears to mean 2^l (e.g., the error term k/(2lmn) in item 3 and the Case 1 verification rely on an exponential factor), but the text as written could be read as 2l. The distinction is load-bearing because it determines whether item 2 or item 3 applies at the boundary n<k and whether the phase transition in Case 1 is exponential or polynomial in l. Please replace '2l' by 2^\\ell throughout and re-verify the inequalities justifying the use of items 2 and 3 in Cases 1 and 2.","section":"§III-B, Lemma 2; Eq. (2); §IV-B"},{"comment":"The proof of Lemma 6, the polynomial strong-data-processing bound used for Cases 2 and 4, contains a gap. After equation (44) the paper states that, under the conditional measure p_{Z^k}(·|E(x^n)=1), the variables L_{s,Z^k}(X^n|E=1) are independent and form a sub-Gaussian vector with parameter 2(δ1+δ2). This is not justified: conditioning on the global event E couples the disjoint bins, and the pointwise bound |L_s-1|≤2(δ1+δ2) does not by itself give the Euclidean-parameter sub-Gaussian property needed for the transportation lemma (Lemma 12). In the preceding Lemma 5 the independence of L_s across s is valid because these quantities depend on disjoint bins under the product measure, but that argument does not survive conditioning. Since Lemma 6 is essential for the lower bounds in Cases 2 and 4, the lower-bound proof is incomplete as written. Please provide a corrected argument that avoids conditioning on a global event or proves the required sub-Gaussian vector bound under the conditional measure.","section":"§V, Lemma 6; Appendix C-D"}],"minor_comments":[{"comment":"The displayed statement for Case 3 reads 'We show that R(m,n,l,r) ≼ (lm)^{-2r}', but since this is a lower bound it should be ≽.","section":"Appendix C-C"},{"comment":"The event in Lemma 8(2) is misstated: the probability should be P[∃s: V_s ≥ cn/k], not 'max_{1≤s≤k} V_s ≥ cn/k, ∀s', which is not a well-formed event and does not match the proof by union bound.","section":"Appendix A-D, Lemma 8(2)"},{"comment":"The displayed formula for Ness in Remark 2 has a corrupted exponent: '(2lm)^{2r+1/(2r+1)}' cannot be correct as written. This is likely related to the 2^l notation issue and should be corrected.","section":"Remark 2"},{"comment":"The word 'Gaussion' in the statement of Theorem 3 should be 'Gaussian'.","section":"Theorem 3"}],"recommendation":"major_revision","confidential_remarks":"The two main issues are the unproved dependence on Lemma 2 from the authors' own preprint and the suspected gap in Lemma 6's conditioning argument. The latter is serious because it affects the lower bounds in Cases 2 and 4; the former makes the upper bound not self-contained. Both are fixable within the scope of the paper, so I recommend major revision rather than rejection."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"The paper delivers what it promises: a unified minimax rate for distributed nonparametric estimation across all sparse-to-dense regimes, summarized by the effective sample size Ness. The formula (2)-(3) is new, and the phase transitions are clearly laid out. The layered protocol that reduces nonparametric estimation to parametric distribution estimation is a neat idea, and the lower bound machinery—strong data processing inequalities plus the balls-and-bins analysis—is genuinely worked out. The assumptions are explicit and verified for density, Gaussian, binary, Poisson, and heteroskedastic regression, which makes the corollaries credible. This is a serious theoretical contribution, not a repackaging of known results.\n\nThe soft spots are real but not fatal. The upper bound's inner layer leans on Lemma 2, which is cited to the authors' own prior preprint [8] rather than proved here; only item 1' is derived in Appendix A-C. If any of the rates in items 1-3 fail at the regime boundaries, the matched upper bound in Theorem 4 collapses. That is the load-bearing point a referee must check. I do not see circularity—the parametric problem is separate—but the dependency should be made fully visible, ideally by proving Lemma 2 in this paper or citing a published version. \n\nSecond, the plain-text rendering has exponent ambiguities: what should be 2^l appears as 2l, and the threshold (2^l - 1)n appears as (2l - 1)n. This looks like an OCR/formatting artifact rather than a mathematical error, but it genuinely obscures the boundary verifications in Cases 1 and 2. The authors should be asked to clean this up; a referee cannot independently check the case analysis as written.\n\nMinor issues are just that: typos like 'spase' and 'Gaussion' do not affect the math. The case enumeration in the proof of Theorem 1 omits some logarithmic boundary terms, which is standard but worth a footnote.\n\nOverall the central argument holds up if Lemma 2 is correct. The paper is for researchers in communication-constrained estimation and federated learning theory. I would send it to a serious referee rather than desk reject, and I would ask for the Lemma 2 proof plus a version where the exponents are unambiguous.","headline":"A substantial all-regime minimax characterization that deserves a serious referee, contingent on the authors' external parametric-protocol lemma.","tokens_in":36819,"tokens_out":3461,"would_cite":true,"duration_ms":34686,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":["62G05","62C20","94A17","60C05"],"pacs":[],"model":"deepseek-v4-flash","headline":"The paper proves that the minimax L2 error of distributed nonparametric estimation with $m$ terminals, $n$ samples each, and $l$ bits per terminal is $N_{\\mathrm{ess}}^{-2r/(2r+1)}$ up to logarithmic factors, for every sparse-to-dense…","keywords":["distributed estimation","nonparametric estimation","minimax rates","communication constraints","strong data processing inequality","wavelet estimation","phase transitions","effective sample size"],"falsifier":"For density estimation with $r=1$, take $m=n^4$, $l=1$, and let $n$ grow. The theorem predicts $R(n^4,n,1,1)\\asymp (2n^5)^{-1/2}\\mathrm{Poly}(\\log n)$. Simulate the layered protocol on this instance and measure the average squared $L^2$ error; if the error decays polynomially faster or slower than $n^{-5/2}$ times logarithmic factors, the Case 1 boundary analysis is wrong.","tokens_in":35930,"feed_emoji":"📉","tokens_out":9956,"duration_ms":86893,"temperature":0.7,"pith_summary":"This paper asks: if each of $m$ terminals holds $n$ i.i.d. samples from a distribution parameterized by an unknown Sobolev-smooth function, and each terminal may send only $l$ bits, what is the fastest possible $L^2$ error at the decoder? The answer, up to logarithmic factors, is the same as centralized estimation from $N_{\\mathrm{ess}}$ samples, where $N_{\\mathrm{ess}}$ is an explicit function of $m,n,l,r$ given by equation (2). This collapses the entire sparse-to-dense spectrum into one effective sample size and identifies phase transitions where the role of the communication budget changes from exponential to polynomial. The result matters because it closes the gap between earlier work that handled either dense samples or exactly one sample per terminal, and because it yields minimax rates for density estimation and several regression models as corollaries. The proof uses a layered protocol in which a wavelet outer layer converts nonparametric estimation into parametric distribution estimation, and an information-theoretic lower bound built on a tensorized strong data processing inequality with balls-and-bins bounds.","feed_headline":"Distributed nonparametric rates collapse to one effective sample size","feed_subtitle":"One formula gives the optimal L2 error for every m, n and bit budget, closing the sparse-to-dense gap.","key_machinery":"The load-bearing object is the effective sample size $N_{\\mathrm{ess}}$, whose explicit formula determines the rate in every regime. For the upper bound, the machinery is a two-layer protocol: the outer layer uses a Daubechies wavelet basis with $S$ vanishing moments to approximate the Sobolev function by $K=2^H$ coefficients; each encoder maps each sample to a truncated, quantized wavelet coefficient, producing a parametric alphabet $\\mathcal{W}=\\{1,\\dots,K\\}\\times\\{0,1\\}^{2S+2}$; the inner layer then runs a parametric distribution-estimation protocol on the induced distribution $p_{\\mathcal{W}}$, and the decoder reconstructs the wavelet coefficients. For the lower bound, the machinery is a finite wavelet sieve $\\mathcal{F}(k,C_0,\\epsilon)$ over Rademacher perturbations, a terminal-wise likelihood ratio $L_{s,z_k}(x^n)=p^n_{z_k\\odot e_s}(x^n)/p^n_{z_k}(x^n)$, and a generalized tensorization of the strong data processing inequality whose strong data processing constant is controlled by the balls-and-bins occupancy $V_s$, the number of samples falling in bin $s$.","core_discovery":"The central discovery is a minimax characterization: under Assumptions 1, 2, and 3, the risk $R(m,n,l,r)$ is bounded above and below by $N_{\\mathrm{ess}}^{-2r/(2r+1)}$ up to polynomial factors of $\\log N$, where $N_{\\mathrm{ess}}$ is the effective sample size defined in equation (2). Thus the communication-constrained problem is equivalent, in rate, to a centralized problem with $N_{\\mathrm{ess}}$ samples. The result covers all five regimes of $(m,n,l)$ and shows that in the sparsest regime the rate decays exponentially in $l$, while in all other regimes it depends on $l$ only polynomially. It also gives the minimal $l$ needed to match the centralized rate: $n$ for $m>n^{2r}$, and $(mn)^{1/(2r+1)}$ for $m\\le n^{2r}$.","pith_inferences":["An extension the authors leave implicit: the same balls-and-bins tensorization should yield lower bounds for heterogeneous per-terminal sample sizes (different $n_i$ per terminal), with $\\sum_i n_i$ replacing $mn$ in the occupancy bounds; the paper does not state this.","Another consequence of the same machinery: the layered protocol can be read as a design rule — pick the bit budget $l$ by inverting the rate formula for a target error — even though the paper presents the protocol only as an achievability proof.","A testable extension: run the protocol with unequal $n_i$ and check whether the rate is governed by the same effective-sample-size formula with $mn$ replaced by $\\sum_i n_i$; the paper's fixed-$n$ analysis does not cover this."],"forward_implications":["For all parameter regimes covered by Assumptions 1 through 3, the minimax $L^2$ error is $N_{\\mathrm{ess}}^{-2r/(2r+1)}$ up to logarithmic factors, so the communication-constrained problem is equivalent in rate to a centralized problem with $N_{\\mathrm{ess}}$ samples.","In the sparsest regime $m\\ge n^{2r+1}$ with $1\\le l\\le \\frac{1}{2r+1}\\log(m/n^{2r+1})$, the optimal rate decays exponentially in $l$; in all other regimes it depends on $l$ only polynomially.","To match the centralized rate, terminals need about $n$ bits each when $m>n^{2r}$, and about $(mn)^{1/(2r+1)}$ bits each when $m\\le n^{2r}$.","The same theorem supplies minimax rates for nonparametric density estimation and for Gaussian, binary, Poisson, and heteroskedastic regression as direct corollaries.","Previously solved special cases, such as dense samples with $m<n^\\gamma$ and one-sample-per-terminal density estimation, are recovered as boundary cases of the same effective-sample-size formula."],"supporting_citations":[{"why":"Supplies the parametric distribution-estimation protocol ASR and the three-regime error rates quoted in Lemma 2, which the inner layer uses as an oracle.","marker":"[8]"},{"why":"Establishes the one-sample-per-terminal density estimation rates that this paper extends to general n, and whose simulate-and-infer step motivates the outer layer.","marker":"[7]"},{"why":"Provides the Fisher-information-style lower-bound technique that the paper adapts into a tensorized strong data processing inequality.","marker":"[6]"},{"why":"Gives the previous dense-sample framework and assumptions that this paper generalizes to all sample-per-terminal regimes.","marker":"[4]"},{"why":"Gives the dense-sample Gaussian regression rates that appear as a special case of the new formula.","marker":"[5]"},{"why":"Supplies the Markov-chain and testing lemmas used to convert mutual-information bounds into minimax lower bounds.","marker":"[9]"},{"why":"Provides the strong data processing inequality and transportation lemma that Lemma 6 generalizes to irregular events.","marker":"[10]"},{"why":"Provides the Daubechies wavelet construction underlying the sparse wavelet-coefficient representation used in both upper and lower bounds.","marker":"[24]"}],"fun_headline_variants":["All distributed nonparametric rates follow one effective sample size","Minimax rates unified for all distributed regimes","Effective sample size sets minimax rates for distributed estimation","Sparse-to-dense gap closed in distributed estimation","Phase transitions mapped in distributed estimation"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The upper-bound proof assumes that the inner parametric distribution-estimation protocol truly attains the three-regime error rates stated in Lemma 2, and only one of those three regimes is proved in this paper; if that oracle rate fails at a boundary, the matched upper bound collapses.","fun_headline_variants_meta":{"raw":{"variants":["All distributed nonparametric rates follow one effective sample size","Minimax rates unified for all distributed regimes","Effective sample size sets minimax rates for distributed estimation","Sparse-to-dense gap closed in distributed estimation","Phase transitions mapped in distributed estimation"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.001028,"raw_usage":{"total_tokens":4301,"prompt_tokens":884,"completion_tokens":3417,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":500,"completion_tokens_details":{"reasoning_tokens":3360}},"tokens_in":500,"tokens_out":3417,"duration_ms":23026,"temperature":1.0,"reasoning_tokens":3360,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-10T20:32:17.056568+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"For density estimation with $r=1$, take $m=n^4$, $l=1$, and let $n$ grow. The theorem predicts $R(n^4,n,1,1)\\asymp (2n^5)^{-1/2}\\mathrm{Poly}(\\log n)$. Simulate the layered protocol on this instance and measure the average squared $L^2$ error; if the error decays polynomially faster or slower than $n^{-5/2}$ times logarithmic factors, the Case 1 boundary analysis is wrong.","supporting_citations":[{"cited_title":"Adaptive Refinement Protocols for Distributed Distribution Estimation under $\\ell^p$-Losses","cited_arxiv_id":"2410.06884","evidence_quote":"Supplies the parametric distribution-estimation protocol ASR and the three-regime error rates quoted in Lemma 2, which the inner layer uses as an oracle."},{"cited_title":"Opti mal rates for nonparametric density estimation under commu nication constraints,","cited_arxiv_id":null,"evidence_quote":"Establishes the one-sample-per-terminal density estimation rates that this paper extends to general n, and whose simulate-and-infer step motivates the outer layer."},{"cited_title":"Lower bounds for learn ing distributions under communication constraints via ﬁsh er information,","cited_arxiv_id":null,"evidence_quote":"Provides the Fisher-information-style lower-bound technique that the paper adapts into a tensorized strong data processing inequality."},{"cited_title":"Adaptive distributed method s under communication constraints,","cited_arxiv_id":null,"evidence_quote":"Gives the dense-sample Gaussian regression rates that appear as a special case of the new formula."},{"cited_title":"In teractive inference under information constraints,","cited_arxiv_id":null,"evidence_quote":"Supplies the Markov-chain and testing lemmas used to convert mutual-information bounds into minimax lower bounds."},{"cited_title":"Uniﬁed l ower bounds for interactive high-dimensional estimation u nder information constraints,","cited_arxiv_id":null,"evidence_quote":"Provides the strong data processing inequality and transportation lemma that Lemma 6 generalizes to irregular events."},{"cited_title":"Daubechies, Ten Lectures on W avelets","cited_arxiv_id":null,"evidence_quote":"Provides the Daubechies wavelet construction underlying the sparse wavelet-coefficient representation used in both upper and lower bounds."}],"review_version":1}