{"id":"7d9fa5c2-c426-4f27-add5-f565d4d8df80","arxiv_id":"2502.06200","paper_version":3,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":8.0,"correctness_risk":"low","formal_verification":"none","parameter_count":0,"one_line_summary":"The paper characterizes the worst-case query complexity of sampling from smooth non-log-concave distributions as exponential in dimension, with matching lower and upper bounds.","lead":"This paper determines how many queries are needed to sample from a high-dimensional distribution when an algorithm can only evaluate the potential function and its gradient, proving that the answer grows exponentially with dimension. The matching upper and lower bounds settle the worst-case query complexity of a basic and widely studied sampling model.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Theorem 4's upper bound is proven only for potentials with ∇f(0)=0; the claimed (LM/dε)^{Θ(d)} characterization for all distributions satisfying Assumptions 1 and 2 depends on an unquantified gradient-descent reduction.","rationale":"The reader's weakest-assumption analysis identifies exactly this gap: the upper-bound proof is written under ∇f(0)=0, and the promised reduction to a stationary point is not formalized. I agree that this is the most load-bearing issue for the central claim. The lower bound itself appears structurally sound: the packing argument, the smooth interpolation with the mollifier, and the TV separation estimate are all internally consistent, and the O(M) second-moment normalization gap noted by the reader is an asymptotic-constant issue rather than a threat to the exponent. The upper bound is where the formal statement and proof diverge: the grid approximation in Proposition 18, the truncation construction, the Poincaré bound, and the warm-start analysis all invoke ∇f(0)=0 at least once. If the reduction to an exact stationary point is not available or requires more than (LM/dε)^{O(d)} queries, then Theorem 4 does not match Theorem 3 on the full stated family. This does not make me reject the paper: the construction and proofs are detailed and largely coherent, and the issue is precisely the kind of missing formalization a conditional verdict should request. My concrete test would settle the concern by forcing the authors to either supply the reduction with explicit constants or restrict the theorem statement, in which case the abstract's Θ(d) phrasing must be softened. Since the reader already marked the paper CONDITIONAL and my concern is the same one, the verdict should remain unchanged.","tokens_in":80543,"tokens_out":4764,"duration_ms":50433,"concrete_test":"Add a preprocessing lemma to Section 4: given only Assumptions 1 and 2, find a point s with ∥∇fμ(s)∥≤δ using value/gradient queries, then re-derive Lemma 32, Lemma 26, Corollary 28, and Lemma 34 with the origin shifted to s and with all grid and smoothness estimates carrying explicit δ-dependence. Compute the largest δ for which f̂* stays within d of f*, Ẑμ stays within the stated factor of Zμ, and the KL warm-start bound remains polynomial; then verify that the gradient-descent query count plus the subsequent (LM/dε)^{O(d)} poly(ε^{-1},d,L,M) stays within the theorem's bound for all LM≥d and ε<1. If no such δ exists, Theorem 4 applies only to centered potentials and the paper's claimed tight characterization for all non-log-concave distributions is not established.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The abstract and Theorem 3 state a lower bound for every L-log-smooth distribution with second moment at most M, while Theorem 4, the matching upper bound, is stated only under the extra condition ∇f(0)=0. The paper says this is 'for simplicity' and that one can first run gradient descent to find a stationary point and shift the origin, but no part of Section 4 quantifies that reduction. The missing quantification is load-bearing because the proof uses ∇f(0)=0 in several places that would fail if the origin is only an approximate stationary point. In Lemma 32, the grid estimates of f* and Zµ rely on ∥∇fμ(x)∥≤L∥x∥, which gives f(vx)≤f(x)+d/2; with only ∥∇f(s)∥≤δ after shifting to s, each grid-error bound acquires an extra δ·√d·ℓ term, where ℓ is the grid side length, and the allowable δ must be computed before the claimed accuracy of f̂* and Ẑµ is preserved. Lemma 26 uses ∇f≤2Rπ(0)=0 both to get ∇f≤2Rπ(0)=0 and to bound gradients in B2R; Corollary 28 and Lemma 34 then use fπ(0)−min fπ to bound the KL warm start. If the shifted origin is only δ-stationary, these bounds change by terms involving δ and the location of s, and the second moment about s need not still be at most M. The text asserts that the reduction can be done but gives no theorem, no query count for the preprocessing, and no error-propagation analysis. Without these, Theorems 3 and 4 do not formally establish the stated tight complexity for the full family DL,M; they establish it only for the centered subclass and leave the asserted Θ(d) matching claim conditional on an unverified reduction.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper studies the worst-case query complexity of sampling from a d-dimensional distribution whose log-density is L-smooth and whose second moment is at most M. The lower-bound construction (Section 3) starts from a Gaussian-like base density with a flat annular plateau, then perturbs disjoint balls on that plateau; the authors prove that any algorithm must discover the perturbed ball, yielding an (LM/(dε))^{Ω(d)} query lower bound. The upper-bound algorithm (Section 4) constructs an auxiliary distribution π by truncating low-density regions of the target, approximating the minimum and normalizing constant on a grid, and then samples from π with a Langevin algorithm, giving (LM/(dε))^{O(d)} queries. The paper also compares the target-smoothness assumption with smoothness along the Ornstein-Uhlenbeck trajectory (stitched Gaussians and mixtures of Gaussians) and compares sampling with non-convex optimization, arguing that sampling can be super-exponentially easier than optimization.","tokens_in":80875,"tokens_out":9145,"duration_ms":92617,"significance":"If the matching upper and lower bounds hold for the full class, this is a significant contribution: it identifies the correct exponential dependence of query complexity on L, M, d, and ε for non-log-concave sampling, improves the earlier e^{Ω(d)} lower bound, and gives the first ε-dependence in this regime. The explicit stitched-Gaussian family clarifies that smoothness of the initial log-density does not imply smoothness along the OU trajectory, and the Ising-model connection is a nice addition. The proof structure is coherent, with detailed estimates for the lower-bound construction and for the Poincaré constant, smoothness, and warm start of the auxiliary distribution. However, the upper bound is formally proved only under the extra condition ∇f(0)=0, and the paper's claim that this is removable by a gradient-descent preprocessing step is not backed by a theorem; this gap affects the central matching-characterization claim for the full family.","major_comments":[{"comment":"Theorem 4 is stated only for potentials with ∇f(0)=0, and the text says the assumption is made 'for simplicity' and that one can first run gradient descent to find a stationary point and shift the origin. No theorem, query count, or error-propagation analysis for this reduction is provided. The gap is load-bearing: Lemma 26 uses ∇f(0)=0 to conclude ∇f_{≤2Rπ}(0)=0 and to bound gradients by L‖x‖ in B_{2R}; Lemma 32 uses ∥∇fμ(x)∥≤L‖x‖ when estimating f* and Zμ on the grid; and Corollary 28 together with Lemma 34 uses fπ(0)=min fπ and the warm-start bound KL(μ0∥π). If the new origin is only a δ-stationary point, each of these estimates changes: the grid errors in Lemma 32 acquire extra δ·√d·ℓ terms, the second moment about the shifted origin need not remain at most M, and the KL warm-start bound must be recomputed. A formal reduction with explicit δ and query cost is therefore necessary before Theorems 3 and 4 establish the claimed tight complexity for the full family D_{L,M}; alternatively, the abstract and Section 1 should state the upper bound only for the centered subclass.","section":""},{"comment":"Theorem 8 claims that for every algorithm that succeeds on all of D_{L,M}, there is a hard distribution in D_{L,M}. However, the hard instances constructed in Section 3 are shown only to be O(L)-log-smooth with second moment O(M): Lemma 10 gives second moment O(M), Lemma 13 gives E_{μv}[‖X‖²]=O(M), and Lemma 14 gives O(L)-smoothness with unspecified universal constants. The proof then asserts, without a further argument, that the instances can be assumed to satisfy second moment at most M and smoothness L. This is a formal gap in the theorem statement. It is likely fixable by rescaling M (or by absorbing the universal constants into the Ω-exponent), but as written the lower bound is not literally against D_{L,M}.","section":""}],"minor_comments":[{"comment":"The definition r₂ = √(2r₁) is dimensionally inconsistent and incompatible with the mollifier construction, which requires r₂ ≥ r₁; the intended definition is presumably r₂ = √2·r₁. Please correct this throughout Section 3, since all subsequent radius ratios depend on it.","section":""},{"comment":"The displayed Hessian computations in Lemma 10 (and similar long displayed equations in Lemma 22 and Section 5.2.1) contain unreadable inserted symbols in the provided version. These are likely transcription artifacts, but the arXiv version should be checked so that every displayed calculation is legible and complete.","section":""},{"comment":"The statement of Theorem 5 says 'for arbitrary s=Ω(d)' but uses s both for the squared center distance and later for time scales; please define the parameter explicitly and avoid reusing s with the stationary-point notation from Section 1.1.","section":""}],"recommendation":"major_revision","confidential_remarks":"This is a strong theory paper with a substantial central result. The main issue is formal rather than conceptual: the upper bound is proved only for the centered case ∇f(0)=0, and the claimed reduction to the general case needs a real proof with quantified query cost and error propagation. The second lower-bound gap (instances having O(M) rather than ≤M second moment) is also fixable. I recommend major revision rather than rejection; if the stationarity reduction can be written out, the paper will be a solid journal contribution."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Two things you should know. The main result is real: the (LM/dε)^{Θ(d)} query complexity for non-log-concave sampling, with the first ε-dependence in the lower bound. The lower-bound construction (plateau-and-bump on a ring) is the real contribution; it improves the old e^{Ω(d)} bound and gets the right dependence on L, M, and ε. The upper bound is an honest algorithmic construction — truncate, estimate f* and Zμ on a grid, sample the smoothed version by LMC — and it matches the lower bound up to the exponent constant. The OU-process analysis and the sampling-vs-optimization comparison are secondary but worth reading.\n\nThe soft spots are in proportion. Most importantly, Theorem 4 is stated for the full family DL,M, but proven under the extra condition ∇f(0)=0. The paper says you can first run gradient descent to find a stationary point and shift the origin, but no theorem, no query count, no error propagation is given. This is load-bearing, because the proof uses ∇f(0)=0 to bound gradients on the ball and to ensure ∇fπ(0)=0 for the KL warm-start bound (Corollary 28 and Lemma 34). Without it, the bound on fπ(0) − min fπ picks up extra terms; they may be harmless or may not, but the reader can't tell. The stress-test note is right about this. The fix may be straightforward — ∇f(0) is at most L√M by integration by parts, so the grid estimates survive with slightly larger constants — but the KL warm-start part needs real work. The authors should either prove the reduction or restate the upper bound for the centered subclass and adjust the abstract accordingly.\n\nTwo smaller issues: r2 = √(2r1) in Section 3.2 is dimensionally inconsistent and is almost certainly a typo for something like √2·r1 or 2r1; should be fixed. And the hard instances have second moment O(M), not ≤ M; this is fixable by rescaling and doesn't threaten the exponent, but the formal statement needs a sentence.\n\nIf the reduction is patched, this is a clean, significant paper. As it stands, the lower bound is solid and the upper bound is a strong partial result. It deserves peer review, and the referees should push on the reduction.","headline":"Strong lower bound with a matching upper bound that is formally proven only for centered potentials; the gap to the stated general theorem is real but probably fixable.","tokens_in":81441,"tokens_out":8011,"would_cite":true,"duration_ms":72609,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":["68Q25","68W20"],"pacs":[],"model":"deepseek-v4-flash","headline":"The paper proves matching upper and lower bounds showing the worst-case query complexity of sampling from $L$-log-smooth distributions with second moment at most $M$ is $(LM/(d\\varepsilon))^{\\Theta(d)}$.","keywords":["non-log-concave sampling","query complexity","log-smooth","second moment","total variation distance","value and gradient oracle","Ornstein-Uhlenbeck process","sampling versus optimization"],"falsifier":"For a fixed parameter choice such as $d=10$, $L=M=10$, $\\varepsilon=1/200$, evaluate the Hessian of the perturbed potential $f_v$ from Section 3.2 at points in the interpolation shell $r_1<\\|x-v\\|<r_2$; if its operator norm exceeds the universal constant times $L$, the hard-instance family is not $L$-log-smooth and the lower bound collapses. A complementary check is to run the upper-bound algorithm on the stitched-Gaussian family with $LM=\\Theta(d)$ and constant $\\varepsilon$: success in $\\exp(o(d))$ queries would contradict the claimed $(LM/(d\\varepsilon))^{\\Omega(d)}$ lower bound.","tokens_in":80301,"feed_emoji":"🎲","tokens_out":11266,"duration_ms":93497,"temperature":0.7,"pith_summary":"The paper settles, up to a constant in the exponent, how many value and gradient queries are needed to draw one approximate sample from a $d$-dimensional distribution whose log-density is $L$-smooth and whose second moment is at most $M$. It proves a lower bound of $(LM/(d\\varepsilon))^{\\Omega(d)}$ queries for any algorithm, and a matching algorithm using $(LM/(d\\varepsilon))^{O(d)}$ queries, so the worst-case query complexity is $(LM/(d\\varepsilon))^{\\Theta(d)}$ whenever $LM \\ge d \\ge 5$ and $\\varepsilon < 1/200$. The lower bound is built from a plateau-shaped base density with many disjoint perturbation balls, forcing any algorithm to locate which ball carries the extra mass. The paper also contrasts this with a prior quasi-polynomial sampler that requires smoothness along the Ornstein--Uhlenbeck trajectory, proving that condition strictly stronger than mere $O(1)$-smoothness of the initial distribution, and it shows sampling can beat optimization by a super-exponential factor in $d$.","feed_headline":"Tight query bound: sampling non-log-concave needs $(LM/d\\varepsilon)^{\\Theta(d)}$","feed_subtitle":"Matching lower and upper bounds settle the worst-case cost of approximate sampling under value and gradient queries.","key_machinery":"The lower bound's load-bearing object is the plateau base distribution: a Gaussian with a flat ring of height $h_1 \\approx \\log(1/\\varepsilon) + d \\log R$ between radii $R/2$ and $R$, with $R = \\sqrt{M/\\varepsilon}$. Because the plateau raises the density where perturbations are placed, a perturbation of height $\\gamma \\approx d \\log(3R/r)$ inside a ball of radius $r \\approx \\sqrt{d/L}$ adds about $\\varepsilon$ of mass while keeping the Hessian at $O(L)$; a spherical-cap packing argument then yields $\\left(\\frac{LM}{d\\varepsilon}\\right)^{\\Omega(d)}$ disjoint such balls on the sphere of radius $3R/4$. The upper bound's machinery is the truncated surrogate $\\pi$: the target potential is cut at $h_1$, smoothly interpolated to $h_2 = h_1 + \\frac d2 \\log\\frac{LM}{d\\varepsilon}$, and replaced by a Gaussian outside radius $2R$; grid queries give $\\hat f_* \\in [f_*, f_*+d]$ and $\\hat Z_\\mu \\in [e^{-d}Z_\\mu/2, Z_\\mu]$, enough to keep the density ratio $p_\\pi/p_\\gamma$ within $(LM/(d\\varepsilon))^{O(d)}$ of a Gaussian and hence to control the Poincaré constant.","core_discovery":"The central claim is that, for the class of distributions satisfying only $L$-log-smoothness and a second-moment bound $M$, the query complexity of $\\varepsilon$-accurate sampling in total variation distance is $(LM/(d\\varepsilon))^{\\Theta(d)}$ under value and gradient oracle access. The lower bound holds for any $L,M$ with $LM \\ge d \\ge 5$ and $\\varepsilon \\in (0,1/200)$: the paper constructs a base distribution that is Gaussian except for a flat plateau ring, packs roughly $((R/r))^{d-1}$ disjoint balls on a sphere, and lowers the potential inside each ball by a carefully chosen amount so that each perturbed distribution is still $L$-log-smooth with second moment $O(M)$, while any two perturbed distributions are $4\\varepsilon$ apart in total variation. The upper bound constructs a surrogate distribution $\\pi$: outside a large ball it is Gaussian, inside a smaller ball the target potential is kept below a threshold, and the values of $\\min f$ and the normalizing constant are estimated on a grid to within additive $d$ and multiplicative $e^{-d}$ respectively; the surrogate has a controlled Poincaré constant and is sampled with averaged Langevin dynamics. Together the two bounds characterize the worst-case exponent of the query complexity.","pith_inferences":["A natural extension of the lower-bound recipe is to weaker oracle models: if the same hard family can be recognized only through noisy or zeroth-order information, the $(LM/d\\varepsilon)^{\\Omega(d)}$ barrier should persist, although the paper does not analyze such oracles.","The plateau construction suggests a general packing principle—place perturbations where the base density is highest so that small potential shifts move $\\varepsilon$ mass—which could yield tight lower bounds for other structured non-log-concave families such as bounded mixtures.","The paper's open conjecture that the exponent constant is $1/2$ implies that the gap between the current upper and lower bounds would be closed by replacing the truncation analysis with direct weak-Poincaré inequalities for the target distribution, an approach the paper explicitly leaves to future work.","The smoothness analysis of the Ising-type mixture of Gaussians points toward a boundary question the paper does not resolve: for which spectra of the interaction matrix does polynomial-time sampling remain possible without extra assumptions."],"forward_implications":["Any algorithm for this family must use exponentially many queries when $LM=\\Theta(d)$, and at least $(1/\\varepsilon)^{\\Omega(d)}$ when $\\varepsilon$ shrinks, ruling out samplers with polylogarithmic dependence on $1/\\varepsilon$.","When $LM=\\omega(d)$, the lower bound becomes super-exponential in $d$, so the family contains distributions for which no sub-super-exponential sampling algorithm can exist under this oracle model.","The upper bound shows that a very coarse estimate of $\\min f$ and the normalizing constant—errors of size $d$ and factor $e^{-d}$—suffices to build a sampleable surrogate, which is why sampling does not require solving the optimization problem accurately.","The OU-smoothness condition used by prior diffusion-based samplers is strictly stronger than $O(1)$-smoothness of the target: the stitched-Gaussian family is $O(1)$-log-smooth initially but develops Hessian of size $\\Omega(e^{-2t}\\|u\\|^2)$ along the OU flow.","For $LM=\\Theta(d)$ and constant accuracy, the sampling upper bound is $(LM/d)^{O(d)}$, while the optimization lower bound is $(\\alpha LM)^{d/2}$, so sampling can outperform optimization by a super-exponential factor."],"supporting_citations":[{"why":"Supplies the oracle lower-bound framework—perturbing a base distribution in disjoint balls—that the paper adapts and strengthens by replacing the Gaussian base with a plateau.","marker":"[LRG18]"},{"why":"Provides the averaged Langevin Monte Carlo convergence theorem the upper-bound algorithm invokes to sample from the surrogate distribution $\\pi$.","marker":"[BCE+22]"},{"why":"Gives the Poincaré constant of the Gaussian reference distribution $\\gamma$, used to lower bound the Poincaré constant of $\\pi$.","marker":"[BL76]"},{"why":"Provides the optimization hard-instance construction and lower bound used in the paper's comparison showing sampling can be easier than optimization.","marker":"[MCJ+19]"},{"why":"The quasi-polynomial diffusion-based sampler whose OU-trajectory smoothness assumption the paper proves strictly stronger than initial $O(1)$-smoothness.","marker":"[HZD+24]"},{"why":"Supplies the formula relating the Hessian of the OU-evolved log-density to a covariance, used to prove the stitched-Gaussian blow-up.","marker":"[CLL23]"},{"why":"Provides the convolution lemma used to show the Ising-type mixture of Gaussians stays $O(1)$-smooth along the OU process.","marker":"[LPSR21]"},{"why":"Gives the hyperspherical cap area bound used to count the disjoint perturbation balls in the lower bound.","marker":"[Li10]"}],"fun_headline_variants":["Non-log-concave sampling: (LM/dε)^Θ(d) query complexity","Tight bounds for non-log-concave sampling: (LM/dε)^Θ(d)","Sampling non-log-concave: (LM/dε)^Θ(d) queries","Worst-case non-log-concave sampling: (LM/dε)^Θ(d)"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The upper-bound algorithm and its proof assume the potential satisfies $\\nabla f(0)=0$, using that origin to make the grid estimates of $f_*$ and $Z_\\mu$ accurate; the paper says a stationary point can first be found by gradient descent, but it does not formalize the extra queries or the error propagation from an only approximately stationary point.","fun_headline_variants_meta":{"raw":{"variants":["Non-log-concave sampling: (LM/dε)^Θ(d) query complexity","Tight bounds for non-log-concave sampling: (LM/dε)^Θ(d)","Sampling non-log-concave: (LM/dε)^Θ(d) queries","Worst-case non-log-concave sampling: (LM/dε)^Θ(d)"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.00067,"raw_usage":{"total_tokens":3182,"prompt_tokens":1203,"completion_tokens":1979,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":819,"completion_tokens_details":{"reasoning_tokens":1887}},"tokens_in":819,"tokens_out":1979,"duration_ms":13863,"temperature":1.0,"reasoning_tokens":1887,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-08T16:25:17.085395+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"For a fixed parameter choice such as $d=10$, $L=M=10$, $\\varepsilon=1/200$, evaluate the Hessian of the perturbed potential $f_v$ from Section 3.2 at points in the interpolation shell $r_1<\\|x-v\\|<r_2$; if its operator norm exceeds the universal constant times $L$, the hard-instance family is not $L$-log-smooth and the lower bound collapses. A complementary check is to run the upper-bound algorithm on the stitched-Gaussian family with $LM=\\Theta(d)$ and constant $\\varepsilon$: success in $\\exp(o(d))$ queries would contradict the claimed $(LM/(d\\varepsilon))^{\\Omega(d)}$ lower bound.","supporting_citations":[],"review_version":1}