{"id":"7622297d-a61d-4bbd-a39b-3b58d7630d4d","arxiv_id":"2507.17243","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":3.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":3,"one_line_summary":"A nonparametric Bayesian test confirms that VoidFinder-defined void galaxies are fainter, less massive, bluer, and more star-forming than wall galaxies, while V2 REVOLVER void classification washes out these differences.","lead":"This undergraduate thesis applies a flexible Bayesian statistical test to compare galaxies in dense and empty cosmic regions. It finds that the way voids are defined, not just the statistical method, controls how strongly environmental effects are detected.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The probability integral transform mapping galaxy properties into the Polya tree domain [0,1) is never specified; every log Bayes factor in Tables 4.1-4.2 depends on it, so the statistical evidence is non-reproducible and may be transform-dependent.","rationale":"The reader's weakest assumption correctly identifies the missing probability integral transform as the most load-bearing gap. Every numerical result in the paper's central tables is produced by feeding transformed galaxy properties into a Polya tree prior that is only defined on [0,1). Without an explicit transform, the numbers are not reproducible, and if the transform is estimated from the same data, the Bayes factor is no longer the clean marginal-likelihood ratio claimed in Section 2.2. This is more than a stylistic omission: it affects the validity of the statistical evidence for the paper's main astrophysical conclusion. The qualitative claim that VoidFinder void galaxies are fainter, less massive, bluer, and more star-forming is independently visible in the histograms and consistent with prior work, so the empirical direction may survive. But the quantitative strength of the evidence, expressed in log Bayes factors like -3896, is not trustworthy until the transform is specified and checked. The abstract's additional claim of superiority over the KS test is also unsupported by any KS experiment in the paper, and the admitted lack of a systematic study of tree depth m adds further uncertainty. None of this requires overturning the reader's CONDITIONAL verdict; it confirms it. The proposed test would settle the concern by showing whether the tables are stable under alternative, clearly specified transforms and tree depths.","tokens_in":13857,"tokens_out":6795,"duration_ms":72055,"concrete_test":"Recompute the nonparametric Bayes factors for DESI DR1 BGS (Table 4.2) under two explicit transforms: (i) rank-based empirical CDF of the combined sample, and (ii) a fixed logistic CDF whose location/scale are estimated on a randomly chosen 50% training half of the combined sample and applied to the other half. Also vary tree depth m in {4,6,8,10} for the V2 rows of Tables 4.1 and 4.2. If any log Bayes factor changes sign, or the ordering 'VoidFinder strongly negative, V2 near zero or positive' is reversed, the reported results are transform- or depth-dependent and the central claim needs qualification.","verdict_should_be":"UNCHANGED","load_bearing_attack":"All six galaxy properties in Section 1.1 are real-valued (stellar mass, Mr, colors, SFR, sSFR/H-alpha EW), yet the Polya tree prior in Section 2.1 is defined only on [0,1). The paper never states how the data are mapped into this domain. If the transform is an empirical CDF estimated from the combined void+wall sample, then the partition in Eq. 2.1 and the marginal likelihoods in Eqs. 2.10-2.11 are computed conditional on the data, so the reported Bayes factor is not the ratio of marginal likelihoods for the original galaxy properties under the stated prior. If instead a fixed or separately-estimated transform is used, the paper does not say which, and Tables 4.1 and 4.2 cannot be reproduced. The sensitivity analysis in Section 2.3 uses simulated N(0,1) data and does not vary the transform; the conclusion (Section 5) admits tree depth m has not been systematically studied, so the choice m=6 is also unvalidated for real data. These gaps do not necessarily overturn the qualitative direction seen in the histograms, but they undermine the central statistical claim that the nonparametric Bayes factors decisively quantify void/wall differences.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper applies a Polya-tree-based nonparametric Bayesian two-sample test to compare the distributions of six galaxy properties (stellar mass, r-band absolute magnitude, g-r and u-r colors, SFR/sSFR, and H-alpha EW) between void and wall galaxies in SDSS DR7 and DESI DR1 BGS, using two void-finding algorithms (VoidFinder and V2 REVOLVER). It reports log Bayes factors in Tables 4.1 and 4.2 and concludes that VoidFinder voids host systematically fainter, less massive, bluer, and more star-forming galaxies, while these contrasts are weaker for V2 REVOLVER voids. The paper also claims that the nonparametric test is more sensitive and robust than the Kolmogorov-Smirnov test and parametric Bayesian alternatives, based on simulation-based sensitivity analysis and a comparison with parametric results from Zaidouni et al. [4].","tokens_in":14052,"tokens_out":3455,"duration_ms":33854,"significance":"If the statistical framework is valid, the scientific conclusion that environmental effects depend on the void-finding algorithm is interesting and consistent with earlier work, and the application to DESI DR1 BGS is a useful extension. The paper's explicit strength is its use of a fully Bayesian nonparametric procedure with a published implementation, replicated simulation checks for the c parameter, and a clear scientific hypothesis. However, the central statistical claims about sensitivity and robustness are currently under-supported, and the reported Bayes factors are not reproducible as written because of an unspecified data transform and unvalidated tree depth. The qualitative histogram comparisons do support the main astrophysical conclusion, but the quantitative evidence in Tables 4.1 and 4.2 needs additional methodological work before the paper's stronger claims can be accepted.","major_comments":[{"comment":"The Polya tree prior is defined on the domain Ω = [0,1), but all six galaxy properties analyzed in Section 1.1 are real-valued. The paper never specifies how the data are mapped into [0,1). Every log Bayes factor in Tables 4.1 and 4.2 depends on this transform. If the transform is the empirical CDF of the pooled void+wall sample, then the partition counts n_{j0}, n_{j1} in Eqs. (2.10)–(2.11) are conditional on the data, so the reported quantity is not the ratio of marginal likelihoods under the stated prior; the test becomes circular and biased toward H1. If a fixed transform is used, it must be described for reproducibility. The sensitivity analysis in Section 2.3 does not test the transform choice, so the robustness claim is incomplete.","section":"§2.1, §2.2, Tables 4.1–4.2"},{"comment":"The abstract claims that the approach, compared to the Kolmogorov-Smirnov test and a parametric Bayesian test, 'provides a more sensitive and robust comparison,' but no KS test is run anywhere in the paper. Section 4.1 only compares against the parametric Bayes factors from Zaidouni et al. [4]. The claimed superiority over KS is therefore unsupported. Either a KS test should be performed on the same datasets and its performance compared (e.g., by p-value calibration or by reporting Bayes factors alongside KS statistics), or the abstract should be revised to remove the unsubstantiated comparison.","section":"Abstract and §4.1"},{"comment":"The magnitude of a Bayes factor is not comparable across different prior specifications: the parametric mixture model and the nonparametric Polya tree prior occupy different model spaces, so the statement that a change from -1708 (parametric) to -3896 (nonparametric) 'amplifies the evidence' is not a valid measure of sensitivity. Comparing absolute log Bayes factors across methods conflates prior sensitivity with evidence for the alternative. A valid sensitivity comparison would require a controlled simulation study with known ground truth and a measure such as power at a fixed type-I error rate, or calibration of Bayes factors under the null.","section":"§4.1, Table 4.1"},{"comment":"The applications use tree depth m = 6, but the sensitivity analysis in Section 2.3 fixes m = 8 (stated under the variance-shift setting), and the conclusion admits that 'the effect of tree depth m' has not been systematically studied. The choice m = 6 is therefore unvalidated for the real datasets. The paper should report whether the signs and approximate magnitudes of the log Bayes factors in Tables 4.1 and 4.2 are stable across a range of m (e.g., 4, 6, 8, 10) and across a range of c values, not only c = 1.","section":"§2.3 and §5"}],"minor_comments":[{"comment":"The statement that the KS test 'can yield an extremely low p-value since it computes the tail probability of the null hypothesis being true' misstates the definition of a p-value; a p-value is the probability of observing a test statistic as extreme as or more extreme than the observed one under the null, not the probability that the null is true.","section":"§1.2"},{"comment":"The sentence 'with n = 10, 50, 100, 200 and 500 replications' is ambiguous; it should clarify that n refers to sample sizes and 500 to the number of replications.","section":"§2.3"},{"comment":"The legend label 'holms' should read 'Holmes et al. [7]' and the reference should be spelled consistently as 'Holmes' (not 'Holms').","section":"Figures 2.2 and 2.3"},{"comment":"In the caption of Figure 4.1, the right column is labeled 'VoidFinder' in the figure text; it should be 'V2' to match the left/right description in the caption.","section":"§4.1, Figure 4.1"},{"comment":"The numerator Pr(y^{(1,2)} | H0) is notationally awkward; it should be written as Pr(y^{(1)}, y^{(2)} | H0) or explicitly defined as the marginal likelihood of the pooled sample under H0.","section":"Eq. (1.1)"}],"recommendation":"major_revision","confidential_remarks":"The paper is a senior thesis and reads as one; the referee report focuses on the technical content, but the editor may wish to consider whether the level of methodological rigor meets the journal's standard. The core astrophysical finding is plausible and consistent with prior work, but the statistical evidence needs to be made reproducible and the KS-test comparison must either be performed or removed."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Quick take: the scientific direction holds up. The histograms clearly show that VoidFinder void galaxies are fainter, less massive, bluer, and more star-forming than wall galaxies, and that V2 REVOLVER classifications wash most of that out. That matches Zaidouni et al., so the paper is confirmation rather than a new physical result. The genuinely new piece is applying the Polya-tree Bayes factor of Holmes et al. to SDSS DR7 and DESI DR1 BGS, and the DESI numbers are new.\n\nWhat the paper does well: the simulation check reproduces Holmes's results across c values, the discussion of why c controls sensitivity is clear, and the histograms are honest evidence for the direction of the effect. The authors also openly admit in the conclusion that tree depth m has not been systematically studied.\n\nThe soft spots are concentrated in the statistics, and one of them is load-bearing. The Polya tree prior is defined on [0,1), but the paper never says how the six galaxy properties are mapped into that interval. If the transform is an empirical CDF estimated on the same combined samples, the Bayes factors in Tables 4.1 and 4.2 are not marginal likelihood ratios for the original data under the stated priors; they are conditional on the data-dependent partition. If a fixed transform is used, the paper does not say which, so no one can reproduce the numbers. This does not kill the qualitative conclusion, but it means the quantitative evidence is currently unverifiable. The sensitivity analysis also only varies c on simulated N(0,1) data, not the transform or m on real data.\n\nTwo smaller issues. First, the abstract claims superiority over the KS test, but no KS test is ever run; that claim is unsupported. Second, the reported Bayes factors have no uncertainty intervals, which matters given the sensitivity analysis shows substantial scatter across c. Also, the comparison with parametric Bayes factors in Table 4.1 is not apples-to-apples, because those numbers come from Zaidouni et al. with a different model and priors, so the 'more sensitive' conclusion does not follow directly. The V2 sSFR case where the nonparametric test gives +161 against the parametric -19 hints that the nonparametric test can be conservative, which the paper itself notes.\n\nBottom line: a serious, usable application with a clear qualitative result, but the headline statistics need fixing, not just polishing. The authors should specify the transform, run a KS test, and add uncertainty or sensitivity to the Bayes factors. I would send it to peer review rather than reject it, but I would not cite the numerical Bayes factors until those issues are resolved.","headline":"Qualitatively right and a useful first DESI application, but the headline Bayes factors are not reproducible until the data transform is specified and the KS comparison is actually run.","tokens_in":14655,"tokens_out":2012,"would_cite":false,"duration_ms":20896,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Galaxies inside VoidFinder voids are systematically fainter, less massive, bluer, and more star-forming than wall galaxies, and a nonparametric Pólya-tree Bayes factor detects those differences more strongly than a parametric mixture…","keywords":["galaxy evolution","cosmic voids","void galaxies","Pólya tree prior","Bayes factor","nonparametric Bayesian testing","SDSS DR7","DESI DR1 BGS"],"falsifier":"Re-run the Pólya-tree Bayes factor on the DESI DR1 BGS void/wall samples with the $[0,1)$ transform fixed in advance (for example, ranking all galaxies once in the pooled sample before splitting into void and wall) and check whether the strong negative log Bayes factors for VoidFinder in Table 4.2 survive; if they flip toward zero, the unspecified transform is driving the result.","tokens_in":13547,"feed_emoji":"🌌","tokens_out":12542,"duration_ms":122406,"temperature":0.7,"pith_summary":"Galaxies in the emptiest cosmic regions should, if environment shapes evolution, be fainter, less massive, bluer, and more actively star-forming than galaxies in dense walls. This paper claims that such differences are real and detectable, but only when both the statistical test and the void catalog are chosen carefully. Using a nonparametric Bayesian test based on Pólya tree priors on SDSS DR7 and DESI DR1 BGS data, the author finds strong evidence of these contrasts for VoidFinder-defined voids and much weaker evidence for V² REVOLVER-defined voids. The point of the result is that environmental effects on galaxy evolution exist, yet their measured strength is tied to how 'void' is defined. A fair reader should come away knowing that the statistical machinery matters as much as the astrophysical one.","feed_headline":"Void galaxies are fainter, bluer, and more star-forming","feed_subtitle":"A flexible Bayesian test sharpens the contrast—but only for VoidFinder voids, not watershed voids.","key_machinery":"The load-bearing machinery is the Pólya tree prior, a prior over probability distributions on the unit interval $[0,1)$ that recursively splits the interval into binary cells; each split gets an independent Beta-distributed branching probability, and the tree is truncated at depth $m$. Setting the branching parameters to $c/m^2$ with $c=1$ makes the prior conjugate, so the marginal likelihood for each split has a closed Gamma-function product form. The test statistic is the Bayes factor $B_{01}$, the ratio of the marginal likelihood under $H_0$ (one common distribution for void and wall samples) to the product of marginal likelihoods under $H_1$ (two independent distributions); negative log Bayes factors count as evidence for distinct environments. The precision parameter $c$ controls how strongly the prior concentrates near the centering distribution, and the paper's simulations show that $c=1$ balances sensitivity to mean and variance shifts against robustness.","core_discovery":"The central claim, on the paper's own terms, is that a Bayesian nonparametric two-sample test built from Pólya tree priors detects environmental differences in galaxy populations more sensitively and more robustly than a parametric Gaussian-mixture Bayes factor or the Kolmogorov-Smirnov test. Applied to SDSS DR7, the nonparametric log Bayes factors under VoidFinder are more negative than the parametric values for every property—stellar mass goes from $-1708$ to $-3896$—meaning stronger evidence that void and wall distributions differ. Applied to DESI DR1 BGS, VoidFinder void galaxies show lower stellar mass and luminosity, bluer $u-r$ and $g-r$ colors, and higher H$\\alpha$ equivalent width than wall galaxies, while V$^2$ REVOLVER classifications show much weaker or absent contrasts, with log Bayes factors near zero or positive. A notable sign flip occurs for specific star formation rate in SDSS DR7 under V$^2$ REVOLVER: the parametric test gives $-19$ (weak support for a difference) while the nonparametric test gives $+161$ (support for no difference). The paper concludes that environmental effects on galaxy evolution are detectable and statistically significant, but their measured strength depends on the void-finding algorithm.","pith_inferences":["I infer that published void-galaxy contrasts are only meaningful when paired with the exact void-finding algorithm; future reviews or merger studies should not average results across VoidFinder and watershed-based catalogs.","I infer that the same Pólya-tree test could be run on additional baryonic tracers, such as gas-phase metallicity or satellite counts, to see whether the environment's fingerprint extends beyond the six properties studied here.","I infer that the missing $[0,1)$ transform is a reproducibility risk; a pre-registered transform, such as ranking the pooled sample once before splitting, would let readers judge whether the reported log Bayes factors are robust."],"forward_implications":["If the central claim is right, the standard expectation that void galaxies are less evolved holds at least for VoidFinder-defined voids: they are fainter, less massive, bluer, and more actively star-forming in both SDSS DR7 and DESI DR1 BGS.","The nonparametric Bayes factor gives stronger evidence for well-separated void/wall differences than the parametric Gaussian-mixture Bayes factor, so future environmental studies can obtain decisive evidence without assuming a distributional shape.","The near-disappearance of differences under V² REVOLVER means that the void catalog itself is part of the physical conclusion; galaxies classified as void by one algorithm may be wall-like by another.","In subtle cases the nonparametric test is conservative, sometimes supporting the null hypothesis where the parametric test favored the alternative, so conclusions about weak environmental effects must state which test produced them."],"supporting_citations":[{"why":"Supplies the parametric Bayesian log Bayes factors and the SDSS DR7 void/wall classifications that the nonparametric test is compared against.","marker":"[4]"},{"why":"Introduces the Pólya-tree two-sample Bayes factor, including the simulation settings and the parameter scaling replicated in the sensitivity analysis.","marker":"[7]"},{"why":"Provides the DESI DR1 BGS selection criteria and the VoidFinder and V² REVOLVER void catalogs used in the DESI analysis.","marker":"[17]"},{"why":"The implementation used to compute the simulated and real-data Bayes factors.","marker":"[13]"},{"why":"Establishes the Pólya tree prior construction and the parameter scaling that guarantees absolute continuity.","marker":"[9]"},{"why":"Supplies the Bayes factor interpretation scale used to turn log Bayes factors into evidence strengths.","marker":"[12]"},{"why":"The software used to build and prune the void catalogs for both surveys.","marker":"[2]"}],"fun_headline_variants":["Nonparametric Bayes sharpens void-wall galaxy contrast","VoidFinder exposes galaxy differences that watershed voids miss","Bayesian test reveals environment effects, but void finder matters","Nonparametric test shows galaxy evolution depends on void definition"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that every galaxy property can be converted onto the test's unit interval without distorting the comparison, yet the paper never specifies the conversion; if it is estimated from the same data, the reported evidence for differences could be artificially strong.","fun_headline_variants_meta":{"raw":{"variants":["Nonparametric Bayes sharpens void-wall galaxy contrast","VoidFinder exposes galaxy differences that watershed voids miss","Bayesian test reveals environment effects, but void finder matters","Nonparametric test shows galaxy evolution depends on void definition"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000925,"raw_usage":{"total_tokens":3961,"prompt_tokens":942,"completion_tokens":3019,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":558,"completion_tokens_details":{"reasoning_tokens":2955}},"tokens_in":558,"tokens_out":3019,"duration_ms":24460,"temperature":1.0,"reasoning_tokens":2955,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-06T14:52:39.257590+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Re-run the Pólya-tree Bayes factor on the DESI DR1 BGS void/wall samples with the $[0,1)$ transform fixed in advance (for example, ranking all galaxies once in the pooled sample before splitting into void and wall) and check whether the strong negative log Bayes factors for VoidFinder in Table 4.2 survive; if they flip toward zero, the unspecified transform is driving the result.","supporting_citations":[{"cited_title":"The impact of void-finding algorithms on galaxy classification","cited_arxiv_id":null,"evidence_quote":"Supplies the parametric Bayesian log Bayes factors and the SDSS DR7 void/wall classifications that the nonparametric test is compared against."},{"cited_title":"Two-sample Bayesian nonparametric hypothesis testing","cited_arxiv_id":null,"evidence_quote":"Introduces the Pólya-tree two-sample Bayes factor, including the simulation settings and the parameter scaling replicated in the sensitivity analysis."},{"cited_title":"PTTests: Polya Tree Hypothesis Tests","cited_arxiv_id":null,"evidence_quote":"The implementation used to compute the simulated and real-data Bayes factors."},{"cited_title":"Prior distributions on spaces of probability mea- sures","cited_arxiv_id":null,"evidence_quote":"Establishes the Pólya tree prior construction and the parameter scaling that guarantees absolute continuity."},{"cited_title":"V AST: the Void Analysis Software Toolkit","cited_arxiv_id":null,"evidence_quote":"The software used to build and prune the void catalogs for both surveys."}],"review_version":1}