Pith. sign in

REVIEW 3 major objections 5 minor 3 cited by

Are there Spectral Features in the MIRI/LRS Transmission Spectrum of K2-18b?

T0 review · 3 major / 5 minor · reviewed 2026-08-16 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This paper re-examines the K2-18b MIRI/LRS spectrum and finds no strong statistical evidence for the spectral features behind the reported 3.4-sigma detection.

desk verdict A concise, timely Gaussian-feature reanalysis finds the flat line acceptable for K2-18b's MIRI/LRS spectrum, but the conclusion overreaches from 'no Gaussian features' to 'no spectral features.' read the letter →

arxiv 2504.15916 v1 pith:N7GHYXXZ submitted 2025-04-22 astro-ph.EP astro-ph.IM

Jake Taylor This is my paper · ORCID
classification astro-ph.EPastro-ph.IM
keywords K2-18bMIRI/LRStransmissionspectrumGaussianspectralfeaturesBayesianmodelcomparisondimethylsulfide(DMS)flat-lineJWSTexoplanetatmospheres
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper asks whether the MIRI/LRS transmission spectrum of K2-18b actually shows any spectral features. Fitting six nested Gaussian models to the published spectrum, the author finds that a flat line is an acceptable fit in five of six cases; the only model that beats the flat line, two Gaussians fixed at 7 and 8.8 microns, does so weakly, with ln(B)=1.21, about a 2-sigma preference. This contradicts an earlier claim of a 3.4-sigma detection of spectral features and weakens the case that dimethyl sulfide or dimethyl disulfide has been detected in this dataset. A flat spectrum matters because biosignature claims require ruling out simpler, featureless explanations.

What carries the argument

The central object is the Gaussian feature model $\delta_\lambda(A,\mu,\sigma_m,c)=A\exp(-(\lambda-\mu)^2/(2\sigma_m^2))+c$ combined with a constant flat-line model $\delta_\lambda(c)=c$. The argument runs on nested model comparison: because the flat line is a subset of every Gaussian model, the difference in log Bayesian evidence equals the log Bayes factor, judged on the Jeffreys scale. MultiNest nested sampling supplies the evidence values, and equivalent-$\sigma$ conversion translates the Bayes factor into the familiar but potentially misleading '2-$\sigma$' language.

What would settle it

A re-reduction of the raw MIRI/LRS time series that yields materially different transit depths near 7 and 8.8 microns, or an injection-recovery test showing that the method fails to recover a simulated feature at the claimed amplitude, would overturn or confirm the flat-line conclusion.

Watch

Extended reading notes

Core claim

The central claim is that the K2-18b MIRI/LRS transmission spectrum does not contain statistically significant spectral features. The author reanalyzes the same binned spectrum presented in the earlier detection paper and compares six Gaussian-based models against a constant flat line using Bayesian evidence. Five of the six Gaussian models fall into the 'no evidence' category on the Jeffreys scale, and the most favorable model—positive and negative Gaussians fixed at 7 and 8.8 microns—has ln(B)=1.21, which is 'weak evidence' and roughly a 2-sigma preference. The reduced chi-squared values around 1 show the flat line fits the data well.

Load-bearing premise

The conclusion rests on the accuracy of the published binned spectrum's error bars; if they are underestimated, real features could hide, and if overestimated, phantom flatness could appear.

Editorial extensions

If this is right

  • A flat-line description of the K2-18b MIRI/LRS spectrum is a valid baseline; the claimed 3.4-sigma feature detection is not reproduced by a model-agnostic search.
  • Atmospheric abundances of DMS/DMDS derived from this dataset carry much less weight than the original publication suggests.
  • Molecule-specific, fixed-wavelength models can inflate the statistical evidence for a detection relative to agnostic feature searches.
  • Future JWST observations of K2-18b in transmission should be designed with enough precision to distinguish a genuinely featureless spectrum from weak 2-sigma bumps.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Editorial inference: the same flat-line-versus-Gaussian test could be applied to K2-18b's NIRISS/SOSS and NIRSpec/G395H spectra; if those also prefer a flat line, the case for any molecular detection in this planet's transmission spectra weakens further.
  • Editorial inference: an independent reduction of the raw MIRI/LRS time series would be the cleanest check, because the flat-line result depends on the error bars of the published binned spectrum.
  • Editorial inference: the method generalizes: any claimed exoplanet spectral feature can be required to beat a flat line in a nested Bayesian comparison before being interpreted as a molecular detection.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This research note reanalyzes the JWST MIRI/LRS transmission spectrum of K2-18b published by Madhusudhan et al. (2025). The author fits a flat line and six Gaussian-feature models (positive, negative, and combined, with free or fixed central wavelengths) to the JexoRes binned data and compares Bayesian evidences computed with MultiNest. Five of the six Gaussian models yield ln(B) < 1 relative to the flat line, and the most favorable model, two Gaussians fixed at ~7 and ~8.8 um, gives ln(B) = 1.21, which is classified as weak evidence on the Jeffreys scale. The paper concludes that there is no strong statistical evidence for spectral features and argues that the original 3.4-sigma detection claim is not supported by the MIRI/LRS data alone.

Significance. If the conclusion holds, this is a useful independent check on a high-profile biosignature claim: it would show that the MIRI/LRS data do not, by themselves, strongly endorse the DMS/DMDS detection claimed by Madhusudhan et al. (2025). The paper is transparent about the data source, reports chi-squared values for every model, and avoids the circularity of reusing fitted parameters as hypotheses. The fixed-wavelength tests are a legitimate targeted hypothesis, motivated by the original paper's own figures. However, the significance is limited by the narrow model family considered: all tests assume Gaussian-shaped features, and no injection-recovery or sensitivity test is performed. The reported evidence values also depend on unstated prior ranges and sampler settings. The result is therefore best read as 'no evidence for Gaussian-shaped features' rather than as a general statement about the absence of spectral features.

major comments (3)
  1. [Sec. 2, Eq. (1)] The central conclusion in Section 4 ('no strong evidence for detected spectral features') is inferred from tests in which the only non-flat model is one or two Gaussians. The manuscript asserts that DMS/DMDS spectral shapes are 'approximately Gaussian' by citing Figure 3 of Madhusudhan et al. (2025), but this assumption is not independently tested. Molecular band envelopes, especially with P/R branch structure, can deviate substantially from a Gaussian, and the Bayesian model comparison will then penalize the Gaussian model through the Occam factor even when a physically motivated molecular model fits the data well. Because the title, abstract, and conclusion make a broad claim about 'spectral features,' this model-family restriction is load-bearing. I recommend either explicitly restricting the conclusion to Gaussian-shaped features or adding an injection-recovery test that includes both Gaussian and non-Gaussian (e.g., molecular opacity) synthetic signals.
  2. [Sec. 2] The reported Bayesian evidences are not reproducible. No prior ranges are stated for the Gaussian amplitude A, width sigma_m, or vertical offset c, and no MultiNest settings are provided (e.g., number of live points, evidence tolerance, sampling efficiency). Since the Bayes factors and hence the Jeffreys-scale classifications in Section 3 depend directly on the prior volumes, the 'weak evidence' statement and the quantitative ln(B) values cannot be checked by readers. Please provide the full prior specification and sampler configuration, and ideally release the code or configuration files.
  3. [Sec. 3] The analysis contains no sensitivity or injection-recovery test. A finding of 'no evidence' is ambiguous: it can mean that no spectral feature is present, or that the data are too noisy, or that the adopted error bars are too large to permit detection of a feature of the expected amplitude. For instance, injecting a Gaussian with amplitude comparable to the claimed ~7 um DMS feature into the JexoRes binned data and checking whether ln(B) exceeds the weak-evidence threshold would calibrate the test's power. Without such a test, the flat-line preference cannot be interpreted as a strong upper limit on spectral features, especially since the analysis takes the JexoRes error bars at face value; underestimated errors would also produce the same qualitative pattern.
minor comments (5)
  1. [Sec. 3] 'Jeffrey's scale' should be 'Jeffreys scale' (and similarly in the abstract and conclusions).
  2. [Eq. (1)] The displayed Gaussian formula contains a mismatched parenthesis: the argument of the exponential appears as '(lambda - mu)^2) / 2 sigma_m^2)' with an extra closing parenthesis. Please correct the equation formatting.
  3. [Fig. 1] The figure would be easier to compare if the six panels were labeled (a)-(f) and the y-axis label were placed once rather than repeated on every panel, especially since the models are discussed as a suite in the text.
  4. [Sec. 3] The phrase 'Bayes factor = 3.35' would be clearer as 'Bayes factor of e^{1.21} = 3.35' or 'Bayes factor = 3.35 (since ln B = 1.21)' to avoid any confusion about logarithms.
  5. [Abstract and Sec. 2] The repeated style 'N. Madhusudhan et al. 2025' is slightly awkward; 'Madhusudhan et al. (2025)' is more standard and avoids the author-initial prefix in prose.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the analysis is an independent model comparison against external published data.

full rationale

The paper's derivation chain is self-contained. It takes the published MIRI/LRS transmission spectrum from Madhusudhan et al. (2025) as an external dataset and compares a flat-line model (Eq. 2) with Gaussian feature models (Eq. 1) using Bayesian evidence. No fitted parameter from one side of the comparison is recycled into the hypothesis being tested; the Gaussian amplitudes, widths, and centers are free parameters or are fixed at wavelengths explicitly motivated by the external paper's Figure 6, which is a targeted hypothesis rather than a mathematical reduction. The conclusion that there is no strong statistical evidence for spectral features is conditional on the Gaussian model family, and that scope limitation is a scientific correctness concern, not a circularity: the paper does not define 'spectral feature' as 'Gaussian', nor does it fit a parameter to a subset and then predict that same subset. There is also no load-bearing self-citation chain; the cited Gaussian-search methodology (JWST ERS Team et al. 2023; May et al. 2023) is an established external approach, and nothing in the paper's own equations makes the conclusion equal to an input by construction. Therefore the appropriate circularity score is 0.

Assumptions & free parameters 4 free parameters · 5 assumptions · 0 invented entities

The statistical conclusion relies on standard Bayesian model comparison and on the integrity of the published spectrum. The only hand-chosen quantities are the fixed Gaussian centers, taken from the paper being challenged.

free parameters (4)
  • Gaussian amplitude A = not reported
    Amplitude of the fitted Gaussian feature; fitted to the MIRI/LRS data. Not quoted numerically.
  • Gaussian width sigma_m = not reported
    Width of the fitted Gaussian; prior range not stated.
  • Vertical offset c = not reported
    Baseline transit depth; fitted for both flat line and Gaussian models.
  • Fixed Gaussian centers mu = 7 um and 8.8 um = 7 um, 8.8 um
    Chosen by hand from Figure 6 of Madhusudhan et al. 2025; this choice drives the only model with weak evidence.
assumptions (5)
  • domain assumption The flat line is the correct null model for the transmission spectrum.
    The analysis compares every Gaussian model to a constant offset. If the true continuum is not flat or the data contain systematics, the null is misspecified.
  • domain assumption DMS/DMDS spectral features are approximately Gaussian.
    Justified by Figure 3 of Madhusudhan et al. 2025, but real line shapes may deviate; non-Gaussian features could be missed.
  • domain assumption The published JexoRes spectrum and its uncertainties are accurate.
    The analysis uses the exact data points and error bars from the contested paper, so uncertainties in that reduction propagate directly.
  • domain assumption Bayesian evidence from MultiNest is converged with the chosen (unstated) priors.
    No prior ranges, number of live points, or convergence checks are reported, so prior sensitivity cannot be assessed.
  • standard math A flat line is formally nested within the Gaussian model at A=0.
    The paper calls the comparison nested, but if the prior on A excludes zero or is continuous, the nested-model comparison is only approximate.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Are there Spectral Features in the MIRI/LRS Transmission Spectrum of K2-18b?." pith.science (2026). https://pith.science/paper/N7GHYXXZ

@misc{pith2026250415916,
  author       = {Pith},
  title        = {Pith review of: Are there Spectral Features in the MIRI/LRS Transmission Spectrum of K2-18b?},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/N7GHYXXZ}},
  note         = {Machine review of arXiv:2504.15916}
}
abstract

Determining the composition of an exoplanet atmosphere relies on the presence of detectable spectral features. The strongest spectral features, including DMS, look approximately Gaussian. Here, I perform a suite of Gaussian feature analyses to find any statistically significant spectral features in the recently published MIRI/LRS spectrum of K2-18b (N. Madhusudhan et al. 2025). In N. Madhusudhan et al. 2025, they claim a 3.4-$\sigma$ detection of spectral features compared to a flat line. In 5 out of 6 tests, I find the data preferred a flat line over a Gaussian model, with a $\chi^{2}_{\nu}$ of 1.06. When centering the Gaussian where the absorptions for DMS and DMDS peak, I find ln(B) = 1.21 in favour of the Gaussian model, with a $\chi^{2}_{\nu}$ of 0.99. With only $\sim$2-$\sigma$ in favour of Gaussian features, I conclude no strong statistical evidence for spectral features.

Figures

Figures reproduced from arXiv: 2504.15916 by the authors.

Figure 1
Figure 1. Model fits to the MIRI/LRS observations of K2-18b from (N. Madhusudhan et al. 2025). The median, 1-σ and 2-σ credible region envelopes for each model fit are overlaid (purple curve and shading). The χ 2 , degrees of freedom, reduced χ 2 , and the ln Bayesian evidence values are annotated [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Three-dimensional Transport-induced Chemistry on Temperate sub-Neptune K2-18b, Part I: the Effects of Atmospheric Dynamics

    astro-ph.EP 2025-06 conditional novelty 6.0 of 10

    On K2-18b, a 3D climate model shows atmospheric winds concentrate long-lived gases at the evening terminator, and the fastest rotation studied creates tracer-rich polar regions.

  2. Insufficient evidence for DMS and DMDS in the atmosphere of K2-18 b. From a joint analysis of JWST NIRISS, NIRSpec, and MIRI observations

    astro-ph.EP 2025-05 accept novelty 6.0 of 10

    A joint re-analysis of NIRISS, NIRSpec, and MIRI spectra of K2-18 b finds no statistically significant evidence for DMS or DMDS, with ethane offering an equally good fit.

  3. Life on the Edge: Using Planetary Context to Enhance Biosignatures and Avoid False Positives

    astro-ph.EP 2025-04 accept novelty 6.0 of 10

    The authors introduce peribiosignatures, biosignatures found where life is unlikely, and argue that targeting the edges of the habitable zone may reduce false positives in the search for extraterrestrial life.

Reference graph

Works this paper leans on

16 extracted references · 2 canonical work pages · cited by 3 Pith papers

  1. [1]

    2015, Science, 348, 1466, doi: 10.1126/science.aab1586

    Alcolombri, U., Ben-Dor, S., Feldmesser, E., et al. 2015, Science, 348, 1466, doi: 10.1126/science.aab1586

    work page doi:10.1126/science.aab1586 2015

  2. [2]

    2019, ApJL, 887, L14, doi: 10.3847/2041-8213/ab59dc

    Benneke, B., Wong, I., Piaulet, C., et al. 2019, ApJL, 887, L14, doi: 10.3847/2041-8213/ab59dc

    doi:10.3847/2041-8213/ab59dc 2019

  3. [3]

    2014, A&A, 564, A125, doi: 10.1051/0004-6361/201322971

    Buchner, J., Georgakakis, A., Nandra, K., et al. 2014, A&A, 564, A125, doi: 10.1051/0004-6361/201322971

    doi:10.1051/0004-6361/201322971 2014

  4. [4]

    2019, A&A, 621, A49, doi: 10.1051/0004-6361/201833995

    Cloutier, R., Astudillo-Defru, N., Doyon, R., et al. 2019, A&A, 621, A49, doi: 10.1051/0004-6361/201833995

    doi:10.1051/0004-6361/201833995 2019

  5. [5]

    P., & Bridges, M

    Feroz, F., Hobson, M. P., & Bridges, M. 2009, MNRAS, 398, 1601, doi: 10.1111/j.1365-2966.2009.14548.x JWST Transiting Exoplanet Community Early Release Science Team, Ahrer, E.-M., Alderson, L., et al. 2023, Nature, 614, 649, doi: 10.1038/s41586-022-05269-w

    arXiv 2009

  6. [6]

    New Constraints on DMS and DMDS in the Atmosphere of K2-18 b from JWST MIRI

    Madhusudhan, N., Constantinou, S., Holmberg, M., et al. 2025, arXiv e-prints, arXiv:2504.12267, doi: 10.48550/arXiv.2504.12267

    work page Pith review arXiv doi:10.48550/arxiv.2504.12267 2025

  7. [7]

    Madhusudhan, N., Piette, A. A. A., & Constantinou, S. 2021, ApJ, 918, 1, doi: 10.3847/1538-4357/abfd9c

    doi:10.3847/1538-4357/abfd9c 2021

  8. [8]

    2023, ApJL, 956, L13, doi: 10.3847/2041-8213/acf577

    Madhusudhan, N., Sarkar, S., Constantinou, S., et al. 2023, ApJL, 956, L13, doi: 10.3847/2041-8213/acf577

    doi:10.3847/2041-8213/acf577 2023

Show all 16 references
  1. [9]

    M., MacDonald, R

    May, E. M., MacDonald, R. J., Bennett, K. A., et al. 2023, ApJL, 959, L9, doi: 10.3847/2041-8213/ad054f

    2023 doi

  2. [10]

    P., MacDonald, R

    Schmidt, S. P., MacDonald, R. J., Tsai, S.-M., et al. 2025, arXiv e-prints, arXiv:2501.18477, doi: 10.48550/arXiv.2501.18477

    2025 doi arXiv

  3. [11]

    J., G¨ unther, M

    Seager, S., Petkowski, J. J., G¨ unther, M. N., et al. 2021, Universe, 7, 172, doi: 10.3390/universe7060172

    2021 doi

  4. [12]

    Petkowski, J. J. 2025, arXiv e-prints, arXiv:2504.12946, doi: 10.48550/arXiv.2504.12946

    2025 doi

  5. [13]

    Bower, D. J. 2024, ApJL, 962, L8, doi: 10.3847/2041-8213/ad206e

    2024 doi

  6. [14]

    2008, Contemporary Physics, 49, 71, doi: 10.1080/00107510802066753

    Trotta, R. 2008, Contemporary Physics, 49, 71, doi: 10.1080/00107510802066753

    2008 doi

  7. [15]

    F., & Schwieterman, E

    Tsai, S.-M., Innes, H., Wogan, N. F., & Schwieterman, E. W. 2024, ApJL, 966, L24, doi: 10.3847/2041-8213/ad3801

    2024 doi

  8. [16]

    F., Batalha, N

    Wogan, N. F., Batalha, N. E., Zahnle, K. J., et al. 2024, ApJL, 963, L7, doi: 10.3847/2041-8213/ad2616

    2024 doi

Pith tools

Reviewed August 16, 2026 · model on record in the stance chip above.