{"id":"94fbaa9a-9499-4529-9630-a2db5be5e8e7","arxiv_id":"2411.16836","paper_version":1,"verdict":"CONDITIONAL","confidence":"HIGH","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":5,"one_line_summary":"OrCAS presents a repeatable metric to select 26 sub-Neptune TESS planet candidates for precise mass measurement, along with uniform light-curve fits and statistical validation.","lead":"This paper defines the OrCAS radial-velocity survey, which will measure masses of 26 sub-Neptune exoplanets to support JWST and ARIEL atmospheric studies. It introduces a repeatable target-prioritization metric based on demographic under-representation, JWST transmission-spectroscopy metric, and estimated observing time.","discovery_kind":"new_method","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The t5σ estimate in Section 3.1 assumes a single-valued mass-radius power law, but sub-Neptune masses scatter by up to a factor of 5; if masses skew low, several targets may not reach a 5σ mass within the planned RV budget.","rationale":"The reader's weaker-assumption field identified the SUR proxy, but the more load-bearing uncertainty for the paper's strongest claim is the deterministic mass-radius relation used to compute t5σ. The strongest claim has four conjuncts: validated, unlikely false positive, good atmospheric prospects, and masses measurable with reasonable investment. The first two are supported by TRICERATOPS, high-resolution imaging, and ground-based photometry; the last two depend on assumed masses. Section 3.1 uses M_P = R_P^2.06 despite Section 2.2 acknowledging factor-of-5 scatter in sub-Neptune masses, and t5σ appears both in the prioritization metric and in the observing strategy. If masses skew low, K is smaller and t5σ grows quadratically, so several targets could require substantially more than the planned 30 RVs. The SUR proxy affects the demographic-representativeness motivation, which is not part of the quoted central claim; even a miscalibrated SUR would not invalidate the per-target sample properties. I therefore agree with the reader's conditional verdict and recommend keeping it unchanged pending the proposed mass-scatter stress test. The paper deserves credit for releasing reproducible code, providing transparent vetting, and performing a homogeneous light-curve analysis, all of which independently support the validation and TSM claims.","tokens_in":29486,"tokens_out":6769,"duration_ms":66677,"concrete_test":"Draw masses for the 26 targets from an empirical mass-radius relation with intrinsic scatter (e.g., Wolfgang et al. 2016 or Parviainen et al. 2024) and recompute K, σ1, and t5σ using the Section 3.1 noise model (KPF 0.5 m/s floor plus Yu et al. 2018 granulation/oscillation plus Galland et al. 2005 rotation). Report the fraction of targets whose required RV count exceeds 30 (or the stated per-target budget) under 1σ low-mass draws, and recompute TSM to count targets dropping below the TSM=30 threshold. As a calibration, compare predicted K from M=R^2.06 with the actual masses reported in Polanski et al. (2024) for the 13 overlapping systems. If roughly 20% or more of targets need more than the allocated budget, the claim should be softened.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The Conclusion's central claim (Section 6) promises 26 targets whose masses can be measured with a reasonable investment of observing time. The weakest load-bearing link is the mass used to estimate the RV semi-amplitude K and the required RV count. Section 3.1 assumes a single-valued power law M_P = R_P^2.06 (Earth units), then computes the minimum number of RVs as (5/(K/σ1))^2; this t5σ also enters the prioritization metric M in Eq. (1). Yet Section 2.2 itself states that sub-Neptune masses at fixed radius vary by up to a factor of 5 (Wolfgang et al. 2016; Otegi et al. 2020; Parviainen et al. 2024). If a target's true mass is at the low end, K is smaller, t5σ grows quadratically, and the planned ~30 RVs may not reach 5σ. The 'reasonable investment' claim, and secondarily the TSM≥30 filter (TSM scales roughly as M^{-1}), both rest on this deterministic relation rather than on the observed scatter. The SUR proxy raised by the reader is less central: an imperfect demographic weighting would weaken the representativeness goal, but it would not change the per-target feasibility and atmospheric-quality claims. This concern is testable rather than an internal inconsistency.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper presents the survey definition for OrCAS, an RV follow-up program targeting 26 TESS-discovered sub-Neptune candidates with the goal of providing precise masses for future JWST/ARIEL atmospheric characterization. The authors define a repeatable prioritization metric M = SUR × TSM / t5σ (Eq. 1), perform uniform TESS light-curve fits, carry out TRICERATOPS statistical validation, and report the resulting sample's stellar and planetary properties. The central claim, stated in the Conclusion (Section 6), is that the 26 targets are well-validated, unlikely to be false positives, promising for atmospheric spectroscopy, and amenable to mass measurement with a reasonable investment of observing time. The paper also releases code and electronic maps to reproduce the target selection.","tokens_in":29798,"tokens_out":9660,"duration_ms":87229,"significance":"If the sample holds up, the paper is a useful contribution to the small-planet characterization ecosystem: it provides a transparent, code-released prioritization scheme, a homogeneous set of transit fits and ephemerides, and a vetted target list for a high-impact RV program. The public code, electronic occurrence maps, and uniform TESS analysis are commendable and lower the barrier for future demographic studies. However, the headline claim about 'reasonable investment' of observing time depends on a single-valued mass-radius relation that the paper itself acknowledges is inconsistent with the observed factor-of-five scatter in sub-Neptune masses. Because that assumption enters the prioritization metric and the planned 30-RV floor, the central claim needs additional support before the paper can be accepted as is. No circularity issue is apparent: the metric is used for target selection, not to infer a physical result.","major_comments":[{"comment":"The 'reasonable investment' claim rests on t5σ = (5/(K/σ1))^2, computed from a single-valued power law M_p = R_p^2.06 in Earth units. Section 2.2 itself notes that sub-Neptune masses at fixed radius vary by up to a factor of 5 (Wolfgang et al. 2016; Otegi et al. 2020; Parviainen et al. 2024). Since K is approximately proportional to planet mass for these low-mass planets, t5σ scales roughly as M^-2, so a factor-of-2-to-5 lower true mass raises the required number of RVs by roughly 4 to 25 times. The manuscript does not propagate this scatter into the prioritization metric or into the 30-RV floor, and it does not report per-target t5σ values. Consequently, the concluding claim that these masses can be measured with a reasonable investment of observing time is not directly supported. Please recompute t5σ under optimistic and pessimistic mass assumptions (e.g., using the 16th and 84th percentile masses from the cited mass-radius studies), report the resulting RV counts per target, identify any targets requiring substantially more than 30 RVs, or soften the conclusion accordingly. Note also that a target whose true mass is higher than the power-law estimate could have TSM below the 30 threshold despite passing the filter, which affects the atmospheric-prospects claim.","section":"§3.1, Eq. (1)"},{"comment":"The Sub-neptune Under-representation Rate (SUR) is a multiplicative factor in the prioritization metric M (Eq. 1), but it is constructed from a self-made proxy for the intrinsic occurrence distribution rather than the original Fulton & Petigura (2018) period-radius distribution, which was unavailable from the authors. The manuscript discloses this in the paragraph beginning 'Since the underlying period-radius distribution from that work was not available...', but no cross-check against the original distribution or against alternative occurrence assumptions is given. Because SUR is used to weight the sample toward JWST-underrepresented planets, the 'demographically representative' framing is not quantitatively supported, even though this does not affect the per-target feasibility claims. Please add a robustness test (e.g., varying the CKS cuts or comparing against a published occurrence map) and report how the final rank ordering changes, or explicitly describe SUR as an illustrative weighting rather than a calibrated demographic correction.","section":"§3.1"},{"comment":"The conclusion describes the 26 targets as 'well-validated,' but Table 2 assigns 'Likely Planet' (LP) rather than 'Validated Planet' (VP) to six of the 26 selected candidates (TOI-1630.01, TOI-1716.01, TOI-1744.01, TOI-1768.01, TOI-1777.01, and TOI-2211.01). The aggregate FPP+NFPP of 0.17 supports 'unlikely to be false positives,' but it does not support 'well-validated' in the Giacalone et al. (2021) taxonomy. Please present the VP/LP breakdown in the conclusion or rephrase the sample description to match the reported validation dispositions.","section":"§6 and Table 2"}],"minor_comments":[{"comment":"There are several typographical errors: 'sup-Neptunes' in the Figure 2 caption, 'esimating' in §3.1, 'T able 1' and 'T able 2' in table environments, and 'This is paper is based' in the acknowledgments. These should be corrected in a final pass.","section":"Figure 2 caption and §3.1"},{"comment":"The sentence 'characterizing these properties is a key goal of Theme II (Sec. 2.4)' refers to Section 2.4, which is Theme IV (Stellar Activity), not Theme II (Internal Compositions). The theme number should be corrected.","section":"§5.1"},{"comment":"The statement that the total sum of FPP and NFPP across the sample is 0.17 treats false-positive probabilities as approximately additive; this is an informal aggregation and should be flagged as such, since FPP and NFPP are not strictly additive probabilities.","section":"§3.2"},{"comment":"The quantity t5σ is defined as a number of RV observations (5/(K/σ1))^2, but the text and Eq. (1) refer to it as 'the estimated time to measure a 5σ mass.' Please clarify the units and, if a time estimate is intended, describe how exposure times per observation are folded in.","section":"§3.1, Eq. (1)"},{"comment":"The transit light-curve fits are shown only as binned data with best-fit models; adding a residual panel or rms value for each system would help the reader assess the quality of the uniform fits.","section":"Figure 3"}],"recommendation":"major_revision","confidential_remarks":"This is a well-organized survey-definition paper with useful public software and data products. The main blocker is the mass-radius scatter issue in the t5σ calculation, which directly affects the central 'reasonable investment' claim. The SUR proxy is a stated limitation that should be tested or reframed. The 'well-validated' language also needs to be reconciled with the LP/VP dispositions. I see no citation or novelty concerns; the paper is within the journal's scope and should be revisable within a revision cycle."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Worth a read if you work on RV follow-up or sub-Neptune demographics. The genuinely new piece is the SUR-weighted metric M = SUR x TSM / t5sigma, which explicitly trades demographic under-representation against observing cost, and they ship public code for it. That is a real, reusable contribution. The target sample itself — 26 statistically vetted sub-Neptunes with uniform TESS light-curve fits, ground-based follow-up tabulated, FPP/NFPP sums kept low — is a useful resource for the community. The paper is transparent about its procedures and limitations, which counts for a lot.\n\nThe soft spot is the mass-radius handling. Section 3.1 estimates K and t5sigma from the single-valued relation M_P = R_P^2.06, but Section 2.2 itself notes that masses at fixed radius vary by up to a factor of five. Since t5sigma scales roughly as K^{-2}, a target sitting at the low-mass end of the scatter could need many more than the planned ~30 RVs to reach 5 sigma. That directly bears on the central claim that these 26 masses can be measured with a reasonable investment of observing time. It is not a fatal flaw — the paper hedges by saying they may gather more RVs for a subset — but the feasibility forecast is more optimistic than the known scatter justifies, and it should be stress-tested, e.g. by propagating the observed mass-radius scatter through the t5sigma calculation. The reader's concern about the SUR proxy is real but less central: an imperfect demographic weighting weakens the representativeness claim without changing per-target feasibility or atmospheric prospects. The 'Likely Planet' dispositions for a few targets are minor given the summed FPP is only 0.17.\n\nCitation practice looks honest; prior surveys (PFS, TKS, NCORES) are named and the novelty is scoped as a metric plus a validated sample, not a new physics claim. Overall the central argument holds: this is a well-executed survey definition that should enter the literature.","headline":"Solid survey-definition paper with a genuinely new prioritization metric; the per-target feasibility claim leans harder on a deterministic mass-radius relation than the paper acknowledges.","tokens_in":30664,"tokens_out":1623,"would_cite":true,"duration_ms":17795,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"A repeatable scorecard selects 26 sub-Neptunes whose masses are within reach and whose atmospheres JWST should study.","keywords":["sub-Neptune exoplanets","radial velocity mass measurement","TESS transit candidates","transmission spectroscopy","exoplanet target selection","statistical validation","JWST","planet occurrence"],"falsifier":"Recompute the prioritization using the original period-radius occurrence distribution and compare the resulting ranks; if a substantially different set of 26 targets emerges, or if the final sample's radius-period histogram no longer preferentially fills the JWST under-represented region, the demographic claim fails. Independently, if more than one or two of the 26 validated candidates are later shown to be false positives despite a summed FPP plus NFPP of 0.17, the statistical-validation claim is falsified.","tokens_in":1960,"feed_emoji":"🪐","tokens_out":1999,"duration_ms":83628,"temperature":0.7,"pith_summary":"The paper targets a specific bottleneck: JWST can characterize sub-Neptune atmospheres, but doing so requires a precisely measured planet mass, and the pool of suitable sub-Neptunes with 5-sigma masses is nearly exhausted. OrCAS is a radial-velocity survey that picks TESS planet candidates using a quantitative, repeatable metric, ranking them by how much they offset JWST's demographic bias, how detectable their atmospheres should be, and how cheaply their masses can be measured. Applying that metric as of September 2023, then vetting the top candidates with ground-based photometry, high-resolution imaging, and statistical validation, leaves a sample of 26 systems (31 known planets) with median radius near 2.5 Earth radii and median equilibrium temperature near 800 K. The paper's claim is that this sample is well-validated, unlikely to harbor false positives, promising for transmission spectroscopy, and mass-measurable with a reasonable investment of observing time. If the claim holds, these measurements keep the target pipeline flowing for atmospheric characterization of the most common type of known exoplanet.","feed_headline":"26 sub-Neptunes selected to fill JWST's biggest gap","feed_subtitle":"A repeatable score ranks TESS planets by demographic need, atmospheric promise, and the cost of a 5-sigma mass.","key_machinery":"The load-bearing object is the priority metric M = SUR(Rp, P) × TSM / t5σ. SUR is a two-dimensional map built by subtracting a kernel-density estimate of JWST Cycle 1–2 targets from a kernel-density estimate of the intrinsic occurrence distribution; t5σ is the estimated total observing time to reach a 5-sigma mass, derived from a single instrument's exposure-time calculator, an assumed 0.5 m/s noise floor, granulation and oscillation jitter, rotation jitter, and a power-law mass-radius relation. The metric is what makes the survey repeatable and minimally biased. Secondary machinery is the validation pipeline—TRICERATOPS false-positive probability runs on the TESS apertures and high-resolution imaging, plus uniform BATMAN transit fits to TESS photometry with emcee—which turns the top-ranked candidates into the final 26.","core_discovery":"The central discovery is a method and a vetted sample. The paper defines the Sub-neptune Under-representation Rate (SUR) as the difference between the intrinsic occurrence of short-period planets and the density of planets actually scheduled for JWST spectroscopy; the target priority M multiplies SUR by the transmission spectroscopy metric (TSM) and divides by the estimated time to reach a 5-sigma radial-velocity mass. The authors then apply this to all TESS Objects of Interest, reject candidates that imaging or photometry shows could be eclipsing binaries or background blends, validate the survivors with a false-positive probability calculation, and fit the TESS light curves uniformly. The resulting 26 systems span planet radii from 1.6 to 4.2 Earth radii, have a median estimated TSM of 56, and have a summed false-positive probability of about 0.17; the companion planets bring the total to 31. On the paper's terms, this is a sample deliberately constructed to correct the under-representation of temperate sub-Neptunes in JWST's target pool while keeping mass measurement costs manageable.","pith_inferences":["If the masses land as estimated, the homogeneous 1.6–4.2 Earth-radius sample will be a direct test of whether the rocky/icy/gaseous trichotomy seen for small planets around M dwarfs also holds for FGK hosts, because the selection is demographic rather than composition-based.","The SUR construction is sensitive to the choice of occurrence proxy, so the demographic weighting is an empirical hypothesis that updated or original occurrence catalogs can check.","The same metric could be re-run as JWST's target list evolves, or adapted for other missions, for example by replacing TSM with expected spectral information content, which would change the ranking for cloudy planets.","If several targets turn out to be false positives or need many more than 30 radial velocities, that would indicate the time estimator is optimistic; comparing planned versus actual observing cost per target would calibrate the metric for future surveys."],"forward_implications":["If the 26 masses reach at least 5-sigma significance, the sample roughly doubles the number of sub-Neptunes with precise masses that are good transmission-spectroscopy targets and are not already in JWST's Cycle 1–3 pool.","Because the selection metric is published as code and the SUR maps are available in electronic form, future candidates can be ranked the same way, so later mass-radius studies can account for the selection function.","The summed false-positive probability of 0.17 implies roughly one-in-six odds that a single target in the sample is not a real planet, so most of the 26 should survive as genuine sub-Neptunes.","A floor of 30 radial velocities per target guards against the known upward bias from stopping once 5-sigma is reached, so the reported masses should be less biased than early-terminated surveys.","If the survey succeeds, the sample's median 800 K equilibrium temperature puts many targets in the regime where aerosols are expected to be less prevalent, increasing the chance that JWST transmission spectra show molecular features."],"supporting_citations":[{"why":"Supplies the intrinsic period-radius occurrence distribution whose JWST under-representation the SUR map measures; the paper reconstructs a proxy in its absence.","marker":"Fulton & Petigura 2018"},{"why":"Defines the Transmission Spectroscopy Metric used in both the priority formula and the TSM >= 30 sample cut.","marker":"Kempton et al. 2018"},{"why":"Quantifies the mass precision needed for atmospheric retrievals, motivating the 5-sigma mass goal.","marker":"Batalha et al. 2019"},{"why":"Provides the TRICERATOPS false-positive and nearby-false-positive probabilities and the validated-planet disposition thresholds used to remove three TOIs.","marker":"Giacalone et al. 2021"},{"why":"Gives the single-valued mass-radius power law used to estimate radial-velocity semi-amplitude and therefore t5σ.","marker":"Lissauer et al. 2011"},{"why":"Shows that stopping radial-velocity campaigns once a significance threshold is reached biases masses upward, justifying the 30-RV minimum.","marker":"Burt et al. 2018"},{"why":"Supplies the granulation and oscillation noise model that enters the per-observation radial-velocity uncertainty in t5σ.","marker":"Yu et al. 2018"},{"why":"Supplies the stellar rotation jitter relation used to estimate per-observation radial-velocity noise.","marker":"Galland et al. 2005"},{"why":"Reports existing masses for 12 of the selected planets, all below 3.5 sigma, showing why the new spectrograph campaign is needed.","marker":"Polanski et al. 2024"}],"fun_headline_variants":["New metric picks 26 sub-Neptunes to fix JWST's blind spot","JWST's sub-Neptune drought: 26 planets chosen","Scorecard fixes JWST's sub-Neptune gap with 26 targets","OrCAS survey zeroes in on 26 sub-Neptunes for JWST"],"cache_read_input_tokens":32512,"weakest_assumption_plain":"The load-bearing premise is that the self-constructed proxy for the intrinsic occurrence distribution—built from a Kepler sample with fixed cuts on impact parameter, period, stellar radius, and temperature because the original period-radius distribution was unavailable—is close enough to the true occurrence rate that the SUR map correctly identifies which sub-Neptunes the JWST target pool most under-represents.","fun_headline_variants_meta":{"raw":{"variants":["New metric picks 26 sub-Neptunes to fix JWST's blind spot","JWST's sub-Neptune drought: 26 planets chosen","Scorecard fixes JWST's sub-Neptune gap with 26 targets","OrCAS survey zeroes in on 26 sub-Neptunes for JWST"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.001223,"raw_usage":{"total_tokens":5064,"prompt_tokens":1018,"completion_tokens":4046,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":634,"completion_tokens_details":{"reasoning_tokens":3963}},"tokens_in":634,"tokens_out":4046,"duration_ms":24970,"temperature":1.0,"reasoning_tokens":3963,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-12T12:48:55.589020+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Recompute the prioritization using the original period-radius occurrence distribution and compare the resulting ranks; if a substantially different set of 26 targets emerges, or if the final sample's radius-period histogram no longer preferentially fills the JWST under-represented region, the demographic claim fails. Independently, if more than one or two of the 26 validated candidates are later shown to be false positives despite a summed FPP plus NFPP of 0.17, the statistical-validation claim is falsified.","supporting_citations":[{"cited_title":"J., & Petigura , E","cited_arxiv_id":null,"evidence_quote":"Supplies the intrinsic period-radius occurrence distribution whose JWST under-representation the SUR map measures; the paper reconstructs a proxy in its absence."},{"cited_title":"D., Jensen , E","cited_arxiv_id":null,"evidence_quote":"Provides the TRICERATOPS false-positive and nearby-false-positive probabilities and the validated-planet disposition thresholds used to remove three TOIs."},{"cited_title":"J., Ragozzine , D., Fabrycky , D","cited_arxiv_id":null,"evidence_quote":"Gives the single-valued mass-radius power law used to estimate radial-velocity semi-amplitude and therefore t5σ."},{"cited_title":"2005, , 443, 337","cited_arxiv_id":null,"evidence_quote":"Supplies the stellar rotation jitter relation used to estimate per-observation radial-velocity noise."}],"review_version":1}