{"id":"e039a724-13fd-497c-99ee-51290f30edc2","arxiv_id":"2412.10508","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":7.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":6,"one_line_summary":"MOCKA, a new end-to-end simulation catalogue for the PLATO mission, predicts that the dominant gravity-mode frequency of gamma Doradus and SPB stars will be recovered in more than 95% of simulated cases within its chosen magnitude limits.","lead":"This paper simulates what Europe's PLATO space telescope will see when it studies pulsating stars that are more massive or more evolved than the Sun. It predicts that the dominant brightness-oscillation frequency of two classes of gravity-mode pulsators, gamma Doradus and SPB stars, will be recovered in more than 95% of cases within the studied brightness ranges.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The >95% recovery headline is partly a design choice and partly an input assumption: the G=14/16 limits were chosen at the ~95% recovery contour, and the SPB amplitude distribution rests on only 26 Kepler stars.","rationale":"The paper is a careful, transparent simulation benchmark; the realistic PlatoSim pipeline, the public data products, and the unusually candid limitation statements are genuine strengths, and credit should be given for those. The central claim is not internally inconsistent: it is true of the simulations by construction and under the stated assumptions. The load-bearing uncertainty is external validity, and the reader's weakest_assumption correctly identifies the amplitude distribution as the key bridge to reality. I would sharpen that concern: because the G limits were chosen at the ~95% recovery contour in Appendix C, the headline 95% number is not a discovered result but a calibration target, which raises the stakes on the amplitude distribution. The paper's own high-amplitude batch demonstrates the sensitivity, and the 26-star SPB sample is a small statistical base. A direct re-run with Hey & Aerts (2024) distributions would settle whether the forecast survives a plausible alternative input. If that test passes, the conditional can be relaxed on this axis; if it fails, the abstract and conclusions need reframing. Since the reader's conditional verdict already includes quantifying the amplitude-distribution dependence and making the circular Pmax design explicit, my read does not change the recommended verdict.","tokens_in":44955,"tokens_out":6498,"duration_ms":65232,"concrete_test":"Re-run the Affogato and Cortado SPB and gamma Dor batches with the mode amplitude (and frequency) distributions fit to the TESS/Gaia sample of Hey & Aerts (2024), keeping all other MOCKA settings fixed, and recompute the recovery-rate-versus-G curves. If the magnitude at which >95% recovery occurs moves by more than about 0.5 mag from G=14 (gamma Dor) or G=16 (SPB), or if recovery falls below 95% at those magnitudes, the headline claim does not generalise across plausible amplitude distributions.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The headline >95% figure is not an independent simulation outcome. Appendix C states that the detection limit is defined as the magnitude where more than 95% of the injected amplitudes can be recovered, and that 'this limit is used to define the limiting simulated magnitude'. The G <= 14 and G <= 16 boundaries are therefore chosen, within the same simulation framework, to sit at the ~95% recovery contour for the injected log-normal amplitude distributions. This circularity means the abstract's external claim reduces to a property of the injected pulsation model. That model is the weakest load-bearing link: the gamma Dor distribution comes from 611 Kepler stars (Li et al. 2020) and the SPB distribution from only 26 Kepler stars (Pedersen et al. 2021, Sect. 4.1.2), with Kepler selection biases and a passband conversion to PLATO. The authors concede in Sect. 7 that the 'exact underlying amplitude distribution ... plays a key role', and their own high-amplitude SPB batch (Fig. 15) changes where the detection plateau lies. If the true LOPS2 populations have lower amplitudes, or a different amplitude distribution shape, as Hey & Aerts (2024) suggest for the dominant modes, the 95% magnitude thresholds and recovery rates will shift. The claim is therefore conditionally true for the simulated inputs, but not yet established for the real survey.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper presents MOCKA, an end-to-end PlatoSim simulation catalogue for PLATO's LOPS2 field, focusing on gravity-mode pulsators (gamma Doradus and SPB stars) among eight variability classes. The authors construct a Gaia DR3-based target catalogue, inject oscillation-mode models with log-normal amplitude distributions calibrated to Kepler samples, simulate three noise scenarios (Affogato, Cortado, Doppio), reduce the light curves with a custom pipeline, and extract frequencies with an iterative prewhitening method. The headline result is that within the simulated magnitude limits (G ≲ 14 for gamma Dor and G ≲ 16 for SPB) the dominant g-mode frequency is recovered in more than 95% of cases under both expected and degraded spacecraft systematics. The paper also reports mode occurrence rates, amplitude and frequency precision, and the impact of stellar contamination.","tokens_in":45276,"tokens_out":7385,"duration_ms":73969,"significance":"If the central yield claim holds, this is a valuable quantitative benchmark for the PLATO-CS program: it suggests that bright gamma Dor and SPB stars in LOPS2 will yield recoverable dominant g-mode frequencies and enable period-spacing pattern studies. The study's strengths are its realistic pixel-level end-to-end simulations, the explicit three-batch comparison of spacecraft systematics and contamination, the public data products, the careful passband and apodization corrections, and the analysis of SNR stopping criteria. The main caveat is that the headline recovery fractions are conditional on assumed Kepler-based amplitude distributions and on magnitude limits that are themselves defined at the ~95% recovery contour, so the external predictive power for the real LOPS2 population is not fully established.","major_comments":[{"comment":"The limiting magnitudes P = 14 and P = 16 are not independent mission constraints: Appendix C defines the detection limit as the magnitude at which more than 95% of the injected log-normal amplitudes can be recovered, and §3.1 states that each detection-magnitude threshold was set using this noise budget. The abstract then presents the >95% dominant-mode recovery within these same magnitude limits as the paper's headline result. The recovery fractions in §6.1 (98.9% and 95.8% for gamma Dor; 98.2% and 95.4% for SPB) are therefore partly a design criterion rather than an independent simulation prediction. This is not fully circular, because the criterion concerns all injected amplitudes while the headline concerns the dominant mode, but the threshold choice still removes much of the risk that the headline could fail. Please reframe the claim as conditional on the assumed input amplitude distributions and on Pmax being chosen by this 95% recovery criterion, or fix the magnitude limits a priori and let the recovery fraction be a genuine output.","section":"§3.1, Appendix C, Abstract"},{"comment":"The SPB mode amplitude distribution is fitted to only 26 Kepler stars (Pedersen et al. 2021), and §7 concedes that 'the exact underlying amplitude distribution that will be observed plays a key role in how many modes can be detected.' This sensitivity is visible in the paper's own high-amplitude SPB test batch (Fig. 15), which changes the location of the detectability plateau by about a magnitude. The reported recovery rates (98.2% for Affogato and 95.4% for Cortado) are thus tied to a specific small-sample input. Please quantify the dominant-mode recovery fractions for the high-amplitude batch and/or provide a sensitivity analysis over plausible amplitude distributions, so that the abstract's numerical claim is explicitly attached to a stated input assumption rather than to a single Kepler-based sample.","section":"§4.1.2, Fig. 15, §7"},{"comment":"The target catalogue is restricted to presumed single stars: binaries are excluded via the Gaia reduced unit weight error cut, and the text states 'we only intend to simulate targets as if they are all single stars.' Since the abstract frames the >95% recovery as a statement about gamma Dor and SPB stars in the LOPS2 field, and massive SPB stars have a high multiplicity fraction, the yield may not apply to the full population. Please either include a binary-dilution test (e.g., injecting companions at representative flux ratios and separations) or state explicitly in the abstract and conclusions that the headline applies only to a single-star subsample. As written, the LOPS2 population-level claim goes beyond the simulated sample.","section":"§3.1"}],"minor_comments":[{"comment":"There are several typographical and grammatical errors: 'SPB stars are are high-order' in §4.1.2, 'catagorised' in §4.2.5, 'unset' in Appendix C (should be 'onset'), and 'interferences' in §5.5 (likely 'inferences').","section":"§4.1.2, §4.2.5, §5.5, Appendix C"},{"comment":"Table 1 lists the gamma Doradus spectral type as 'F4-F0'; this range is conventionally written F0-F4 and should be corrected for consistency with the text's 'late-A to early-F' description.","section":"Table 1, §4.1.1"},{"comment":"The batch name 'Cortado' is typeset as 'C ortado' in several places (e.g., Section 2 and the figure captions); please standardize the formatting of the batch names.","section":"§2 and throughout"},{"comment":"The note that 'blue indicates the most desirable result' in Fig. 17 inverts the color convention used in most other figures; please add explicit color-bar labels to all panels and clarify the convention in the caption.","section":"Fig. 17"},{"comment":"The sentence 'We recover 98.9% and 95.8% for the gamma Dor sample and 98.2% and 95.4% for the SPB sample as per simulation batch Affogato and Cortado, respectively' is ambiguous; please state explicitly which batch corresponds to each pair of numbers.","section":"§6.1"}],"recommendation":"major_revision","confidential_remarks":"This is a strong and useful simulation catalogue paper that fits A&A well, and the public data products are a community resource. My main concern is that the abstract's headline >95% recovery figure is presented as a prediction when it is partly determined by the choice of the magnitude limits and strongly dependent on the small-sample Kepler amplitude distributions. The authors can address this with a clear conditional framing and a sensitivity analysis. I see no issues with novelty disclosure or citation practices."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Bottom line: this is a useful, honestly-reported benchmark paper, but the headline >95% number is less of an independent prediction than the abstract implies. The magnitude limits (G<14 for gamma Dor, G<16 for SPB) are defined in Appendix C as the ranges where more than 95% of injected amplitudes are recoverable from the noise budget, so the headline partly reflects a design choice. That said, the full simulation does validate that the pipeline achieves the predicted recovery, so it is a consistency check that passes, not an empty tautology.\n\nWhat is genuinely new: the first end-to-end pixel-level mock catalogue for PLATO g-mode pulsators across eight classes, with realistic systematics (Affogato, Cortado, Doppio batches), contaminants, data gaps, and cadences. The SNR significance surfaces for PLATO cadences (Eq. 9) are a practical tool, and the public catalogue will be a useful resource for Guest Observer proposers. The paper is transparent: they test a high-amplitude SPB batch (Fig. 15), explicitly acknowledge in Sect. 7 that the underlying amplitude distribution plays a key role, and use a custom detrending pipeline they expect to be worse than the official one, which is conservative.\n\nThe soft spots, in proportion: the main load-bearing input is the injected amplitude distribution. The SPB distribution comes from only 26 Kepler stars, the gamma Dor from 611, with Kepler selection biases and a passband conversion. If the true LOPS2 populations differ, as Hey & Aerts (2024) suggest may be the case, the recovery rates and limiting magnitudes will shift. The authors know this and say so. The circularity is real but moderate: because Pmax is set at the 95% recovery contour, the abstract's claim should be read as 'within the regimes where the simulations were designed to recover 95%'. That framing should be explicit in the abstract. Also, recovery rates are quoted without uncertainties, and binarity is excluded from targets.\n\nWho the paper is for: PLATO-CS planners, Guest Observer proposers, and anyone building yield estimates for g-mode asteroseismology. The catalogue and SNR surfaces are concrete deliverables. It deserves serious peer review, with conditions attached: quantify sensitivity to alternative amplitude distributions, state uncertainties on recovery rates, and make the circular framing of Pmax explicit in the abstract.","headline":"Useful, honest PLATO g-mode yield benchmark; the >95% headline is real within the simulated regimes, but those regimes were chosen at the 95% recovery contour and the amplitude inputs are the main uncertainty.","tokens_in":45900,"tokens_out":2429,"would_cite":true,"duration_ms":24297,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"End-to-end simulations of PLATO's first southern field recover the dominant g-mode frequency in more than 95% of bright gamma Doradus and SPB stars, under both expected and degraded spacecraft noise.","keywords":["asteroseismology","gravity-mode pulsators","PLATO","space photometry","gamma Doradus stars","slowly pulsating B stars","mock catalogue","period-spacing patterns"],"falsifier":"Re-run the MOCKA pipeline with SPB and gamma Doradus mode amplitudes drawn from the full TESS+Gaia amplitude distribution of Hey & Aerts (2024) instead of the Kepler log-normal fits, and check whether the dominant-mode recovery rate stays above 95% for $G \\lesssim 16$ SPB stars and $G \\lesssim 14$ gamma Doradus stars under Cortado systematics; if it falls below 95%, the headline claim does not survive a realistic population shift.","tokens_in":44735,"feed_emoji":"🔭","tokens_out":7794,"duration_ms":68048,"temperature":0.7,"pith_summary":"This paper argues that PLATO's complementary-science program will be a working asteroseismic observatory for gravity-mode pulsators, not just a planet hunter. The authors build MOCKA, a simulated catalogue of intermediate- and massive-star pulsators in PLATO's first southern pointing field (LOPS2), and run realistic end-to-end pixel-level simulations of two-year observations. Their central quantitative claim is that the dominant g-mode frequency of a gamma Doradus star brighter than $G \\lesssim 14$ and of an SPB star brighter than $G \\lesssim 16$ is recovered in more than 95% of cases under both the expected and the degraded spacecraft-noise scenario. A sympathetic reader cares because those recovered modes are the basis of period-spacing patterns, the main tool for probing near-core rotation, chemical mixing, and angular-momentum transport in intermediate-mass stars.","feed_headline":"PLATO will recover dominant g-mode frequencies for >95% of bright pulsators","feed_subtitle":"End-to-end simulations of the LOPS2 field predict period-spacing patterns for thousands of gamma Dor and SPB stars.","key_machinery":"The load-bearing machinery is the MOCKA end-to-end simulation chain. A magnitude-limited Gaia DR3 catalogue of the LOPS2 field supplies potential targets; for each pulsation class, synthetic light curves are generated from empirically calibrated oscillation-mode models, with gamma Doradus modes built from the period-spacing pattern formalism of Li et al. (2020) and SPB modes from the 26-star Kepler sample of Pedersen et al. (2021). These signals are injected at pixel level with PlatoSim into multi-camera images that include pointing jitter, thermo-elastic distortion, readout noise, cosmic rays, realistic data gaps, and, in one batch, variable contaminating stars. Detection proceeds by iterative prewhitening with a false-alarm-calibrated SNR stopping criterion, and the recovery rate of the injected dominant mode is the metric that translates the mission noise budget into scientific yield.","core_discovery":"The paper's claim is that, for the first time, PLATO's ability to detect and recover oscillation modes of main-sequence g-mode pulsators is demonstrated quantitatively. Using the MOCKA catalogue, the authors report dominant-frequency recovery rates of 98.9% (Affogato, expected systematics) and 95.8% (Cortado, degraded systematics) for gamma Doradus stars, and 98.2% and 95.4% for SPB stars, within the magnitude-limited simulated regimes. They also claim that an increased spacecraft noise budget degrades g-mode recovery more than contamination by variable stars, that stellar pollution below roughly a 6% third-light ratio leaves amplitude precision acceptable while frequency precision stays almost unaffected, and that recovered frequency precisions of order $10^{-4}\\,\\mathrm{d}^{-1}$ lie well below the $10^{-3}\\,\\mathrm{d}^{-1}$ required for forward asteroseismic modelling.","pith_inferences":["If the true gamma Doradus and SPB amplitude distributions actually match the TESS/Gaia results of Hey & Aerts (2024), the paper's own high-amplitude batch suggests the detectability plateau would extend to about $P \\sim 13$, so the 95% recovery claim would likely hold or improve in the bright regime but could shift in detail.","The SNR significance surfaces computed here for PLATO cadences could be transferred to TESS and future space photometry missions; the result that the classical SNR $=4$ threshold is too optimistic for continuous space-based data is a general caution, not a PLATO-specific one.","Because hybrid g-mode plus p-mode pulsators were deliberately excluded, the real LOPS2 yield may differ from MOCKA's for stars crossing both instability regions; extending the catalogue to hybrids would test whether the greater than 95% dominant-mode recovery carries over."],"forward_implications":["Within LOPS2, the recovery rates imply that period-spacing pattern construction will be feasible for a large fraction of bright gamma Doradus and SPB stars, including many of the 1455 pure g-mode and 1449 hybrid pulsators already identified in the field.","The difference between expected and degraded spacecraft noise corresponds to roughly one magnitude of brightness: reaching the same photometric precision with degraded noise requires targets about one magnitude brighter, mostly in the regime $9 < P < 13$.","If stellar pollution is kept below about 6% third-light, contaminating light does not dominate the noise budget; above that threshold amplitude precision degrades sharply while frequency precision remains nearly unaffected.","Recovered frequency precisions around or below $10^{-4}\\,\\mathrm{d}^{-1}$ are well inside the $10^{-3}\\,\\mathrm{d}^{-1}$ needed for forward asteroseismic modelling of high-order g modes, so the simulated catalogue yields seismically usable mode lists."],"supporting_citations":[{"why":"Supplies PlatoSim and PLATOnium, the pixel-level camera and mission simulator that generates the simulated light curves.","marker":"Jannsen et al. (2024)"},{"why":"Supplies the Kepler gamma Doradus star sample and the period-spacing formalism used to draw mode periods, spacings, and amplitudes for injected gamma Doradus signals.","marker":"Li et al. (2020)"},{"why":"Supplies the 26-star Kepler SPB sample whose mode amplitude and spacing distributions seed the SPB injection models.","marker":"Pedersen et al. (2021)"},{"why":"Supplies the alternative TESS/Gaia amplitude distribution used for the high-amplitude batch and motivates the caveat on amplitude representativeness.","marker":"Hey & Aerts (2024)"},{"why":"Supplies the light-curve generation formalism and the period-spacing gradient model for injected g modes.","marker":"Van Reeth et al. (2015)"},{"why":"Supplies the method for computing SNR significance criterion surfaces used in the frequency extraction.","marker":"Baran & Koen (2021)"},{"why":"Supplies the optimal aperture mask algorithm used to define on-board photometry and the stellar pollution ratio (SPR).","marker":"Marchiori et al. (2019)"},{"why":"Supplies STARSHADOW, the iterative prewhitening software used for frequency extraction and mode matching.","marker":"IJspeert et al. (2024)"}],"fun_headline_variants":["PLATO mock catalogue predicts >95% g-mode recovery for bright stars","MOCKA simulates PLATO's gravity-mode yield, hitting >95% detection","Simulated PLATO data show high g-mode detection for gamma Dor and SPB stars","PLATO mock catalogue: g-mode frequencies recovered in over 95% of cases","MOCKA forecasts high g-mode detection for PLATO's first field"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The injected pulsation amplitude distributions, especially the SPB distribution fitted to only 26 Kepler stars, match what PLATO will actually see in the LOPS2 field; the authors themselves note that the exact amplitude distribution plays a key role in how many modes can be detected.","fun_headline_variants_meta":{"raw":{"variants":["PLATO mock catalogue predicts >95% g-mode recovery for bright stars","MOCKA simulates PLATO's gravity-mode yield, hitting >95% detection","Simulated PLATO data show high g-mode detection for gamma Dor and SPB stars","PLATO mock catalogue: g-mode frequencies recovered in over 95% of cases","MOCKA forecasts high g-mode detection for PLATO's first field"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.001254,"raw_usage":{"total_tokens":5240,"prompt_tokens":1149,"completion_tokens":4091,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":765,"completion_tokens_details":{"reasoning_tokens":3987}},"tokens_in":765,"tokens_out":4091,"duration_ms":25818,"temperature":1.0,"reasoning_tokens":3987,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-11T15:54:15.324981+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Re-run the MOCKA pipeline with SPB and gamma Doradus mode amplitudes drawn from the full TESS+Gaia amplitude distribution of Hey & Aerts (2024) instead of the Kepler log-normal fits, and check whether the dominant-mode recovery rate stays above 95% for $G \\lesssim 16$ SPB stars and $G \\lesssim 14$ gamma Doradus stars under Cortado systematics; if it falls below 95%, the headline claim does not survive a realistic population shift.","supporting_citations":[{"cited_title":"2015, , 574, A17","cited_arxiv_id":null,"evidence_quote":"Supplies the light-curve generation formalism and the period-spacing gradient model for injected g modes."}],"review_version":1}