{"id":"031c3179-7dde-4a69-8a87-5e7f373bc314","arxiv_id":"2412.04438","paper_version":3,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":4.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":3,"one_line_summary":"Single-star exoplanet systems with planet-to-star mass ratios above roughly 2e-3 are preferentially spin-orbit aligned, even for hot stars, suggesting a primordial formation boundary.","lead":"Planets that are very massive relative to their host stars tend to orbit in line with the star's spin, even around hot stars, a 3.7-sigma pattern seen in 135 single-star systems. The paper adds a new spin-orbit measurement of the main outlier, XO-3, and argues the alignment is set at birth rather than by tides.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The 3.7-sigma significance is inflated by in-sample boundary selection; a permutation test over the mass-ratio threshold is needed before the headline claim is accepted.","rationale":"The reader's weakest_assumption was binary contamination, but the paper's own handling of XO-3 (removing it as a likely binary would increase the significance to 4.1 sigma) means binary contamination among the aligned systems would need to act in a specific direction to destroy the trend. The in-sample boundary selection is more directly load-bearing: the headline 3.7-sigma is the quantitative evidence for the central claim, and it is computed on the same data used to choose the mass-ratio split. This is a textbook look-elsewhere problem. The paper's AD-scan boundary search is not corrected for multiple comparisons, and the bootstrap significance is conditional on the optimized split. The consistency with Albrecht et al. (2022) is reassuring but does not remove the double use of the data in the current significance calculation. A permutation test that repeats the entire selection procedure would settle whether the 3.7-sigma survives. The NEID measurement of XO-3 is independent, careful, and consistent with prior work, so the observational core is solid; the concern is specifically about the population-level statistical claim. This supports the reader's CONDITIONAL verdict: accept with the requirement of a corrected significance, or at least a fixed-boundary analysis.","tokens_in":23954,"tokens_out":8178,"duration_ms":88568,"concrete_test":"Perform a permutation test over the full hot-star sample (or all 135 systems): randomly reassign Mp/M* values to the observed |lambda| measurements (preserving the set of obliquities), repeat the entire Section 5 procedure—AD scan for the best boundary and the 100,000-draw bootstrap at that boundary—and record the maximum significance. The fraction of permutations yielding a significance at least as large as the observed 3.7 sigma is the look-elsewhere-corrected p-value. Also report the significance with the boundary fixed at 2e-3 without scanning; if the fixed-boundary significance is much lower, the headline overstates the evidence.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central quantitative claim, the 3.7-sigma alignment of high-Mp/M* hot-star systems (Section 6), is an in-sample statistic. In Section 5 the authors scan the boundary in Mp/M* between 10^-4 and 10^-1, select the threshold maximizing the Anderson-Darling separation (giving 0.0021 for hot stars), and then use that same optimized threshold to define the 14 'high-ratio' systems and run the bootstrap that yields 3.7 sigma. This double use of the data—selecting the boundary and then testing the difference at the selected boundary—introduces a look-elsewhere effect that the paper does not correct for. Agreement with the 2e-3 boundary proposed by Albrecht et al. (2022) mitigates but does not eliminate the problem, because the significance numbers in this paper are computed from the same sample that determined the boundary, and the bootstrap draws are made conditional on that optimized split. A corrected significance could be materially below 3 sigma.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper reports a new NEID Rossiter-McLaughlin and Doppler-tomography measurement of the XO-3 system, yielding a sky-projected spin-orbit angle lambda = 41.8+2.1/-2.0 degrees, consistent with the most precise previous measurements within 1.3 sigma. The authors then compile a sample of 135 single-star systems with stellar obliquity measurements, separate them by host-star temperature, and use Anderson-Darling tests to locate a mass-ratio boundary between aligned and misaligned systems (2.7e-4 for cool stars, 2.1e-3 for hot stars). The central population claim is that hot-star systems with Mp/M* >= 2e-3 are preferentially aligned, with a reported significance of 3.7 sigma, and that XO-3 is the only outlier; the paper interprets this as primordial alignment and connects the boundary to the gap-opening mass. Section 5 also identifies the hot-star boundary by scanning the Anderson-Darling statistic over mass-ratio thresholds, which is the main statistical concern addressed in this report.","tokens_in":24057,"tokens_out":5827,"duration_ms":61165,"significance":"If the population trend is real, it would sharpen the empirical case for a mass-ratio boundary in spin-orbit alignment, extending earlier tentative findings to hot stars and providing a quantitative target for formation models. The new XO-3 measurement is a strength: it is modeled with four distinct data combinations, includes convergence diagnostics, and agrees with prior high-precision values, making the misalignment of XO-3 robust unless an unseen companion is present. The paper also makes good use of public catalogs and standard modeling tools. However, the headline 3.7-sigma significance is computed after the same dataset is used to select the mass-ratio boundary, so it is not an independent significance level; this is a load-bearing issue that requires a corrected statistical treatment or a confirmatory framing. The treatment of XO-3 as a single-star system despite its elevated Gaia RUWE also needs to be reconciled with the sample-selection criteria.","major_comments":[{"comment":"The 3.7-sigma significance for the alignment of hot-star, high-Mp/M* systems is an in-sample statistic. The authors scan the Anderson-Darling statistic over Mp/M* values from 1e-4 to 1e-1, select the boundary that maximizes the separation (0.0021 for hot stars), and then use that same optimized boundary to define the 14 high-ratio systems and run the 100,000-iteration bootstrap that yields 3.7 sigma. This double use of the data introduces a look-elsewhere effect: the quoted significance does not account for the fact that the threshold was chosen on the same data. The paper should either report a significance that properly corrects for the threshold search (for example, a permutation test that maximizes the test statistic over all candidate boundaries and compares the observed maximum with the null distribution of maxima) or treat Mp/M* = 2e-3 as a pre-specified boundary motivated by Albrecht et al. (2022) and clearly state that the 3.7-sigma result is conditional on that prior choice. As written, the abstract and Section 6 overstate the evidence.","section":"Section 5, 'Empirical boundary' and 'Statistical significance'"},{"comment":"The sample-construction paragraph states that systems containing binary or multiple stars are excluded, but XO-3 is retained in the single-star sample even though its Gaia RUWE of 1.25 is cited by the authors themselves as a strong indicator of an unresolved stellar companion. This is internally inconsistent and directly affects the 'only outlier' claim. Moreover, the 14 hot-star systems with Mp/M* >= 2e-3 are not screened for RUWE or other companion indicators, so the observed alignment could be affected by unresolved binaries rather than being a property of dynamically isolated planets. The authors should list the RUWE values and companion-search status for all 14 systems, rerun the population analysis after excluding systems with RUWE > 1.2 (or with any companion indicator), and report the resulting significance and outlier set. This is a concrete, testable request and is directly relevant to the paper's interpretation.","section":"Section 5, 'Sample construction' and 'XO-3: Exception'"},{"comment":"The paper derives two different mass-ratio boundaries: 2.7e-4 for cool stars and 2.1e-3 for hot stars, yet the abstract and the final interpretive paragraphs repeatedly refer to a single empirical boundary of Mp/M* = 2e-3 and connect it to the gap-opening mass. The lower cool-star boundary is attributed to tidal damping, but the text should explicitly state that the 2e-3 boundary is the hot-star boundary and clarify whether the two boundaries are expected to be the same physical quantity at different stellar temperatures or separate phenomena. This is important for the interpretation of the gap-opening-mass scenario, which is presented as one of the main implications.","section":"Section 5, 'Empirical boundary' and Section 6, 'Summary and implications'"}],"minor_comments":[{"comment":"The sentence 'The boundary value was varied logarithmically from 1e-4 to 1e-1 with a step size of 0.001' is ambiguous: it should specify whether the step is 0.001 in log10(Mp/M*) or in linear Mp/M*. The later fit of the distribution of best boundaries with a Gaussian profile should also be justified; a percentile interval would be more robust for a skewed distribution.","section":"Section 5, 'Empirical boundary'"},{"comment":"For the cool-star sample, the statement that '97.8% of the resultant p-values are less than 0.05' is not itself a p-value; the authors should report the median p-value and the fraction of Monte Carlo realizations with p < 0.05, and should avoid the phrase 'strongly rejecting the null hypothesis' based solely on that fraction.","section":"Section 5, 'Statistical significance'"},{"comment":"The caption contains a typo ('plant-to-star mass ratio') and the arrows labeled 1, 2, and 3 are not defined in the caption, making the intended dynamical scenarios difficult to follow without reading the main text.","section":"Figure 2 caption"},{"comment":"The paper would benefit from a formal data-availability statement listing the compiled 135-system sample and the code used for the Anderson-Darling and bootstrap analyses; the current link in the Figure 2 caption is not a stable repository citation.","section":"Data availability"},{"comment":"The four data-combination fits are presented in Table 2, but the text does not explicitly compare the inferred lambda values across the four fits; a sentence summarizing the agreement (e.g., the range of lambda values and their uncertainties) would help the reader assess the robustness of the adopted value.","section":"Table 2"}],"recommendation":"major_revision","confidential_remarks":"The new XO-3 measurement appears carefully done and the agreement with previous values is reassuring. The main obstacle is the statistical procedure in Section 5: the 3.7-sigma significance is obtained after optimizing the mass-ratio boundary on the same data, so a multiple-testing correction or a confirmatory re-analysis using the Albrecht et al. (2022) boundary as pre-specified is needed before the headline claim is accepted. I would also encourage the editor to ask for RUWE screening of the 14 hot-star high-mass-ratio systems, since the treatment of XO-3 is currently inconsistent with the sample-selection criteria. The paper's scope is appropriate for the journal and the result is potentially interesting, but the corrected significance could be materially weaker, so major revision is appropriate."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"First thing you should know: the headline 3.7σ is not an independent significance. Section 5 scans the Mp/M* boundary between 1e-4 and 1e-1, selects the split that maximizes the Anderson-Darling separation, and then uses that same optimized split to define the 14 high-ratio hot-star systems and run the bootstrap. That is a look-elsewhere effect, and the corrected significance could easily fall below 3σ. The paper does not address this. Agreement with Albrecht et al.'s 2e-3 boundary helps, but it does not repair the in-sample statistic.\n\nThe trend itself is not new. Hebrard, Triaud, Albrecht, Hixenbaugh, and Gan all reported alignment in high-Mp/M* systems, and the paper says so. What is new is a larger 135-system sample and a fresh NEID Rossiter-McLaughlin/Doppler tomography measurement of XO-3 giving λ = 41.8+2.1/−2.0 degrees. That measurement looks careful: four data combinations, consistent with prior values within 1.3σ, and the global modeling is thorough. The paper also gets credit for honestly discussing XO-3's RUWE of 1.25 and the possibility that it hides an unresolved stellar companion.\n\nThe soft spots, in proportion: first, the in-sample boundary selection is the main quantitative flaw. Second, the single-star classification is only as good as the absence of detected companions. For the 14 hot-star high-ratio systems, that is mostly nondetection, and XO-3 shows the risk; if unresolved binaries are lurking, the alignment could be binary-driven rather than primordial. Third, the dynamical-isolation interpretation is plausible but speculative, and the paper presents it as a suggestion rather than a proof, which is fair. Minor: the data link in the figure caption is not present in the text, and the same compiled sample is used both to define and to test the empirical boundary.\n\nBottom line: the XO-3 measurement is publishable on its own, and the compiled sample is a useful community resource. But the paper should not present the 3.7σ as headline strength without a permutation test over thresholds or a pre-registered boundary. I would send it to review, with a clear request for that correction and for a table documenting companion-search status for the 14 hot-star high-ratio systems.","headline":"The XO-3 NEID measurement is solid and the compiled sample is useful, but the headline 3.7-sigma significance comes from picking the mass-ratio boundary on the same data and then testing it, so the number is not as strong as advertised.","tokens_in":24734,"tokens_out":1997,"would_cite":true,"duration_ms":78801,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Single-star systems with planet-to-star mass ratios at or above 0.002 tend to be spin-orbit aligned even around hot stars, a 3.7-sigma effect whose only misaligned outlier, XO-3, may be a hidden binary.","keywords":["stellar obliquity","spin-orbit alignment","hot Jupiters","brown dwarf companions","planet-to-star mass ratio","Rossiter-McLaughlin effect","Doppler tomography","XO-3"],"falsifier":"Apply high-contrast imaging and the next astrometric data release to all 14 hot-star single-star systems with $M_{\\rm p}/M_{\\ast}\\geq 2\\times10^{-3}$: resolving XO-3's suspected companion would strengthen the trend, resolving companions around several of the 13 aligned systems would break the single-star premise, and newly discovered single-star high-ratio systems with $|\\lambda|>10^\\circ$ would weaken the claimed $3.7\\sigma$ alignment.","tokens_in":23671,"feed_emoji":"🪐","tokens_out":14736,"duration_ms":128121,"temperature":0.7,"pith_summary":"Using obliquity measurements for 135 single-star systems, the paper finds that systems with planet-to-star mass ratio $M_{\\rm p}/M_{\\ast} \\geq 2\\times10^{-3}$ — super-Jupiters, brown-dwarf companions, and Jupiters around M dwarfs — tend to be aligned even when the host star is hot ($T_{\\rm eff} \\geq 6100$ K), where tidal realignment is expected to be weak. The contrast with the lower-mass-ratio population around hot stars is a $3.7\\sigma$ effect. The paper adds a new in-transit measurement of the contested system XO-3, confirming its misalignment ($\\lambda = 41.8^{+2.1}_{-2.0}$ degrees) and making it the only known outlier; the system's elevated astrometric goodness-of-fit suggests an unresolved stellar companion that could explain it. If the pattern is real, the alignment of high-mass-ratio planets is primordial, and $M_{\\rm p}/M_{\\ast} = 2\\times10^{-3}$ marks an empirical boundary between a quiet, isolated formation channel and a compact, instability-prone one.","feed_headline":"Heavy planets stay aligned even around hot stars","feed_subtitle":"A 135-system survey finds planets heavier than 0.2% of their star stay spin-aligned at 3.7 sigma, with one possible hidden binary.","key_machinery":"The argument is carried by the empirical mass-ratio boundary $M_{\\rm p}/M_{\\ast}=2\\times10^{-3}$, located by scanning candidate thresholds and applying Anderson-Darling tests to the $|\\lambda|$ distributions of 135 single-star systems (64 hot, 71 cool), with noise injected on the measured obliquities and a bootstrap used to quantify the significance. On the measurement side, the new XO-3 obliquity comes from the Rossiter-McLaughlin effect (the Doppler shift of stellar lines during transit) and Doppler tomography (mapping the transiting body across the rotating stellar line profile), analyzed in a global photometric plus radial-velocity fit. The companion hypothesis for XO-3 is carried by the renormalized unit weight error, an astrometric goodness-of-fit statistic whose elevated value indicates a likely unresolved stellar companion.","core_discovery":"The central claim is that stellar obliquity in single-star exoplanet systems is ordered by planet-to-star mass ratio: systems with $M_{\\rm p}/M_{\\ast}\\geq 2\\times10^{-3}$ show low projected obliquities even around hot stars, whereas lower-ratio systems around the same stars display the full range of misalignment. Statistical comparison (Anderson-Darling tests plus bootstrap resampling) places the significance at $3.7\\sigma$; for the hot-star subsample the empirical boundary is $M_{\\rm p}/M_{\\ast}=0.0021^{+0.0006}_{-0.0008}$, and for cool stars it is $0.00027\\pm0.00002$. Earlier counterexamples in very hot stars turn out, on inspection, to be binaries or systems with only upper-limit masses. The newly collected Rossiter-McLaughlin and Doppler-tomography data for XO-3 give $\\lambda=41.8^{+2.1}_{-2.0}$ degrees, confirming it as the single genuine outlier among single-star high-ratio systems; its astrometric goodness-of-fit is poor enough that an unresolved companion is plausible, and confirming one would raise the significance to $4.1\\sigma$. Because hot stars cannot tidally realign such systems, the authors conclude the alignment is primordial.","pith_inferences":["Extension: if alignment is truly primordial and tied to isolation, high-ratio systems should show no correlation between obliquity and orbital eccentricity or period, while low-ratio systems should show misaligned planets preferentially on eccentric orbits; this can be checked with existing catalogs without new data.","Extension: the two empirical boundaries (cool stars at $\\sim3\\times10^{-4}$, hot stars at $\\sim2\\times10^{-3}$) suggest the controlling quantity may not be the raw planet-to-star ratio but something that scales with stellar or disk mass; comparing M-dwarf and A-star hosts at the same mass ratio would separate the two.","Editorial inference: XO-3-type cases may represent a hidden selection effect rather than a new physical mechanism—if misaligned high-ratio planets are preferentially removed from the sample by binary companions, the observed trend is amplified and the single-star population is more homogeneous than it appears."],"forward_implications":["Future obliquity surveys of transiting super-Jupiters and brown dwarfs around hot stars should find mostly aligned systems, so a misaligned high-ratio system becomes a candidate for an unseen stellar companion.","The mass-ratio boundary can serve as a formation diagnostic: systems above it formed in relative isolation, while systems below it were likely sculpted by dynamical instabilities in compact multi-planet configurations.","If epoch astrometry resolves a companion around XO-3, the exception disappears and the alignment trend's significance rises to $4.1\\sigma$; if companions are found around several of the other 13 aligned systems instead, the single-star sample is contaminated.","Tidal realignment need not be invoked for high-ratio planets, shifting the explanation of the hot-star temperature–obliquity relation toward initial conditions and formation environment.","The cool-star boundary at $M_{\\rm p}/M_{\\ast}\\sim3\\times10^{-4}$ predicts that sub-Saturns around cool stars remain misaligned because their tidal damping times are long, not because they formed misaligned."],"supporting_citations":[{"why":"Establishes the baseline temperature–obliquity pattern this paper revises: hot Jupiters around hot stars are often misaligned, around cool stars aligned.","marker":"Winn et al. 2010"},{"why":"Supplies the reference obliquity catalog and the prior mass-ratio trend that the paper re-tests with an expanded sample and stricter binary exclusion.","marker":"Albrecht et al. 2022"},{"why":"First noticed that planets heavier than about three Jupiter masses lack very high obliquities, the seed of the mass-ratio trend.","marker":"Hébrard et al. 2011"},{"why":"One of the high-precision XO-3 obliquity measurements against which the new result is checked for consistency.","marker":"Winn et al. 2009"},{"why":"Prior high-precision XO-3 obliquity measurement and the tentative radial-velocity trend that the new companion search revisits.","marker":"Hirano et al. 2011a"},{"why":"Source of the astrometric data and the renormalized unit weight error (RUWE = 1.25) that motivates the unresolved-companion hypothesis for XO-3.","marker":"Gaia Collaboration et al. 2023"},{"why":"Defines the sample-construction criteria (single stars, RM or Doppler-tomography measurements, no mass limits) used to build the 135-system population.","marker":"Wang et al. 2024"},{"why":"Supplies the theoretical gap-opening-mass limit used to interpret the empirical boundary as the maximum planet mass reachable in compact multi-planet systems.","marker":"Ginzburg & Chiang 2019"}],"fun_headline_variants":["Heavy planets stay aligned even around hot stars","Massive worlds align with hot stars at 3.7σ","Super-Jupiters and brown dwarfs keep spin alignment","Planets above 0.2% star mass show low obliquities","Alignment wins for planets with high mass ratios"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing assumption is that the systems classified as single-star really have no stellar companion: the sample removes known binaries and mass-limit systems, but for the 14 hot-star high-ratio systems it relies on the absence of detected companions, and XO-3 shows through its astrometric scatter that such a companion can hide.","fun_headline_variants_meta":{"raw":{"variants":["Heavy planets stay aligned even around hot stars","Massive worlds align with hot stars at 3.7σ","Super-Jupiters and brown dwarfs keep spin alignment","Planets above 0.2% star mass show low obliquities","Alignment wins for planets with high mass ratios"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000201,"raw_usage":{"total_tokens":1513,"prompt_tokens":1217,"completion_tokens":296,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":833,"completion_tokens_details":{"reasoning_tokens":214}},"tokens_in":833,"tokens_out":296,"duration_ms":3682,"temperature":1.0,"reasoning_tokens":214,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-11T21:23:26.406015+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Apply high-contrast imaging and the next astrometric data release to all 14 hot-star single-star systems with $M_{\\rm p}/M_{\\ast}\\geq 2\\times10^{-3}$: resolving XO-3's suspected companion would strengthen the trend, resolving companions around several of the 13 aligned systems would break the single-star premise, and newly discovered single-star high-ratio systems with $|\\lambda|>10^\\circ$ would weaken the claimed $3.7\\sigma$ alignment.","supporting_citations":[],"review_version":1}