{"id":"06d718c3-3e6a-4422-982b-167e9633f62c","arxiv_id":"2507.13817","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":2,"one_line_summary":"A statistical survey of 521 MMS crossings finds ion holes in 65% of shocks, implying the quasi-perpendicular bow shock is typically rippled and non-stationary.","lead":"Ion phase-space holes, signposts of ripples on Earth's bow shock, appear in 65% of 521 MMS crossings, and more often in slower crossings. The authors argue the quasi-perpendicular bow shock is usually non-stationary, with an estimated true occurrence near 90%.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The 65% occurrence statistic counts single closed contours as type-II ripple signatures, but the detector never validates the type-I/type-II symmetry distinction that Section 2 identifies as decisive.","rationale":"The reader's weakest-assumption analysis identified the same core issue: the automated detector does not explicitly validate the symmetry distinguishing type II from type I holes. My stress-test concurs and sharpens it by noting that the prevalence of single-PSH events makes this ambiguity directly load-bearing for the headline 65% statistic. The paper is otherwise well structured, uses a reasonable dataset from a published MMS shock database, and its statistical trends (e.g., P_H increasing with crossing time and with M_A) are internally consistent and physically plausible. However, the absence of any validation of the type-I/type-II classification—either through labelled examples, forward-model false-positive tests, or a symmetry metric—means the central occurrence rate is not yet established to the standard needed for a strong claim of 'predominantly non-stationary.' The reader's CONDITIONAL verdict is appropriate; my analysis does not move it, so I set verdict_should_be to UNCHANGED. The proposed concrete test would settle whether the concern lands: if synthetic stationary-shock crossings rarely produce closed contours, the detector is likely selective enough; if they frequently do, the occurrence rates need downward revision and the central claim weakens.","tokens_in":11368,"tokens_out":3404,"duration_ms":43062,"concrete_test":"Run the automated PSH detector on synthetic 1D reduced ion velocity distributions generated from a forward model of a spacecraft crossing a stationary (non-rippled) quasi-perpendicular shock, with realistic FPI 150 ms sampling and noise; measure the false-positive rate for single closed contours. If the detector reports type-II PSHs in a substantial fraction of such stationary crossings, the 65% statistic overstates non-stationarity. A complementary check on real data: have two independent experts classify a stratified random sample of ~50 detected single-PSH events as symmetric type-II or asymmetric type-I blind to the algorithm output, and compare with the detector's labels.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper's central claim—that Earth's quasi-perpendicular bow shock is predominantly non-stationary—rests on the automated identification of ion phase-space holes (PSHs) as type-II signatures of ripples. Section 2 argues that the critical difference between a stationary shock crossing (type I) and a non-stationary ripple crossing (type II) is that type II produces a symmetric, closed PSH while type I is asymmetric and 'open' on the upstream side. However, the automated detection procedure (steps 5–6) filters only on contour closedness, width (0.2–10 s), center location, and nestedness; it never measures or enforces the upstream/downstream symmetry that is the stated physical discriminator. A single closed contour from a stationary crossing—if it survives the openness filter because the local minimum happens to be bounded—would be counted as non-stationary. This matters because Figure 3c shows that most positive events have N_H = 1, so the type-I/type-II ambiguity directly inflates the 65% headline rate, and consequently the extrapolated ~90% true-occurrence estimate. No validation against manually labeled events, synthetic distributions, or an independent symmetry metric is provided, leaving the load-bearing classification unverified.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper analyzes 521 MMS burst-mode crossings of Earth's quasi-perpendicular bow shock to statistically determine how often the shock is non-stationary, using ion phase-space holes (PSHs) as the observational signature. An automated contour-based detector identifies at least one PSH in 65% of crossings; the detection rate rises with Alfvén Mach number and saturates near 70% for MA > 7, while the detectability strongly depends on the spacecraft-frame shock speed/crossing time. From the slowest crossings the authors extrapolate a true occurrence rate of roughly 90% and conclude that the quasi-perpendicular bow shock is predominantly non-stationary for MA > 3.","tokens_in":11647,"tokens_out":5480,"duration_ms":61211,"significance":"If the central claim holds, this is the first large statistical demonstration that rippling/non-stationarity is the typical state of Earth's quasi-perpendicular bow shock, with important implications for interpreting shock structure, ion reflection, and energy dissipation. The paper uses a large public MMS burst dataset, an automated procedure, and publicly available data/software, which are strengths. The main result, however, rests entirely on the automated PSH detector, whose physical selectivity for non-stationary (type II) signatures over stationary (type I) crossings is not validated. The paper also introduces a quantitative ~90% 'true occurrence' estimate without a formal detection-bias model. These issues make the current evidence suggestive rather than conclusive.","major_comments":[{"comment":"The automated detector does not operationalize the type I/type II symmetry distinction that Section 2 itself identifies as 'a critical difference.' The preceding text states that type I yields an asymmetric PSH that is open on the upstream side, while type II yields a symmetric closed PSH. Steps 5 and 6, however, filter only on contour closedness, width (0.2-10 s), center location, and nestedness; no measure of upstream/downstream symmetry or openness is computed. A single closed contour produced by a stationary crossing could therefore be counted as a type II event if it survives the 'open contour' removal after Gaussian smoothing and the chosen contour level. Since Figure 3c shows that most positive events have N_H = 1, this ambiguity directly affects the headline 65% occurrence rate and the conclusion that the bow shock is predominantly non-stationary. The paper provides no validation of the detector against manually labeled events or synthetic VDFs to quantify the false-positive rate. This is the load-bearing issue for the paper's central claim.","section":"Section 2, steps 5-6; Figure 3c"},{"comment":"The statement 'we estimate the occurrence rate of ion holes ... to be ~90%' is presented as a quantitative conclusion, but the paper offers no detection-efficiency model. The estimate is based on the behavior of P_H for the slowest moving shocks, yet no asymptotic value, functional fit, or confidence interval is given, and the text does not specify which bins in Figure 3d/e are used or how the 90% number is obtained. If this corrected rate is to appear in the abstract and conclusions, the authors must derive it from an explicit model of detection probability versus V_sh or Δt, with uncertainty propagation. As written, the 90% estimate is an unquantified extrapolation.","section":"Section 5; Figure 3d/3e"},{"comment":"The claim 'P_H = 0 for M_A < 3' is based on only five shocks, all from a single CME encounter (Graham et al., 2024; Graham & Khotyaintsev, 2025). These five events are not a random sample of the low-Mach-number bow shock population, and the binomial 95% confidence interval for 0 detections out of 5 spans roughly 0-52%. The text in Section 4 and Conclusion 4 states this as a definitive result ('P_H = 0 for M_A <3' and 'sharply increases for 3 < M_A < 7'). The authors should qualify the statement as based on five non-representative CME shocks and provide the confidence interval or omit the M_A<3 bin from the trend claim.","section":"Section 3, Figure 4b"}],"minor_comments":[{"comment":"The headline '65% of cases' should be accompanied by a confidence interval (e.g., the binomial 95% CI for n=521 is approximately 61-69%). This would also set a standard for the binned probabilities in Figures 3d-3g and 4.","section":"Abstract"},{"comment":"Step 5 lists two items labeled 'c)': 'remove contours that are too narrow' and 'remove contours that are too wide.' Renumber them (c) and (d) and renumber the subsequent conditions. Also, step 5e ('require that a contour is not isolated so that contours share at least two center points from all identified contours') is hard to parse; please reword to clarify whether a single PSH requires at least two nested contours sharing a center point.","section":"Section 2, step 5"},{"comment":"The manual selection of the crossing time is a potential source of bias. Please state whether the selection was performed before running the detector, whether the selector was blinded to the PSH count, and whether a second observer reproduced the selections for a subset of events.","section":"Section 2, step 3"},{"comment":"The white contour lines over the color plots are difficult to see in several panels. Increasing line width or using a contrasting color (e.g., black with white outline) would improve readability.","section":"Figure 2"},{"comment":"There are two Khotyaintsev et al. (2024) entries with identical author lists: one is the irfu-matlab software (Zenodo) and the other is the Physical Review Letters paper. Please disambiguate, e.g., as Khotyaintsev et al. (2024a) and (2024b) in the text and reference list.","section":"References"}],"recommendation":"major_revision","confidential_remarks":"The paper's detection thresholds and the interpretation of PSHs as ripple signatures come from the same group's prior case studies. This is not circular in a statistical sense, but it increases the risk of confirmation bias in the manual crossing-time selection and threshold choices. An independent validation set, ideally labeled by a different group or with synthetic VDFs, would substantially strengthen the paper. The 65% result is interesting and likely worth publishing after the classification validity is addressed; the 90% extrapolation should be either rigorously derived or removed."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Here's my honest take. The new thing is real: this is the first statistical census of ion phase-space holes (PSHs) across 521 quasi-perpendicular bow shock crossings, and it gives the field a number—65% of crossings show at least one hole, with occurrence up to 70% for MA>7 and a sharp rise across the subcritical-to-supercritical transition. The dependencies on shock speed and crossing time are exactly what you'd expect for a detection-limited signature, and the authors are careful to say the true rate may be higher. This is useful, well-posed work.\n\nThe paper is also honest about its limits: the extrapolation to ~90% is just 'based on the slowest-moving shocks,' not a fitted bias model, and the low-M_A bin has only five events. Those are minor caveats, not flaws.\n\nThe real soft spot is the type I/type II discrimination. The whole logic rests on the idea that a closed symmetric PSH is a ripple/reflection signature while a stationary crossing gives an open asymmetric hole. But the automated detector (steps 5–6) filters on contour closedness, width, and center sharing—it never measures symmetry. So a closed contour from a stationary crossing, if it survives the openness filter, is silently counted as non-stationary. The authors assert the difference in the text but don't validate the detector against synthetic phase-space distributions or manually labeled events. Since most positive crossings have N_H=1, this ambiguity could directly inflate the 65% headline rate. I don't think this sinks the paper—the physics argument is plausible and the slow-crossing trend supports the idea that holes are missed rather than overcounted—but it needs a direct test.\n\nVerdict: worth a serious referee. I'd send it out. A good referee should push for validation of the symmetry metric on a subset of events and for confidence intervals on the occurrence rates. If that comes back clean, this becomes a standard citation for shock non-stationarity statistics.","headline":"First solid statistical census of ion phase-space holes at the quasi-perpendicular bow shock, but the type I/II classification needs direct validation before the 65% rate is taken at face value.","tokens_in":12160,"tokens_out":2982,"would_cite":true,"duration_ms":34690,"reading_group":"yes","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Analyzing 521 crossings of Earth's quasi-perpendicular bow shock, this paper reports ion phase-space holes in 65% of crossings, with the rate corrected for fast crossings estimated near 90%.","keywords":["bow shock","collisionless shock non-stationarity","ion phase-space holes","shock ripples","Magnetospheric Multiscale","quasi-perpendicular shock","Mach number dependence"],"falsifier":"Take a random subset of the 521 crossings and have the contours blindly classified by symmetry, comparing how open the upstream side is with the downstream side against the automated routine's type labels; if most single-hole events are asymmetric, the 65% raw rate and the ~90% corrected estimate are inflated. Alternatively, run the detector on synthetic single-spacecraft crossings through a stationary shock in a particle-in-cell simulation with the same noise levels; if it produces comparable symmetric closed contours, the signature is not uniquely non-stationary.","tokens_in":11182,"feed_emoji":"🌊","tokens_out":8625,"duration_ms":86511,"temperature":0.7,"pith_summary":"This paper asks how often Earth's quasi-perpendicular bow shock is genuinely non-stationary, meaning its surface ripples and reforms, rather than a fixed structure. Analyzing 521 crossings by the Magnetospheric Multiscale mission, the authors detect ion phase-space holes, the observational signature of surface ripples, in 65% of crossings. Because slow shocks in the spacecraft frame reveal holes more readily, they estimate the true occurrence rate is near 90%. If correct, the result means a quasi-perpendicular bow shock at nominal solar-wind conditions is usually rippled, and spacecraft measurements of its ramp and foot must be interpreted as time-varying structures.","feed_headline":"Earth's bow shock is rippled in most crossings, survey finds","feed_subtitle":"Ion phase-space holes flag surface ripples in 65% of 521 crossings; the true rate may be near 90%.","key_machinery":"The carrier of the argument is an automated phase-space-hole detector applied to reduced one-dimensional ion velocity distributions. A phase-space hole is a local minimum in the velocity distribution along the shock normal, appearing as a closed contour; it forms between the incident and reflected ion populations near the reflection point. The method distinguishes a type-I hole, which a stationary shock would produce as a spacecraft crosses it once and which is open on the upstream side, from a type-II hole, which is a symmetric closed contour produced by the spacecraft's oscillating motion relative to a rippled shock surface. The detector keeps only closed contours that are not too narrow or wide, whose geometric center lies inside the contour, and that are shared with at least one nearby similarly shaped contour. Observing even one type-II hole is taken as evidence of non-stationarity, since a rippled surface lets the spacecraft cross the reflection point more than once.","core_discovery":"The central discovery is that non-stationarity is the rule, not the exception, for Earth's quasi-perpendicular bow shock. Phase-space holes, closed minima in the reduced ion velocity distribution along the shock normal, are found in 65% of the 521 crossings studied. The probability of seeing a hole rises with Alfvén Mach number for $3 \\lesssim M_A \\lesssim 7$ and saturates near 70% for $M_A > 7$; no clear dependence on shock angle $\\theta_{Bn}$, upstream speed, or upstream ion $\\beta$ is found. The fraction of crossings showing holes increases with the time the spacecraft spends in the shock, and for the slowest crossings, where detection is least biased, the occurrence is near 90%. The authors conclude that a quasi-perpendicular bow shock with $M_A > 3$ is typically non-stationary.","pith_inferences":["A clean test of the paper's mechanism would be to compare, on the same crossings, the $B_n$ oscillations that ripple theory predicts with the automated phase-space-hole detections; the paper notes this is left to case studies.","The same contour-based search applied to Solar Orbiter and Parker Solar Probe data on high-Mach interplanetary shocks could separate true stationarity from a crossing-speed artifact, since those shocks are often faster in the spacecraft frame.","If the ~90% rate holds, local ramp speed estimates from single spacecraft crossings will need to incorporate ripple-induced oscillations, which may change published scalings of electron heating at the bow shock.","The detector's fixed 0.2-10 second width window sets an implicit ripple scale; varying the window on synthetic crossings would show how much of the 65% is an instrument-cadence effect rather than a physical occurrence rate."],"forward_implications":["For $M_A > 3$ quasi-perpendicular bow shock crossings, the standard 'steady shock' interpretation should be abandoned in favor of a rippled, time-dependent surface.","Statistical shock surveys that rely on single crossings will undercount non-stationarity; only slow crossings or multi-spacecraft methods reveal it.","The ramp and foot thicknesses and the electron heating scales derived from single crossings mix spatial structure with temporal oscillations in the local shock speed.","Since phase-space-hole occurrence saturates at large $M_A$ and does not depend on $\\theta_{Bn}$, the ripple mechanism likely operates across the quasi-perpendicular bow shock regardless of position, flank or subsolar.","Interplanetary shocks moving fast in the spacecraft frame may ripple as well, but the holes would be missed; their apparent stationarity is not evidence against rippling."],"supporting_citations":[{"why":"First MMS observation linking ion phase-space holes to surface ripples at the quasi-perpendicular shock; establishes the PSH signature used throughout.","marker":"Johlander et al. (2016)"},{"why":"Characterizes ripple dispersive properties and shows multiple symmetric PSHs in a slow crossing, the type-II template the automated detector targets.","marker":"Johlander et al. (2018)"},{"why":"Provides the machine-learning-based MMS bow shock crossing database (2797 crossings) from which the 521 quasi-perpendicular, burst-mode cases are drawn.","marker":"Lalti et al. (2022)"},{"why":"The convolutional neural network that classifies MMS 3D ion distributions into solar wind, magnetosheath, foreshock, and magnetosphere, defining the crossings.","marker":"Olshevsky et al. (2021)"},{"why":"Supplies the method for converting shock crossing time and foot width into shock speed, used to show that PSH detection falls with increasing $V_{sh}$.","marker":"Gosling and Thomsen (1985)"},{"why":"Defines the nonlinear critical whistler Mach number $M_{nw}$ used to test whether the gradient-catastrophe reformation mechanism is required for PSHs.","marker":"Krasnoselskikh et al. (2002)"},{"why":"Describes the FPI-DIS instrument whose 150 ms 3D ion distributions are the raw data for the reduced velocity distributions.","marker":"Pollock et al. (2016)"},{"why":"Proposes the Alfvén ion cyclotron instability as the generator of ion-scale shock surface ripples, the physical non-stationarity mechanism.","marker":"Winske & Quest (1988)"}],"fun_headline_variants":["Non-stationary bow shock: the norm, not the exception","Bow shock is non-stationary in 65% of crossings","Most bow shock crossings are non-stationary","Non-stationarity dominates Earth's quasi-perpendicular bow shock","Survey: 65% of bow shock crossings show non-stationarity"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The whole estimate rests on the assumption that every closed contour the automated routine keeps is a symmetric type-II hole caused by a rippled shock surface, rather than an apparent hole created by a single traversal of a stationary shock.","fun_headline_variants_meta":{"raw":{"variants":["Non-stationary bow shock: the norm, not the exception","Bow shock is non-stationary in 65% of crossings","Most bow shock crossings are non-stationary","Non-stationarity dominates Earth's quasi-perpendicular bow shock","Survey: 65% of bow shock crossings show non-stationarity"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000974,"raw_usage":{"total_tokens":4086,"prompt_tokens":842,"completion_tokens":3244,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":458,"completion_tokens_details":{"reasoning_tokens":3157}},"tokens_in":458,"tokens_out":3244,"duration_ms":26273,"temperature":1.0,"reasoning_tokens":3157,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-06T16:15:45.923621+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Take a random subset of the 521 crossings and have the contours blindly classified by symmetry, comparing how open the upstream side is with the downstream side against the automated routine's type labels; if most single-hole events are asymmetric, the 65% raw rate and the ~90% corrected estimate are inflated. Alternatively, run the detector on synthetic single-spacecraft crossings through a stationary shock in a particle-in-cell simulation with the same noise levels; if it produces comparable symmetric closed contours, the signature is not uniquely non-stationary.","supporting_citations":[{"cited_title":"\\ Thomsen, M F","cited_arxiv_id":null,"evidence_quote":"Supplies the method for converting shock crossing time and foot width into shock speed, used to show that PSH detection falls with increasing $V_{sh}$."}],"review_version":1}