{"id":"927c92cf-b551-43ef-b9f9-d71c0c0c9daf","arxiv_id":"2506.15475","paper_version":2,"verdict":"CONDITIONAL","confidence":"HIGH","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":8,"one_line_summary":"SDSS-V defines five data collection scenarios whose observing and fiber assignment parameters allow the survey to be planned algorithmically while meeting data quality targets.","lead":"SDSS-V plans observations by giving its robotic fiber system a fixed set of rules for which targets, calibrators, and sky positions can share a field. This paper spells out the five observing scenarios and the archival and on-sky tests that set those rules.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The PSF-based offsets and bright-star exclusion radii rest on plate-era wing data and a handful of core fits with no quoted uncertainties; Section 4.1.4 shows the core was recalibrated once operations began, so the abstract's 'guarantee' of data quality is less secure than the evidence supports.","rationale":"The reader's weakest_assumption is the same one I identify. The paper is a transparent operational specification: it provides parameter tables, open-source validation tooling, a large archival sample for the PSF wings, and an honest account of the core recalibration and non-enforced FOV metrics. Those are real independent supports. Still, the abstract's 'guaranteeing data quality' is not derivable from the shown evidence because the PSF model enters every design through bright-star exclusion and every offset target through the Moffat core. The wing sample is large (57,183 spectra) but comes from a different optical system; the core sample is tiny and had to be recalibrated once already. A single FPS-era test of the PSF model at both observatories, using the same SPECTROFLUX-CALIBFLUX technique, would settle whether the concern lands. Since this is a residual-uncertainty issue rather than a demonstrated failure, the CONDITIONAL verdict stands; no change is needed.","tokens_in":28707,"tokens_out":5626,"duration_ms":55808,"concrete_test":"Recompute Figure 11 using only SDSS-V FPS-era spectra (DR19/DR20, MJD>59000): select sky or science fibers within 90 arcsec of V_T<12 Tycho-2 stars, compute median SPECTROFLUX-CALIBFLUX as a function of separation, and compare with Eqs. 4-5 and the Table 4 Moffat profiles at both APO and LCO. If the FPS-era medians agree within the plate-era scatter, the PSF-based constraints are supported; if they deviate by more than roughly 0.5 mag in any separation bin, exclusion radii and offsets are biased and the data-quality guarantee is not yet established.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The load-bearing assumption is that the PSF model used for fiber offsets (Section 4.1) and bright-star avoidance (Section 4.2) is accurate enough to enforce the designmode bright limits on every design. That model has two weakly supported parts. First, the wing relations (Eqs. 4-5) are fit to archival BOSS/eBOSS plate data taken with a different corrector and plug-plate system; Section 4.1.1 says this is expected to be a good approximation for SDSS-V, but no FPS-era wing verification is presented, and azimuthal structure around bright stars is ignored. Second, the core Moffat profiles are fit to two APO test nights and one LCO test night (Section 4.1.2) with no quoted uncertainties on FWHM or beta, and Section 4.1.4 reports that the initial core model had to be recalibrated using science observations because bright offset targets received too little flux. The updated profiles vary strongly with observatory and lunation (Table 4: APO bright FWHM=0.5'', beta=1.6 versus APO dark FWHM=1.4'', beta=1.9). If the wing or core profiles are biased in unobserved conditions, exclusion radii and offsets are wrong: faint science fibers can sit inside a bright star's contamination radius, or bright targets can be over-offset and lost. Either outcome breaks the abstract's guarantee of data quality. The paper honestly reports the recalibration and the scatter, but it does not bound the residual PSF error, so the guarantee is stronger than the evidence.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper describes the parameter framework used to constrain robotic fiber positioning for SDSS-V's Focal Plane System (FPS). The authors define five data collection scenarios (Bright Time, Dark Plane, Dark Monitoring, Dark RM, Dark Faint), each with obsmode parameters specifying observing conditions and designmode parameters specifying calibration requirements and fiber assignment restrictions. They explain how each parameter value was chosen, drawing on archival SDSS/eBOSS plate data, FPS commissioning observations, and past survey experience, and they present the PSF modeling work used to implement deliberate fiber offsets for bright targets and bright-star exclusion radii. The paper also describes the software ecosystem (robostrategy, coordio, kaiju, mugatu), reports validation statistics for the zeta-3 survey plan, and discusses cases where constraints are not enforced or are weakly correlated with data quality. The central claim is that these parameters allow algorithmic survey planning that maximizes science output while guaranteeing data quality throughout SDSS-V operations.","tokens_in":29046,"tokens_out":6307,"duration_ms":60067,"significance":"If the claimed guarantee held, this paper would be a valuable reference both for SDSS-V users constructing the survey selection function and for future robotic multi-object spectroscopic surveys. The manuscript's strengths are its explicit tabulation of parameters, the empirical basis for most choices, the honest reporting of constraints that are not enforced or not tightly correlated with data quality (e.g., BOSS FOV metrics in §3.2.2 and Table 5), and its public software artifacts. However, the abstract's 'guarantee' is not fully supported by the evidence: the PSF-based offsets and bright-star exclusion radii, which are load-bearing for data quality, rest on plate-era wing fits and a small number of core fits with no uncertainty quantification, and §4.1.4 shows that a recalibration was needed after operations began. These concerns are correctness risks rather than internal inconsistencies, and they are addressable with additional analysis or a more qualified claim.","major_comments":[{"comment":"The PSF wing model used for bright-star avoidance and offsets is fit to archival BOSS/eBOSS plate data taken with a different corrector and plug-plate system at APO. The paper states that this is expected to be a good approximation for SDSS-V, but no FPS-era verification of the wing shape is presented, and azimuthal structure around bright stars is explicitly ignored. Because §4.2 computes exclusion radii from these wings without a safety factor, a wing bias directly translates into incorrect bright limits for faint fibers. I request either an FPS-era wing check (e.g., using residuals of sky fibers near bright stars in actual FPS data) or a quantitative bound on the wing model error and its propagation into exclusion radii.","section":"§4.1.1, Eqs. (4)–(5); Table 4"},{"comment":"The Moffat core parameters are fitted to only two APO test nights and one LCO test night, with no quoted uncertainties on FWHM or beta. Section 4.1.4 reports that the initial eta-series model had to be recalibrated using science observations because bright offset targets received too little flux; Table 4 shows the APO bright-time FWHM changing from 1.7\" to 0.5\" between the eta and theta series, a factor greater than 3. Such a large recalibration demonstrates that the model uncertainty was substantial, and the current values are presented without error bars. Since offsets and exclusion radii are monotonic functions of these parameters, the abstract's guarantee of data quality is stronger than the evidence supports. Please provide uncertainty estimates or a sensitivity analysis showing that residual PSF errors keep offset targets below the bright limits and correctly place faint fibers.","section":"§4.1.2, §4.1.4; Table 4"},{"comment":"Offsets are always applied in the positive RA direction rather than perpendicular to the parallactic angle, in order to avoid collisions. The paper notes that this is 'often close to the desired direction' but does not quantify the chromatic effects from atmospheric differential refraction. For a bright target offset from fiber center, differential refraction over a 15-minute exposure will produce a wavelength-dependent displacement, potentially causing differential light loss that degrades the spectrophotometric accuracy that Dark Monitoring and Dark RM are designed to preserve. I ask for an estimate of the magnitude of this effect over the survey's airmass and exposure-time ranges, or an explicit argument that it is negligible.","section":"§4.1.3"}],"minor_comments":[{"comment":"The phrase 'the addition of the FPS facilities an increase' should read 'facilitates an increase'.","section":"Abstract"},{"comment":"'Their is a balance' should be 'There is a balance'.","section":"§2.3"},{"comment":"In the description of the FOV metric, 'distance id calculated' should be 'distance is calculated'.","section":"§3.2.2"},{"comment":"The phrase 'within 90” of the a Tycho-2 star' contains a duplicated article; it should be 'the Tycho-2 star'.","section":"§4.1.1"},{"comment":"The sentence 'we do account for these at the time of fiber placement' appears to mean 'we do not account for these', because the text explains that conditions are stochastic and designs are planned ahead of time; please clarify.","section":"§4.1.2"},{"comment":"'to unsure the science requirements' should be 'to ensure the science requirements'.","section":"§4.2"},{"comment":"The checkmark symbols indicating whether offsetting was allowed render as blank spaces in the provided text; please verify they appear correctly in the published version.","section":"Table 4 and Figures 14–15"}],"recommendation":"major_revision","confidential_remarks":"The paper is within the scope of an astronomical instrumentation/methods journal and the empirical parameter framework is genuinely useful, especially for selection-function modeling and for future robotic MOS surveys. The main risk is that the abstract overclaims a 'guarantee' of data quality when the PSF-model uncertainty is unquantified and a post-commissioning recalibration was already necessary. This is fixable by adding uncertainty analysis or softening the claim, so I recommend major revision rather than rejection. I would also encourage the authors to make the PSF fitting data and fit residuals available to support reproducibility."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"The paper deserves peer review, but with one clear caveat: the abstract says the parameters \"guarantee data quality throughout its operation,\" and that is stronger than the evidence supports. The body is actually more careful than the abstract. It honestly reports pass rates, admits when constraints are not enforced (BOSS FOV metrics pass only ~30-50% of designs), and describes a PSF-core recalibration after science operations began. That honesty is the paper's best feature.\n\nWhat is actually new: the obsmode/designmode parameter tables (Tables 2 and 3), the empirical PSF wing relations and Moffat core fits for APO and LCO (Eqs. 2-5, Table 4), the offset safety factors, and the validation statistics from mugatu. None of that appears in the cited prior literature. The general idea of constraining robotic fiber placement is not new, but this is the first detailed specification for SDSS-V and it will be the reference for the SDSS-V selection function. That alone makes it worth publishing.\n\nThe soft spot is Section 4.1, and the stress-test note is mostly right about it. The PSF core fits come from two APO nights and one LCO night, with no quoted uncertainties on FWHM or beta. The wing fits use plate-era BOSS/eBOSS data with a different corrector and plug-plate system. Section 4.1.4 shows the initial core model was biased for bright targets and had to be recalibrated. That is exactly the kind of check you want to see, but it also proves the model was not initially reliable in survey conditions. The paper does not bound residual PSF error for unobserved conditions. The safety factor and the ongoing recalibration loop mitigate the practical risk, so the central framework claim survives, but the abstract's guarantee does not.\n\nThe circularity concern is minor. The parameters are fitted to data and validated against designs that obey the same parameters; that is empirical specification, not a derived physical claim, and the paper is upfront about what is hand-tuned.\n\nBottom line: this is a solid operational paper with a real weak spot that is clearly disclosed. It should go to peer review. I would cite it if working on survey planning or selection-function modeling, and I would bring it to a reading group focused on survey operations.","headline":"Worth a serious referee: the parameter tables and validation statistics are genuinely useful, and the honest reporting outweighs the soft spots, but the abstract overpromises on the PSF fits.","tokens_in":29705,"tokens_out":1361,"would_cite":true,"duration_ms":14876,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"SDSS-V's robotic fiber placement can be constrained by two parameter tables so that the entire survey, roughly 42,000 designs, is planned algorithmically while data quality is guaranteed.","keywords":["robotic fiber positioning","SDSS-V","Focal Plane System","spectroscopic survey planning","observing constraints","bright star avoidance","fiber offsets","survey selection function"],"falsifier":"Measure the flux recovered through offset fibers for bright stars over a range of seeing, airmass, and lunar illumination and compare it with the piecewise Moffat-plus-wing prediction; if systematic deviations exceed the 0.5 to 1.0 magnitude safety factor, or if the Moffat parameters must be re-derived again after another season of operations, the claimed survey-wide quality guarantee fails.","tokens_in":28498,"feed_emoji":"🔭","tokens_out":6607,"duration_ms":59802,"temperature":0.7,"pith_summary":"The paper claims that SDSS-V's robotic fiber positioning can be constrained by two small parameter sets, observing-condition limits (obsmode) and fiber-assignment rules (designmode), chosen so that the survey can assign all roughly 42,000 designs algorithmically without per-design human inspection while still delivering the spectrophotometric quality, sky subtraction, and contamination control each science program needs. The values are set empirically from archival BOSS/eBOSS plate data and FPS commissioning tests, including deliberate fiber offsets from bright stars so that targets brighter than the detector's linearity limit can still be observed. If right, it means a very large, multi-program spectroscopic survey can be scheduled entirely by software, and the same constraint framework transfers to other robotic multiplexed spectrographs.","feed_headline":"Two parameter tables let SDSS-V plan 42,000 fiber layouts by algorithm","feed_subtitle":"Sky and fiber-assignment rules replace hand inspection, and bright stars get deliberately offset fibers.","key_machinery":"The load-bearing mechanism is the pairing of obsmode and designmode parameter sets, each bound to a data collection scenario. obsmode tells the scheduler when a Design may be observed; designmode tells the assignment software which fibers may be placed where: minimum sky and standard counts, a focal-plane distribution metric computed as the 95th percentile distance from each science fiber to its k-th nearest calibrator, per-band magnitude floors and ceilings, and exclusion radii around bright stars derived from piecewise PSF fits (Moffat core profiles plus linear transition and wing relations). Offsets for bright targets are computed by inverting the PSF magnitude-loss functions, with safety factors of 0.5 in bright time and 1.0 in dark time.","core_discovery":"SDSS-V organizes all observations into five data collection scenarios, Bright Time, Dark Plane, Dark Monitoring, Dark RM, and Dark Faint, each with a named obsmode (minimum lunar separation, sky-brightness limit via the Krisciunas-Schaefer $\\Delta V$, twilight angle, maximum airmass) and designmode (minimum sky and standard-star fiber counts, their required distribution across the focal plane via a nearest-neighbor metric, per-band magnitude limits, and bright-star exclusion radii). The paper's central empirical claim is that these parameter values, fixed by archival plate tests and commissioning observations, are sufficient to guarantee reduced-data quality across the survey: calibration-fiber counts at the tested levels keep spectrophotometric errors at 0.5 to 3 percent, magnitude limits keep on-chip contamination below the faintest target flux, and the PSF-wing plus Moffat-core models allow safe fiber offsets and bright-star avoidance. The consequence is that the survey planning and validation software can check every Design algorithmically, with more than 99 percent of Designs passing all non-FOV criteria in the zeta-3 plan, so the survey no longer requires the human visual inspection that plug-plate surveys demanded.","pith_inferences":["If the framework is right, the key transferable insight is separating 'when may we observe' from 'where may fibers go', and the empirical calibration step, archival plus commissioning tests, replaces human plate inspection in any multiplexed robotic-fiber survey.","A testable extension would turn the sky and standard FOV metrics into a continuous loss function for assignment optimization rather than a pass/fail threshold, potentially recovering more science fibers in crowded fields.","The paper's own recalibration of the PSF between the eta and theta survey-plan series implies the quality guarantee depends on periodic re-derivation; one could quantify how often recalibration is needed as a function of season and airmass and fold that into the survey plan."],"forward_implications":["SDSS-V can produce and validate a full survey plan of about 42,000 Designs in roughly 95 CPU hours, with no per-design human inspection.","Programs with different science needs can share a field because the dominant program's data collection scenario fixes the constraints for the whole Design, with only mixed-cadence fields allowed to split between dark and bright scenarios.","Bright targets down to about $G = 6$ in bright time and $G = 13$ in dark time become observable through offset fibers, while no targets brighter than those thresholds will be observed.","The designmode parameters define hard limits of the SDSS-V selection function, so any model of the survey's selection function must incorporate them as strict observability boundaries.","The same two-table constraint framework can serve as a template for other robotic-fiber spectroscopic surveys."],"supporting_citations":[{"why":"Provides the $\\Delta V$ sky-brightness framework that defines the obsmode minimum sky-brightness limits.","marker":"Krisciunas & Schaefer (1991)"},{"why":"Supplies the eBOSS plate data used as a proxy to set BOSS calibrator counts through masked-calibrator reduction tests.","marker":"Dawson et al. (2016)"},{"why":"Archival BOSS/eBOSS data source for the PSF wing analysis via CALIBFLUX versus SPECTROFLUX comparisons.","marker":"Ahumada et al. (2020)"},{"why":"APOGEE-1 commissioning experience that set the 35 sky-fiber minimum, 15 telluric standards, and the $H > 7$ bright limit.","marker":"Zasowski et al. (2013)"},{"why":"Describes the FPS hardware, including the 500 robotic positioners and the fiber spacing that grounds the patrol, collision, and bright-neighbor separation constraints.","marker":"Pogge et al. (2020)"},{"why":"Supplies the kaiju collision-free path planning software that enforces physical reachability and collision constraints during assignment.","marker":"Sayres et al. (2021)"},{"why":"Describes robostrategy, the survey planning software that applies the obsmode and designmode constraints when creating Designs.","marker":"Blanton et al. (2025)"},{"why":"Defines SDSS-V targeting and calibration-target selection, the catalog inputs that the designmode magnitude and count requirements act on.","marker":"Almeida et al. (2023)"},{"why":"Provides the magnitude transformation used to place Tycho-2 bright stars on the Gaia system for bright-star exclusion radii.","marker":"Evans et al. (2018)"}],"fun_headline_variants":["SDSS-V uses five data scenarios to auto-constrain fiber placements","Algorithmic fiber positioning replaces hand inspection for SDSS-V","SDSS-V's parameter tables let robots place fibers without human checks","Five obsmode and designmode sets fence in SDSS-V fiber placements"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The point-spread function models that set bright-star exclusion radii and fiber offsets were derived from plate-era data taken with a different corrector and from a few test nights, with no quoted uncertainties, so if those PSF shapes do not generalize to real survey conditions, the brightness limits, offsets, and exclusion radii will misplace flux and the data-quality guarantee collapses.","fun_headline_variants_meta":{"raw":{"variants":["SDSS-V uses five data scenarios to auto-constrain fiber placements","Algorithmic fiber positioning replaces hand inspection for SDSS-V","SDSS-V's parameter tables let robots place fibers without human checks","Five obsmode and designmode sets fence in SDSS-V fiber placements"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000249,"raw_usage":{"total_tokens":1609,"prompt_tokens":1062,"completion_tokens":547,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":678,"completion_tokens_details":{"reasoning_tokens":471}},"tokens_in":678,"tokens_out":547,"duration_ms":5195,"temperature":1.0,"reasoning_tokens":471,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-15T19:34:15.495280+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Measure the flux recovered through offset fibers for bright stars over a range of seeing, airmass, and lunar illumination and compare it with the piecewise Moffat-plus-wing prediction; if systematic deviations exceed the 0.5 to 1.0 magnitude safety factor, or if the Moffat parameters must be re-derived again after another season of operations, the claimed survey-wide quality guarantee fails.","supporting_citations":[{"cited_title":"W., Derwent, M","cited_arxiv_id":null,"evidence_quote":"Describes the FPS hardware, including the 500 robotic positioners and the fiber spacing that grounds the patrol, collision, and bright-neighbor separation constraints."}],"review_version":2}