{"id":"b6821209-2375-408b-8249-91dfe15c4233","arxiv_id":"1909.02802","paper_version":1,"verdict":"UNVERDICTED","confidence":"HIGH","novelty_score":2.0,"correctness_risk":"low","formal_verification":"none","parameter_count":0,"one_line_summary":"No new VHE detection or upper limit is presented; the paper is a status report on MAGIC's GRB follow-up program and its sample of 103 bursts.","lead":"This conference paper reports the status of the MAGIC telescopes' follow-up of gamma-ray bursts, listing 103 bursts observed through December 2018. It describes the upgraded automatic alert procedure and notes that analysis and upper limits are still in progress, with results to appear in a forthcoming publication.","discovery_kind":"review","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The 103-GRB sample lacks a quantitative selection function, so the promised upper limits may be biased by targeting, weather, and human-decision choices.","rationale":"The paper is an honest status report: it explicitly says the analysis is ongoing and the sample will be treated in a future publication, so there is no fabricated measurement. The 103-GRB count is plausible and the description of the automatic procedure is consistent with MAGIC's known capabilities. The reader's verdict of UNVERDICTED is appropriate because no actual upper limits or physics results are presented. My stress-test agrees with the reader's weakest assumption: the sample selection is not quantitatively defined, which is the main load-bearing risk for the future use of these data. The absence of a selection function and the deliberate over-targeting of Fermi-LAT GRBs could bias any eventual stacking or population inference unless modeled. This does not change the verdict, but it sharpens the caveat that should accompany the forthcoming publication. I found no internal inconsistency in the paper's quantitative statements; the apparent tension between the 103 total and the 25 listed GRBs is resolved by noting that the catalog spans the full history since before the 2013 upgrade, while Table 1 lists only the May 2015 to December 2018 subset. The abstract overclaims 'ULs and results' relative to the body, but this is an editorial flaw, not a scientific one. The concrete test I propose would settle whether the selection bias is severe enough to require correction in the upcoming upper-limit analysis.","tokens_in":6363,"tokens_out":9990,"duration_ms":91754,"concrete_test":"Reconstruct the observation log: cross-match all GCN alerts from 2004 to 2018 against MAGIC visibility criteria (e.g., zenith below 60 degrees during dark time with decent weather) and compare the result with the reported 103 GRBs. If the 103 are not a complete subset of the visibility-limited automatic triggers, derive per-event selection probabilities and verify that the forthcoming upper-limit paper applies them. As a specific probe, test whether the mean redshift or Fermi-LAT detection fraction of the 103 differs significantly from the visibility-limited parent sample; such a difference would confirm the need for a selection correction in stacking analyses.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim that MAGIC's 103-GRB sample enables meaningful upper limits requires the sample to be a well-defined, unbiased draw from the GRB population, or at least a modeled selection. Section 3.3 defines the sample only as follow-ups with 'good or decent weather and without technical problems preventing the analysis', and Section 3.2 describes human Burst Advocate discretion plus preferential late-time follow-up of Fermi-LAT bursts (visible in the 'LAT' and 'late' notes of Table 1). No selection function, GCN alert comparison, or trigger log is provided, and the pre-May-2015 part of the catalog is delegated to reference [21]. Without knowing the observability thresholds and Burst Advocate decision rules, future stacking upper limits over these 103 events cannot be interpreted as population constraints; the deliberate LAT/late targeting alone biases the sample toward GRBs already bright at high energies. The paper itself defers the analysis to a forthcoming publication, so no upper limits are shown to validate the abstract's promise of 'ULs and results'.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"This ICRC 2019 proceedings paper reports the status of the MAGIC very-high-energy (VHE) gamma-ray burst (GRB) follow-up program in advance of the Cherenkov Telescope Array. It describes the MAGIC telescopes' capabilities, the automatic alert and fast-repositioning procedure, the upgrade implemented in 2013 that reduced hardware failures, and the follow-up strategy including the role of the Burst Advocate and late-time observations of Fermi-LAT bursts. The paper claims that up to December 2018 MAGIC followed 103 GRBs under favorable conditions, presents a skymap of those events, and lists 25 GRBs observed between May 2015 and December 2018 in Table 1, with columns for trigger time, T90, redshift, zenith angle, and delay. The paper reviews VHE emission models as context, and concludes by discussing planned hardware and analysis improvements. Crucially, the abstract states that the paper focuses on upper limits and results from the 2013-2018 sample, but the body explicitly states that the analysis is still ongoing and will appear in a forthcoming publication; no upper limits are presented.","tokens_in":1460,"tokens_out":1726,"duration_ms":61706,"significance":"If the reported sample count and procedure description are accurate, this paper provides a useful community status report and a preliminary catalog that could serve as a precursor for CTA-era GRB follow-up. It documents a concrete operational improvement: the 2013 upgrade reduced hardware failures during fast repositioning. The paper is honest in its body about the analysis being incomplete, and the references to MAGIC performance papers are standard instrument citations. However, the paper contains no new measurements, no upper limits, and no quantitative validation of the sample's completeness or selection. Its value as a catalog for future population-level constraints is therefore currently limited by the absence of a documented selection function.","major_comments":[{"comment":"The abstract states that the paper 'focuses on the ULs and results obtained from a sample of GRBs observed between 2013 and 2018', but Section 3.3 explicitly says that 'The analysis of the GRBs listed in Table 1 is currently ongoing' and that these GRBs 'will be the topic of a forthcoming publication.' No upper limit or result appears anywhere in the paper. This is a direct contradiction between the abstract and the body. The authors should either present the promised upper limits or revise the abstract to describe the paper as a status report and catalog without results.","section":"Abstract and Section 3.3"},{"comment":"The 103-GRB sample is defined only by 'favorable conditions (good or decent weather and without technical problems preventing the analysis of the data)', with no selection function, no comparison against all received GCN alerts, and no trigger log. Given that the paper motivates future flux upper limits from this sample and presents it as a precursor for CTA, the lack of a quantitative selection function, including observability thresholds, the Burst Advocate's decision criteria described in Section 3.2, and the deliberate preferential follow-up of Fermi-LAT bursts at late times, prevents the catalog from being interpreted as a population-level draw. Please add a selection flowchart or at least a numerical breakdown of excluded alerts by reason such as weather, visibility, technical failure, or human decision.","section":"Section 3.3 and Table 1"},{"comment":"The total of 103 GRBs includes events observed between 2013 and April 2015 that are not listed in this paper but are delegated to reference [21]. As a result, the paper's headline count is not independently verifiable from the presented material. The authors should either reproduce the pre-2015 list with the same parameters as in Table 1 or provide a machine-readable cross-check against GCN alerts for the full period, so that readers can trace the construction of the 103-GRB sample.","section":"Section 3.3 and Reference [21]"}],"minor_comments":[{"comment":"The sentence 'Gamma-Ray Bursts (GRBs) are one of the most elusive and enigmatic class of sources' has a subject-verb agreement error; it should be 'classes of sources' or 'one class of the most elusive...'.","section":"Abstract and Section 1"},{"comment":"In the sentence 'making it suitable to observe and possibly detect far-away sources, like most GRBs, for which the the effect of the gamma rays absorption on the Extragalactic Background Light (EBL) is relevant', there is a duplicated 'the' and the phrase 'gamma rays absorption' should be 'gamma-ray absorption'.","section":"Section 3.1"},{"comment":"The description of the Burst Advocate's role in 'evaluating the relevance of the alert (if it is real or not)' is vague. Please specify what criteria are used to judge whether an alert is real, since this is a part of the human decision layer that affects the sample selection.","section":"Section 3.2"},{"comment":"In the Notes column, the entries 'LAT' and 'late' conflate two different properties: whether the GRB had a Fermi-LAT detection and whether a late-time observation was performed. Consider splitting these into two separate columns or using distinct markers so the sample's LAT bias is readily apparent for each event.","section":"Table 1"}],"recommendation":"major_revision","confidential_remarks":"As a conference proceedings paper, the mismatch between the abstract's promise of upper limits and the body's statement that the analysis is ongoing is particularly unfortunate, as it misleads the casual reader about the paper's content. The selection-function concern is substantive: if the collaboration intends this catalog to support future stacking or population upper limits, a documented selection model will be essential. The paper would benefit from a clear revision that either adds the promised ULs if they exist or reframes the contribution as a pure status report. The operational details about the 2013 upgrade and the sample description are of value and should be preserved."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Short version: this is a conference proceedings status report, not a results paper. What it gives you is the first compiled list of MAGIC GRB follow-ups (103 bursts to December 2018, 24 with parameters in Table 1) and a clear description of the automatic procedure since the 2013 upgrade. That list and the honest account of the selection logic are genuinely useful for anyone planning CTA GRB observations. I agree with the reader's read: no new measurement or upper limit appears; the body explicitly defers the analysis to a forthcoming paper.\n\nThe paper does several things well. The follow-up description is candid about human Burst Advocate discretion, weather cuts, and the deliberate preference for Fermi-LAT and late-time targets. The catalog table gives trigger time, T90, redshift where known, zenith distance, and delay, which is more than most instrument status reports provide. The EBL discussion is brief but appropriate.\n\nThe soft spots are proportionate. The abstract says \"focus on the ULs and results obtained\" but the text contains no ULs. That is an overclaim, though common in conference abstracts; the body corrects it. More substantive: the 103-burst sample is defined only qualitatively (\"good or decent weather and without technical problems\"), and there is no selection function, no comparison with all GCN alerts, and no estimate of observability completeness. The stress-test note is right that the sample is biased toward LAT-detected and late-time events; anyone stacking these events later will need to model that. But the paper does not actually stack anything, and it presents the table as a follow-up record, not as a population sample. So the bias is a caveat for future use rather than a flaw in this paper's claims.\n\nThe citation pattern is standard instrument references; no circularity. The math is descriptive only.\n\nBottom line: for a proceedings paper, this is fine. If it crossed my desk as a journal submission, I would desk reject it on the grounds that it contains no results, with a suggestion that the authors submit the full analysis when ready. If I were refereeing it for the ICRC, I would ask for a revised abstract and a sentence warning that the sample is not unbiased. It is worth knowing about for CTA planning, but not worth a reading group slot.","headline":"A candid status report from MAGIC: the compiled 103-burst follow-up sample is useful for CTA planning, but the abstract overpromises upper limits the paper defers, and the sample's targeting biases are unquantified.","tokens_in":7099,"tokens_out":3014,"would_cite":false,"duration_ms":33724,"reading_group":"no","serious_thinker":"yes","would_accept_peer_review":false},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"MAGIC has followed up 103 gamma-ray bursts at very high energies; the scientific payoff will be upper limits.","keywords":["gamma-ray bursts","very high energy gamma rays","MAGIC telescopes","imaging atmospheric Cherenkov telescopes","upper limits","GRB follow-up","Cherenkov Telescope Array","extragalactic background light"],"falsifier":"Count, from the GCN alert stream, every GRB between 2013 and 2018 that was visible from the MAGIC site under good or decent weather, and check whether all of them appear in the 103-GRB list; any systematic gap would show the sample is not the unbiased record the paper implies. Alternatively, obtain the upgrade's claimed hardware-failure reduction by comparing failure counts per fast repositioning before and after 2013, which the paper asserts but does not quantify.","tokens_in":6162,"feed_emoji":"🔭","tokens_out":6158,"duration_ms":61392,"temperature":0.7,"pith_summary":"The paper reports the status of MAGIC's search for gamma-ray bursts (GRBs) emitting at very high energies ($E > 100$ GeV). It states that up to December 2018 MAGIC followed up 103 GRBs under favorable conditions, and that the 2013 upgrade of its automatic alert procedure sharply reduced hardware failures during fast slewing. Since no GRB except 190114C has been firmly detected in this band, the near-term scientific product is a set of flux upper limits from the full sample. These upper limits matter because they can constrain the emission mechanisms proposed for GRB high-energy radiation, and they define the observational baseline for the Cherenkov Telescope Array.","feed_headline":"103 gamma-ray bursts followed, zero TeV detections so far","feed_subtitle":"A new catalog of very-high-energy observations will yield upper limits that test how GRBs emit gamma rays.","key_machinery":"The load-bearing mechanism is the automatic GRB follow-up procedure: on a Gamma-ray Coordinate Network alert, the telescopes reposition at up to $7^\\circ$/s while the data acquisition is re-initialized and the mirrors are focused, so observation can begin almost immediately; a Burst Advocate evaluates the alert and can prolong or stop the run. This is what lets an imaging atmospheric Cherenkov telescope with a $3.5^\\circ$ field of view and a trigger threshold near 50 GeV respond to satellite-discovered transients. The companion piece is the upper-limit framework, which must fold in extragalactic background light attenuation: at redshift $z=1$ the intrinsic flux is reduced by a factor of about 2.3 at 100 GeV and roughly $1.5\\times10^6$ at 1 TeV, so the low energy threshold is what keeps distant GRBs within reach.","core_discovery":"The paper's central claim is that MAGIC has built a substantial and growing sample of GRB observations at very high energies: 103 bursts observed with good or decent weather and no technical obstacles up to December 2018, many within hours of the trigger, including Fermi-LAT-detected bursts and late-time afterglow observations. It argues that the upgraded automatic procedure, which keeps the data acquisition running while the telescopes slew, is what made prompt follow-up routine and reduced hardware failures. With no significant detection in the sample, the paper asserts the value of the program lies in upper limits: each non-detection, properly accounting for extragalactic background light absorption, can be compared with synchrotron and synchrotron-self-Compton model predictions to reduce parameter degeneracies. The paper also presents the near-term hardware path, lowering the energy threshold toward about 30 GeV, as the way to extend these searches to more distant bursts and to overlap with Fermi-LAT.","pith_inferences":["A stacked analysis of the full 103-GRB sample could produce a meaningful ensemble constraint on VHE emission, but only if the selection function of which alerts were followed is published; without it, the stacking result would be hard to interpret.","If the upper limits exclude standard SSC parameters for the nearest bursts, that would strengthen the case for hadronic or external-shock contributions to GRB high-energy emission.","The paper's claim of reduced hardware failures is testable: comparing failure rates per fast repositioning before and after 2013 would quantify the upgrade's benefit.","The same upper-limit catalog could be used to bound intergalactic magnetic fields through VHE time delays, a connection the paper does not pursue."],"forward_implications":["Once the analysis of the 103 bursts is published, the flux upper limits will provide a direct test of synchrotron and synchrotron-self-Compton emission models for GRB afterglows.","The higher rate of Fermi-LAT-triggered follow-ups and late-time observations means the sample covers phases of GRB evolution that earlier VHE searches rarely reached.","If the energy threshold is lowered to about 30 GeV with Sum-Trigger II, MAGIC will be able to observe more distant GRBs and to compare signals directly with Fermi-LAT.","The 103-GRB program and its upper limits establish the observing pattern and expectations that CTA will build on for GRB science."],"supporting_citations":[{"why":"The only firm VHE detection of a GRB, GRB 190114C, which motivates the search and frames the sample's non-detections.","marker":"[1, 2]"},{"why":"The Fermi-LAT second GRB catalog, which provides the HE emission properties and LAT-triggered follow-up targets.","marker":"[3]"},{"why":"The synchrotron-self-Compton afterglow model used to interpret upper limits on VHE GRB emission.","marker":"[8]"},{"why":"An earlier MAGIC GRB observation and upper limit that illustrates how such limits constrain models.","marker":"[9]"},{"why":"A second MAGIC GRB upper-limit study, used as an example of the analysis applied to individual bursts.","marker":"[10]"},{"why":"The major MAGIC hardware upgrade and commissioning, the context for the system's current performance.","marker":"[18]"},{"why":"The MAGIC performance study that supplies the sensitivity, angular resolution, and energy resolution figures.","marker":"[19]"},{"why":"The extragalactic background light model used to compute flux attenuation at high redshift.","marker":"[20]"},{"why":"The earlier MAGIC GRB follow-up catalog covering 2013 to April 2015, the direct predecessor of the present 103-GRB sample.","marker":"[21]"}],"fun_headline_variants":["MAGIC's GRB hunt: 103 bursts tracked, no VHE detections","Zero TeV GRBs from 103 bursts: upper limits lead the way","103 GRBs, no VHE: MAGIC's catalog sets upper limits for CTA","Fast-slewing upgrades let MAGIC catch 103 GRBs for VHE search","No VHE detections yet: MAGIC's 103 GRB catalog builds for CTA"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The record of 103 GRBs is treated as a complete, unbiased list of all MAGIC follow-ups with favorable conditions in the period, but the paper does not compare it with the full stream of alerts; if weather, visibility, or human decisions silently selected which bursts were observed, any later stacking or upper-limit interpretation would inherit that bias.","fun_headline_variants_meta":{"raw":{"variants":["MAGIC's GRB hunt: 103 bursts tracked, no VHE detections","Zero TeV GRBs from 103 bursts: upper limits lead the way","103 GRBs, no VHE: MAGIC's catalog sets upper limits for CTA","Fast-slewing upgrades let MAGIC catch 103 GRBs for VHE search","No VHE detections yet: MAGIC's 103 GRB catalog builds for CTA"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000206,"raw_usage":{"total_tokens":1437,"prompt_tokens":1023,"completion_tokens":414,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":639,"completion_tokens_details":{"reasoning_tokens":301}},"tokens_in":639,"tokens_out":414,"duration_ms":4729,"temperature":1.0,"reasoning_tokens":301,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T04:37:32.191120+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Count, from the GCN alert stream, every GRB between 2013 and 2018 that was visible from the MAGIC site under good or decent weather, and check whether all of them appear in the 103-GRB list; any systematic gap would show the sample is not the unbiased record the paper implies. Alternatively, obtain the upgrade's claimed hardware-failure reduction by comparing failure counts per fast repositioning before and after 2013, which the paper asserts but does not quantify.","supporting_citations":[{"cited_title":"et al., MAGIC observation of the GRB 080430 afterglow, A&A 517 (2010) A5 [astro-ph.HE/1004.3665]","cited_arxiv_id":null,"evidence_quote":"An earlier MAGIC GRB observation and upper limit that illustrates how such limits constrain models."},{"cited_title":"et al., MAGIC upper limits on the GRB 090102 afterglow, MNRAS 437 (2014) 3103 [astro-ph.HE/1311.3637]","cited_arxiv_id":null,"evidence_quote":"A second MAGIC GRB upper-limit study, used as an example of the analysis applied to individual bursts."},{"cited_title":"et al., Recent follow-up observations of GRBs in the very high energy band with the MAGIC telescopes, in proceedings of ICRC2015, PoS(ICRC2015)809 6","cited_arxiv_id":null,"evidence_quote":"The earlier MAGIC GRB follow-up catalog covering 2013 to April 2015, the direct predecessor of the present 103-GRB sample."}],"review_version":1}