pith. machine review for the scientific record. sign in

arxiv: 1007.1727 · v3 · submitted 2010-07-10 · ⚛️ physics.data-an · hep-ex

Recognition: 2 theorem links

· Lean Theorem

Asymptotic formulae for likelihood-based tests of new physics

Glen Cowan , Kyle Cranmer , Eilam Gross , Ofer Vitells
Authors on Pith no claims yet

Pith reviewed 2026-05-11 01:44 UTC · model grok-4.3

classification ⚛️ physics.data-an hep-ex
keywords asymptotic distributionslikelihood ratio testsWilks theoremAsimov datasetsystematic uncertaintiesnew physicsdiscovery significancemedian sensitivity
0
0 comments X

The pith

Explicit asymptotic formulae are derived for the distributions of likelihood ratio test statistics in searches for new physics, including systematic uncertainties, along with the Asimov dataset for computing median experimental sensitivity.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Physicists need practical ways to assess the significance of potential signals or to set limits on new physics parameters when data are limited and systematic effects are present. This work supplies closed-form expressions for how common test statistics behave in the large-sample limit, based on established statistical results. These expressions replace the need for many Monte Carlo simulations when calculating p-values or expected sensitivities. A central tool is the Asimov dataset, a single representative dataset in which every observed value is set to its expected value, which directly yields the median outcome of an experiment.

Core claim

Using results from Wilks and Wald, explicit formulae are derived for the asymptotic distributions of the likelihood ratio test statistics. These account for systematic uncertainties by profiling over nuisance parameters. The Asimov dataset is motivated and justified as a representative data set that provides the median experimental sensitivity of a search or measurement as well as fluctuations about this expectation.

What carries the argument

The Asimov data set, a single constructed dataset in which observed values equal their expected values under the model hypothesis, which serves as a direct proxy for the median value of the test statistic.

If this is right

  • P-values and significances for discovery can be calculated analytically from the asymptotic distributions without generating pseudo-experiments.
  • Systematic uncertainties enter the test through the profiled likelihood and are automatically included in the asymptotic formulae.
  • The median expected sensitivity or exclusion reach of an experiment is obtained by evaluating the test statistic once on the Asimov dataset.
  • The same machinery supplies the asymptotic behaviour needed to construct confidence intervals on parameters of interest.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The method lowers the computational cost of sensitivity studies in analyses where full detector simulations are expensive.
  • Analogous asymptotic shortcuts may prove useful in likelihood-based inference problems outside particle physics that also involve nuisance parameters.
  • The accuracy of the approximations for moderate event counts or near parameter boundaries remains an open question that can be checked case by case.

Load-bearing premise

The profiled likelihood satisfies the regularity conditions of Wilks' and Wald's theorems, including sufficiently large sample size and an interior maximum.

What would settle it

Monte Carlo simulations of a concrete analysis in which the observed distribution of the test statistic under the background-only hypothesis deviates substantially from the predicted asymptotic form, such as a chi-squared distribution with one degree of freedom.

read the original abstract

We describe likelihood-based statistical tests for use in high energy physics for the discovery of new phenomena and for construction of confidence intervals on model parameters. We focus on the properties of the test procedures that allow one to account for systematic uncertainties. Explicit formulae for the asymptotic distributions of test statistics are derived using results of Wilks and Wald. We motivate and justify the use of a representative data set, called the "Asimov data set", which provides a simple method to obtain the median experimental sensitivity of a search or measurement as well as fluctuations about this expectation.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

0 major / 3 minor

Summary. The manuscript derives explicit asymptotic formulae for the distributions of profile likelihood ratio test statistics for testing new physics signals and constructing confidence intervals in high energy physics, incorporating systematic uncertainties. It uses results from Wilks and Wald to obtain these distributions, including boundary-adjusted forms for non-negative signal strengths, and introduces the Asimov dataset to efficiently calculate the median experimental sensitivity and its fluctuations, supported by comparisons with toy Monte Carlo simulations.

Significance. This work offers practical and widely applicable methods for statistical inference in particle physics searches. The provision of closed-form expressions for the test statistic distributions and the Asimov dataset approach significantly reduces the computational burden for sensitivity studies. The paper's analytic results are validated against numerical simulations, enhancing their reliability for use in experimental analyses at facilities like the LHC. The explicit formulae and reproducible comparisons with toy MC are particular strengths.

minor comments (3)
  1. It would be helpful to specify in the abstract that the formulae account for systematic uncertainties through the inclusion of nuisance parameters in the likelihood.
  2. The presentation of the asymptotic distributions could include a brief note on the conditions under which the chi-squared approximation holds for the profiled likelihood.
  3. The definition of the Asimov dataset is well-motivated, but adding an equation for the expected event counts in the presence of systematics would aid reproducibility.

Simulated Author's Rebuttal

0 responses · 0 unresolved

We thank the referee for the careful review and for recommending acceptance of the manuscript. The referee's summary and assessment accurately reflect the scope and contributions of the work.

Circularity Check

0 steps flagged

No significant circularity

full rationale

The paper derives asymptotic distributions of profile likelihood ratio statistics directly from the external theorems of Wilks (1938) and Wald (1943), with explicit mixture-of-chi-squared forms for boundary cases (μ ≥ 0) obtained by applying those theorems under stated regularity conditions. The Asimov data set is introduced as an explicitly constructed representative dataset whose expected counts yield the median value of the test statistic under the asymptotic limit; this construction is definitional and does not reduce any prediction to a fitted parameter or self-referential input. No load-bearing self-citations, uniqueness theorems imported from the authors' prior work, or ansatzes smuggled via citation appear in the central derivation chain. The paper supplies both analytic expressions and independent toy-MC validation, confirming the derivations remain self-contained against external benchmarks.

Axiom & Free-Parameter Ledger

0 free parameters · 2 axioms · 1 invented entities

The paper rests on two classical theorems plus the definition of the Asimov dataset; no free parameters are fitted and no new physical entities are postulated.

axioms (2)
  • standard math Wilks' theorem: under regularity conditions the likelihood-ratio statistic is asymptotically chi-squared distributed.
    Invoked in §2 and §3 to obtain the asymptotic null distribution.
  • standard math Wald's theorem: the maximum-likelihood estimator is asymptotically normal with variance given by the inverse Fisher information.
    Used to derive the non-centrality parameter of the test statistic under the alternative.
invented entities (1)
  • Asimov dataset independent evidence
    purpose: Single representative dataset whose likelihood ratio equals the median of the test-statistic distribution under a given hypothesis.
    Defined in §4 as the expected counts under the hypothesis; independent evidence is the numerical agreement with toy-MC medians shown in the paper.

pith-pipeline@v0.9.0 · 5384 in / 1427 out tokens · 42222 ms · 2026-05-11T01:44:37.886555+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Lean theorems connected to this paper

Citations machine-checked in the Pith Canon. Every link opens the source theorem in the public Lean library.

What do these tags mean?
matches
The paper's claim is directly supported by a theorem in the formal canon.
supports
The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
extends
The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
uses
The paper appears to rely on the theorem as machinery.
contradicts
The paper's claim conflicts with a theorem or certificate in the canon.
unclear
Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.

Forward citations

Cited by 44 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Search for single vector-like quark production in opposite-sign dilepton final states in proton-proton collisions at $\sqrt{s}$ = 13 TeV

    hep-ex 2026-05 accept novelty 8.0

    No excess observed in search for vector-like top quark T to tH in opposite-sign dilepton final states; 95% CL upper limits on sigma times BR range from 2.0 pb at 600 GeV to 0.1 pb at 1000 GeV.

  2. Proton Structure from Neural Simulation-Based Inference at the LHC

    hep-ph 2026-04 unverdicted novelty 8.0

    Neural simulation-based inference on unbinned top-quark pair data at 13 TeV yields improved gluon PDF precision over traditional binned analyses while incorporating experimental and theoretical uncertainties.

  3. Differential measurements of $\gamma\gamma\to\tau\tau$ and constraints on $\tau$-lepton electromagnetic moments in Pb+Pb collisions at $\sqrt{s_{_\text{NN}}} = 5.02$ TeV with ATLAS

    nucl-ex 2026-05 unverdicted novelty 7.0

    First differential cross-sections for γγ→ττ in Pb+Pb collisions yield 95% CL intervals -0.057 < a_τ < 0.035 and |d_τ| < 2.7×10^{-16} e cm.

  4. Forecasting graviton-mass constraints from the full covariance of PTA-astrometry ORF estimators

    gr-qc 2026-04 unverdicted novelty 7.0

    A full-covariance formalism for PTA-astrometry ORF estimators forecasts graviton-mass upper limits of 4.41e-24 eV/c2 for current-like setups and 0.48e-24 eV/c2 for SKA/Theia-like future setups, with astrometry adding ...

  5. Odd Physics Off the Diagonal: Constraining CP-violating SMEFT with Quantum Tomography

    hep-ph 2026-04 unverdicted novelty 7.0

    Quantum tomography of diboson spin density matrices yields superior sensitivity to CP-even and CP-odd SMEFT contributions, including quadratic new-physics terms not captured by traditional angular observables.

  6. Study of the $B^0 \to \Lambda_c^+ \bar{\Lambda}_c^- K_S^0$ decay

    hep-ex 2026-04 unverdicted novelty 7.0

    Relative branching fraction B(B0 → Λc+ Λc- KS0)/B(B+ → Λc+ Λc- K+) measured as 0.53 ± 0.05 ± 0.05 with 3.9σ evidence for Ξc(2923)+ and Ξc(2939)+ resonances consistent with isospin partners.

  7. Measurement of the top quark pair production cross section in PbPb collisions at $\sqrt{s_\mathrm{NN}}$ = 5.36 TeV

    nucl-ex 2026-04 unverdicted novelty 6.0

    The ttbar production cross section in PbPb collisions at 5.36 TeV is measured as 3.42 +0.54-0.51 (stat) +0.50-0.43 (syst) μb and is consistent with NNLO pQCD predictions using nuclear PDFs.

  8. Precision measurement of positron decay modes of Xe-125 in the LUX-ZEPLIN experiment

    hep-ex 2026-04 unverdicted novelty 6.0

    Xe-125 positron decay branching ratio measured as 0.29% at 5.5 sigma significance, providing the first constraint on individual levels in I-125.

  9. Search for a new heavy resonance decaying to a top quark and a neutral scalar boson in proton-proton collisions at $\sqrt{s}$ = 13 TeV

    hep-ex 2026-04 accept novelty 6.0

    No excess found in search for T' to top plus phi; excludes T' masses 0.85-1.3 TeV at 95% CL for SM Higgs case with 5% width, and sets cross-section limits as low as 0.1 fb.

  10. Probing Higgs and Top Interactions through the Muon Lens at multi-TeV Muon Colliders

    hep-ph 2026-04 unverdicted novelty 6.0

    A 10 TeV muon collider could improve existing bounds on muon-Higgs-gauge and muon-top interactions by up to an order of magnitude over current limits and FCC-ee projections.

  11. Improving Neutrino Point Source Sensitivity with Source-Informed Event Selection

    hep-ex 2026-04 conditional novelty 6.0

    Source-informed event selection in multi-level neutrino reconstruction improves median point source sensitivity by factors of ~2-3 over uniform subsampling.

  12. Probing the Solar $^8$B Neutrino Fog with XENONnT

    hep-ex 2026-04 unverdicted novelty 6.0

    XENONnT measures solar 8B neutrino coherent scattering at 3.3 sigma, finds no light dark matter, and constrains the weak mixing angle at low momentum transfer.

  13. Heavy Vector Triplets at a Muon Collider

    hep-ph 2026-05 unverdicted novelty 5.0

    Muon colliders can probe heavy vector triplets up to 12 TeV, competitive with HE-LHC but below FCC-hh projections, including indirect electroweak precision limits.

  14. Search for pair production of additional neutral scalars within the Inert Doublet Model in a final state with two electrons or two muons in proton-proton collisions at $\sqrt{s}$ = 13 TeV and 13.6 TeV

    hep-ex 2026-05 accept novelty 5.0

    No significant excess found; new exclusion limits reach m_H = 108 GeV for m_H - m_A = 78 GeV in the Inert Doublet Model.

  15. Time-dependent signals of new physics at the LHC

    hep-ph 2026-05 unverdicted novelty 5.0

    Incorporating timing information from time-dependent new physics signals can improve LHC search sensitivity by up to a factor of two compared to standard time-invariant analyses.

  16. Electronic Direct Detection of Light Dark Matter with Intermediate-Mass Mediators

    hep-ph 2026-05 unverdicted novelty 5.0

    For sub-GeV dark matter, the light and heavy mediator mass limits in direct detection are separated by up to three orders of magnitude in mediator mass, enabling precise sensitivity calculations for Si, Ge, and DAMIC-...

  17. LHC Mono-$W/Z$ Signatures as a Probe for Dark Matter Explanations of Astrophysical Excesses

    hep-ph 2026-05 unverdicted novelty 5.0

    LHC mono-W/Z searches with a new channel-separation method can exclude large ranges of neutral and charged mass splittings in the 70-75 GeV IDM dark matter scenario that fits astrophysical excesses.

  18. Sensitivity of the Cherenkov Telescope Array Observatory to Gamma-Ray Signals in Dwarf Irregular Galaxies

    astro-ph.HE 2026-05 unverdicted novelty 5.0

    CTAO could set competitive limits on dark matter annihilation cross sections from dwarf irregular galaxies, reaching around 2×10^{-24} cm³/s for 100 GeV WIMPs in the tau channel and exceeding dwarf spheroidal expectat...

  19. Search for a new heavy scalar resonance decaying into the Higgs boson and a new scalar particle in the $\mathrm{b}\bar{\mathrm{b}}\mathrm{b}\bar{\mathrm{b}}$ final state using proton-proton collisions at $\sqrt{s}$ = 13 TeV

    hep-ex 2026-05 accept novelty 5.0

    No evidence found for a new heavy scalar resonance X decaying to Higgs plus new scalar Y in the four-bottom-quark final state; 95% CL upper limits set on cross section times branching fraction.

  20. Search for light charged Higgs bosons decaying to charm and strange quarks in $\mathrm{t\bar{t}}$ events in proton-proton collisions at $\sqrt{s}$ = 13 TeV

    hep-ex 2026-04 unverdicted novelty 5.0

    No evidence found for light charged Higgs bosons in ttbar events; upper limits set on B(t to H±b) of 0.07-1.12% at 95% CL for masses 40-160 GeV assuming 100% decay to cs.

  21. Effective field theory interpretation of ATLAS measurements involving the Higgs boson, electroweak bosons and the top quark

    hep-ex 2026-04 accept novelty 5.0

    A simultaneous fit to multiple ATLAS datasets constrains 48 SMEFT Wilson coefficients and matches subsets to 2HDM and heavy-vector models, finding consistency with the Standard Model.

  22. Kitchen Sink Anomaly Detection

    hep-ph 2026-04 unverdicted novelty 5.0

    A combined kitchen sink observable set of Energy Flow Polynomials and subjettiness variables outperforms standard baselines in sensitivity to a wide range of resonant signals, with new public benchmarks released and a...

  23. A search for microscopic black holes, string balls, and sphalerons in proton-proton collisions at $\sqrt{s}$ = 13 TeV

    hep-ex 2026-04 unverdicted novelty 5.0

    No evidence found; excludes semiclassical black holes below 8.4-11.4 TeV and string balls below 9.0-10.7 TeV at 95% CL, and caps the quark-quark sphaleron fraction above 9 TeV at 0.0034.

  24. DREAMuS: Dark matter REsearch with Advanced Muon Source

    hep-ph 2026-04 unverdicted novelty 5.0

    DREAMuS proposes a muon-beam fixed-target setup at HIAF to probe GeV-scale muon-philic dark matter with sensitivity to couplings around 10^{-4} using background-suppressed signatures from a light flavor-violating mediator.

  25. Wave-Function Femtometry: Hypertriton - The Ultimate Halo Nucleus

    nucl-ex 2026-04 unverdicted novelty 5.0

    Hypertriton production yield in LHC pp collisions, described by nuclear coalescence, confirms its halo structure with a Lambda separation of 9.54 fm from the deuteron core.

  26. LHC signatures of a light pseudoscalar in a flipped two-Higgs scenario: the usefulness of boosted $b{\bar b}$ pairs

    hep-ph 2026-04 unverdicted novelty 5.0

    Boosted di-b-jet tagging plus BDT analysis yields 5-10 sigma significance for a light pseudoscalar in flipped 2HDM with 3 ab^{-1} including 10% systematics.

  27. Aspects of a Five-Dimensional $U(1)_{L_\mu - L_\tau}$ Model at Future Muon-Based Colliders

    hep-ph 2026-04 unverdicted novelty 5.0

    Future muon colliders can probe Kaluza-Klein excitations of a 5D U(1)_{Lμ-Lτ} gauge boson across MeV to TeV masses with couplings down to 10^{-5}.

  28. Search for charginos and neutralinos with $B-L$ $R$-parity violating decays in $\sqrt{s}=13$ TeV and $13.6$ TeV $pp$ collisions with the ATLAS detector

    hep-ex 2026-05 accept novelty 4.0

    No evidence for charginos and neutralinos in R-parity violating Higgs-decay channels; masses 150-1100 GeV excluded at 95% CL assuming equal lepton branching fractions.

  29. Revisiting predictions for cosmic-ray antinucleon fluxes from Galactic Dark Matter

    hep-ph 2026-05 unverdicted novelty 4.0

    Updated predictions for cosmic antinuclei fluxes from dark matter yield tighter upper limits on light DM annihilation cross sections from AMS-02 antiproton data and show that GAPS could improve those limits by up to a...

  30. Improved results on Higgs boson pair production in the 4b final state

    hep-ex 2026-04 unverdicted novelty 4.0

    CMS sets an observed upper limit of 4.4 on the HH signal strength μ_HH in the 4b final state at 13.6 TeV, improving prior LHC results by more than a factor of two in the resolved topology.

  31. Same-Sign Tetralepton Signature at $\mu$TRISTAN

    hep-ph 2026-04 unverdicted novelty 4.0

    The paper identifies promising parameter regions for observing same-sign tetralepton events from charged Higgs pair and single production decaying to muons and heavy neutral leptons at μTRISTAN.

  32. Search for dark matter produced in association with a dark Higgs boson decaying into a bottom quark-antiquark pair in proton-proton collisions at $\sqrt{s}$ = 13 TeV

    hep-ex 2026-04 unverdicted novelty 4.0

    New upper limits exclude mediator masses up to 4.5 TeV for a 50 GeV dark Higgs and up to 2.5 TeV for 150 GeV in a spin-1 mediator dark matter model, the most stringent to date for these masses.

  33. Search for quantum black holes in lepton+jet final states using proton-proton collisions at $\sqrt{s}=13.6$ TeV with the ATLAS detector

    hep-ex 2026-04 accept novelty 4.0

    No significant excess of high-mass lepton+jet events is observed in 164 fb^{-1} of 13.6 TeV pp collisions, setting 95% CL upper limits on quantum black hole production cross-section times branching ratio that reach a ...

  34. Search for the single production of vector-like quarks decaying into a W boson and a b quark using single-lepton final states in proton-proton collisions at $\sqrt{s}$ = 13 TeV

    hep-ex 2026-04 accept novelty 4.0

    No significant excess observed in search for vector-like quark single production to Wb, setting 95% CL upper limits on κ_W as low as 0.086 near 1.4 TeV mass and excluding masses below 2.4 TeV at κ_W=0.2.

  35. Sensitivity to top-quark FCNC interactions at future muon colliders

    hep-ph 2026-04 unverdicted novelty 4.0

    A 10 TeV muon collider with 10 ab^{-1} could reach O(10^{-3}) sensitivity on top-quark FCNC couplings, improving current ATLAS/CMS bounds by more than an order of magnitude.

  36. New Deep Learning Data Analysis Method for PROSPECT using GAPE: Genetic Algorithm Powered Evolution

    physics.data-an 2026-04 unverdicted novelty 4.0

    GAPE evolves deep learning models that improve PROSPECT IBD signal classification, promising up to 2.8 times better signal-to-background ratio than conventional methods after bias mitigation via period-specific training.

  37. Probing Heavy Neutral Higgs Bosons via Single Vector-Like Bottom Quark Production at the HL-LHC

    hep-ph 2026-03 unverdicted novelty 4.0

    XGBoost multivariate analysis extends the 5-sigma discovery reach for singly produced vector-like bottom quarks decaying via heavy neutral Higgs bosons to 1.6 TeV at the HL-LHC with 3 ab^{-1}.

  38. Search for new physics in triple boson production in proton-proton collisions at $\sqrt{s}$ = 13 TeV using the effective field theory approach

    hep-ex 2026-05 unverdicted novelty 3.0

    No excess in VVV production; bounds set on c_W/Λ² (-0.13 to 0.12 TeV^{-2}) and c_Hq3/Λ² (-0.24 to 0.21 TeV^{-2}) at 95% CL.

  39. Prospects for Measuring $H\to \rm{invisble}$ at the FCCee

    hep-ph 2026-05 unverdicted novelty 3.0

    FCC-ee at 240 GeV with 10.8 ab^{-1} could set a 95% CL upper limit of 0.15% on the branching ratio of Higgs to invisible particles.

  40. Possibility of Probing an Extra Higgs Boson at the Compact Linear Collider

    hep-ph 2026-05 unverdicted novelty 3.0

    CLIC can probe an additional neutral Higgs boson H in the Two Higgs Doublet Model through the process e+e- to H nu nu-bar with H decaying to WW in the dilepton channel.

  41. Limit on high energy neutrino emission from Abell 119 using IceCube 10-year muon track data

    astro-ph.HE 2026-05 unverdicted novelty 3.0

    Upper limit on muon neutrinos from Abell 119 is 1.2 times below the flux predicted for hadronic gamma-ray production, marginally excluding that origin.

  42. Lepton Flavor Violating Higgs decays at the Compact Linear Collider

    hep-ph 2026-05 unverdicted novelty 3.0

    CLIC could place 95% CL upper limits of 10^{-4} to 10^{-5} on the branching fractions of h→eμ, h→τμ, and h→eτ with 4 ab^{-1} at 1.4 TeV and 5 ab^{-1} at 3 TeV.

  43. Machine Learning Study on Single Production of a Singlet Vector-like Lepton at the Large Hadron Collider

    hep-ph 2026-04 unverdicted novelty 3.0

    XGBoost machine learning improves discrimination in LHC searches for singlet vector-like leptons, yielding projected 2σ mass exclusion limits of 620 GeV (three-lepton) and 490 GeV (four-lepton) at 14 TeV with 3000 fb^{-1}.

  44. The FASER experiment at the Large Hadron Collider

    hep-ex 2026-04 unverdicted novelty 2.0

    FASER is now running at the LHC and has started delivering first collider-based neutrino data along with searches for new light particles.

Reference graph

Works this paper leans on

18 extracted references · 18 canonical work pages · cited by 44 Pith papers

  1. [1]

    Wilks, The large-sample distribution of the likelihood ratio for te sting composite hypotheses, Ann

    S.S. Wilks, The large-sample distribution of the likelihood ratio for te sting composite hypotheses, Ann. Math. Statist. 9 (1938) 60-2

    work page 1938

  2. [2]

    Wald, Tests of Statistical Hypotheses Concerning Several Paramet ers When the Number of Observations is Large , Transactions of the American Mathematical Society, Vol

    A. Wald, Tests of Statistical Hypotheses Concerning Several Paramet ers When the Number of Observations is Large , Transactions of the American Mathematical Society, Vol. 54, No. 3 (Nov., 1943), pp. 426-482

    work page 1943

  3. [3]

    1 , Broadway Books, 1990

    Isaac Asimov, Franchise, in Isaac Asimov: The Complete Stories, Vol. 1 , Broadway Books, 1990

    work page 1990

  4. [4]

    Bartsch and G

    V. Bartsch and G. Quast, Expected signal observability at future experiments , CMS Note 2005/004 (2003) (available on CMS information server)

    work page 2005

  5. [5]

    ATLAS Collaboration, Expected Performance of the ATLAS Experiment, Detector, Trigger and Physics , CERN-OPEN-2008-020, Geneva, 2008, e-print: arXiv:0901. 0512

    work page 2008

  6. [6]

    ALEPH, DELPHI, L3 and OPAL Collaborations, Search for the Standard Model Higgs Boson at LEP , CERN-EP/2003-011, Phys. Lett. B565 (2003) 61-75

    work page 2003

  7. [7]

    Stuart, J.K

    A. Stuart, J.K. Ord, and S. Arnold, Kendall’s Advanced Theory of Statistics , Vol. 2A: Classical Inference and the Linear Model 6th Ed., Oxford Univ. Press (1999), and earlier editions by Kendall and Stuart

    work page 1999

  8. [8]

    Cousins and Gary J

    Robert D. Cousins and Gary J. Feldman, Phys. Rev. D 57, 387 3 (1998)

    work page 1998

  9. [9]

    Abramowitz and I.A

    M. Abramowitz and I.A. Stegun, Handbook of Mathematical Functions , Dover (1972) Section 26.4.25. See also Noncentral chi-square distribution , Wikipedia, The Free En- cyclopedia. Wikimedia Foundation, Inc., 6 July 2010

    work page 1972

  10. [10]

    Aaltonen et al., Phys

    T. Aaltonen et al., Phys. Rev. Lett. 104 061802 (2010); e-Print: arXiv:1001.4162 [hep- ex]

    work page arXiv 2010

  11. [11]

    Lyons et al

    Kyle Cranmer, Frequentist Hypothesis Testing with Background Uncertainty in L. Lyons et al. (eds.), Proceedings of PHYSTAT 2003, SLAC, Stanford C alifornia, September 8–11, 2003, 261–264

    work page 2003

  12. [12]

    Junk, Nucl

    T. Junk, Nucl. Instrum. Methods Phys. Res., Sec. A 434, 435 (1999); A.L. Read, J. Phys. G 28, 2693 (2002)

    work page 1999

  13. [13]

    Cousins, James T

    Robert D. Cousins, James T. Linnemann, Jordan Tucker, N uclear Instruments and Methods in Physics Research A 595 (2008) 480–501; e-Print: a rXiv:physics/0702156v4 [physics.data-an]

    work page arXiv 2008

  14. [14]

    Eilam Gross and Ofer Vitells, Trial factors or the look elsewhere effect in high energy physics, arXiv:1005.1891 [physics.data-an] (2010)

    work page Pith review arXiv 2010

  15. [15]

    Moneta, K

    L. Moneta, K. Belasco, K. Cranmer et al. , “The RooStats Project,” pro- ceedings of ACAT, 2010, Jaipur, India [arXiv:1009.1003 [ph ysics.data-an]]. [https://twiki.cern.ch/twiki/bin/view/RooStats/] 31

    work page arXiv 2010

  16. [16]

    R. Brun, F. Rademakers, ROOT: An object oriented data analysis framework , Nucl. Instrum. Meth. A389, 81-86 (1997)

    work page 1997

  17. [17]

    The RooFit toolkit for data modeling

    W. Verkerke, D. P. Kirkby, The RooFit toolkit for data modeling , Proceedings for CHEP03 (2003) [physics/0306116]

    work page Pith review arXiv 2003

  18. [18]

    James, M

    F. James, M. Roos, Minuit: A System for Function Minimization and Analysis of t he Parameter Errors and Correlations , Comput. Phys. Commun. 10, 343-367 (1975). 32

    work page 1975