Pith. sign in

REVIEW 3 major objections 5 minor 1 cited by

Stopping Rules for Monte Carlo Methods: A Review

T0 review · 3 major / 5 minor · reviewed 2026-08-04 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read The paper claims that the scattered literature on sequential stopping rules for Monte Carlo mean estimation becomes coherent once organized by a few core choices: absolute versus relative accuracy, iid versus dependent samples, and asymptot

desk verdict A competent but uneven survey: its organizational value is real, yet the most novel sections rest on unverifiable author preprints and at least one displayed algorithm is missing a parameter. read the letter →

arxiv 2510.22688 v3 pith:LZYSPENA submitted 2025-10-26 stat.ME math.STstat.TH

Jiezhong Wu , Reiichiro Kawai This is my paper · ORCID
classification stat.MEmath.STstat.TH MSC 65C0562E2062L0562L1560G42
keywords sequentialstoppingrulesMonteCarlomethodsfixed-widthconfidenceintervalsabsoluteprecisionrelativeBernoullitrialsmartingaledifferencecoverageprobability
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to establish that the apparently fragmented literature on sequential stopping rules for Monte Carlo mean estimation is actually organized around a small set of choices: whether accuracy is measured in absolute or relative terms, whether the samples are independent, whether guarantees are asymptotic or finite-sample, and what extra information (moment bounds, boundedness) is available. By collecting and comparing recent work under these headings, it aims to give practitioners and researchers a usable guide for choosing a stopping rule and a baseline for developing new ones. A sympathetic reader would care because simulations routinely waste compute or terminate early with misleading coverage, and the relevant results are currently scattered across specialized papers.

What carries the argument

The central object is the stopping time, the smallest sample size such that the probability the empirical mean misses the true mean by more than a tolerance is below a significance level (or the relative version with the true mean in the denominator). Because exact determination is impossible without extra information, each rule in the review is a way of approximating that stopping time: two-stage designs estimate the variance first, moment-based corrections improve the normal approximation, concentration inequalities give non-asymptotic bounds for bounded variables, and the martingale-difference rule extends the approach to dependent sequences with batch indices. The review also uses covera

What would settle it

A concrete check: recompute the stated cost factor for the bounded-variable Bernoulli rule (claimed between 3.64 and 5.09 times the normal-approximation sample size for significance levels between 0.001 and 0.1); if the factor falls outside that range, the summary is wrong. For the comprehensiveness claim, find a stopping rule in active use for Monte Carlo mean estimation that fits no category in the review—say a confidence-sequence rule with no fixed width—and show it delivers better expected run length in the same iid setting.

Watch

Extended reading notes

Core claim

On its own terms, the review's central claim is that the many recent stopping rules—two-stage rules that inflate the variance estimate to guarantee coverage, rules that add third- and fourth-moment corrections to the normal approximation, relative-precision rules for bounded and Bernoulli variables, rules for martingale-difference and quasi-Monte Carlo sequences, and rules for estimating several means at once—are not isolated tricks but instances of a common design problem: finding the smallest sample size that keeps the error probability under a prescribed threshold. The paper's contribution is to state that problem once, to classify the solutions by their assumptions and guarantees, and to

Load-bearing premise

The load-bearing premise is that the post-1991 papers the review selected are representative of the state of the art for Monte Carlo mean estimation, and that the authors' short summaries of each cited result are accurate.

Editorial extensions

If this is right

  • If the classification is right, then selecting a stopping rule is a matching problem: check boundedness and moment information, decide absolute vs relative accuracy, and only then choose between asymptotic and finite-sample rules.
  • The review makes the classic fixed-width interval asymptotics the common benchmark, so different rules can be compared in terms of asymptotic consistency and efficiency.
  • Finite-sample reliability is not free: two-stage and moment-based rules require prior information such as a kurtosis bound or a bounded support, and coverage profiles show that otherwise early stopping can badly undercut coverage.
  • Relative-precision rules can cut run length substantially but are risky when the mean is near zero, since the procedure may stop too early; the review flags this trade-off.
  • Valid stopping rules exist beyond iid data, including martingale-difference sequences and low-discrepancy quasi-Monte Carlo, so dependent-sample users are not restricted to the iid toolbox.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A direct extension of the review's map is a decision procedure: if a practitioner can bound the support or moments, use a finite-sample rule; otherwise use an asymptotic rule with a coverage-profile pre-check and a variance inflation factor.
  • The deliberate exclusions—confidence sequences, resampling, and group-sequential trials—suggest a follow-up review that integrates those with the current taxonomy, since betting-based confidence sequences share the same goal with different machinery.
  • The coverage-profile diagnostic could be turned into a standardized benchmark: run each candidate rule on a suite of distributions and report coverage against run length, giving an empirical table that the field currently lacks.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This paper is a review article on sequential stopping rules for Monte Carlo estimation of expectations, with emphasis on iid sampling and lightly generalized settings (bounded, Bernoulli, martingale-difference, low-discrepancy, multiple means). It first lays out essential components—error tolerances, confidence/significance levels, multivariate outputs, non-iid sequences, preliminary sample sizes, large-sample theory, normal approximation, and single- versus two-stage procedures—then surveys recent developments organized by asymptotic analyses, moment-based rules, distributional assumptions, non-iid sequences, multiple means, quality assessment, and unconventional criteria. The stated aim is to provide a comprehensive, up-to-date guidebook of core assumptions, algorithms, convergence properties, and practical trade-offs.

Significance. If taken at face value, the review fills a real gap: the sequential-stopping-rule literature for Monte Carlo is scattered, and the paper provides a structured map of it. The classical summaries in Sections 2 and 3 (Chow–Robbins asymptotics, Glynn–Whitt framework, two-stage kurtosis-based rules, Berry–Esseen refinements, relative-precision rules) are consistent with the original sources and will be useful to both practitioners and researchers entering the area. The paper's contribution is synthesis and organization rather than new mathematics or reproducible code. Its value therefore depends on the accuracy and verifiability of the summaries, and it is precisely there that the manuscript needs work: one displayed algorithm uses an undefined parameter, and several key recent results are drawn from unnumbered preprints without accessible details.

major comments (3)
  1. [§3.3.2] The first stopping rule of [27] is presented with ϒ = 4(e−2)λ ln(2/δ)/ε², but λ is never defined anywhere in the manuscript. Since τ1 = argmin{n : X1+...+Xn ≥ ϒ1} and the displayed bound E[τ1] ≤ ϒ1/E[X1] both depend on λ, a reader cannot implement or check the algorithm. This is a concrete internal defect in a section whose purpose is to summarize numerical algorithms. Please define λ (or state its range/value as in the source) and reconcile the notation with [27].
  2. [§3.1.1, §3.4.2, Refs. [58], [59], [113]] The review's most recent content—non-asymptotic malfunction of stopping rules and a martingale-difference stopping rule—rests on two unnumbered preprints by the corresponding author ([58], [59]) and one by both authors ([113]), cited as 'available here' without URLs or theorem/page numbers. These are not standard archival sources, so the accuracy of the summarized claims cannot be independently checked from the manuscript. Since the paper's central claim is to be a reliable up-to-date guide, please either state the precise results with assumptions and theorem numbers, or provide public links and identify the exact statements being summarized.
  3. [§3 (overall)] The introduction promises 'comparisons' and a guidebook covering 'core assumptions, numerical algorithms, convergence properties, and practical trade-offs', but the review contains no synthesis table or side-by-side comparison of the surveyed rules beyond descriptive prose. Given the stated aim, a summary table (columns: assumptions, algorithm type, convergence properties, required inputs, limitations) would make the comparison and selection criteria explicit. This is not a correctness issue but it is load-bearing for the paper's contribution as a review.
minor comments (5)
  1. [§3.1.2] Notation for the significance level changes from δ to α without explanation; e.g., α appears in the second-order expansions after δ was used in §2.6. Please harmonize.
  2. [§3.3.2] In the second stopping rule, S_n := 2^{-1}∑_{k=1}^n (X_{2k-1}-X_{2k})² uses n for a number of pairs, while τ2 and τ3 are sample sizes; clarify the index conventions.
  3. [References] Refs. [58], [59], [113] should include arXiv IDs or URLs if they are to be usable. There are also typos in [2] ('randam'), [35] ('Marcel Dekkerr'), and [55] (author list formatting).
  4. [§3.2.2, §3.2.3] Several displayed results (e.g., the Berry-Esseen stopping criterion and the [61] complexity bound) are given without theorem or proposition numbers from the sources; this makes verification unnecessarily difficult for a review.
  5. [§2.4] The statement that resampling methods are not explored is helpful, but the exclusion criteria for confidence sequences and group-sequential clinical-trial methods could be stated more explicitly in one place.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the review summarizes external results and does not derive predictions from fitted inputs.

full rationale

This manuscript is a literature review rather than an original derivation chain. It organizes results from external primary sources (Chow–Robbins, Glynn–Whitt, Hickernell et al., Bayer et al., Huber, Gajek et al.) and does not claim to derive new predictions from fitted parameters. The nearest thing to a derivation, Section 2.8, explicitly explains that the normal-approximation rule defines τ in terms of the stopped empirical standard deviation, so the asymptotic identities in Eq. (2.2) are consequences of that construction rather than advertised as independent predictions. The author-affiliated preprints [58], [59], and [113] are cited as sources for recent developments, and this is a visible self-citation pattern; however, the review's content is the summarized results themselves, and no central claim or target quantity is defined in terms of those summaries in a way that would make the summary equivalent to its input. The undefined λ in Section 3.3.2 and the lack of page/theorem numbers for several cited results are verification and reproducibility concerns, not circularity. Under the hard rule requiring quotation of a specific equation-to-equation reduction or a fitted parameter renamed as a prediction, none is present. The appropriate finding is therefore no significant circularity, score 0.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The ledger is minimal because the paper introduces no new mathematical objects, parameters, or entities. Its load-bearing assumptions are about the fidelity of its literature summaries and the representativeness of its selection, which are necessary premises for the review to be useful. The classical statistical assumptions (iid or martingale-difference structure, bounded moments, normal approximation) are attributed to the cited rules rather than introduced by this paper.

assumptions (3)
  • domain assumption The norm of representing the literature is accuracy of summarization, including that the cited theorems are rendered correctly and that the categorization is faithful to the sources.
    The entire paper is a review; its correctness depends on the accuracy of its summaries of other papers, which cannot be verified from the text alone. The authors acknowledge some summaries are brief, and two preprints are cited without full bibliographic details.
  • domain assumption The papers selected are representative of the recent literature on sequential stopping rules for Monte Carlo methods.
    The review deliberately focuses on standard and lightly generalized Monte Carlo methods, and explicitly leaves aside confidence sequences, resampling methods, and clinical-trial stopping rules. No selection criteria are given beyond approximate dates and topic, so representativeness is assumed.
  • standard math Standard results of sequential analysis, such as the central limit theorem for random sums and the nonexistence theorems of Chow-Robbins and Bahadur-Savage, hold as stated in the cited literature.
    Section 2.6 and 2.8 invoke classical results about asymptotic consistency and efficiency of Chow-Robbins-type stopping rules, and Section 2.5 calls on Bahadur-Savage and Takada. These are standard results in the field.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Stopping Rules for Monte Carlo Methods: A Review." pith.science (2026). https://pith.science/paper/LZYSPENA

@misc{pith2026251022688,
  author       = {Pith},
  title        = {Pith review of: Stopping Rules for Monte Carlo Methods: A Review},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LZYSPENA}},
  note         = {Machine review of arXiv:2510.22688}
}
read the original abstract

Sequential analysis encompasses simulation theories and methods where the sample size is determined dynamically based on accumulating data. Since the conceptual inception, numerous sequential stopping rules have been introduced, and many more are currently being refined and developed. This article aims to deliver an up-to-date review of recent developments in sequential stopping rules, with a deliberate emphasis on Monte Carlo methods for estimating an unknown expectation, including binomial proportions, primarily under standard iid sampling and also under certain lightly generalized settings. These methodologies have long served and likely will continue to serve, as fundamental bases for both theoretical and practical developments in stopping rules for general statistical inference, advanced Monte Carlo techniques, and their modern applications. Building upon over a hundred references and empirical studies, we explore the essential aspects of these methods, such as core assumptions, numerical algorithms, convergence properties, and practical trade-offs to guide further developments, particularly at the intersection of sequential stopping rules and related areas of research.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Stop the Sampler! Classifier-Based Adaptive Stopping for Sampling Kernels

    cs.LG 2026-06 conditional novelty 6.0 of 10

    Classifier-based adaptive stopping, trained as a non-acyclic GFlowNet, shortens MCMC trajectories while preserving or improving sample quality relative to ULA and diffusion-sampler baselines.

Reference graph

Works this paper leans on

114 extracted references · 1 linked inside Pith · cited by 1 Pith paper

  1. [58]

    R. Kawai. Monte Carlo methods with infinite variances, 2025. preprint available here

    2025

  2. [59]

    R. Kawai. Sequential stopping rules malfunctioning, 2025. preprint available here

    2025

  3. [113]

    Wu and R

    J. Wu and R. Kawai. Stopping rules for Monte Carlo methods of martingale difference type, 2025. preprint available here

    2025

  4. [27]

    Dagum, R

    P. Dagum, R. Karp, M. Luby, and S. Ross. An optimal algorithm for Monte Carlo estimation.SIAM Journal on Computing, 29(5):1484–1496, 2000. 20

    2000

  5. [1]

    V . G. Adlakha and G. S. Fishman. Starting and stopping rules for simulations using a priori information. European Journal of Operational Research, 10(4):379–394, 1982

    1982

  6. [2]

    Aerts and H

    M. Aerts and H. Callaert. The exact approximation order in the central limit theorem for randam u-statistics. Sequential Analysis, 5(1):19–35, 1986

    1986

  7. [3]

    Aerts and H

    M. Aerts and H. Callaert. The convergence rate of sequential fixed-width confidence intervals for regular functionals.Australian Journal of Statistics, 28(1):97–106, 1986

    1986

  8. [4]

    F. S. Almeida, F. H. Silveira, and S. Visacro. Stopping criterion for Monte Carlo method-based simulations of the lightning performance of transmission lines.Electric Power Systems Research, 214:108797, 2023

    2023

Show all 114 references
  1. [5]

    F. J. Anscombe. Large-sample theory of sequential estimation.Biometrika, 36(3/4):455–458, 1949

    1949

  2. [6]

    F. J. Anscombe. Large-sample theory of sequential estimation.Mathematical Proceedings of the Cambridge Philosophical Society, 48(4):600–607, 1952

    1952

  3. [7]

    F. J. Anscombe. Sequential estimation.Journal of the Royal Statistical Society. Series B (Methodological), 15(1):1–29, 1953

    1953

  4. [8]

    F. J. Anscombe. Fixed-sample-size analysis of sequential observations.Biometrics, 10(1):89–100, 1954

    1954

  5. [9]

    M. Y . Ata. A convergence criterion for the Monte Carlo estimates.Simulation Modelling Practice and Theory, 15(3):237–246, 2007. 19

    2007

  6. [10]

    R. R. Bahadur and L. J. Savage. The nonexistence of certain statistical procedures in nonparametric problems. The Annals of Mathematical Statistics, 27(4):1115–1122, 1956

    1956

  7. [11]

    O. Balci. Validation, verification, and testing techniques throughout the life cycle of a simulation study.Annals of Operations Research, 53(1):121–173, 1994

    1994

  8. [12]

    B. P. G. V . P. Bartolomeo Stellato and P. J. Goulart. Multivariate Chebyshev inequality with estimated mean and variance.The American Statistician, 71(2):123–127, 2017

    2017

  9. [13]

    Bayer, H

    C. Bayer, H. Hoel, E. von Schwerin, and R. Tempone. On nonasymptotic optimal stopping criteria in Monte Carlo simulations.SIAM Journal on Scientific Computing, 36(2):A869–A885, 2014

    2014

  10. [14]

    Bicher, M

    M. Bicher, M. Wastian, D. Brunmeir, and N. Popper. Review on Monte Carlo simulation stopping rules: How many samples are really enough?Simulation Notes Europe SNE, 32(1):1–8, 2022

    2022

  11. [15]

    Billingsley.Probability and Measure

    P. Billingsley.Probability and Measure. Wiley Series in Probability and Statistics. Wiley, 1995

    1995

  12. [16]

    Bratley, B

    P. Bratley, B. L. Fox, and L. E. Schrage.A Guide to Simulation. 2nd ed. Springer, New York, 1987

    1987

  13. [17]

    Callaert and P

    H. Callaert and P. Janssen. The convergence rate of fixed-width sequential confidence intervals for the mean. Sankhy¯a: The Indian Journal of Statistics, Series A (1961-2002), 43(2):211–219, 1981

    1961

  14. [18]

    Chen and W

    E. Chen and W. Kelton. A stopping procedure based on phi-mixing conditions. In2000 Winter Simulation Conference Proceedings, pages 617–626, 2000

    2000

  15. [19]

    Chen and W

    E. Chen and W. Kelton. Determining simulation run length with the runs test.Simulation Modelling Practice and Theory, 11(3):237–250, 2003

    2003

  16. [20]

    E. J. Chen. A stopping rule using the quasi-independent sequence.Journal of Simulation, 6(2):71–80, 2012

    2012

  17. [21]

    Y . S. Chiew, G. M. Shaw, P. Docherty, J. Dickson, C. Pretty, and J. G. Chase. Early clinical trial termination: Simulation-based design of a robust stopping rule using difference in interventional effect on mortality. In 2016 IEEE EMBS Conference on Biomedical Engineering and...

    2016

  18. [22]

    Y . S. Chow and H. Robbins. On the asymptotic theory of fixed-width sequential confidence intervals for the mean.The Annals of Mathematical Statistics, 36(2):457–462, 1965

    1965

  19. [23]

    Chuang and T

    C.-S. Chuang and T. L. Lai. Hybrid resampling methods for confidence intervals.Statistica Sinica, 10(1):1– 33, 2000

    2000

  20. [24]

    M. C. Costanza and A. A. Afifi. Comparison of stopping rules in forward stepwise discriminant analysis. Journal of the American Statistical Association, 74(368):777–785, 1979

    1979

  21. [25]

    D. R. Cox. Estimation by double sampling.Biometrika, 39(3/4):217–227, 1952

    1952

  22. [26]

    A. Csenki. On the convergence rate of fixed-width sequential confidence intervals.Scandinavian Actuarial Journal, 1980(2):107–111, 1980

    1980

  23. [28]

    Dammertz, J

    H. Dammertz, J. Hanika, A. Keller, and H. Lensch. A hierarchical automatic stopping condition for Monte Carlo global illumination. InProceedings of the WSCG 2010, pages 159–164, 2010

    2010

  24. [29]

    Student’s

    G. B. Dantzig. On the non-existence of tests of “Student’s” hypothesis having power functions independent ofσ.The Annals of Mathematical Statistics, 11(2):186–192, 6 1940

    1940

  25. [30]

    Ellingwood, M

    B. Ellingwood, M. Maes, F. Michael Bartlett, A. T. Beck, C. Caprani, A. Der Kiureghian, L. Due ˜nas-Osorio, N. Galv˜ao, R. Gilbert, J. Li, J. Matos, Y . Mori, I. Papaioannou, R. Parades, D. Straub, and B. Sudret. Devel- opment of methods of structural reliability.Structural Sa...

    2025

  26. [31]

    G. S. Fishman. Achieving specific accuracy in simulation output analysis.Communications of the ACM, 20(5):310–315, 1977

    1977

  27. [32]

    S. C. Fletcher. The stopping rule principle and confirmational reliability.Journal for General Philosophy of Science, 55(1):1–28, 2024

    2024

  28. [33]

    R. W. Frick. A better stopping rule for conventional statistical tests.Behavior Research Methods, Instruments, & Computers, 30(4):690–697, 1998

    1998

  29. [34]

    Gajek, W

    L. Gajek, W. Niemiro, and P. Pokarowski. Optimal Monte Carlo integration with fixed relative precision. Journal of Complexity, 29(1):4–26, 2013

    2013

  30. [35]

    B. K. Ghosh and P. K. Sen.Handbook of Sequential Analysis. Marcel Dekkerr, New York, 1-19, 1991

    1991

  31. [36]

    M. J. Gilman. A brief survey of stopping rules in Monte Carlo simulations. InProceedings of the Second Conference on Applications of Simulations, page 16–20. Winter Simulation Conference, 1968

    1968

  32. [37]

    L. J. Gleser. On the asymptotic theory of fixed-size sequential confidence bounds for linear regression param- eters.The Annals of Mathematical Statistics, 36(2):463–467, 1965

    1965

  33. [38]

    P. W. Glynn and W. Whitt. The asymptotic validity of sequential stopping rules for stochastic simulations. The Annals of Applied Probability, 2(1):180–198, 1992

    1992

  34. [39]

    Govindarajulu.The Sequential Statistical Analysis of Hypothesis Testing, Point and Interval Estimation, and Decision Theory

    Z. Govindarajulu.The Sequential Statistical Analysis of Hypothesis Testing, Point and Interval Estimation, and Decision Theory. 2nd ed. American Science Press, Columbus, OH, 1987

    1987

  35. [40]

    Gupta, S

    V . Gupta, S. Andrad ´ottir, and D. Goldsman. Variance estimation and sequential stopping in steady-state simulations using linear regression.ACM Transactions on Modeling and Computer Simulation, 24(2), 2014

    2014

  36. [41]

    J. B. S. Haldane. On a method of estimating frequencies.Biometrika, 33(3):222–225, 11 1945

    1945

  37. [42]

    P. Hall. Asymptotic theory of triple sampling for sequential estimation of a mean.The Annals of Statistics, 9(6):1229–1238, 1981

    1981

  38. [43]

    P. Hall. Sequential estimation saving sampling operations.Journal of the Royal Statistical Society: Series B (Methodological), 45(2):219–223, 12 1983

    1983

  39. [44]

    Y . He, R. Kawai, Y . Shimizu, and K. Yamazaki. The Gerber-Shiu discounted penalty function: A review from practical perspectives.Insurance: Mathematics and Economics, 109:1–28, 2023. 21

    2023

  40. [45]

    Heidelberger and P

    P. Heidelberger and P. D. Welch. Adaptive spectral methods for simulation output analysis.IBM Journal of Research and Development, 25(6):860–876, 1981

    1981

  41. [46]

    Heidelberger and P

    P. Heidelberger and P. D. Welch. A spectral method for confidence interval generation and run length control in simulations.Communications of the ACM, 24(4):233–245, Apr. 1981

    1981

  42. [47]

    Heidelberger and P

    P. Heidelberger and P. D. Welch. Simulation run length control in the presence of an initial transient.Opera- tions Research, 31(6):1109–1144, 1983

    1983

  43. [48]

    F. J. Hickernell, S.-C. T. Choi, L. Jiang, and L. A. Jim ´enez Rugama. Monte Carlo simulation, automatic stopping criteria for. InWiley StatsRef: Statistics Reference Online, pages 1–7. American Cancer Society, 2018

    2018

  44. [49]

    F. J. Hickernell, L. Jiang, Y . Liu, and A. B. Owen. Guaranteed conservative fixed width confidence intervals via Monte Carlo sampling. In J. Dick, F. Y . Kuo, G. W. Peters, and I. H. Sloan, editors,Monte Carlo and Quasi-Monte Carlo Methods 2012, pages 105–128. Springer Berlin...

    2012

  45. [50]

    Hirose, E

    K. Hirose, E. Isogai, and C. Uno. The convergence rate of fixed-width sequential confidence intervals for a parameter of an exponential distribution.Annals of the Institute of Statistical Mathematics, 49(2):199–209, 1997

    1997

  46. [51]

    M. Huber. A Bernoulli mean estimate with known relative error distribution.Random Structures & Algo- rithms, 50(2):173–182, 2017

    2017

  47. [52]

    M. Huber. An optimal(ε,δ)-randomized approximation scheme for the mean of random variables with bounded relative variance.Random Structures & Algorithms, 55(2):356–370, 2019

    2019

  48. [53]

    Jennison and B

    C. Jennison and B. Turnbull.Group Sequential Methods with Applications to Clinical Trials. Chapman & Hall/CRC Interdisciplinary Statistics. CRC Press, 1999

    1999

  49. [54]

    Jiang and F

    L. Jiang and F. J. Hickernell. Guaranteed Monte Carlo methods for Bernoulli random variables. arXiv:1411.1151, 2014

    2014 arXiv

  50. [55]

    M. C. Y . John G. Saw and T. C. Mo. Chebyshev inequality with estimated mean and variance.The American Statistician, 38(2):130–132, 1984

    1984

  51. [56]

    I. W. Kabak. Stopping rules for queuing simulations.Operations Research, 16(2):431–437, 1968

    1968

  52. [57]

    Kang and B

    K. Kang and B. Schmeiser. Graphical methods for evaluating and comparing confidence-interval procedures. Operations Research, 38(3):546–553, 1990

    1990

  53. [60]

    Koopmans and C

    L. Koopmans and C. Qualls. Fixed length confidence intervals for parameters of the normal distribution based on two-stage sampling procedures.The Rocky Mountain Journal of Mathematics, 1(4):587–602, 1971

    1971

  54. [61]

    R. J. Kunsch, E. Novak, and D. Rudolf. Solvable integration problems and optimal sample size selection. Journal of Complexity, 53:40–67, 2019. 22

    2019

  55. [62]

    T. L. Lai. Sequential analysis: Some classical problems and new challenges.Statistica Sinica, 11(2):303–351, 2001

    2001

  56. [63]

    Landers and L

    D. Landers and L. Rogge. The exact approximation order in the central-limit-theorem for random summation. Zeitschrift f¨ur Wahrscheinlichkeitstheorie und Verwandte Gebiete, 36(4):269–283, 1976

    1976

  57. [64]

    S. S. Lavenberg and C. H. Sauer. Sequential stopping rules for the regenerative method of simulation.IBM Journal of Research and Development, 21(6):545–558, 1977

    1977

  58. [65]

    A. M. Law and J. S. Carson. A sequential procedure for determining the length of a steady-state simulation. Operations Research, 27(5):1011–1025, 1979

    1979

  59. [66]

    A. M. Law and D. M. Kelton.Simulation Modeling and Analysis. McGraw-Hill Higher Education, 3rd edition, 1999

    1999

  60. [67]

    A. M. Law and W. D. Kelton. Confidence intervals for steady-state simulations, II: A survey of sequential procedures.Management Science, 28(5):550–562, 1982

    1982

  61. [68]

    A. M. Law and W. D. Kelton. Confidence intervals for steady-state simulations: I. A survey of fixed sample size procedures.Operations Research, 32(6):1221–1239, 1984

    1984

  62. [69]

    A. M. Law, W. D. Kelton, and L. W. Koenig. Relative width sequential confidence intervals for the mean. Communications in Statistics - Simulation and Computation, 10(1):29–39, 1981

    1981

  63. [70]

    Mendo and J

    L. Mendo and J. Hernando. A simple sequential stopping rule for Monte Carlo simulation.IEEE Transactions on Communications, 54(2):231–241, 2006

    2006

  64. [71]

    Mukhopadhyay and S

    N. Mukhopadhyay and S. Datta. On sequential fixed-width confidence intervals for the mean and second- order expansions of the associated coverage probabilities.Annals of the Institute of Statistical Mathematics, 48(3):497–507, 1996

    1996

  65. [72]

    Mukhopadhyay and B

    N. Mukhopadhyay and B. M. de Silva.Sequential Methods and Their Applications. Chapman and Hall/CRC, New York, 1st edition, 2008

    2008

  66. [73]

    Mukhopadhyay, P

    N. Mukhopadhyay, P. K. Sen, and B. K. Sinha. Stopping rules, permutation invariance and sufficiency princi- ple.Annals of the Institute of Statistical Mathematics, 41(1):121–138, 1989

    1989

  67. [74]

    Mukhopadhyay and T

    N. Mukhopadhyay and T. Solanky. Second order properties of accelerated stopping times with applications in sequential estimation.Sequential Analysis, 10(1-2):99–123, 1991

    1991

  68. [75]

    A. Nadas. An extension of a theorem of Chow and Robbins on sequential confidence intervals for the mean. The Annals of Mathematical Statistics, 40(2):667–671, 1969

    1969

  69. [76]

    Nightingale and C

    M. Nightingale and C. Umrigar.Quantum Monte Carlo Methods in Physics and Chemistry. Nato Science Series C:. Springer Netherlands, 1998

    1998

  70. [77]

    Y . Ohkubo. Revisiting the two predominant statistical problems: The stopping-rule problem and the catch-all hypothesis problem.Annals of the Japan Association for Philosophy of Science, 30:23–41, 2021. 23

    2021

  71. [78]

    K. E. E. Raatikainen. A sequential procedure for simultaneous estimation of several means.ACM Transactions on Modeling and Computer Simulation, 3(2):108–133, 1993

    1993

  72. [79]

    P. H. Randolph, G. Swinson, and C. Ellingsen. Technical note—stopping rules for sequencing problems. Operations Research, 21(6):1309–1315, 1973

    1973

  73. [80]

    W. D. Ray. Sequential confidence intervals for the mean of a normal population with unknown variance. Journal of the Royal Statistical Society. Series B (Methodological), 19(1):133–143, 1957

    1957

  74. [81]

    Robbins and S

    H. Robbins and S. Monro. A stochastic approximation method.The Annals of Mathematical Statistics, 22(3):400–407, 1951

    1951

  75. [82]

    F. Schoen. Stochastic global optimization: Stopping rules. In C. A. Floudas and P. M. Pardalos, editors, Encyclopedia of Optimization, pages 3743–3746. Springer US, Boston, MA, 2009

    2009

  76. [83]

    L. W. Schruben. A coverage function for interval estimators of simulation response.Management Science, 26(1):18–27, 1980

    1980

  77. [84]

    Schuemann, X

    J. Schuemann, X. Jia, and H. Paganetti.Monte Carlo Methods for Medical Physics: A Practical Introduction. Taylor & Francis Group, 2019

    2019

  78. [85]

    R. J. Serfling and D. D. Wackerly. Asymptotic theory of sequential fixed-width confidence interval procedures. Journal of the American Statistical Association, 71(356):949–955, 1976

    1976

  79. [86]

    W. A. Shewhart. Economic quality control of manufactured product.Bell System Technical Journal, 9(2):364– 389, 1930

    1930

  80. [87]

    H. J. Shim and C. H. Kim. Stopping criteria of inactive cycle Monte Carlo calculations.Nuclear Science and Engineering, 157(2):132–141, 2007

    2007

  81. [88]

    Siegmund.Sequential Analysis

    D. Siegmund.Sequential Analysis. Springer, New York, 1985

    1985

  82. [89]

    Siegmund

    D. Siegmund. Herbert Robbins and sequential analysis: invited paper.The Annals of Statistics, 31(2):349– 365, 2003

    2003

  83. [90]

    D. I. Singham. Selecting stopping rules for confidence interval procedures.ACM Transactions on Modeling and Computer Simulation, 24(3), 2014

    2014

  84. [91]

    D. I. Singham and L. W. Schruben. Analysis of sequential stopping rules. InProceedings of the 2009 Winter Simulation Conference (WSC), pages 723–730, 2009

    2009

  85. [92]

    D. I. Singham and L. W. Schruben. Finite-sample performance of absolute precision stopping rules.INFORMS Journal on Computing, 24(4):624–635, 2012

    2012

  86. [93]

    S. L. Solomon. A simplified stopping rule for simulations.ACM SIGSIM Simulation Digest, 4(1):27–28, 1972

    1972

  87. [94]

    Song and R

    C. Song and R. Kawai. Adaptive radial importance sampling under directional stratification.Probabilistic Engineering Mechanics, 72:103443, 2023. 24

    2023

  88. [95]

    Song and R

    C. Song and R. Kawai. Adaptive stratified sampling for structural reliability analysis.Structural Safety, 101:102292, 2023

    2023

  89. [96]

    Song and R

    C. Song and R. Kawai. Monte Carlo and variance reduction methods for structural reliability analysis: A comprehensive review.Probabilistic Engineering Mechanics, 73:103479, 2023

    2023

  90. [97]

    N. Starr. The performance of a sequential procedure for the fixed-width interval estimation of the mean.The Annals of Mathematical Statistics, 37(1):36–50, 1966

    1966

  91. [98]

    C. Stein. A two-sample test for a linear hypothesis whose power is independent of the variance.The Annals of Mathematical Statistics, 16(3):243–258, 1945

    1945

  92. [99]

    Stein and A

    C. Stein and A. Wald. Sequential confidence intervals for the mean of a normal distribution with known variance.The Annals of Mathematical Statistics, 18(3):427–433, 1947

    1947

  93. [100]

    Swanepoel and J

    J. Swanepoel and J. van Wyk. Fixed width confidence intervals for the location parameter of an exponential distribution.Communications in Statistics - Theory and Methods, 11(11):1279–1289, 1982

    1982

  94. [101]

    Y . Takada. The nonexistence of procedures with bounded performance characteristics in certain parametric inference problems.Annals of the Institute of Statistical Mathematics, 50(2):325–335, 1998

    1998

  95. [102]

    Ueki and F

    T. Ueki and F. B. Brown. Stationarity modeling and informatics-based diagnostics in Monte Carlo criticality calculations.Nuclear Science and Engineering, 149(1):38–50, 2005

    2005

  96. [103]

    D. Vats, J. M. Flegal, and G. L. Jones. Monte Carlo simulation: Are we there yet? InWiley StatsRef: Statistics Reference Online, pages 1–15. John Wiley & Sons, Ltd, 2021

    2021

  97. [104]

    Wald.Sequential Analysis

    A. Wald.Sequential Analysis. John Wiley and Sons, New York, 1947

    1947

  98. [105]

    Waudby-Smith and A

    I. Waudby-Smith and A. Ramdas. Estimating means of bounded random variables by betting.Journal of the Royal Statistical Society Series B: Statistical Methodology, 86(1):1–27, 02 2023

    2023

  99. [106]

    G. B. Wetherill and K. D. Glazebrook.Sequential Methods in Statistics. 3rd ed. Chapman and Hall, London, 1986

    1986

  100. [107]

    W. Whitt. Planning queueing simulations.Management Science, 35(11):1341–1366, 1989

    1989

  101. [108]

    W. Whitt. Asymptotic formulas for Markov processes with applications to simulation.Operations Research, 40(2):279–291, 1992

    1992

  102. [109]

    G. Woo. A quitting rule for Monte Carlo simulation of extreme risks.Reliability Engineering & System Safety, 31(2):179–189, 1991

    1991

  103. [110]

    Woodroofe

    M. Woodroofe. Second order approximations for sequential point and interval estimation.The Annals of Statistics, 5(5):984–995, 1977

    1977

  104. [111]

    Woodroofe

    M. Woodroofe. Asymptotic optimality in sequential interval estimation.Advances in Applied Mathematics, 7(1):70–79, 1986. 25

    1986

  105. [112]

    Woodroofe

    M. Woodroofe. Very weak expansions for sequential confidence levels.The Annals of Statistics, 14(3):1049– 1067, 1986

    1986

  106. [114]

    Xu and A

    J. Xu and A. K. Gupta. Improved confidence regions for a mean vector under general conditions.Computa- tional Statistics & Data Analysis, 51(2):1051–1062, 2006. 26

    2006

Pith tools

Reviewed August 4, 2026 · model on record in the stance chip above.