REVIEW 4 major objections 6 minor 19 references
Emittance Minimization for Aberration Correction II: Physics-informed Bayesian Optimization of an Electron Microscope
T0 review · 4 major / 6 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read This paper claims that aligning an aberration-corrected scanning transmission electron microscope can be reduced to optimizing a single scalar—the beam emittance growth predicted from a single Ronchigram by a neural network—using Bayesian…
desk verdict Solid simulation-backed automation paper whose headline experimental claim rests on a circular metric; worth refereeing for the simulation and the method, with a demand for independent experimental validation. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the beam emittance growth $\varepsilon_{rms}^2$, a single scalar obtained from the second moments of the Wigner distribution of the 2D electron wave function at the aperture. For an aberration function $\chi(\vec{\alpha})$ expanded in Krivanek notation, it can be computed from $\langle|\nabla\chi|^2\rangle$, $\langle|\vec{\alpha}|^2\rangle$, and $\langle \vec{\alpha}\cdot\nabla\chi\rangle$, which the authors show reduces to an integral over the squared aperture brightness and the gradient of $\chi$. Its useful properties are that it is independent of defocus and convex in the aberration coefficients, so the Hessian with respect to aberration coefficients is positive semidefinite. That convexity makes it a well-behaved black-box objective, and a CNN trained on simulated Ronchigrams supplies the mapping from experimental images to emittance. The optimizer is Bayesian: a Gaussian-process surrogate with a kernel (RBF, Matern, or a deep-kernel network $k(g(\mathbf{x}_1,\mathbf{w}), g(\mathbf{x}_2,\mathbf{w}))$) is updated after each Ronchigram, and the next corrector setting is chosen by an acquisition function (upper confidence bound). The deep-kernel variant is what lets the surrogate learn couplings between separate control channels without measuring the aberration coefficients explicitly.
What would settle it
Take the states the optimizer declares optimal on a real microscope and measure the probe directly—by imaging a known atomic lattice, by 4D-STEM ptychographic reconstruction, or by reconstructing the phase-space emittance from the Wigner distribution—and check whether the CNN's emittance ranking matches the physical probe quality; if the CNN says a state is good while the probe is demonstrably aberrated, the central equivalence between the learned metric and aberration correction fails.
Extended reading notes
Core claim
The central claim is that minimizing beam emittance growth is equivalent to performing aberration correction, so the whole tuning problem collapses to optimizing a single scalar objective rather than estimating individual Zernike coefficients. Building on the Part I derivation, the authors take the root-mean-square emittance growth $\varepsilon_{rms}^2$ defined from the Wigner distribution of the electron wave function, note that it depends only on the gradient of the aberration function $\chi(\vec{\alpha})$ and is convex in the aberration coefficients, and use a deep convolutional network trained on simulated Ronchigrams to predict it from a single experimental Ronchigram. Around this predictor they build a Bayesian optimization loop, testing generic RBF and Matern kernels and a deep-kernel surrogate that learns correlations between control channels. The reported results are that Bayesian optimization outperforms the Nelder-Mead simplex baseline in simulation, that the deep kernel converges to lower emittance than isotropic kernels given enough iterations, and that on two ThermoFisher microscopes the automated loop reaches a CNN-predicted normalized emittance of $0.0266 \pm 0.0037$ and $0.0264 \pm 0.0045$ in about 50 iterations and 4 minutes, versus $0.0977 \pm 0.0041$ after Zemlin-tableau tuning on the Spectra 300.
Load-bearing premise
The whole demonstration rests on the assumption that the neural network trained on simulated Ronchigrams predicts true emittance on real, imperfect microscopes closely enough that minimizing its output also minimizes actual aberrations.
Editorial extensions
If this is right
- Aberration correction no longer requires measuring individual Zernike aberration coefficients; a single Ronchigram plus one scalar objective suffices, which removes the multi-image tilt-series bottleneck of the Zemlin tableau.
- A commercial microscope can be aligned from a random starting state in about 50 iterations and 4 minutes, compared with hours for a human expert or several multi-minute Zemlin measurements, making frequent re-tuning practical.
- Because the CNN can score every candidate state from a single Ronchigram, the loop can run on an amorphous sample area, allowing re-alignment in the middle of an experiment rather than only at the start.
- Deep-kernel surrogates that learn input couplings reduce the chance of getting trapped near local optima and reach lower emittance than isotropic RBF/Matern kernels in the long run, according to the simulation benchmarks.
- The same emittance-minimization-plus-Bayesian-optimization framework is claimed to generalize to other high-dimensional, expensive scientific-instrument tuning tasks.
Reading between the lines
- A natural extension, not spelled out in the paper, is to use the same Wigner-based emittance metric for other charged-particle optical systems—accelerator beamlines or electron sources—wherever a CNN predictor can be trained.
- The paper does not compare the CNN's emittance scores with a direct experimental phase-space measurement; doing so (for example, with 4D-STEM or a Wigner reconstruction of the probe) would independently confirm that the optimized state is genuinely better.
- The periodic 'deGauss' reset hints that magnetic hysteresis is a confound for the surrogate; an extension would be to model that history explicitly in the kernel or state, potentially removing the need for resets and speeding convergence.
- Because the CNN was trained on simulation and applied without per-instrument recalibration, a practical extension is to fine-tune it with the first few online runs on each microscope, making the objective robust to instrument-specific optics and detectors.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents a Bayesian optimization (BO) framework for automated aberration correction in scanning transmission electron microscopy (STEM). The objective is a scalar beam-emittance-growth metric predicted by a convolutional neural network (CNN) from a single Ronchigram, developed in Part I. The authors propose a deep-kernel Bayesian optimization (DKBO) variant to capture inter-channel correlations. They validate the method in General Particle Tracer (GPT) simulations of a simplified hexapole-corrected microscope, showing that BO outperforms the Nelder-Mead simplex baseline in 2D and 6D tuning tasks, and report online experiments on a ThermoFisher Titan Cryo-S/TEM and a ThermoFisher Spectra 300 (plus a Nion UltraSTEM in Appendix A), where the method converges in about 50 iterations and 4 minutes. They compare the final state to the standard Zemlin tableau method on the Spectra 300 and claim their approach achieves a better optical state (normalized emittance 0.0266 vs. 0.0977) with a higher convergence rate.
Significance. If the claims hold, the method is a substantial practical advance: it replaces a 2–3 hour manual tuning procedure with a fully automated, roughly 4-minute routine that uses a single scalar metric and does not require explicit measurement of aberration coefficients. The simulation results are credible and provide independent support: GPT ray tracing shows a large FWHM reduction (from 0.385 μm to 0.0064 μm in one example), a visibly enlarged Ronchigram flat area, and a reduced phase-space area. The convergence benchmarks over 20 repetitions are a solid feature. However, the central experimental claim that BO 'outperforms conventional approaches' is currently supported only by evaluations using the same CNN that serves as the optimization objective, which is a circular comparison. The paper would be significantly strengthened by an independent optical-state measurement (e.g., residual aberration coefficients, probe size, or image resolution).
major comments (4)
- [III.B] The quantitative experimental comparison is circular. In Section III.B, the CNN emittance predictor is used as (i) the objective for Bayesian optimization, (ii) the metric for the final BO state (0.0266 ± 0.0037), and (iii) the metric for the Zemlin-tuned state (0.0977 ± 0.0041). No independent measurement of the optical state—such as residual aberration coefficients, direct probe size, or a resolution test—is reported for the BO-final states. Therefore the headline claim that the proposed method 'outperforms conventional approaches' in experiments is not established by the reported data. The authors should either provide an independent evaluation of the BO-final states or explicitly limit the experimental claim to a qualitative Ronchigram improvement.
- [III.B] The comparison with the Zemlin tableau is not a controlled experiment. The text states that the Spectra 300 was tuned 'several times' using the Zemlin method, but gives no details on the number of tuning iterations, the stopping criterion, the operator variance, or whether the same experimental conditions (sample, aperture, camera settings) were used as in the BO runs. The BO results are averaged over 10 runs, whereas no distribution is reported for the Zemlin results. This makes the quantitative margin (0.0266 vs. 0.0977) hard to interpret even if the circularity concern were resolved.
- [III.A / Figure 4] The dramatic FWHM reduction (0.3850 μm to 0.0064 μm) is reported for a single illustrative run, not averaged over the 20 repetitions used for the convergence benchmarks in Figure 6. The text claims that 'the optimization of aberration correctors according to the minimization of beam emittance can effectively eliminate lower order aberrations,' but this claim is supported by only one example. Please report the distribution of final FWHM or emittance over the 20 runs and assess statistical significance.
- [II.D / Figure 7] The claim that the deep kernel 'eliminates the chance of being trapped at local optima' is not quantitatively supported. Figure 7 shows qualitative scatter plots of queried points, but no metric for exploration/exploitation balance or local-optimum avoidance is provided, and the standard error bars in Figure 6 overlap in several regions. Please quantify exploration (e.g., coverage of the parameter space, GP predictive variance, or final emittance variance across repetitions) or temper the claim.
minor comments (6)
- [II.C] There is a duplicated heading: 'C. Physics-informed kernel' appears twice, immediately after 'C. Bayesian optimization'. Also, equation numbers are reused (Equation (5) appears twice, and Equation (2) is used for both the emittance definition and the Matern kernel). Please renumber consistently.
- [III.A] Typographical errors: 'Baysian' should be 'Bayesian', 'shruk' should be 'shrunk', and 'posess' should be 'possess'.
- [II.C] The paper's title advertises 'physics-informed' optimization, but the implemented DKBO method uses a deep neural network kernel and the Hessian-derived correlation kernel described in Section II.C is not used in the actual experiments or benchmarks. Please clarify how 'physics-informed' applies to the implemented method, or adjust the title/abstract to avoid overclaiming.
- [III.A / Figure 6] The text states the budget of iterations for the GPT-6D runs is 300, while the right panel of Figure 6 is labeled 'within 100 iterations.' Please clarify the final budget and whether the plotted results are truncated or the budget was changed.
- [III.B] The CNN emittance predictor from Part I is used as the objective for all experiments, but the paper gives only a reference to Part I and does not summarize its architecture, training data, or validation on experimental Ronchigrams. Since the experimental results depend entirely on this predictor, a brief description or at least a validation summary (especially regarding defocus invariance and transfer to different microscopes) should be included.
- [General] No data availability statement is provided. Please include a statement on whether the GPT simulation scripts, BO code, and experimental datasets will be made available.
Circularity Check
The experimental comparison is circular: the CNN from Part I is simultaneously the Bayesian optimizer's objective and the only quantitative evaluator, so the claimed superiority over Zemlin tuning is forced by construction.
-
self definitional
[Section III.B (online optimization of real microscopes), with the CNN-objective link established in Section II.C.]
"we first acquire 10 Ronchigrams with random inputs and predict their emittance growth values with the CNN, upon which we initialize the GP for Bayesian optimization. ... The final normalized emittance values measured by the CNN after Bayesian optimization were 0.0266 ± 0.0037 (Cryo S/TEM) and 0.0264 ± 0.0045 (Spectra 300) averaged across 10 runs. ... Finally, we examine the Ronchigrams acquired from the corrected states and predict final emittance with the same trained deep neural network 0.0977 ± 0.0041 (Spectra 300), averaged across 10 runs."
The CNN is not an independent evaluator. Section II.C makes it the black-box objective ('a deep learning model can build a mapping from experimentally accessible electron Ronchigrams, which becomes the objective function we optimize here'), and Section III.B uses 'the same trained deep neural network' to score both the BO-final and Zemlin-final states. BO therefore minimizes exactly the function used to declare it superior, while the Zemlin state was never optimized against that CNN metric. No independent optical-state measurement (residual aberration coefficients, probe size, or image resolution) is reported for the experimental comparison, so the quantitative claim that BO outperforms conventional approaches reduces, in the experiment, to the identity objective = evaluation metric.
full rationale
The circularity is confined to the experimental comparison. The simulation benchmarks in Section III.A are grounded externally: they evaluate directly ray-traced beam emittance and probe FWHM in GPT, and the Part I CNN is not the scoring function there. Citations to Part I are companion-paper self-citations carrying mathematical derivations and a separately trained network, but they are not used to forbid alternative approaches, so they are not load-bearing circularity by themselves. However, in Section III.B the same fitted CNN is both the Bayesian optimizer's objective and the only quantitative metric for comparing BO against Zemlin tuning; the reported 0.0266 vs 0.0977 emittance values are therefore a by-construction outcome of minimizing that metric, not an independent demonstration of a better optical state. The qualitative Ronchigram flat-area improvement is supporting but does not establish the quantitative superiority claim. Transfer of the CNN to real microscopes without per-instrument calibration is an accuracy risk, not a circularity argument.
Assumptions & free parameters
free parameters (4)
- CNN emittance predictor weights =
not disclosed
- Deep kernel DNN weights and GP lengthscales =
not disclosed
- UCB acquisition beta =
0.2
- Random phase plate size and Gaussian blur =
optimized but unspecified
assumptions (4)
- domain assumption Emittance growth defined in Eq. 2 is convex in aberration coefficients and equivalent to aberration correction
- domain assumption CNN trained on simulated Ronchigrams transfers to real microscopes with no per-instrument calibration
- domain assumption CEOS aberration buttons map stationarily to physical lens currents
- standard math Standard GP/BO machinery and Wigner-Weyl transform results
Cite this review
Pith. "Pith review of Emittance Minimization for Aberration Correction II: Physics-informed Bayesian Optimization of an Electron Microscope." pith.science (2026). https://pith.science/paper/MDRN2SG5
@misc{pith2026241220356,
author = {Pith},
title = {Pith review of: Emittance Minimization for Aberration Correction II: Physics-informed Bayesian Optimization of an Electron Microscope},
year = {2026},
howpublished = {\url{https://pith.science/paper/MDRN2SG5}},
note = {Machine review of arXiv:2412.20356}
}
read the original abstract
Aberration-corrected Scanning Transmission Electron Microscopy (STEM) has become an essential tool in understanding materials at the atomic scale. However, tuning the aberration corrector to produce a sub-{\AA}ngstr\"om probe is a complex and time-costly procedure, largely due to the difficulty of precisely measuring the optical state of the system. When measurements are both costly and noisy, Bayesian methods provide rapid and efficient optimization. To this end, we develop a Bayesian approach to fully automate the process by minimizing a new quality metric, beam emittance, which is shown to be equivalent to performing aberration correction. In part I, we derived several important properties of the beam emittance metric and trained a deep neural network to predict beam emittance growth from a single Ronchigram. Here we use this as the black box function for Bayesian Optimization and demonstrate automated tuning of simulated and real electron microscopes. We explore different surrogate functions for the Bayesian optimizer and implement a deep neural network kernel to effectively learn the interactions between different control channels without the need to explicitly measure a full set of aberration coefficients. Both simulation and experimental results show the proposed method outperforms conventional approaches by achieving a better optical state with a higher convergence rate.
Figures
Reference graph
Works this paper leans on
-
[1]
J. Barthel, A. Thust, On the optical stability of high-resolution transmission electron microscopes, Ultramicroscopy 134 (2013) 6–17
work page 2013
-
[2]
S. Schramm, S. Van Der Molen, R. Tromp, Intrinsic instability of aberration-corrected electron microscopes, Phys. Rev. Lett. 109 (2012) 163901
work page 2012
-
[4]
D. Ma, C. Zhang, Y.-T. Shao, Z. Baraissov, C. Duncan, A. Hanuka, A. Edelen, J. Maxon, D. Muller, Physics-informed Bayesian Optimization of an Electron Microscope, Microsc. Microanal. 29 (2023) 1875–1877. https://doi.org/10.1093/micmic/ozad067.968
-
[5]
Frazier, A Tutorial on Bayesian Optimization, (2018)
P.I. Frazier, A Tutorial on Bayesian Optimization, (2018). https://doi.org/10.48550/arXiv.1807.02811
-
[6]
M.C. Cao, Z. Chen, Y. Jiang, Y. Han, Automatic parameter selection for electron ptychography via Bayesian optimization, Sci. Rep. 12 (2022) 12284. https://doi.org/10.1038/s41598-022-16041-5
-
[7]
A.J. Pattison, S.M. Ribet, M.M. Noack, G. Varnavides, K. Park, E. Kirkland, J. Park, C. Ophus, P. Ercius, BEACON -- Automated Aberration Correction for Scanning Transmission Electron Microscopy using Bayesian Optimization, (2024). http://arxiv.org/abs/2410.14873 (accessed October 23, 2024)
work page Pith review arXiv 2024
-
[8]
The go-to choice of kernel is the radial basis function (RBF) kernel
Appendix B: Other Kernels The kernel plays a significant role in the modeling of Gaussian processes, which encodes the covariance between each pair of the inputs. The go-to choice of kernel is the radial basis function (RBF) kernel. However, we further discuss how we can leverage our knowledge of the physics in the microscope system to choose more suitabl...
work page 2013
-
[9]
J. Duris, D. Kennedy, A. Hanuka, J. Shtalenkova, A. Edelen, P. Baxevanis, A. Egger, T. Cope, M. McIntire, S. Ermon, D. Ratner, Bayesian Optimization of a Free-Electron Laser, Phys. Rev. Lett. 124 (2020) 124801. https://doi.org/10.1103/PhysRevLett.124.124801
Show all 19 references
-
[10]
Shalloo, S.J.D
R.J. Shalloo, S.J.D. Dann, J.-N. Gruse, C.I.D. Underwood, A.F. Antoine, C. Arran, M. Backhouse, C.D. Baird, M.D. Balcazar, N. Bourgeois, J.A. Cardarelli, P. Hatfield, J. Kang, K. Krushelnick, S.P.D. Mangles, C.D. Murphy, N. Lu, J. Osterhoff, K. Põder, P.P. Rajeev, C.P. Ridgers...
2020
-
[11]
Jalas, M
S. Jalas, M. Kirchen, P. Messner, P. Winkler, L. Hübner, J. Dirkwinkel, M. Schnepp, R. Lehe, A.R. Maier, Bayesian Optimization of a Laser-Plasma Accelerator, Phys. Rev. Lett. 126 (2021) 104801. https://doi.org/10.1103/PhysRevLett.126.104801
2021 doi
-
[12]
Zhang, Z
C. Zhang, Z. Baraissov, C. Duncan, A. Hanuka, A. Edelen, J. Maxson, D. Muller, Aberration Corrector Tuning with Machine-Learning-Based Emittance Measurements and Bayesian Optimization, Microsc. Microanal. 27 (2021) 810–812. https://doi.org/10.1017/S1431927621003214
2021 doi
-
[13]
Zhang, Y.-T
C. Zhang, Y.-T. Shao, Z. Baraissov, C.J. Duncan, A. Hanuka, A.L. Edelen, J.M. Maxson, D.A. Muller, Bayesian Optimization for Multi-dimensional Alignment: Tuning Aberration Correctors and Ptychographic Reconstructions, Microsc. Microanal. 28 (2022) 3146–3148. https://doi.org/10...
2022 doi
-
[14]
Krivanek, N
O.L. Krivanek, N. Dellby, A.R. Lupini, Towards sub-Å electron beams, Ultramicroscopy 78 (1999) 1–11. https://doi.org/10.1016/S0304-3991(99)00013-3
1999 doi
-
[15]
De Loos, S.B
M.J. De Loos, S.B. Van der Geer, General Particle Tracer: A New 3D Code for Accelerator and Beamline Design, (1996). https://cds.cern.ch/record/860825 (accessed April 9, 2024)
1996
-
[16]
Wilson, Z
A.G. Wilson, Z. Hu, R. Salakhutdinov, E.P. Xing, Deep Kernel Learning, in: Proc. 19th Int. Conf. Artif. Intell. Stat., PMLR, 2016: pp. 370–378. https://proceedings.mlr.press/v51/wilson16.html (accessed April 9, 2024)
2016
- [17]
-
[18]
Hartel, V
P. Hartel, V. Gerheim, M. Linck, H. Müller, S. Uhlemann, Z. Zach, M. Haider, On the residual six-fold astigmatism in DCOR/ASCOR, Ultramicroscopy 206 (2019) 112821. https://doi.org/10.1016/j.ultramic.2019.112821
2019
-
[2021]
https://www.osti.gov/biblio/1811769 (accessed April 9, 2024)
2024
-
[6355]
https://doi.org/10.1038/s41467-020-20245-6
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.