REVIEW 3 major objections 4 minor 40 references
Developing Machine Learning Models of Subgrid Turbulent Transport for Quiet Sun 3D Radiative Hydrodynamic Simulations
T0 review · 3 major / 4 minor · reviewed 2026-07-13 · grok-4.5
Pith's one-line read A 3D convolutional network predicts solar subgrid Reynolds stresses more accurately than standard physics-based closures.
desk verdict Solid offline a-priori CNN gains on quiet-Sun Reynolds stresses, but the live-closure claim is still untested. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The 3DCNN1.1 architecture: two 3-by-3-by-3 convolutional layers (32 then 64 filters, LeakyReLU) that extract spatial features from the three velocity channels, followed by concatenation of the central density and SoftSign fully-connected layers that output the six stress components; trained after signed-log transformation of the targets.
What would settle it
Insert the trained network as the active subgrid model inside a low-resolution StellarBox run and check whether the resulting large-scale velocity and density statistics, plus the emergent stress distributions, match those of a high-resolution reference simulation better than the same run performed with a Smagorinsky closure.
Extended reading notes
Core claim
A 3D convolutional neural network that ingests local averaged velocity cubes and density can reconstruct the six Reynolds stress tensor components of quiet-Sun turbulence more accurately than the Gradient model, the Smagorinsky model (under two coefficient choices), and a multilayer perceptron, delivering average RMSE reductions of about 31 percent on the diagonal components and 8 percent on the off-diagonal components.
Load-bearing premise
That accurate offline predictions on filtered high-resolution cubes (and static low-resolution snapshots) will remain accurate once the same network is inserted as a live subgrid closure inside a time-evolving solar simulation.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper develops 3D convolutional neural network (3DCNN) surrogates, along with an MLP baseline, to predict the six components of the Reynolds stress tensor τ_ij from local 3×3×3 averaged velocity fields and central density in quiet-Sun StellarBox radiative hydrodynamic simulations. High-resolution (∼12.5 km) cubes are filtered to ∼50 km effective resolution to generate both inputs and exact targets via the definition τ_ij = 〈u_i u_j〉 − ũ_i ũ_j. After log/signed-log transforms and standardization of the heavily skewed targets, the best architecture (3DCNN1.1 with LeakyReLU) is shown via held-out RMSE, R², PDFs, error histograms, density-binned diagnostics, and low-resolution snapshot tests to outperform the Gradient model, Smagorinsky (Cs=Cc=0.1 and 0.001), and MLP, with average RMSE reductions of ∼31 % on diagonal and ∼8 % on off-diagonal components relative to Gradient (Table 5). The authors conclude that CNNs are a viable candidate for subgrid-scale modeling, while explicitly deferring online coupling into StellarBox.
Significance. If the offline gains translate under live coupling, the work would supply a coefficient-free, data-driven alternative to classical Smagorinsky/Gradient closures for solar convection-zone LES, with clear practical value for multi-scale quiet-Sun modeling. Even as a pure a-priori study the manuscript is carefully executed: physical units are restored after inverted transforms, multiple physics baselines and architecture ablations are reported, and density-binned plus cluster diagnostics expose regime-dependent performance. These elements constitute a solid, reproducible foundation for subsequent a-posteriori tests and are already useful to the solar and LES communities.
major comments (3)
- [Abstract, §1, §5.4] Abstract, §1 and §5.4: the central claim that the 3DCNN is “a viable candidate for modeling subgrid processes and a promising alternative to traditional turbulence models” rests exclusively on a-priori regression accuracy (Table 5, Figs. 9–12). When the same network is applied to genuine low-resolution (∼50 km) fields the predicted stress PDFs systematically compress in the tails (Figs. 13–14). Classical LES literature treats the a-priori/a-posteriori gap as decisive; without at least one online StellarBox integration (or a clear, quantitative statement that the present results do not yet establish live-closure viability) the abstract and conclusion over-reach the evidence that is actually supplied.
- [Table 5, §5.1] Table 5 and §5.1: the headline ∼31 % / ∼8 % RMSE reductions are computed solely against the Gradient model. Against Smagorinsky (Cs=Cc=0.001) the gains are larger, yet that coefficient set is known to under-dissipate; against Cs=Cc=0.1 the diagonal gains shrink. The abstract and conclusion should report the full range of relative improvements (or at least both Smagorinsky settings) so that the claimed superiority is not tied to a single, relatively weak baseline.
- [§3.1, Eq. (5)] §3.1 and Eq. (5): targets are obtained by direct spatial averaging of the high-resolution velocity products. While this is the standard a-priori procedure, the manuscript never quantifies how sensitive the learned mapping is to the precise filter kernel or to the non-overlapping 4×4×4 sub-cube sampling. A short sensitivity test (or an explicit statement that the reported RMSE is filter-specific) is needed before the numbers can be treated as robust estimates of subgrid stress.
minor comments (4)
- [Figs. 1–2] Figure 1 and Figure 2 captions: “normalized units” are defined only later in the text; a one-sentence reminder in the captions would improve readability.
- [§5.7] §5.7: the K-means analysis is performed on a single data cube and uses an arbitrary k=5; the section title already labels it “preliminary,” but the body still presents cluster-wise R² values as if they generalize. Soften the language or move the entire subsection to an appendix.
- [Table 6] Table 6: RMSLE is introduced without definition; a brief formula or reference would help non-ML readers.
- Throughout: occasional typographical inconsistencies (e.g., “Th eAstrophysical Journal”, missing spaces around ×10^n) should be cleaned in production.
Circularity Check
No circularity: supervised regression of independently defined Reynolds stresses against held-out data and external physics baselines.
full rationale
The paper computes Reynolds-stress targets directly from high-resolution velocity products via the standard definition (Eq. 5), trains a 3DCNN (and MLP) to regress those targets from filtered 3 imes3 imes3 velocity+density inputs, and evaluates RMSE/R^{2} on a held-out test set after inverting the log transform. The reported ~31 % / ~8 % improvements (Table 5, abstract) are empirical comparisons against the Gradient model (Eq. 6) and two fixed-coefficient Smagorinsky models (Eqs. 7–9); no free parameter is fitted to force agreement with the claimed gains, and the log/signed-log preprocessing is a conventional variance-stabilizing step whose effect is ablated (Sec. 5.6, Table 6). Self-citations supply only the StellarBox data source and prior solar-simulation context; they do not underwrite uniqueness theorems, ansatzes, or load-bearing mathematical steps. The a-priori / a-posteriori gap noted by the skeptic is a validity limitation of the experimental design, not a circular reduction of the derivation chain. The central claim therefore stands as ordinary supervised learning plus external benchmarking and contains no self-definitional, fitted-input-as-prediction, or self-citation-load-bearing circularity.
Assumptions & free parameters
free parameters (4)
- Smagorinsky coefficients Cs=Cc =
0.1 and 0.001
- CNN learning rate, batch size, filter counts, activation slopes =
lr=0.001, batch=128, alpha=0.01
- Log / signed-log offset and scaling constants for targets =
scale 1e8, offset +1
- K-means cluster count (k=5) =
5
assumptions (4)
- domain assumption Reynolds stress is exactly tau_ij = <u_i u_j> - <u_i><u_j> computed on the high-resolution cubes after 4x spatial averaging.
- domain assumption Non-overlapping 4x4x4 sub-cubes sampled every 5 min are statistically independent enough for random train/val/test splits.
- ad hoc to paper Offline regression accuracy on filtered fields is a meaningful indicator of utility as an SGS closure.
- domain assumption Standard LES continuum equations and the compressible Smagorinsky form used by StellarBox remain valid for the quiet-Sun regime studied.
Cite this review
Pith. "Pith review of Developing Machine Learning Models of Subgrid Turbulent Transport for Quiet Sun 3D Radiative Hydrodynamic Simulations." pith.science (2026). https://pith.science/paper/DWJ6QZAZ
@misc{pith2026260708969,
author = {Pith},
title = {Pith review of: Developing Machine Learning Models of Subgrid Turbulent Transport for Quiet Sun 3D Radiative Hydrodynamic Simulations},
year = {2026},
howpublished = {\url{https://pith.science/paper/DWJ6QZAZ}},
note = {Machine review of arXiv:2607.08969}
}
read the original abstract
Numerical modeling of solar plasma dynamics is affected by the resolution of the computational grid. This often requires the estimation of subgrid processes related to the small-scale flow turbulence, as these processes play a critical role in momentum transport and energy dissipation. In this work, we investigate the use of deep learning techniques as surrogate models for subgrid turbulent transport in realistic hydrodynamic simulations of the quiet Sun. We describe the development of a 3D Convolutional Neural Network (CNN) to capture spatial dependencies in 3D velocity fields, leveraging different activation functions, as well as different architectural designs. We specifically focus on the prediction of Reynolds stress tensor components. The resultant model integrates velocity vector components and scalar features, such as plasma density, to enhance prediction accuracy. We compare the 3DCNN model to other types of models, such as a Multilayer Perceptron (MLP) and physics-based Gradient and Smagorinsky models, and show that the final model design reconstructs the Reynolds stress tensor components more accurately. Specifically, a 3DCNN model achieves an average improvement of ~31% on diagonal components and ~8% on the off-diagonal components of the stress tensor. Additionally, we show that applying a logarithmic data transformation of the target stress tensor components, to handle heavily skewed data, improves model performance. Results demonstrate the potential of deep learning, particularly CNNs, to approximate Reynolds stress tensor components for the upper solar convection zone and lower atmosphere, making them a viable candidate for modeling subgrid processes and a promising alternative to traditional turbulence models.
Figures
Figures from the paper (15 more)
Reference graph
Works this paper leans on
-
[1]
Gudiksen, B. V., & Carlsson, M. 2023, Astronomy & Astrophysics, 675, A103, doi: 10.1051/0004-6361/202346765 Bell´ ego, C., Benatia, D., & Pape, L. 2022, Dealing with Logs and Zeros in Regression Models, doi: 10.48550/arXiv.2203.11820 43
-
[2]
2010, Astronomische Nachrichten, 331, 636, doi: 10.1002/asna.201011390
Cao, W., Gorceix, N., Coulter, R., et al. 2010, Astronomische Nachrichten, 331, 636, doi: 10.1002/asna.201011390
-
[3]
Cleophas, T. J., & Zwinderman, A. H. 2016, Logarithmic Transformations, a Great Help to Statistical Analyses (Cham: Springer International Publishing), 243–247, doi: 10.1007/978-3-319-27104-0 43
-
[4]
Cole, T. J., & Altman, D. G. 2017, BMJ, 358, doi: 10.1136/bmj.j3683
-
[5]
Germano, M., Piomelli, U., Moin, P., & Cabot, W. H. 1991, Physics of Fluids A, 3, 1760, doi: 10.1063/1.857955
doi:10.1063/1.857955 1991
-
[6]
Gudiksen, B. V., Carlsson, M., Hansteen, V. H., et al. 2011, Astronomy & Astrophysics, 531, A154, doi: 10.1051/0004-6361/201116520
-
[7]
Harris, C. R., Millman, K. J., et al. 2020, Nature, 585, 357, doi: 10.1038/s41586-020-2649-2
-
[8]
He, K., Zhang, X., Ren, S., & Sun, J. 2015, in Proceedings of the IEEE International Conference on Computer Vision (ICCV), 1026–1034, doi: 10.1109/ICCV.2015.123
Show all 40 references
-
[9]
2016, in Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778, doi: 10.1109/CVPR.2016.90
He, K., Zhang, X., Ren, S., & Sun, J. 2016, in Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778, doi: 10.1109/CVPR.2016.90
2016 doi
-
[10]
Hunter, J. D. 2007, Computing in Science & Engineering, 9, 90, doi: 10.1109/MCSE.2007.55
2007 doi
-
[11]
Mansour, N. N. 2008, The Astrophysical Journal Letters, 684, L51, doi: 10.1086/592042
2008 doi
-
[12]
I., Huang, C., Sitdikov, I., et al
Karpov, P. I., Huang, C., Sitdikov, I., et al. 2022, The Astrophysical Journal, 940, 26, doi: 10.3847/1538-4357/ac88cc
2022 doi
-
[13]
2022, Monthly Weather Review, 150, 2279 , doi: 10.1175/MWR-D-21-0217.1
Khani, S., & Port´ e-Agel, F. 2022, Monthly Weather Review, 150, 2279 , doi: 10.1175/MWR-D-21-0217.1
2022 doi
-
[14]
Kitiashvili, I. N. 2014, Publications of the Astronomical Society of Japan, 66, S8, doi: 10.1093/pasj/psu114
2014 doi
-
[15]
N., Abramenko, V
Kitiashvili, I. N., Abramenko, V. I., Goode, P. R., et al. 2013, Physica Scripta Volume T, 155, 014025, doi: 10.1088/0031-8949/2013/T155/014025
2013 doi
-
[16]
N., Couvidat, S., & Lagg, A
Kitiashvili, I. N., Couvidat, S., & Lagg, A. 2015, Th eAstrophysical Journal, 808, 59, doi: 10.1088/0004-637X/808/1/59
2015 doi
-
[17]
N., Kosovichev, A
Kitiashvili, I. N., Kosovichev, A. G., Mansour, N. N., & Wray, A. A. 2011, Solar Physics, 268, 283, doi: 10.1007/s11207-010-9679-0 —. 2012, The Astrophysical Journal Letters, 751, L21, doi: 10.1088/2041-8205/751/1/L21
2011 doi
-
[18]
M., & Guerrero, G
Sadykov, V. M., & Guerrero, G. 2023, MNRAS, 518, 504, doi: 10.1093/mnras/stac2946
2023 doi
-
[19]
L., Hannun, A
Maas, A. L., Hannun, A. Y., & Ng, A. Y. 2013, in Proceedings of the 30th International Conference on Machine Learning (ICML), PMLR, 3–8. http://proceedings.mlr.press/v28/maas13.html
2013
-
[20]
S., & Cabot, W
Meneveau, C., Lund, T. S., & Cabot, W. H. 1994, Journal of Fluid Mechanics, 319, 353 . https: //api.semanticscholar.org/CorpusID:122183534 44
1994
-
[21]
2022, Astronomy & Astrophysics, 663, A96, doi: 10.1051/0004-6361/202243439
Vitas, N. 2022, Astronomy & Astrophysics, 663, A96, doi: 10.1051/0004-6361/202243439
2022 doi
-
[22]
1985, Solar Physics, 100, 209, doi: 10.1007/BF00158429
Nordlund, A. 1985, Solar Physics, 100, 209, doi: 10.1007/BF00158429
1985 doi
-
[23]
D., & Marshall, G
Olivier, J., Johnson, W. D., & Marshall, G. D. 2008, Annals of Allergy, Asthma & Immunology, 100, 333, doi: 10.1016/S1081-1206(10)60595-9
2008 doi
- [24]
- [25]
-
[26]
2011, Journal of Machine Learning Research, 12, 2825, doi: 10.5555/1953048.2078195
Pedregosa, F., Varoquaux, G., Gramfort, A., et al. 2011, Journal of Machine Learning Research, 12, 2825, doi: 10.5555/1953048.2078195
2011 doi
-
[27]
2020, pandas-dev/pandas: Pandas, doi: 10.5281/zenodo.3509134
Reback, J., et al. 2020, pandas-dev/pandas: Pandas, doi: 10.5281/zenodo.3509134
2020 doi
-
[28]
2018, The Astrophysical Journal, 859, 161, doi: 10.3847/1538-4357/aabba0
Rempel, M. 2018, The Astrophysical Journal, 859, 161, doi: 10.3847/1538-4357/aabba0
2018 doi
-
[29]
R., Warner, M., Keil, S
Rimmele, T. R., Warner, M., Keil, S. L., et al. 2020, Solar Physics, 295, 172, doi: 10.1007/s11207-020-01736-7
2020 doi
-
[30]
M., Kitiashvili, I
Sadykov, V. M., Kitiashvili, I. N., Kosovichev, A. G., & Wray, A. A. 2021, The Astrophysical Journal, 909, 35, doi: 10.3847/1538-4357/abd9c7
2021 doi
- [31]
-
[32]
1963, Monthly Weather Review, 91, 99, doi: 10.1175/1520-0493(1963)091⟨0099: GCEWTP⟩2.3.CO;2
Smagorinsky, J. 1963, Monthly Weather Review, 91, 99, doi: 10.1175/1520-0493(1963)091⟨0099: GCEWTP⟩2.3.CO;2
1963 doi
-
[33]
F., & Nordlund, ˚A
Stein, R. F., & Nordlund, ˚A. 1998, The Astrophysical Journal, 499, 914, doi: 10.1086/305678 Szanda la, T. 2021, in Bio-inspired Neurocomputing, ed. A. K. Bhoi, P. K. Mallick, C.-M. Liu, & V. E. Balas (Singapore: Springer Singapore), 203–224, doi: 10.1007/978-981-15-5495-7 11
1998 doi
-
[34]
2020, Nature Methods, 17, 261, doi: 10.1038/s41592-019-0686-2 V¨ ogler, A., Shelyag, S., Sch¨ ussler, M., et al
Virtanen, P., et al. 2020, Nature Methods, 17, 261, doi: 10.1038/s41592-019-0686-2 V¨ ogler, A., Shelyag, S., Sch¨ ussler, M., et al. 2005, Astronomy & Astrophysics, 429, 335, doi: 10.1051/0004-6361:20041507
2020 doi
-
[35]
Waidele, M., Zhao, J., & Kitiashvili, I. N. 2023, ApJ, 949, 99, doi: 10.3847/1538-4357/accae2
2023 doi
-
[36]
2020, Applied Sciences, 10, doi: 10.3390/app10051897
Wang, Y., Li, Y., Song, Y., & Rong, X. 2020, Applied Sciences, 10, doi: 10.3390/app10051897
2020 doi
- [37]
-
[38]
N., & Kosovichev, A
Mansour, N. N., & Kosovichev, A. G. 2018, Realistic Simulations of Stellar Radiative MHD (Les Ulis: EDP Sciences), 39–62, doi: doi:10.1051/978-2-7598-2196-9.c004
2018 doi
-
[39]
K., & Togashi, K
Yamashita, R., Nishio, M., Do, R. K., & Togashi, K. 2018, Insights into Imaging, 9, 611, doi: 10.1007/s13244-018-0639-9 45
2018 doi
- [40]
Reviewed July 13, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.