REVIEW 3 major objections 6 minor 2 cited by
Ns3 meets Sionna: Using Realistic Channels in Network Simulation
T0 review · 3 major / 6 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read Ns3Sionna replaces ns-3's statistical radio models with ray-traced channels that are spatially and temporally correlated.
desk verdict A solid, useful ns-3/Sionna integration with a real caching design, but the 'more realistic' claim outruns the validation, which only checks free-space Friis agreement. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is Sionna RT, a GPU-accelerated ray tracer that computes radio propagation paths through a user-provided 3D scene with material properties, returning a channel impulse response for each transmitter-receiver pair. Ns3Sionna wraps this into two ns-3 models, SionnaPropagationLossModel and SionnaPropagationDelayModel, and adds a cache keyed by coherence time and channel reciprocity so that channels are not recomputed unnecessarily. To exploit parallelism, the framework asks Sionna to compute the full point-to-multipoint channel from a sender to all potential receivers, including virtual nodes at predicted future positions, in one call, which makes the expensive ray tracing affordable for simulations with a small to medium number of mobile nodes.
What would settle it
Run a measurement campaign in a real two-room indoor layout with an open door, recording received power and delay along a 1 m/s walking path; the central claim fails if Ns3Sionna does not reproduce the measured spatial correlation of shadowing and the sharp wall-induced attenuation more closely than ns-3's independent log-normal shadowing model.
Extended reading notes
Core claim
The central claim is that coupling Sionna RT's physically based ray tracing with ns-3 yields channel realizations, expressed as path loss, delay, and channel frequency response, that reflect the actual propagation environment rather than a probability distribution. In particular, the paper argues that Ns3Sionna's channel estimates are more realistic than ns-3's built-in models in terms of spatial and temporal correlation: a moving station sees smooth, correlated changes in received power as it moves through the 3D scene, and the channel remains stable over the coherence time. The module also provides a ray-tracing-based mobility model that keeps nodes inside the 3D geometry, and it exploits channel reciprocity, coherence time, and parallel point-to-multipoint computation to keep runtime practical.
Load-bearing premise
The entire approach assumes that Sionna RT, given a user-created 3D scene and material parameters, predicts channels accurately enough to represent real wireless propagation; the paper validates this only in free space against the Friis formula and offers no measurement campaign for its indoor and outdoor realism claims.
Editorial extensions
If this is right
- Wi-Fi protocol simulations in indoor environments can now exhibit multipath fading, wall shadowing, and frequency-selective channels that standard ns-3 statistical models cannot produce.
- Because channels are spatially consistent, positioning, sensing, and fine-grained channel state information studies can be done inside ns-3 without a separate propagation tool.
- Coherence-time caching and point-to-multipoint computation keep the ray-tracing overhead practical for small to medium networks, enabling parameter sweeps that would otherwise take years.
- The ray-tracing mobility model keeps nodes inside the 3D geometry and makes them bounce off obstacles, removing the unrealistic bounding-box random walk limitation.
- The same design extends to LTE via the SpectrumChannel, to MIMO, and to reconfigurable intelligent surfaces, since Sionna RT already provides the needed primitives.
Reading between the lines
- Not stated in the paper: the realism claim inherits all of Sionna RT's error; the free-space validation only checks agreement with Friis, so the indoor and outdoor advantage over ns-3 remains an assumption until a measurement campaign compares the two.
- Not stated in the paper: Ns3Sionna could serve as a data generator for machine-learning indoor positioning, since its spatially correlated shadowing is a more realistic training distribution than independent log-normal draws.
- Not stated in the paper: the pre-caching pattern, computing a point-to-multipoint channel and predicting future positions, is a general recipe for coupling expensive physical models into any packet-level simulator.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents Ns3Sionna, a software framework that integrates the Sionna RT ray-tracing engine into the ns-3 network simulator. Two new ns-3 models (SionnaPropagationLossModel and SionnaPropagationDelayModel) offload channel computation to Sionna RT, and the framework adds a ray-tracing-based mobility model, caching of channel state information, channel reciprocity reuse, and parallel computation of point-to-multipoint channels. The authors claim that Ns3Sionna provides more realistic path and delay loss estimates than existing ns-3 propagation models, especially in spatial and temporal correlation, and they report example indoor and outdoor scenarios plus benchmark results showing large runtime overheads that are mitigated by caching and GPU-parallel predictive computation.
Significance. If the realism claim were properly supported, this would be a valuable open-source contribution: it would give the ns-3 community a way to run protocol-level simulations over ray-traced, scene-specific channels with spatial and temporal consistency, and the repository makes the implementation available. The paper also demonstrates useful engineering ideas, such as exploiting channel coherence time for caching and computing point-to-multipoint channels in one Sionna call to amortize ray-tracing cost. However, the central claim of the paper—that Ns3Sionna is more realistic than existing ns-3 models in indoor and outdoor environments—is not currently validated. The only quantitative validation is a free-space comparison against the Friis model, which is a self-consistency check of the integration rather than evidence for multipath, shadowing, or correlation accuracy. The indoor and outdoor examples are qualitative demonstrations without comparison to measured channels or to the ns-3 statistical models that the paper claims are less realistic. The performance study is useful and honestly reports large overheads, but it does not compensate for the missing validation of physical realism.
major comments (3)
- [Section V, Figure 4] The validation section compares Ns3Sionna only with ns-3's Friis propagation loss model and constant-speed delay model in free space. This checks that the integration plumbing works, but it does not validate the paper's central claim of more realistic path and delay loss estimates in indoor and outdoor environments. A distance-dependent Friis-style model would pass this same test in free space, so the test does not exercise multipath, reflections, diffraction, wall penetration, material parameters, shadowing, or any correlation structure. The authors should add validation against measured channel data or against established ray-tracing benchmarks in representative indoor and outdoor scenes, including metrics such as path loss, delay spread, and spatial/temporal correlation.
- [Section VI, Figures 6 and 8] The indoor and outdoor example scenarios are presented as demonstrations of the framework's output, but no quantitative comparison is made against either measured channels or the existing ns-3 propagation models mentioned in the introduction (e.g., LogDistance, ITU-R P.1238, or HybridBuildingsPropagationLossModel). As a result, the abstract's claim that Ns3Sionna 'provides more realistic path and delay loss estimates for both indoor and outdoor environments than existing ns-3 propagation models' is not supported by the evidence in the paper. The authors should run the same scenarios with the relevant ns-3 baseline models and report quantitative differences in path loss, delay, and correlation metrics.
- [Section IV-B and Section V] The propagation delay is defined as the delay of the shortest path among all ray-traced paths. In the free-space validation this reduces exactly to the constant-speed delay d/c, so the delay comparison in Figure 4 is a tautology for the testing environment. The delay model's realism in multipath environments is not assessed at all; the paper reports no delay spread or first-arrival-path statistics for the indoor or outdoor scenarios. Please add delay-related metrics (e.g., RMS delay spread or excess delay) to the scenario evaluation, since delay estimation is part of the central claim.
minor comments (6)
- [Section IV-A] The text says 'The first two points are addressed by caching' and then 'The second point is addressed as follows,' where the second sentence appears to refer to the third design point (avoiding far-away receivers). Please correct the numbering to avoid confusion.
- [Section IV-C] There is a grammatical error in 'message passing as it gives are the possibility to run ns-3 and Sionna on different computers.' Please revise this sentence.
- [Section VIII-A, Figure 9] The y-axis labels in Figure 9 appear to be missing an exponent (the text mentions differences of four orders of magnitude, but the axis shows '100' and '105'). Please format the axis with explicit powers of ten.
- [Section VIII-B, Figure 11] Figure 11 has no y-axis label and the caption does not state what the speedup is relative to. Please clarify the baseline for the speedup computation.
- [Section VIII-C] The term 'PHZ abstraction models' appears to be a typo for 'PHY abstraction models.' Please fix this and similar typos throughout the discussion.
- [References [15] and [17]] The URLs in references [15] and [17] are missing the '://' separator (e.g., 'https:www.nsnam.org'). Please correct them.
Circularity Check
No circularity: Ns3Sionna's channel outputs are computed from scene geometry and positions via Sionna RT; the free-space validation is a consistency check, not a fitted prediction.
full rationale
The paper's channel outputs—path loss, propagation delay, and CFR—are produced by Sionna RT from the 3D scene, material parameters, antenna settings, and node positions; they are not fitted to the abstract's target claims. The free-space check in Section V compares Ns3Sionna with ns-3's Friis and ConstantSpeed models and shows agreement (Fig. 4); this is a wrapper-consistency test and, in free space, ray tracing and Friis coincide for physical reasons, so the agreement is not an input to the indoor/outdoor realism claim. Spatial and temporal correlation are emergent from ray tracing over a scene and from caching over the coherence time (Sections IV-B and VI-A), not from parameters fitted to measured correlation. The abstract's 'more realistic' claim is not circular, but it is under-supported: the only quantitative validation is free-space Friis agreement, and no measurement campaign is given for the indoor/outdoor scenes, so the superiority claim is a correctness/validation gap rather than a self-referential derivation. The one self-citation ([2], supporting a peripheral statement that ns-3 is popular) is not load-bearing for any technical result, and the Sionna RT citations point to an external project, not to the authors' own prior work invoked to forbid alternatives. No equation in the paper is equivalent to an input by construction, and no fitted parameter is renamed as a prediction.
Assumptions & free parameters
assumptions (5)
- domain assumption Sionna RT accurately models electromagnetic wave propagation for the materials and scene geometry provided.
- domain assumption The coherence time formula (Eq. 2) is a valid expiry time for cached channel state information.
- domain assumption The user-provided 3D scene and material parameters faithfully represent the physical environment.
- domain assumption Channel reciprocity holds for cached links.
- domain assumption Future node positions can be precomputed because mobility is independent of network traffic.
Cite this review
Pith. "Pith review of Ns3 meets Sionna: Using Realistic Channels in Network Simulation." pith.science (2026). https://pith.science/paper/7NRATPMP
@misc{pith2026241220524,
author = {Pith},
title = {Pith review of: Ns3 meets Sionna: Using Realistic Channels in Network Simulation},
year = {2026},
howpublished = {\url{https://pith.science/paper/7NRATPMP}},
note = {Machine review of arXiv:2412.20524}
}
read the original abstract
Network simulators are indispensable tools for the advancement of wireless network technologies, offering a cost-effective and controlled environment to simulate real-world network behavior. However, traditional simulators, such as the widely used ns-3, exhibit limitations in accurately modeling indoor and outdoor scenarios due to their reliance on simplified statistical and stochastic channel propagation models, which often fail to accurately capture physical phenomena like multipath signal propagation and shadowing by obstacles in the line-of-sight path. We present Ns3Sionna, which integrates a ray tracing-based channel model, implemented using the Sionna RT framework, within the ns-3 network simulator. It allows to simulate environment-specific and physically accurate channel realizations for a given 3D scene and wireless device positions. Additionally, a mobility model based on ray tracing was developed to accurately represent device movements within the simulated 3D space. Ns3Sionna provides more realistic path and delay loss estimates for both indoor and outdoor environments than existing ns-3 propagation models, particularly in terms of spatial and temporal correlation. Moreover, fine-grained channel state information is provided, which could be used for the development of sensing applications. Due to the significant computational demands of ray tracing, Ns3Sionna takes advantage of the parallel execution capabilities of modern GPUs and multi-core CPUs by incorporating intelligent pre-caching mechanisms that leverage the channel's coherence time to optimize runtime performance. This enables the efficient simulation of scenarios with a small to medium number of mobile nodes.
Figures
Figures from the paper (6 more)
Forward citations
Cited by 2 Pith papers
-
VaN3Twin: the Multi-Technology V2X Digital Twin with Ray-Tracing in the Loop
VaN3Twin integrates ray-tracing into a full-stack V2X simulator to enable accurate multi-technology coexistence modeling and reports 50-70% better agreement with field measurements than prior tools.
-
Enabling Site-Specific Cellular Network Simulation Through Ray-Tracing-Driven ns-3
SioLENA builds full spatial channel matrices inside ns-3 from ray-tracing traces, giving 5G-LENA site-specific propagation while keeping its beamforming and scheduling code untouched.
Reference graph
Works this paper leans on
-
[1]
A performance compar- ison of recent network simulators,
E. Weingartner, H. V om Lehn, and K. Wehrle, “A performance compar- ison of recent network simulators,” in IEEE International Conference on Communications (ICC 2009) , Dresden, Germany: IEEE, Jun. 2009
work page 2009
-
[2]
Toward the Simulation of WiFi Fine Time Measurements in NS3 Network Simulator,
A. Zubow, C. Laskos, and F. Dressler, “Toward the Simulation of WiFi Fine Time Measurements in NS3 Network Simulator,” Elsevier Computer Communications, vol. 210, pp. 35–44, Oct. 2023
work page 2023
-
[3]
Toward realistic WiFi simulation with smartphone
S. Yoo, Y . Shin, S. Kim, and S. Choi, “Toward realistic WiFi simulation with smartphone "Physics",” in 15th IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM 2014) , Sydney, Australia: IEEE, Jun. 2014, pp. 1–6
work page 2014
-
[4]
High-Accuracy Physical Layer Model for Wireless Network Simulations in NS-2,
J.-M. Dricot and P. De Doncker, “High-Accuracy Physical Layer Model for Wireless Network Simulations in NS-2,” in International Workshop on Wireless Ad-Hoc Networks , Oulu, Finland, Jun. 2004, pp. 249–253
work page 2004
-
[5]
Usage of Network Simulators in Machine-Learning-Assisted 5G/6G Networks,
F. Wilhelmi, M. Carrascosa, C. Cano, A. Jonsson, V . Ram, and B. Bellalta, “Usage of Network Simulators in Machine-Learning-Assisted 5G/6G Networks,” IEEE Wireless Communications , vol. 28, no. 1, pp. 160–166, Feb. 2021
work page 2021
-
[6]
P.-H. Tseng, Y . -C. Chan, Y . -J. Lin, D. -B. Lin, N. Wu, and T. -M. Wang, “Ray-Tracing-Assisted Fingerprinting Based on Channel Impulse Response Measurement for Indoor Positioning,” IEEE Transactions on Instrumentation and Measurement , vol. 66, no. 5, pp. 1032–1045, May 2017
work page 2017
-
[7]
Ray Tracing for Radio Propagation Modeling: Principles and Applications,
Z. Yun and M. F. Iskander, “Ray Tracing for Radio Propagation Modeling: Principles and Applications,” IEEE Access , vol. 3, pp. 1089–1100, Jul. 2015
work page 2015
-
[8]
Learning Radio Environments by Differentiable Ray Tracing
J. Hoydis, F. A. Aoudia, S. Cammerer, F. Euchner, M. Nimier-David, S. ten Brink, and A. Keller, “Learning Radio Environments by Differentiable Ray Tracing,” arXiv, cs.IT 2311.18558, Nov. 2023
work page Pith review arXiv 2023
Show all 18 references
-
[9]
Sionna RT: Differentiable Ray Tracing for Radio Propagation Modeling,
J. Hoydis, F. A. Aoudia, S. Cammerer, M. Nimier-David, N. Binder, G. Marcus, and A. Keller, “Sionna RT: Differentiable Ray Tracing for Radio Propagation Modeling,” arXiv, Cs.IT 2303.11103, Mar. 2023
2023 arXiv
-
[10]
Ray-Tracing-Based mm-Wave Beamforming Assessment,
V . Degli-Esposti, F. Fuschini, E. M. Vitucci, M. Barbiroli, M. Zoli, L. Tian, X. Yin, D. A. Dupleich, R. Muller, C. Schneider, and R. S. Thoma, “Ray-Tracing-Based mm-Wave Beamforming Assessment,” IEEE Access, vol. 2, pp. 1314–1325, Oct. 2014
2014
-
[11]
Sionna: An Open-Source Library for Next-Generation Physical Layer Research,
J. Hoydis, S. Cammerer, F. A. Aoudia, A. Vem, N. Binder, G. Marcus, and A. Keller, “Sionna: An Open-Source Library for Next-Generation Physical Layer Research,” arXiv, Information Theory (Cs.IT); Artificial Intelligence (Cs.AI); Machine Learning (Cs.LG) 10.48550/2203.11854, Mar. 2023
-
[12]
From RSSI to CSI: Indoor localization via channel response,
Z. Yang, Z. Zhou, and Y . Liu, “From RSSI to CSI: Indoor localization via channel response,” ACM Computing Surveys , vol. 46, no. 2, pp. 1–32, Nov. 2013
2013
-
[13]
T. S. Rappaport, Wireless Communications: Principles and Practice , 2nd ed. Upper Saddle River, NJ: Prentice Hall, 2009
2009
-
[14]
Tse and P
D. Tse and P. Viswanath, Fundamentals of Wireless Communication . Cambridge University Press, 2005
2005
-
[15]
NS-3 Consortium, ns-3 documentation , https:www.nsnam.org, Accessed: 2019-07-20
2019
-
[16]
FlyNetSim: An Open Source Synchronized UA V Network Simulator based on ns-3 and Ardupilot,
S. Baidya, Z. Shaikh, and M. Levorato, “FlyNetSim: An Open Source Synchronized UA V Network Simulator based on ns-3 and Ardupilot,” in 21st ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems (MSWiM 2018) , Montréal, Canada: ACM, Oc...
2018
-
[17]
Blender Foundation, Project website, https:www.blender .org, Accessed: 2024-12-01
2024
-
[18]
A Hybrid Machine Learning-Based Model for Indoor Propagation,
A. Seretis and C. D. Sarris, “A Hybrid Machine Learning-Based Model for Indoor Propagation,” in 16th European Conference on Antennas and Propagation (EuCAP 2022) , Madrid, Spain: IEEE, Apr. 2022, pp. 1–5
2022
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.