REVIEW 1 major objections 30 references
Sensing-Limited Control Under Non-Designable Observation Mechanisms
T0 review · 1 major / 0 minor · reviewed 2026-07-01 · grok-4.3
Pith's one-line read For linear systems with fixed sensing, the directed information rate from unstable states to observations must exceed the open-loop expansion rate of unstable modes to achieve mean-square observability and stabilizability.
desk verdict Necessary conditions on the directed information rate from unstable states look grounded and new for non-designable observations, but the sufficient conditions rest on an entropy-to-error bridge that is the main soft spot. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The directed information rate from the unstable state process to the observation process, which must dominate the open-loop expansion rate of the unstable modes and, via an entropy-to-error bridge, forces posterior uncertainty to collapse when the surplus is strict.
What would settle it
A linear system and observation mechanism where the directed information rate from the unstable state exceeds the expansion rate yet the estimation error covariance fails to converge to zero, or where the rate is strictly below the expansion rate yet the covariance converges to zero.
Extended reading notes
Core claim
The central claim is that mean-square observability and stabilizability of noiseless linear systems under non-designable observations are possible only when the directed information rate from the unstable state process to the observation process is at least as large as the open-loop expansion rate of the unstable modes; the same lower bound holds with additive disturbances, and an entropy-to-error relation converts a strict surplus into vanishing estimation-error covariance, thereby giving sufficient conditions via certainty equivalence.
Load-bearing premise
A strict surplus of directed information over the expansion rate forces the posterior uncertainty to collapse and the estimation error covariance to zero.
Editorial extensions
If this is right
- The lower bound on the unstable-state directed information rate is necessary for mean-square observability even when process noise is present.
- The full-state directed information rate supplies an exact, computable upper bound that yields necessary conditions in the linear-Gaussian setting.
- Under posterior regularity, a strict information surplus plus certainty-equivalence control yields asymptotic mean-square stabilizability.
- Classical communication-constrained limits must be reinterpreted when the sensing interface itself cannot be designed.
Reading between the lines
- The same information-rate threshold may serve as a quick feasibility check for any linear plant whose sensor map is fixed in advance rather than optimized.
- Because the bound survives additive disturbances, it could be used to decide whether a given sensor suite is adequate before controller design begins.
- The entropy-to-error bridge suggests that similar collapse arguments might apply to other performance metrics once a suitable information measure is identified.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims that for noiseless linear dynamics under non-designable observation mechanisms, the directed information rate from the unstable state process to the observation process must dominate the open-loop expansion rate of the unstable modes to achieve mean-square observability and stabilizability. This lower bound persists under additive process disturbances. In the linear-Gaussian case, an exact characterization of the full-state directed information rate is obtained as an upper bound yielding computable necessary conditions. Under posterior regularity conditions, sufficient conditions for asymptotic mean-square observability and stabilizability (via certainty equivalence) are established through an entropy-to-error bridge asserting that a strict information surplus forces posterior uncertainty collapse and error covariance to zero.
Significance. If the central claims hold, the work would identify a fundamental feasibility boundary for sensing-limited control of unstable systems, extending classical directed-information results to settings where the observation map is fixed and non-designable rather than a designable encoder-channel pair. The persistence of the bound under disturbances and the intrinsic (non-fitted) nature of the open-loop expansion rate as the lower bound are notable strengths. The linear-Gaussian upper-bound characterization also supplies a concrete computational pathway for necessary conditions.
major comments (1)
- [sufficient conditions / entropy-to-error bridge paragraph] The entropy-to-error bridge (invoked for the sufficient conditions) is load-bearing: the manuscript states that a strict surplus of directed information over the expansion rate forces posterior uncertainty to collapse, driving the estimation error covariance to zero under the stated posterior regularity conditions. Because the observation mechanism is non-designable and fixed, it is not immediate that these regularity conditions convert the surplus into covariance collapse for every admissible mechanism; any gap here would invalidate the certainty-equivalence stabilizability claim. Derivation details of this step are unavailable for verification.
Simulated Author's Rebuttal
We thank the referee for the careful reading, positive summary, and identification of the entropy-to-error bridge as central to the sufficient conditions. We address the major comment below.
read point-by-point responses
-
Referee: [sufficient conditions / entropy-to-error bridge paragraph] The entropy-to-error bridge (invoked for the sufficient conditions) is load-bearing: the manuscript states that a strict surplus of directed information over the expansion rate forces posterior uncertainty to collapse, driving the estimation error covariance to zero under the stated posterior regularity conditions. Because the observation mechanism is non-designable and fixed, it is not immediate that these regularity conditions convert the surplus into covariance collapse for every admissible mechanism; any gap here would invalidate the certainty-equivalence stabilizability claim. Derivation details of this step are unavailable for verification.
Authors: We agree that the entropy-to-error bridge is load-bearing for the sufficient conditions and that its justification must hold uniformly for non-designable mechanisms. The derivation (Section 4) proceeds by showing that a strict directed-information surplus implies that the conditional entropy rate of the state given observations is strictly negative relative to the open-loop expansion rate. Under the stated posterior regularity conditions (absolute continuity of the posterior with uniformly bounded second moments of the log-density), standard entropy-to-variance inequalities then force the posterior covariance to decay to zero. These regularity conditions are formulated as properties of the posterior process and are required to hold for every admissible observation map; the proof does not rely on designability. That said, the referee is correct that the explicit chaining of the rate inequality to covariance collapse is not expanded in full detail. We will revise the manuscript to insert an expanded lemma (with all intermediate inequalities) in the appendix, making the uniform applicability explicit and thereby supporting the certainty-equivalence stabilizability claim. revision: yes
Circularity Check
No circularity; derivation uses intrinsic dynamics and standard information rates without reduction to inputs
full rationale
The necessary conditions follow from directed-information inequalities exceeding the open-loop sum of unstable log-eigenvalues, an intrinsic property of the linear dynamics matrix rather than any fitted or self-defined quantity. The linear-Gaussian full-state directed information rate is characterized exactly and used only as an upper bound on the unstable-state rate. The entropy-to-error bridge for sufficient conditions is stated as a derived implication under explicit posterior regularity assumptions, with no evidence of self-citation chains, ansatz smuggling, or renaming of known results as new predictions. The paper remains self-contained against external benchmarks.
Assumptions & free parameters
assumptions (3)
- domain assumption System dynamics are linear (noiseless or with additive process noise)
- standard math Directed information rate is well-defined and comparable to the open-loop expansion rate
- domain assumption Posterior regularity conditions hold
Cite this review
Pith. "Pith review of Sensing-Limited Control Under Non-Designable Observation Mechanisms." pith.science (2026). https://pith.science/paper/SCFBZOP2
@misc{pith2026260631396,
author = {Pith},
title = {Pith review of: Sensing-Limited Control Under Non-Designable Observation Mechanisms},
year = {2026},
howpublished = {\url{https://pith.science/paper/SCFBZOP2}},
note = {Machine review of arXiv:2606.31396}
}
read the original abstract
We study the information-theoretic limits of controlling unstable linear systems through non-designable observation mechanisms. Unlike classical communication-constrained control, the information bottleneck lies in the observation mechanism rather than in a designable encoder-channel interface. For noiseless linear dynamics, we derive necessary conditions for mean-square observability and stabilizability, showing that the directed information rate from the unstable state process to the observation process must dominate the open-loop expansion rate of the unstable modes. We further show that this lower bound persists under additive process disturbances. In the Linear-Gaussian setting, although the unstable-state directed information rate remains intractable in closed form, we obtain an exact characterization of the full-state directed information rate, which upper-bounds the unstable-state quantity and yields computable necessary conditions. Under suitable posterior regularity conditions, we also establish sufficient conditions for asymptotic mean-square observability and, via certainty-equivalence control, asymptotic mean-square stabilizability. The key step is an entropy-to-error bridge: a strict surplus in directed information over the expansion rate forces posterior uncertainty to collapse and thereby drives the estimation error covariance to zero. These results identify a fundamental feasibility boundary for sensing-limited control and clarify how classical communication-based limits must be reinterpreted when the sensing interface is non-designable.
Figures
Reference graph
Works this paper leans on
-
[1]
W. S. Wong and R. W. Brockett, “Systems with finite communication bandwidth constraints. ii. stabilization with limited information feed- back,”IEEE Trans. Autom. Control, vol. 44, no. 5, pp. 1049–1053, 1999
work page 1999
-
[2]
Quantized feedback stabilization of linear systems,
R. W. Brockett and D. Liberzon, “Quantized feedback stabilization of linear systems,”IEEE Trans. Autom. Control, vol. 45, no. 7, pp. 1279– 1289, 2000
work page 2000
-
[3]
Stabilization of linear systems with limited information,
N. Elia and S. K. Mitter, “Stabilization of linear systems with limited information,”IEEE Trans. Autom. Control, vol. 46, no. 9, pp. 1384– 1400, 2001
work page 2001
-
[4]
On stabilization of linear systems with limited informa- tion,
D. Liberzon, “On stabilization of linear systems with limited informa- tion,”IEEE Trans. Autom. Control, vol. 48, no. 2, pp. 304–307, Mar. 2003
work page 2003
-
[5]
Control under communication constraints,
S. Tatikonda and S. Mitter, “Control under communication constraints,” IEEE Trans. Autom. Control, vol. 49, no. 7, pp. 1056–1068, July 2004
work page 2004
-
[6]
——, “Control over noisy channels,”IEEE Trans. Autom. Control, vol. 49, no. 7, pp. 1196–1201, July 2004
work page 2004
-
[7]
Stabilizability of stochastic linear systems with finite feedback data rates,
G. N. Nair and R. J. Evans, “Stabilizability of stochastic linear systems with finite feedback data rates,”SIAM J. Control Optim., vol. 43, pp. 413–436, July 2004
work page 2004
-
[8]
Stochastic stabilization of noisy linear systems with fixed- rate limited feedback,
S. Y ¨uksel, “Stochastic stabilization of noisy linear systems with fixed- rate limited feedback,”IEEE Trans. Autom. Control, vol. 55, no. 12, pp. 2847–2853, 2010
work page 2010
Show all 30 references
-
[9]
Stochastic linear control over a communication channel,
S. Tatikonda, A. Sahai, and S. Mitter, “Stochastic linear control over a communication channel,”IEEE Trans. Autom. Control, vol. 49, no. 9, pp. 1549–1561, Sept. 2004
2004
-
[10]
Evaluating channels for control: Capacity reconsidered,
A. Sahai, “Evaluating channels for control: Capacity reconsidered,” in Proc. Amer. Control Conf., June 2000, pp. 2358–2362
2000
-
[11]
Anytime information theory,
——, “Anytime information theory,” Ph.D. dissertation, Massachusetts Institute of Technology, Cambridge, MA, Feb. 2001
2001
-
[12]
Feedback sta- bilization over signal-to-noise ratio constrained channels,
J. H. Braslavsky, R. H. Middleton, and J. S. Freudenberg, “Feedback sta- bilization over signal-to-noise ratio constrained channels,”IEEE Trans. Autom. Control, vol. 52, no. 8, pp. 1391–1403, Aug. 2007
2007
-
[13]
Feedback control under data rate constraints: An overview,
G. N. Nair, F. Fagnani, S. Zampieri, and R. J. Evans, “Feedback control under data rate constraints: An overview,”Proc. IEEE, vol. 95, no. 1, pp. 108–137, Jan. 2007
2007
-
[14]
Control with limited information,
S. K. Mitter, “Control with limited information,”European Journal of Control, vol. 7, no. 2–3, pp. 122–131, 2001
2001
-
[15]
Y ¨uksel and T
S. Y ¨uksel and T. Bas ¸ar,Stochastic Networked Control Systems: Stabi- lization and Optimization under Information Constraints. Boston, MA: Birkh¨auser, 2013
2013
-
[16]
Rate-cost tradeoffs in control,
V . Kostina and B. Hassibi, “Rate-cost tradeoffs in control,”IEEE Trans. Autom. Control, vol. 64, no. 11, pp. 4525–4540, Nov. 2019
2019
-
[17]
Causality, feedback and directed information,
J. L. Massey, “Causality, feedback and directed information,” inProc. Int. Symp. Inf. Theory Appl. (ISITA), Hawaii, USA, Nov. 1990
1990
-
[18]
Directed information on abstract spaces: Properties and variational equalities,
C. D. Charalambous and P. A. Stavrou, “Directed information on abstract spaces: Properties and variational equalities,”IEEE Trans. Inf. Theory, vol. 62, no. 11, pp. 6019–6052, Nov. 2016
2016
-
[19]
On the structure of real-time source coders,
H. S. Witsenhausen, “On the structure of real-time source coders,”Bell Syst. Tech. J., vol. 58, no. 6, pp. 1437–1451, July–Aug. 1979
1979
-
[20]
Optimal causal coding-decoding prob- lems,
J. C. Walrand and P. Varaiya, “Optimal causal coding-decoding prob- lems,”IEEE Trans. Inf. Theory, vol. 29, no. 6, pp. 814–820, Nov. 1983
1983
-
[21]
Nonanticipative rate distortion function and relations to filtering theory,
C. D. Charalambous, P. A. Stavrou, and N. U. Ahmed, “Nonanticipative rate distortion function and relations to filtering theory,”IEEE Trans. Autom. Control, vol. 59, no. 4, pp. 937–952, Apr. 2014
2014
-
[22]
Improved upper bounds to the causal quadratic rate-distortion function for gaussian stationary sources,
M. S. Derpich and J. Østergaard, “Improved upper bounds to the causal quadratic rate-distortion function for gaussian stationary sources,”IEEE Trans. Inf. Theory, vol. 58, no. 5, pp. 3131–3152, May 2012
2012
-
[23]
The entropy per coordinate of a random vector is highly constrained under convexity conditions,
S. Bobkov and M. Madiman, “The entropy per coordinate of a random vector is highly constrained under convexity conditions,”IEEE Trans. Inf. Theory, vol. 57, no. 8, pp. 4940–4954, Aug. 2011. 16
2011
-
[24]
Reverse Brunn–Minkowski and reverse entropy power inequal- ities for convex measures,
——, “Reverse Brunn–Minkowski and reverse entropy power inequal- ities for convex measures,”J. Funct. Anal., vol. 262, no. 7, pp. 3309– 3339, Apr. 2012
2012
-
[25]
Sensing-limited control of noiseless linear systems under nonlinear observations,
M. Li, F. Liu, Y . Xiong, J. Xu, and T. Liu, “Sensing-limited control of noiseless linear systems under nonlinear observations,”arXiv preprint arXiv:2601.12782, 2026
2026 arXiv
-
[26]
E. F. Beckenbach and R. Bellman,Inequalities, ser. Ergebnisse der Mathematik und ihrer Grenzgebiete. 2. Folge. Berlin, Heidelberg: Springer, 1961
1961
-
[27]
B. D. O. Anderson and J. B. Moore,Optimal filtering. Courier Corporation, 2005
2005
-
[28]
Noise estimation from a single image,
C. Liu, R. Szeliski, S. B. Kang, C. L. Zitnick, and W. T. Freeman, “Noise estimation from a single image,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2006, pp. 901–908
2006
-
[29]
Nonlinear camera response functions and image deblurring: Theoretical analysis and practice,
Y .-W. Tai, X. Chen, S. Kim, S. J. Kim, F. Li, J. Yang, J. Yu, Y . Mat- sushita, and M. S. Brown, “Nonlinear camera response functions and image deblurring: Theoretical analysis and practice,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 10, pp. ...
2013
-
[30]
Recovering high dynamic range radiance maps from photographs,
P. E. Debevec and J. Malik, “Recovering high dynamic range radiance maps from photographs,” inProceedings of SIGGRAPH, 1997, pp. 369– 378
1997
Reviewed July 1, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.