Recognition: 1 theorem link
· Lean TheoremState-space fading memory
Pith reviewed 2026-05-15 01:13 UTC · model grok-4.3
The pith
Incremental input-to-state stability implies fading memory semi-globally for time-invariant systems under equibounded inputs.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Incremental input-to-state stability (δISS) implies the fading-memory property semi-globally for time-invariant systems whenever inputs are equibounded. The state-space fading-memory notion is formalized by augmenting δIOS with a memory kernel that upper-bounds the effect of input differences at earlier times. This equivalence transfers Boyd and Chua's approximation theorems to δISS state-space models, and the same property holds for current-driven memristor equations under mild assumptions.
What carries the argument
The state-space fading-memory property, defined as incremental input-to-output stability augmented by a decaying memory kernel that bounds the influence of past input differences.
If this is right
- δISS state-space models satisfy the fading-memory property semi-globally under equibounded inputs.
- Boyd and Chua approximation theorems apply directly to these nonlinear state-space models.
- Current-driven memristor state equations possess the fading-memory property under mild assumptions.
Where Pith is reading between the lines
- Recurrent network designers can now invoke classical approximation guarantees while staying inside the state-space setting when their models satisfy δISS.
- Removing the equibounded-input hypothesis would likely force either global rather than semi-global statements or extra uniformity conditions on the dynamics.
- The uniform continuity built into the state-space definition may produce stronger uniform approximation bounds than the original operator-theoretic version.
Load-bearing premise
The equibounded input assumption together with time-invariance is required for δISS to imply fading memory semi-globally; without them the implication can fail.
What would settle it
A time-invariant δISS system driven by an equibounded input sequence whose output continues to depend on input values from arbitrarily far in the past.
read the original abstract
The fading-memory (FM) property captures the progressive loss of influence of past inputs on a system's current output and has originally been formalized by Boyd and Chua in an operator-theoretic framework. Despite its importance for systems approximation, reservoir computing, and recurrent neural networks, its connection with state-space notions of nonlinear stability, especially incremental ones, remains understudied. This paper introduces a state-space definition of FM. In state-space, FM can be interpreted as an extension of incremental input-to-output stability ($\delta$IOS) that explicitly incorporates a memory kernel upper-bounding the decay of past input differences. It is also closely related to Boyd and Chua's FM definition, with the sole difference of requiring uniform, instead of general, continuity of the memory functional with respect to an input-fading norm. We demonstrate that incremental input-to-state stability ($\delta$ISS) implies FM semi-globally for time-invariant systems under an equibounded input assumption. Notably, Boyd and Chua's approximation theorems apply to $\delta$ISS state-space models. As a closing application, we show that, under mild assumptions, the state-space model of current-driven memristors possess the FM property.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces a state-space definition of the fading-memory (FM) property as an extension of δIOS that incorporates an explicit memory kernel. It proves that δISS implies the semi-global FM property for time-invariant systems under an equibounded-input assumption, shows that Boyd-Chua approximation theorems therefore apply to such models, and verifies the FM property for current-driven memristor state-space models under mild assumptions.
Significance. If the central implication is established with an explicit kernel construction, the work bridges incremental stability theory with operator-theoretic approximation results, enabling direct use of Boyd-Chua theorems for reservoir computing, RNN analysis, and nonlinear system approximation. The memristor example provides a concrete application in circuit theory.
major comments (2)
- [§3] §3, Theorem 3.1 (or equivalent): the passage from the δISS trajectory inequality to an explicit, uniform memory kernel that dominates past input differences for all equibounded trajectories is only sketched; the uniformity step under the equibounded-input hypothesis must be written out with the precise estimate that produces a single kernel independent of the particular bounded input.
- [§4] §4, memristor application: the mild assumptions invoked to conclude that the memristor model satisfies the equibounded-input hypothesis (and hence inherits semi-global FM) are not listed or verified; without them the application of the general theorem cannot be checked.
minor comments (2)
- [§2] Notation for the memory kernel and the input-fading norm should be introduced once in §2 and used consistently; several ad-hoc symbols appear only in the proof sketch.
- [Abstract] The abstract states that Boyd-Chua theorems 'apply' to δISS models, but the precise sense (uniform continuity of the memory functional) is only clarified in the body; a one-sentence pointer in the abstract would help.
Simulated Author's Rebuttal
We thank the referee for the thorough review and constructive feedback. We address the major comments below and will incorporate the suggested clarifications in the revised manuscript.
read point-by-point responses
-
Referee: [§3] §3, Theorem 3.1 (or equivalent): the passage from the δISS trajectory inequality to an explicit, uniform memory kernel that dominates past input differences for all equibounded trajectories is only sketched; the uniformity step under the equibounded-input hypothesis must be written out with the precise estimate that produces a single kernel independent of the particular bounded input.
Authors: We concur that the uniformity argument requires explicit elaboration. The manuscript currently sketches the implication from δISS to the memory kernel but omits the detailed uniform estimate. In the revision, we will expand Theorem 3.1's proof to derive the kernel explicitly: given δISS with class-KL function β and class-K γ, for inputs bounded by M, we construct a uniform kernel ρ(τ) independent of the specific input by taking the supremum over all equibounded trajectories, ensuring the semi-global FM property holds with a single kernel. revision: yes
-
Referee: [§4] §4, memristor application: the mild assumptions invoked to conclude that the memristor model satisfies the equibounded-input hypothesis (and hence inherits semi-global FM) are not listed or verified; without them the application of the general theorem cannot be checked.
Authors: We agree that the assumptions should be stated clearly. The current text refers to 'mild assumptions' without enumeration. In the revised §4, we will explicitly list them (e.g., Lipschitz continuity of the memristor dynamics and boundedness of the state under bounded current inputs due to passivity) and provide brief verification that they ensure the equibounded-input condition holds for the current-driven model. revision: yes
Circularity Check
Derivation is self-contained; no circular reductions to inputs or self-citations
full rationale
The paper introduces a state-space FM definition as an explicit extension of δIOS via a memory kernel, then proves δISS implies semi-global FM for time-invariant systems under the equibounded-input hypothesis. This is a standard trajectory-based implication relying on the δISS estimate plus the boundedness restriction to obtain a uniform kernel; it does not redefine FM in terms of itself or rename a fitted quantity as a prediction. Boyd-Chua theorems are invoked as external results. No load-bearing self-citation chain appears, and the equibounded assumption is explicitly required rather than smuggled. The derivation therefore remains independent of its own outputs.
Axiom & Free-Parameter Ledger
axioms (3)
- domain assumption Time-invariance of the state-space system
- domain assumption Equibounded input assumption
- domain assumption Uniform continuity of the memory functional with respect to the input-fading norm
Forward citations
Cited by 1 Pith paper
-
On the Importance of Multistability for Horizon Generalization in Reinforcement Learning
Multistability is necessary for temporal horizon generalization in POMDPs, sufficient in simple tasks along with transient dynamics in complex ones, while monostable parallelizable RNNs like SSMs and gated linear RNNs...
Reference graph
Works this paper leans on
-
[1]
S. Boyd, L. O. Chua, Fading memory and the problem of approximating nonlinear operators with V olterra se- ries, IEEE Transactions on Circuits and Systems 32 (11) (1985) 1150–1161.doi:10.1109/tcs.1985.1085649
-
[2]
Angeli, A Lyapunov approach to incremental stability properties, IEEE Trans
D. Angeli, A Lyapunov approach to incremental stability properties, IEEE Trans. Autom. Control. 47 (2002) 410– 421.doi:10.1109/9.989067
-
[3]
D. Angeli, Further results on incremental input-to-state stability, IEEE Transactions on Automatic Control 54 (6) (2009) 1386–1391.doi:10.1109/tac.2009.2015561
-
[4]
R. Kato, D. Astolfi, V . Andrieu, L. Praly, Incremental global asymptotic stability equals incremental global ex- ponential stability—but at equilibria, IFAC-PapersOnLine 59 (19) (2025) 424–429.doi:10.1016/j.ifacol. 2025.11.071
-
[5]
B. D. Coleman, W. Noll, An approximation theorem for functionals, with applications in continuum mechanics, Archive for Rational Mechanics and Analysis 6 (1) (1960) 355–370.doi:10.1007/bf00276168
-
[6]
B. D. Coleman, V . J. Mizel, Norms and semi-groups in the theory of fading memory, Archive for Rational Mechan- ics and Analysis 23 (2) (1966) 87–123.doi:10.1007/ bf00251727
work page 1966
-
[7]
B. D. Coleman, V . J. Mizel, On the general theory of fad- ing memory, Archive for Rational Mechanics and Analy- sis 29 (1) (1968) 18–31.doi:10.1007/bf00256456
-
[8]
Šilhavý, The scientific work of Bernard D
M. Šilhavý, The scientific work of Bernard D. Cole- man, Mathematics and Mechanics of Solids 24 (2) (2019) 339–360.doi:10.1177/1081286519825544. 10
-
[9]
W. A. Day, The thermodynamics of simple materials with fading memory, V ol. 22, Springer Science & Business Me- dia, 2013.doi:10.1007/978-3-642-65318
-
[10]
J.-P. Ortega, F. Rossmannek, Fading memory and the con- volution theorem (2024).doi:10.48550/ARXIV.2408. 07386
-
[11]
J. S. Shamma, The necessity of the small-gain theorem for time-varying and nonlinear systems, IEEE Transactions on Automatic Control 36 (10) (1991) 1138–1147.doi: 10.1109/9.90227
-
[12]
J. S. Shamma, R. Zhao, Fading-memory feedback systems and robust stability, Automatica 29 (1) (1993) 191–200. doi:10.1016/0005-1098(93)90182-s
-
[13]
I. W. Sandberg,Z + fading memory and extensions of in- put–output maps, International Journal of Circuit Theory and Applications 29 (4) (2001) 381–388.doi:10.1002/ cta.156
work page 2001
-
[14]
I. W. Sandberg,R + fading memory and extensions of input-output maps, IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 49 (11) (2002) 1586–1591.doi:10.1109/tcsi.2002.804547
-
[15]
I. W. Sandberg, Notes on fading-memory conditions, Circuits, Systems, and Signal Processing 22 (1) (2003) 43–55.doi:10.1007/s00034-004-7012-6
-
[16]
J. Partington, P. Makila, Modeling of linear fading mem- ory systems, IEEE Transactions on Automatic Control 41 (6) (1996) 899–903.doi:10.1109/9.506247
-
[17]
M. A. Dahleh, E. D. Sontag, D. N. Tse, J. N. Tsitsik- lis, Worst-case identification of nonlinear fading mem- ory systems, Automatica 31 (3) (1995) 503–508.doi: 10.1016/0005-1098(94)00131-2
-
[18]
G. Zang, P. A. Iglesias, Fading memory and stability, Jour- nal of the Franklin Institute 340 (6–7) (2003) 489–502. doi:10.1016/j.jfranklin.2003.11.002
-
[19]
M. B. Matthews, Approximating nonlinear fading- memory operators using neural network models, Circuits, Systems, and Signal Processing 12 (2) (1993) 279–307. doi:10.1007/bf01189878
-
[20]
J. Dambre, D. Verstraeten, B. Schrauwen, S. Massar, In- formation processing capacity of dynamical systems, Sci. Rep. 2 (1) (2012) 514.doi:10.1038/srep00514
-
[21]
Echoes of the Past: A Unified Perspective on Fading memory and Echo States
J.-P. Ortega, F. Rossmannek, Echoes of the past: A uni- fied perspective on fading memory and echo states (2025). doi:10.48550/ARXIV.2508.19145
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2508.19145 2025
-
[22]
L. Gonon, J.-P. Ortega, Fading memory echo state net- works are universal, Neural Networks 138 (2021) 10–13. doi:10.1016/j.neunet.2021.01.025
-
[23]
S. Sugiura, R. Ariizumi, T. Asai, S.-I. Azuma, Nonessen- tiality of reservoir’s fading memory for universality of reservoir computing, IEEE Transactions on Neu- ral Networks and Learning Systems 35 (11) (2024) 16801–16815.doi:10.1109/tnnls.2023.3298013
-
[24]
Y . Huo, T. Chaffey, R. Sepulchre, Kernel modelling of fading memory systems (2024).doi:10.48550/ARXIV. 2403.11945
work page internal anchor Pith review doi:10.48550/arxiv 2024
-
[25]
Sepulchre, Fading memory [from the editor], IEEE Control Systems 41 (1) (2021) 4–5.doi:10.1109/mcs
R. Sepulchre, Fading memory [from the editor], IEEE Control Systems 41 (1) (2021) 4–5.doi:10.1109/mcs. 2020.3033098
work page doi:10.1109/mcs 2021
-
[26]
I. Karafyllis, M. Krstic, Fading Memory Input-to-State Stability, Springer International Publishing, 2018, p. 185–191.doi:10.1007/978-3-319-91011-6_7
-
[27]
E. D. Sontag, Input to State Stability: Basic Concepts and Results, Springer Berlin Heidelberg, 2008, p. 163–220. doi:10.1007/978-3-540-77653-6_3
-
[28]
L. Praly, Y . Wang, Stabilization in spite of matched un- modeled dynamics and an equivalent definition of input- to-state stability, Mathematics of Control, Signals, and Systems 9 (1) (1996) 1–33.doi:10.1007/bf01211516
-
[29]
L. Grune, Input-to-state dynamical stability and its Lya- punov function characterization, IEEE Transactions on Automatic Control 47 (9) (2002) 1499–1504.doi:10. 1109/tac.2002.802761
-
[30]
E. Sontag, Smooth stabilization implies coprime factor- ization, IEEE Transactions on Automatic Control 34 (4) (1989) 435–443.doi:10.1109/9.28018
-
[31]
L. O. Chua, S. M. Kang, Memristive devices and systems, Proceedings of the IEEE 64 (2) (1976) 209–223.doi: 10.1109/proc.1976.10092
- [32]
-
[33]
C. M. Kellett, A compendium of comparison func- tion results, Mathematics of Control, Signals, and Systems 26 (3) (2014) 339–374.doi:10.1007/ s00498-014-0128-8
work page 2014
- [34]
-
[35]
A. Davydov, S. Jafarpour, F. Bullo, Non-euclidean con- traction theory for robust nonlinear stability, IEEE Trans- actions on Automatic Control 67 (12) (2022) 6667–6681. doi:10.1109/tac.2022.3183966
-
[36]
M. Giaccagli, D. Astolfi, V . Andrieu, Further results on incremental input-to-state stability based on contraction- metric analysis, in: 2023 62nd IEEE Conference on De- cision and Control (CDC), IEEE, 2023, p. 1925–1930. doi:10.1109/cdc49753.2023.10384172. 11
-
[37]
S.-J. Kim, A note on the connection between incremen- tal input-to-state stability and fading memory in nonlinear systems, Unpublished (2007)
work page 2007
-
[38]
V . Lakshmikantham, S. Leela, Differential and integral in- equalities: theory and applications: volume I: ordinary differential equations, Academic press, 1969
work page 1969
- [39]
-
[40]
R. Sepulchre, T. Chaffey, F. Forni, On the incremental form of dissipativity, IFAC-PapersOnLine 55 (30) (2022) 290–294.doi:10.1016/j.ifacol.2022.11.067
-
[41]
I. Sandberg, L. Xu, Uniform approximation of multidi- mensional myopic maps, IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 44 (6) (1997) 477–500.doi:10.1109/81.585959
-
[42]
V . Hassani, T. Tjahjowidodo, T. N. Do, A survey on hys- teresis modeling, identification and control, Mechanical Systems and Signal Processing 49 (1–2) (2014) 209–233. doi:10.1016/j.ymssp.2014.04.012. Appendix A. Some settings whereδISS does not imply input-to-state FM Several counterexamples demonstrate that the implication fails in the presence of dela...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.