Rate-Distortion Dimension of Stochastic Processes

Elza Erkip; Farideh Ebrahim Rezagah; H. Vincent Poor; Shirin Jalali

arxiv: 1607.06792 · v1 · pith:CQN4WKGHnew · submitted 2016-07-22 · 💻 cs.IT · math.IT

Rate-Distortion Dimension of Stochastic Processes

Farideh Ebrahim Rezagah , Shirin Jalali , Elza Erkip , H. Vincent Poor This is my paper

classification 💻 cs.IT math.IT

keywords processdimensionrate-distortioninformationamountanalogapproachapproaches

0 comments

read the original abstract

The rate-distortion dimension (RDD) of an analog stationary process is studied as a measure of complexity that captures the amount of information contained in the process. It is shown that the RDD of a process, defined as two times the asymptotic ratio of its rate-distortion function $R(D)$ to $\log {1\over D}$ as the distortion $D$ approaches zero, is equal to its information dimension (ID). This generalizes an earlier result by Kawabata and Dembo and provides an operational approach to evaluate the ID of a process, which previously was shown to be closely related to the effective dimension of the underlying process and also to the fundamental limits of compressed sensing. The relation between RDD and ID is illustrated for a piecewise constant process.

This paper has not been read by Pith yet.

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Polynomial Context-Truncation Sensitivity in Autoregressive Language Models: Sequential Wyner-Ziv Bounds for KV Cache Compression
cs.IT 2026-05 unverdicted novelty 7.0

Under a polynomial context-truncation sensitivity assumption, suffix-only KV cache policies require per-token memory scaling as Θ(ε^{-1/α}) to achieve distortion ε.