pith. machine review for the scientific record. sign in

arxiv: 1109.4856 · v2 · submitted 2011-09-22 · 💻 cs.IT · math.IT· nlin.SI

Recognition: unknown

On the Information Loss in Memoryless Systems: The Multivariate Case

Bernhard C. Geiger , Gernot Kubin
Authors on Pith no claims yet
classification 💻 cs.IT math.ITnlin.SI
keywords lossinformationsystemsclassdefinitionaccompaniedanalyzebelong
0
0 comments X
read the original abstract

In this work we give a concise definition of information loss from a system-theoretic point of view. Based on this definition, we analyze the information loss in static input-output systems subject to a continuous-valued input. For a certain class of multiple-input, multiple-output systems the information loss is quantified. An interpretation of this loss is accompanied by upper bounds which are simple to evaluate. Finally, a class of systems is identified for which the information loss is necessarily infinite. Quantizers and limiters are shown to belong to this class.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Rate-Distortion Optimization for Transformer Inference

    cs.LG 2026-01 unverdicted novelty 5.0

    A rate-distortion framework for lossy compression of transformer representations yields substantial bitrate savings on language tasks while preserving accuracy, with observed rates aligning to derived information-theo...