Non-stable subnormal contractions have nontrivial hyperinvariant subspaces

Maria F. Gamal'

Pith reviewed 2026-05-07 12:20 UTC · model grok-4.3

classification 🧮 math.FA

keywords subnormalvarphicontractioncontractionsdensehyperinvariantnon-stablenontrivial

0 comments

The pith

Non-stable pure subnormal contractions on Hilbert spaces have nontrivial hyperinvariant subspaces.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

A contraction on a Hilbert space is a linear operator with norm at most one. It is stable if repeated applications converge strongly to the zero operator. Subnormal means it extends to a normal operator on a larger space, and pure means it has no nontrivial unitary component. The result states that if such an operator is not stable, there exists a singular inner function (an analytic function with modulus one almost everywhere on the unit circle) such that applying it to the operator yields a range that is not dense in the space. This non-density directly implies the existence of a nontrivial hyperinvariant subspace: a closed subspace, neither zero nor the whole space, that remains invariant under every operator commuting with the given one. The argument relies on prior theorems by Esterle and Kérchy. The paper also constructs examples of stable subnormal contractions where every nonzero bounded analytic function applied to the operator has dense range.

Core claim

For a non-stable pure subnormal contraction T there exists a singular inner function θ such that the range of θ(T) is not dense. Consequently, T has nontrivial hyperinvariant subspaces.

Load-bearing premise

That T is pure and subnormal, together with the direct applicability of the cited results by Esterle and Kérchy without further restrictions on the operator or space.

read the original abstract

A contraction $T$ on a (complex, separable) Hilbert space is stable, or of class $C_{0\cdot}$, if $T^n\to 0$ in the strong operator topology. It is proved that for a non-stable pure subnormal contraction $T$ there exists a singular inner function $\theta$ such that the range of $\theta(T)$ is not dense. Consequently, $T$ has nontrivial hyperinvariant subspaces. The proof is based on results by Esterle and K\'erchy. Examples of stable subnormal contractions are given for which the range of $\varphi(T)$ is dense for every $\varphi\in H^\infty$ ($\varphi\not\equiv 0$).

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

The paper shows that non-stable pure subnormal contractions have nontrivial hyperinvariant subspaces via a singular inner function with non-dense range.

read the letter

The main point of this paper is that any non-stable pure subnormal contraction has a singular inner function θ with the range of θ(T) not dense, and therefore it has nontrivial hyperinvariant subspaces. This is a concrete step forward for the subnormal case in the broader invariant subspace problem. It builds directly on Esterle and Kérchy's work on inner functions and applies it to show the existence for this operator class when the contraction is not stable. The examples of stable subnormal contractions, where every nonzero H^∞ function produces dense range, provide a useful counterpoint and clarify the boundary between the cases. The paper does well in keeping the argument focused and in giving explicit examples. The proof strategy is outlined without fluff, and it correctly identifies the role of non-stability. The main soft spot is the need to confirm that the Esterle-Kérchy theorems apply to pure subnormal contractions without additional restrictions. Subnormality involves a normal extension that defines the functional calculus, and the conditions for non-dense range might require explicit checking in this setting. The abstract does not detail this verification, so the full manuscript should address whether the hypotheses are satisfied or if any modification is needed. This appears minor if the check is straightforward, but it is the load-bearing step. This work is for operator theorists studying hyperinvariant subspaces and the invariant subspace problem on Hilbert spaces. A reader already familiar with subnormal operators and H^∞ functional calculus will find it directly useful. It deserves serious referee attention because it resolves a specific open case for a well-studied class of operators. I recommend sending it to peer review, with the referee asked to pay particular attention to the applicability of the cited results.

Referee Report

2 major / 2 minor

Summary. The paper claims that for any non-stable pure subnormal contraction T on a separable complex Hilbert space, there exists a singular inner function θ such that the range of θ(T) is not dense; this implies T has nontrivial hyperinvariant subspaces. The argument relies on theorems of Esterle and Kérchy. The paper also supplies examples of stable subnormal contractions for which the range of φ(T) is dense for every nonzero φ in H^∞.

Significance. If the central claim is established, the result distinguishes the non-stable case from the stable one in the theory of hyperinvariant subspaces for subnormal operators and provides a concrete functional-calculus obstruction. Credit is due for grounding the argument in prior theorems of Esterle and Kérchy rather than ad-hoc constructions and for supplying explicit stable-case examples that illustrate the necessity of the non-stable hypothesis.

major comments (2)

[main argument / proof] The proof invokes results of Esterle and Kérchy but does not explicitly verify that pure subnormal contractions satisfy the hypotheses of those theorems (e.g., the required spectral or functional-calculus conditions induced by the minimal normal extension). This verification is load-bearing for the existence of θ with non-dense range(θ(T)).
[abstract and proof strategy] The distinction between stable (C_{0·}) and non-stable cases is central, yet the manuscript gives no indication that the cited theorems apply directly once the operator is restricted to the pure subnormal class; the minimal normal extension may alter the precise conditions under which a singular inner function produces a non-dense range.

minor comments (2)

[abstract] The term 'pure' subnormal contraction is used without a brief reminder of its definition (T has no nonzero reducing subspace on which it is unitary); a one-sentence clarification would aid readers.
[examples] The examples of stable subnormal contractions are stated to exist but their construction is not referenced by section or theorem number; a pointer would improve readability.

Axiom & Free-Parameter Ledger

0 free parameters · 2 axioms · 0 invented entities

The paper introduces no new free parameters, invented entities, or ad-hoc axioms; it rests entirely on the standard definitions and background theorems of Hilbert-space operator theory.

axioms (2)

standard math Complex separable Hilbert space with standard inner product and operator norm
Explicitly stated in the abstract as the setting for the contraction T.
domain assumption Definitions of contraction, stable (C_{0·}), pure subnormal, singular inner function, hyperinvariant subspace, and H^∞ functional calculus
These are the domain-specific background notions required for the statement; invoked throughout the abstract.

pith-pipeline@v0.9.0 · 5405 in / 1398 out tokens · 71908 ms · 2026-05-07T12:20:04.306760+00:00 · methodology

Non-stable subnormal contractions have nontrivial hyperinvariant subspaces

Core claim

Load-bearing premise

discussion (0)