REVIEW 2 major objections 6 minor 43 references
Fast and Provable Tensor-Train Format Tensor Completion via Precondtioned Riemannian Gradient Descent
T0 review · 2 major / 6 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read The paper claims that a data-driven preconditioner makes Riemannian gradient descent provably linear for low TT-rank tensor completion, with a contraction constant independent of the target tensor's condition number, and that the method…
desk verdict A simple, useful preconditioner for TT completion, but the main theorem's sample bound is stated in terms of undefined iteration-dependent quantities and the paper skips a comparison with the prior preconditioned-TT method. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the data-driven weighted inner product $\langle X, Y\rangle_{W_l} = \langle W_l X, Y\rangle$, with $W_l$ acting by scaling each mode-$i$ slice of a tensor by $G_{l,i}^{1/(2m)}$, where $G_{l,i} = \varepsilon_l I + \operatorname{diag}(M_i(G_l) M_i(G_l)^\top)$ and $G_l = P_\Omega(T_l - T^*)$. This makes the Riemannian gradient equal to $P_{T_l}(W_l^{-1} G_l)$, and the paper proves the projection factors as $W_l^{-1/2} P_{\hat T_l} W_l^{1/2}$; hence the preconditioned update is almost RGD run on the weighted tensor $\hat T_l = W_l^{1/2} T_l$. The diagonal scaling is cheap to apply ($O(m|\Omega|)$ for the sparse gradient) and does not change TT-rank, so the TT-SVD retraction keeps the same cost as in RGD. This mechanism is what removes the condition-number dependence from the contraction rate.
What would settle it
Run PRGD on a synthetic TT-rank tensor with a large condition number, using the theorem's sampling and initialization, and record the ratios $\|T_l - T^*\|_F^2 / \|T_{l-1} - T^*\|_F^2$; a single ratio above $0.3574$ contradicts the claimed contraction. Also monitor $\max_{i,k} \|M_i(G_l)(k,:)\|_2$: if this quantity grows with $l$, the fixed sample-size bound cannot be maintained and the proof's premise fails.
Extended reading notes
Core claim
The paper's discovery is that a preconditioned metric built from the current gradient makes the Riemannian gradient descent iterate on the fixed TT-rank manifold behave like ordinary RGD on a weighted tensor, and that this weighted view yields a clean contraction bound. The proof shows that with initial error bounded by $\sigma/(C_m \kappa_0 \bar{r}^{1/2})$, incoherence bounded by $2\kappa_0^2 \nu$, and sample size $n$ at least a polylogarithmic factor times the stated rank-dependent expression, Algorithm 2 produces iterates satisfying $\|T_l - T^*\|_F^2 \le 0.3574\|T_{l-1} - T^*\|_F^2$ for every $l$. The constant $0.3574$ is independent of the condition number $\kappa(T^*)$, which is the main improvement over standard RGD. The numerical sections report that PRGD with an optimal constant step size is faster than RGD by two to three orders of magnitude on synthetic tensors, and that it reaches higher PSNR on hyperspectral images and far fewer iterations in quantum state tomography.
Load-bearing premise
The theorem's sample-size condition is written in terms of $\rho_l$ and $\varepsilon_l$, quantities that depend on the current gradient and are only fixed later in the proof ($\varepsilon_l = \|G_l\|_\vee^2$), so the argument assumes these data-dependent quantities stay uniformly controlled at every iteration; if the gradient's largest row norm grows, the required sample size grows and the fixed linear rate no longer follows.
Editorial extensions
If this is right
- PRGD converges linearly to the target tensor with a per-step squared-error contraction of at most $0.3574$, under the initialization and sample-size conditions of Theorem 4.1.
- The contraction rate is independent of the condition number of the target tensor, so ill-conditioned TT tensors do not slow the asymptotic convergence.
- The preconditioner adds only $O(m|\Omega|)$ work per iteration for the sparse gradient scaling and does not change the TT-rank, so the per-iteration cost stays comparable to RGD.
- On synthetic data PRGD with optimal constant step size reduces computation time by two orders of magnitude (and up to three at larger sizes) compared with standard RGD.
- In hyperspectral image completion and quantum state tomography, PRGD reaches the same recovery quality with substantially fewer iterations and less wall-clock time.
Reading between the lines
- A natural extension, not pursued in the paper, is to make the sample-size condition iteration-independent by proving uniform bounds on $\|G_l\|_\vee$; without such a bound, the theorem's $n$ is a per-iteration requirement rather than a single upfront sample budget.
- The observation that a constant step size beats the adaptive steepest step suggests the preconditioner changes the local geometry in a way that makes exact line search over-optimistic; the same phenomenon should be testable in the matrix PRGD of the cited work.
- The same diagonal row-norm preconditioning could be applied to other tensor formats, such as Tucker or CP, where the manifold geometry and retraction differ but the row-norm scaling is format-agnostic.
- Experimental validation of the $0.3574$ constant is missing; reporting per-iteration error ratios on ill-conditioned tensors would test the rate directly rather than only final recovery quality.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a preconditioned Riemannian gradient descent algorithm (PRGD) for low-rank tensor completion in the tensor-train (TT) format. The preconditioner is derived from a data-dependent weighted inner product built from the row norms of the current gradient, and the algorithm uses TT-SVD as a retraction together with a trimming step. The main theoretical claim is Theorem 4.1: under a sample-size condition and a sufficiently good initialization, PRGD converges linearly to the target tensor with a contraction factor 0.3574 that is independent of the condition number of the target. Numerical experiments on synthetic tensors, hyperspectral images, and quantum state tomography report substantial reductions in iterations and CPU time relative to the RGD algorithm of [5].
Significance. If the main theorem is correct, the result is significant: it gives a provable, condition-number-independent linear convergence rate for TT-format tensor completion with a computationally cheap preconditioner, and the experiments indicate large practical speedups. The paper builds on the established machinery of [5], provides an explicit algorithm with a detailed proof structure, and evaluates the method on realistic applications including quantum state tomography. However, the central theorem, as stated, has a load-bearing well-posedness gap: its sample-complexity condition depends on quantities that are not defined in the theorem and are data-dependent, so the guarantee cannot be checked as written. This is repairable, but it must be fixed before the main claim can be accepted.
major comments (2)
- [Theorem 4.1, Lemmas 4.2–4.4, Appendix B.2] Theorem 4.1 states the sample-size condition in terms of ρ_l and ε_l, but neither is defined in Section 4. Lemmas 4.3–4.4 use ρ_l, and the proof of Lemma 4.3 in Appendix A shows that ρ_l = μ_l/ν_l = (( ε_l + ‖G_l‖²_∨ ) / ε_l)^{1/2}. Appendix B.2 later chooses ε_l = ‖G_l‖²_∨, which gives ρ_l = √2, but this choice is not part of the theorem statement or of Algorithm 2. Since n is fixed in advance while ρ_l and ε_l are iteration- and gradient-dependent, the displayed sample-size condition cannot be checked as written, and the estimates (B.16) and (B.22) require a uniform upper bound on ‖G_l‖_∨ that is never established. The theorem must either state the choice ε_l = ‖G_l‖²_∨, define ρ_l explicitly, and supply such a uniform bound, or state the sample complexity with ρ_l replaced by its worst-case bound.
- [Algorithm 2, Eq. (3.2), Eq. (4.3), Appendix B.2] Algorithm 2 specifies the metric in Eq. (3.2) with a fixed parameter ε, whereas the proof of Theorem 4.1 (Appendix B.2, before (B.16)) sets ε_l = ‖G_l‖²_∨ and the theorem’s step size is α_l = 1.001 ε_l^{1/2} p^{-1}. These are different specifications: with a fixed positive ε the sample-complexity bound still involves ρ_l = (1 + ‖G_l‖²_∨/ε)^{1/2}, so a uniform gradient-norm bound is needed, while with ε_l = ‖G_l‖²_∨ the metric degenerates when G_l = 0 and the division by ν_l = ε_l^{1/2} in (4.3) is not justified without a limiting or safeguarding argument. The algorithm, the theorem, and the proof must be aligned, and the precise dependence of ε_l on G_l must be stated.
minor comments (6)
- [Section 2.1] The definition of the tensor condition number is garbled: it reads κ(T) := σ(T)/σ(T) := max / min, which should presumably be σ_max(T)/σ_min(T).
- [Theorem 4.1] The theorem uses r = (r_1, ..., r_m) and the word “spkiness”, but the TT-rank should be (r_1, ..., r_{m-1}) and the intended word is “spikiness”. Also, the quantities Spiki(T*), Incoh(T0), σ, and κ_0 are used without being defined in the main text; σ and κ_0 only appear later in Appendix A.
- [Algorithm 2] The symbol W_l is overloaded: it denotes the metric operator in Section 3.2.1 and also the tensor W_l = T_l - α_l fP_{T_l} W_l^{-1} G_l inside Algorithm 2. This makes the pseudocode confusing and should be fixed.
- [Lemma 4.2 proof] In the proof of Lemma 4.2, the inequality ε_l < |G_{i,l}(j,k)| < ε_l + ‖G_l‖²_∨ refers to diagonal entries of a diagonal matrix and appears to have a square/exponent typo; it should be stated as a bound on the diagonal entries of G_{l,i}.
- [Section 5] The numerical comparisons are only against the RGD algorithm from [5]; since the paper cites the quotient-geometry preconditioned method [22] as closely related, a comparison with that method or another recent TT-completion algorithm would strengthen the empirical claims.
- [Title] The title contains a typo: “Precondtioned” should be “Preconditioned”.
Circularity Check
No circularity: the preconditioner is built from observed residuals, the rate proof uses independently published lemmas, and the undefined ρ_l/ε_l condition is a rigor gap rather than a self-referential reduction.
full rationale
The derivation chain is not circular. The preconditioner W_l in Eqs. (3.2)–(3.3) is constructed from G_l = P_Ω(T_l − T*); its restriction to Ω is exactly the observed data, so no target quantity is fitted to force the theorem true. Theorem 4.1's contraction bound is obtained by bounding I1, I2, and I3 in Eq. (4.2) using the events E_1–E_5 and Lemmas A.1–A.6, which are quoted from the independently published paper [5]; although a coauthor of the present paper is an author of [5], those lemmas are parameter-free facts with stated assumptions that do not include the target convergence and are not assumptions invented for this paper. The preconditioned scheme is motivated by [11], but the new-left-orthogonal decomposition, tangent-space parameterization, and projection formulas (Lemmas 3.3–3.5) are proved in this manuscript rather than imported by citation. There is no fitted-input-called-prediction: the step size α_l = 1.001 ε_l^{1/2} p^{-1} and the sample-size condition are stated in the theorem before the proof, and the proof later fixes ε_l = ||G_l||^2_∨ in Appendix B.2. The main concern is a well-posedness gap, not circularity: ρ_l and ε_l are not defined in Theorem 4.1, and the sample-size condition is therefore iteration-dependent as written, with no quantified sup_l ρ_l in the theorem statement. Since ε_l = ||G_l||^2_∨ would make ρ_l = sqrt(1 + ||G_l||^2_∨/ε_l) = sqrt(2), the condition could be made uniform, but the theorem does not state that choice. No uniqueness theorem from the authors' prior work is invoked to forbid alternatives, and no known empirical pattern is merely renamed in new coordinates. Hence the central claim has independent content and the observed issues are rigor/presentation concerns rather than circularity.
Assumptions & free parameters
free parameters (3)
- epsilon_l (metric regularization) =
set to ||G_l||^2_vee in Appendix B; otherwise left unspecified in Theorem 4.1
- step size alpha_l =
1.001 epsilon_l^{1/2} p^{-1} in theory; 'optimal constant step size' tuned empirically in experiments
- trimming threshold xi_l =
10 ||W_l||_F / (9 sqrt(d_*) nu)
assumptions (5)
- standard math The set of fixed TT-rank tensors is an embedded Riemannian manifold.
- domain assumption The target tensor has bounded spikiness Spiki(T*) <= nu and each iterate maintains incoherence Incoh(T_l) <= sqrt(mu).
- domain assumption The sampling set Omega is drawn uniformly with replacement and the events E1-E5 from [5] hold with high probability.
- standard math TT-SVD is a quasi-optimal retraction satisfying Lemma A.2.
- standard math The preconditioning matrices G_{l,i} are positive definite, so W_l^{1/2} and the weighted tangent space projection are well-defined.
Cite this review
Pith. "Pith review of Fast and Provable Tensor-Train Format Tensor Completion via Precondtioned Riemannian Gradient Descent." pith.science (2026). https://pith.science/paper/WWXL6OV2
@misc{pith2026250113385,
author = {Pith},
title = {Pith review of: Fast and Provable Tensor-Train Format Tensor Completion via Precondtioned Riemannian Gradient Descent},
year = {2026},
howpublished = {\url{https://pith.science/paper/WWXL6OV2}},
note = {Machine review of arXiv:2501.13385}
}
read the original abstract
Low-rank tensor completion aims to recover a tensor from partially observed entries, and it is widely applicable in fields such as quantum computing and image processing. Due to the significant advantages of the tensor train (TT) format in handling structured high-order tensors, this paper investigates the low-rank tensor completion problem based on the TT-format. We proposed a preconditioned Riemannian gradient descent algorithm (PRGD) to solve low TT-rank tensor completion and establish its linear convergence. Experimental results on both simulated and real datasets demonstrate the effectiveness of the PRGD algorithm. On the simulated dataset, the PRGD algorithm reduced the computation time by two orders of magnitude compared to existing classical algorithms. In practical applications such as hyperspectral image completion and quantum state tomography, the PRGD algorithm significantly reduced the number of iterations, thereby substantially reducing the computational time.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[5]
J.-F. Cai, J. Li, and D. Xia , Provable tensor-train format tensor completion by riemannian optimization , The Journal of Machine Learning Research, 23 (2022), pp. 5365–5441
work page 2022
-
[11]
F. Bian, J.-F. Cai, and R. Zhang , A preconditioned Riemannian gradient descent algorithm for low-rank matrix recovery, SIAM J. Matrix Anal. Appl., 45 (2024), pp. 2075–2103. 29
work page 2024
-
[22]
J.-F. Cai, W. Huang, H. W ang, and K. Wei, Tensor Completion via Tensor Train Based Low-Rank Quotient Geometry under a Preconditioned Metric , arXiv preprint arXiv:2209.04786, (2022)
arXiv 2022
-
[1]
F. Harper and J. Konstan , The movieLens datasets: history and context , ACM Transactions on Interactive Intelligent Systems, 5 (2016), pp. 1–19
work page 2016
-
[2]
Recht, A simpler approach to matrix completion , J
B. Recht, A simpler approach to matrix completion , J. Mach. Learn. Res., 12 (2011)
work page 2011
-
[3]
C. J. Hillar and L.-H. Lim , Most tensor problems are np-hard. , Journal of the ACM (JACM), 60 (2013), pp. 1–39
work page 2013
-
[4]
C.-Y. Ko, K. Batselier, L. Daniel, W. Yu, and N. Wong , Fast and accurate tensor completion with total variation regularized tensor trains , IEEE Trans. Image Process., 29 (2020), pp. 6918–6931
work page 2020
-
[6]
D. Kressner, M. Steinlechner, and B. V andereycken , Low-rank tensor completion by riemannian opti- mization, BIT Numerical Mathematics, 54 (2014), pp. 447–468
work page 2014
Show all 43 references
-
[7]
Perez-Garcia, F
D. Perez-Garcia, F. Verstraete, M. M. Wolf, and J. I. Cirac , Matrix product state representations. , arXiv preprint quant-ph/0608197, (2006)
2006 arXiv
-
[8]
Xia and M
D. Xia and M. Yuan , Statistical inferences of linear forms for noisy matrix completion , J. R. Stat. Soc. Ser. B. Stat. Methodol., 83 (2021), pp. 58–77
2021
-
[9]
Cand`es and B
E. Cand`es and B. Recht, Exact matrix completion via convex optimization , Found. Comput. Math., 9 (2009), pp. 712–772
2009
-
[10]
Cand`es and T
E. Cand`es and T. Tao, The power of convex relaxation: Near-optimal matrix completion , IEEE Trans. Inform. Theory, 56 (2010), pp. 2053–2080
2010
-
[12]
F. L. Hitchcock , The expression of a tensor or a polyadic as a sum of products. , J. Math. Physics, 6 (1927), pp. 164–189
1927
-
[13]
D. H. Foster and A. Reeves , Colour constancy failures expected in colourful environments , Proceedings of the Royal Society B, 289 (2022), p. 20212483
2022
-
[14]
Vidal, Efficient classical simulation of slightly entangled quantum computations
G. Vidal, Efficient classical simulation of slightly entangled quantum computations. , Phys. Rev. Lett., 91 (2003), p. 147902
2003
-
[15]
, Efficient simulation of one-dimensional quantum many-body systems , Phys. Rev. Lett., 93 (2004), p. 040502
2004
-
[16]
C. J. Hillar and L.-H. Lim , Most tensor problems are np-hard , Journal of the ACM (JACM), 60 (2013), pp. 1–39
2013
-
[17]
Holtz, T
S. Holtz, T. Rohwedder, and R. Schneider , On manifolds of tensors of fixed tt-rank , Numerische Mathe- matik, 120 (2012), pp. 701–731
2012
-
[18]
I. V. Oseledets , Tensor-train decomposition, SIAM J. Sci. Comput., 33 (2011), pp. 2295–2317
2011
-
[19]
J. A. Bengua, H. N. Phien, H. D. Tuan, and M. N. Do , Efficient tensor completion for color image and video recovery: Low-rank tensor train. , IEEE Trans. Image Process., 26 (2017), pp. 2466–2479
2017
-
[20]
J.-F. Cai, E. Cand `es and Z. Shen , A singular value thresholding algorithm for matrix completion , SIAM J. Optim., 20 (2010), pp. 1956–1982
2010
-
[21]
J.-F. Cai, J. Li and D. Xia , Generalized Low-Rank Plus Sparse Tensor Estimation by Fast Riemannian Opti- mization, J. Amer. Statist. Assoc., 118 (2023), pp. 2588–2604
2023
-
[23]
K. Glau, D. Kressner, and F. Statti , Low-rank tensor approximation for Chebyshev interpolation in para- metric option pricing , SIAM J. Financial Math., 11 (2020), pp. 897–927
2020
-
[24]
Wei, J.-F
K. Wei, J.-F. Cai, T. Chan, and S. Leung , Guarantees of riemannian optimization for low rank matrix recovery, SIAM J. Matrix Anal. Appl., 37 (2016), pp. 1198–1222
2016
-
[25]
Imaging, 14 (2020), pp
, Guarantees of Riemannian optimization for low rank matrix completion, Inverse Probl. Imaging, 14 (2020), pp. 233–265
2020
-
[26]
L. R. Tucker, Some mathematical notes on three-mode factor analysis , Psychometrika, 31 (1966), pp. 279–311
1966
-
[27]
L. Yuan, Q. Zhao, L. Gui, and J. Cao , High-order tensor completion via gradient-based optimization under tensor train format , Signal Processing: Image Communication, 73 (2019), pp. 53–61
2019
-
[28]
Lubich, I
C. Lubich, I. V. Oseledets, and B. V andereycken , Time integration of tensor trains , SIAM Journal on Numerical Analysis, 53 (2015), pp. 917–941
2015
-
[29]
Ding, T.-Z
M. Ding, T.-Z. Huang, T.-Y. Ji, X.-L. Zhao, and J.-H. Yang , Low-rank tensor completion using matrix factorization based on tensor train rank and total variation. , J. Sci. Comput., 81 (2019), pp. 941–964
2019
-
[30]
Imaizumi, T
M. Imaizumi, T. Maehara, and K. Hayashi , On tensor train rank minimization: Statistical efficiency and scalable algorithm, arXiv preprint arXiv: 1708.00132, (2017)
2017 arXiv
-
[31]
Steinlechner , Riemannian optimization for high-dimensional tensor completion
M. Steinlechner , Riemannian optimization for high-dimensional tensor completion. , SIAM J. Sci. Comput., 38 (2016), pp. S461–S484
2016
-
[32]
Z. Qin, C. Jameson, Z. Gong, M. B. W akin, and Z. Zhu , Quantum state tomography for matrix product density operators, IEEE Transactions on Information Theory, (2024)
2024
-
[33]
Sun and Z.-Q
R. Sun and Z.-Q. Luo , Guaranteed matrix completion via non-convex factorization. , IEEE Trans. Inform. Theory, 62 (2016), pp. 6535–6579
2016
-
[34]
S. Dong, B. Gao, Y. Guan, and F. Glineur , New Riemannian preconditioned algorithms for tensor comple- tion via polyadic decomposition , SIAM J. Matrix Anal. Appl., 43 (2022), pp. 840–866
2022
-
[35]
Steinlechner, Riemannian optimization for high-dimensional tensor completion, SIAM Journal on Scientific Computing, 38 (2016), pp
M. Steinlechner, Riemannian optimization for high-dimensional tensor completion, SIAM Journal on Scientific Computing, 38 (2016), pp. S461–S484
2016
-
[36]
T. Cai, T. T. Cai, and A. Zhang, Structured matrix completion with applications to genomic data integration., J. Amer. Statist. Assoc., 111 (2016), pp. 621–633
2016
-
[37]
T.G., Kolda and B. W. Bader , Tensor decompositions and applications, SIAM Rev., 51 (2009), pp. 455–500. 30
2009
-
[38]
Verstraete, J
F. Verstraete, J. J. Garcia-Ripoll, and J. I. Cirac , Matrix product density operators: Simulation of finite-temperature and dissipative systems , Physical review letters, 93 (2004), p. 207204
2004
-
[39]
W ang, V
W. W ang, V. Aggarwal, and S. Aeron. , Tensor completion by alternating minimization under the tensor train (tt) model. , arXiv preprint arXiv:1603.06610, (2016)
2016 arXiv
-
[40]
W ang, J
H. W ang, J. Chen, and K. Wei, Implicit regularization and entrywise convergence of riemannian optimization for low tucker-rank tensor completion , Journal of Machine Learning Research, 24 (2023), pp. 1–84
2023
-
[41]
Y. Chen, J. F an, C. MA, and Y. Yan, Inference and uncertainty quantification for noisy matrix completion , Proc. Natl. Acad. Sci. USA, 116 (2019), pp. 22931–22937
2019
-
[42]
Y. Zhou, A. R. Zhang, L. Zheng, and Y. W ang , Optimal high-order tensor svd via tensor-train orthogonal iteration, arXiv preprint arXiv:2010.02482, (2020)
2020 arXiv
-
[43]
Zhang, Y.-N
Y. Zhang, Y.-N. Zhu, and X. Zhang, A single-mode quasi riemannian gradient descent algorithm for low-rank tensor recovery, arXiv preprint arXiv:2401.15925, (2024). 31
2024 arXiv
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.