Systematic study of direct and iterative triangular matrix inversion algorithms for Delta-Rule linear transformers, with focus on numerical stability, hardware efficiency, and benchmarks showing 4.3x NPU speedup over SGLang.
An improved newton iteration for the generalized inverse of a matrix, with applications.SIAM Journal on Scientific and Statistical Computing, 12(5):1109– 1130
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Fast and Stable Triangular Inversion for Delta-Rule Linear Transformers
Systematic study of direct and iterative triangular matrix inversion algorithms for Delta-Rule linear transformers, with focus on numerical stability, hardware efficiency, and benchmarks showing 4.3x NPU speedup over SGLang.