REVIEW 5 cited by
Fully Hyperbolic Neural Networks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Hyperbolic neural networks have shown great potential for modeling complex data. However, existing hyperbolic networks are not completely hyperbolic, as they encode features in a hyperbolic space yet formalize most of their operations in the tangent space (a Euclidean subspace) at the origin of the hyperbolic space. This hybrid method greatly limits the modeling ability of networks. In this paper, we propose a fully hyperbolic framework to build hyperbolic networks based on the Lorentz model by adapting the Lorentz transformations (including boost and rotation) to formalize essential operations of neural networks. Moreover, we also prove that linear transformation in tangent spaces used by existing hyperbolic networks is a relaxation of the Lorentz rotation and does not include the boost, implicitly limiting the capabilities of existing hyperbolic networks. The experimental results on four NLP tasks show that our method has better performance for building both shallow and deep networks. Our code will be released to facilitate follow-up research.
Forward citations
Cited by 5 Pith papers
-
New non-Euclidean neural quantum states from hyperbolic Lorentz recurrent architectures
On 100-site Heisenberg J1-J2 and J1-J2-J3 chains, hyperbolic Poincaré/Lorentz RNN and GRU neural quantum states mostly beat Euclidean counterparts; Lorentz RNN wins four of eight settings despite about three times few...
-
Advancing Multimodal Fusion on Heterogeneous Medical Data with Hybrid Geometry Attention
CURE, a cascaded fusion framework with hybrid hyperbolic/quantum attention, reports state-of-the-art accuracy and lower compute on 16 medical datasets.
-
HyPCV-Former: Hyperbolic Spatio-Temporal Transformer for 3D Point Cloud Video Anomaly Detection
HyPCV-Former embeds point cloud video features in Lorentzian hyperbolic space and uses hyperbolic attention to improve video anomaly detection on two benchmarks.
-
HLFormer: Enhancing Partially Relevant Video Retrieval with Hyperbolic Learning
HLFormer adds hybrid Euclidean and Lorentz attention plus a partial-order cone loss to partially relevant video retrieval and reports the best total recall on ActivityNet Captions, Charades-STA, and TVR.
-
Hyperbolic Deep Learning for Foundation Models: A Survey
A structured survey of hyperbolic-geometry methods for foundation models, concluding the approach is promising but showing limited independent evidence at scale.
Discussion (0). Sign in to comment.