PyTorch Frame: A Modular Framework for Multi-Modal Tabular Learning
read the original abstract
We present PyTorch Frame, a PyTorch-based framework for deep learning over multi-modal tabular data. PyTorch Frame makes tabular deep learning easy by providing a PyTorch-based data structure to handle complex tabular data, introducing a model abstraction to enable modular implementation of tabular models, and allowing external foundation models to be incorporated to handle complex columns (e.g., LLMs for text columns). We demonstrate the usefulness of PyTorch Frame by implementing diverse tabular models in a modular way, successfully applying these models to complex multi-modal tabular data, and integrating our framework with PyTorch Geometric, a PyTorch library for Graph Neural Networks (GNNs), to perform end-to-end learning over relational databases.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
RelBench v2: A Large-Scale Benchmark and Repository for Relational Data
RelBench v2 expands a relational deep learning benchmark with four new large datasets and autocomplete tasks, showing models that use table relationships outperform single-table baselines.
-
What Makes a Desired Graph for Relational Deep Learning?
Schema-derived graphs for relational deep learning suffer from information overload and semantic fragmentation; controlled filtering and injection via an end-to-end optimizer improves accuracy on 26 tasks while often ...
-
Retrieval-Augmented Generation with Graphs (GraphRAG)
A survey proposing a holistic GraphRAG framework with components including query processor, retriever, organizer, generator, and data source, plus domain-tailored reviews, challenges, and future directions.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.