REVIEW 4 cited by
Graph Neural Networks for Learning Equivariant Representations of Neural Networks
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Neural networks that process the parameters of other neural networks find applications in domains as diverse as classifying implicit neural representations, generating neural network weights, and predicting generalization errors. However, existing approaches either overlook the inherent permutation symmetry in the neural network or rely on intricate weight-sharing patterns to achieve equivariance, while ignoring the impact of the network architecture itself. In this work, we propose to represent neural networks as computational graphs of parameters, which allows us to harness powerful graph neural networks and transformers that preserve permutation symmetry. Consequently, our approach enables a single model to encode neural computational graphs with diverse architectures. We showcase the effectiveness of our method on a wide range of tasks, including classification and editing of implicit neural representations, predicting generalization performance, and learning to optimize, while consistently outperforming state-of-the-art methods. The source code is open-sourced at https://github.com/mkofinas/neural-graphs.
Forward citations
Cited by 4 Pith papers
-
On the Expressive Power of Permutation-Equivariant Weight-Space Networks
Permutation-equivariant weight-space networks are all equally expressive, and universality holds when hidden-layer biases are pairwise distinct.
-
Can this Model Also Recognize Dogs? Zero-Shot Model Search from Weights
ProbeLog represents each classifier output by its responses to fixed probe images and uses CLIP to answer text queries, achieving 43.8% top-1 accuracy when searching 1,500 ImageNet-trained models for a concept.
-
Approximate Energy-Integration Method for Identifying Collisional Neutrino Flavor Instabilities
A sector-wise energy-integration approximation (method C) robustly reduces multi-energy collisional neutrino flavor dispersion relations while matching exact growth rates and frequencies across isotropic, anisotropic,...
-
Deep Active Inference Agents for Delayed and Long-Horizon Environments
A policy-conditional world model trained under active inference enables single-lookahead planning over hundreds of steps and beats a DQN baseline on energy-efficient control of parallel machines.
Discussion (0). Continue with ORCID to comment.