Beyond Scaling: Chemical Intuition as Emergent Ability of Universal Machine Learning Interatomic Potentials
read the original abstract
Machine Learning Interatomic Potentials (MLIPs) have successfully demonstrated scaling behavior, i.e. the power-law improvement in training performance, however the emergence of novel capabilities at scale remains unexplored. We have developed Edge-wise Emergent Decomposition (E3D) framework to investigate how an MLIP develops the ability to derive physically meaningful local representations of chemical bonds without explicit supervision. Employing an E(3)-equivariant network (Allegro) trained on molecular data (SPICE~2), we found that the trained MLIP spontaneously learned representations of bond dissociation energy (BDE) by decomposing the global potential energy landscape. The learned BDE values quantitatively agree with literature and its scalability are found to be robust across diverse training datasets, suggesting the presence of underlying representation that captures chemical reactions faithfully beyond given training information. Our E3D analysis utilizing Shannon's entropy reveals a close interplay between the decomposability of potential energy learning, scalability of learning, and emergent chemical reactivity, thus providing novel insights of scaling limitations and pathways toward more physically interpretable and predictive simulations.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
Toward Exascale AI for Science: A Scalable AI Skill for Autonomous Microkinetics Discovery
Introduces a scalable AI skill framework for autonomous microkinetics discovery that automates workflows and evaluates surrogate reliability.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.