pith. sign in

arxiv: 2605.01822 · v1 · submitted 2026-05-03 · 💻 cs.LG

Molecular Representations for Large Language Models

Pith reviewed 2026-05-09 17:29 UTC · model grok-4.3

classification 💻 cs.LG
keywords molecularmoljsoniupacsmileschemistrygpt-5llmsreasoning
0
0 comments X

The pith

MolJSON, an explicit graph-schema format, yields higher LLM accuracy than SMILES or IUPAC on translation (71% vs 43.7%), constrained generation (95.3% vs 64%), and shortest-path tasks while using fewer tokens.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Large language models struggle with chemistry because molecules can be written in many ways. The authors created MolJSON, which stores atoms, bonds, and rings as structured data rather than a linear string. They asked four different LLMs to translate between formats, find shortest paths in molecular graphs, and generate molecules that satisfy constraints. Across 78,000 questions, MolJSON produced fewer mistakes on ring counting and atom totals than the older string formats. The improvement was largest for the strongest model tested.

Core claim

MolJSON consistently outperforming existing formats. On translation tasks, GPT-5 achieved 71.0% accuracy when converting IUPAC names to MolJSON, compared with 43.7% when converting the same inputs to SMILES. For constrained generation, GPT-5 reached 95.3% accuracy generating MolJSON, compared with 76.3% for IUPAC and 64.0% for SMILES.

Load-bearing premise

That the three chosen reasoning tasks (translation, shortest path, constrained generation) and the 78,045 synthetic questions are representative of the chemical reasoning demands that arise in actual scientific workflows.

read the original abstract

Large Language Models (LLMs) are increasingly being used to support scientific discovery. In chemistry, tasks such as reaction prediction and structure elucidation require reasoning about the structures of molecules. As such, LLM-based systems for chemistry must interact reliably with molecular structures. Most previous studies of LLMs in chemistry have used SMILES strings or IUPAC names as molecular representations; however, the suitability of these formats has not been systematically assessed. In this work, we introduce MolJSON, a novel molecular representation for LLMs, and systematically compare it with five common chemical formats. We evaluated each representation with GPT-5-nano, GPT-5-mini, GPT-5, and Claude Haiku 4.5 using a set of 78,045 questions spanning translation, shortest path, and constrained generation reasoning tasks. We observed substantial variation across representations in the ability of LLMs to interpret and generate molecular graphs, with MolJSON consistently outperforming existing formats. On translation tasks, GPT-5 achieved 71.0% accuracy when converting IUPAC names to MolJSON, compared with 43.7% when converting the same inputs to SMILES. For constrained generation, GPT-5 reached 95.3% accuracy generating MolJSON, compared with 76.3% for IUPAC and 64.0% for SMILES. As an input format for shortest-path reasoning, GPT-5 successfully answered 98.5% of questions with MolJSON, compared with 92.2% for SMILES and 82.7% for IUPAC, whilst also using fewer reasoning tokens. We observed systematic errors associated with atom count and ring complexity for SMILES strings and IUPAC names, whereas MolJSON was more robust to these failure modes. Our results show that the choice of molecular representation has a material impact on LLM performance, and that explicit molecular graph schemas, such as MolJSON, are a promising direction for LLM-based systems in chemistry.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 1 invented entities

The central claim rests on the empirical observation that an explicit graph schema improves LLM performance; no free parameters are fitted, no new physical entities are postulated, and the only background assumptions are standard LLM evaluation practices.

invented entities (1)
  • MolJSON no independent evidence
    purpose: Structured JSON schema for molecular graphs intended as LLM input
    New format introduced in the paper; independent evidence is the performance numbers on the three tasks.

pith-pipeline@v0.9.0 · 5658 in / 1233 out tokens · 26926 ms · 2026-05-09T17:29:45.945731+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.