Pith. sign in

REVIEW 1 cited by

MolBind: Multimodal Alignment of Language, Molecules, and Proteins

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2403.08167 v2 pith:IQPSOUI6 submitted 2024-03-13 cs.LG cs.CLq-bio.QM

classification cs.LGcs.CLq-bio.QM
keywords modalitiesmolbindlanguagelearningmultiplealignmentmolecularmolecules
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Recent advancements in biology and chemistry have leveraged multi-modal learning, integrating molecules and their natural language descriptions to enhance drug discovery. However, current pre-training frameworks are limited to two modalities, and designing a unified network to process different modalities (e.g., natural language, 2D molecular graphs, 3D molecular conformations, and 3D proteins) remains challenging due to inherent gaps among them. In this work, we propose MolBind, a framework that trains encoders for multiple modalities through contrastive learning, mapping all modalities to a shared feature space for multi-modal semantic alignment. To facilitate effective pre-training of MolBind on multiple modalities, we also build and collect a high-quality dataset with four modalities, MolBind-M4, including graph-language, conformation-language, graph-conformation, and conformation-protein paired data. MolBind shows superior zero-shot learning performance across a wide range of tasks, demonstrating its strong capability of capturing the underlying semantics of multiple modalities.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. GeomCLIP: Contrastive Geometry-Text Pre-training for Molecules

    cs.LG 2024-11 conditional novelty 6.0 of 10

    GeomCLIP aligns 3D molecular geometries with biomedical text via contrastive and denoising pretraining and reports improved performance on property prediction, retrieval, and captioning.

Pith tools