Cheminformatics

How Well Can Frontier Large Language Models Generate Structures? High Quality Prediction of Molecular Geometries with Help from Fine-Tuning

Joseph M. Cavanagh, Jonathan B. Arnold, Giovanni Battista Alteri, Andrew Gritsevskiy, Teresa Head-Gordon

Featured August 13, 2026

AI-generated analysis — This is SciGrove's AI interpretation of the paper, not peer-reviewed content. Always refer to the original paper.

Simply

By teaching powerful language models the 'language of molecular geometry' using Z-matrices and smart fine-tuning, the authors enable them to accurately predict 3D shapes of molecules from simple text descriptions.

In depth

The paper demonstrates that Large Language Models (LLMs) can be fine-tuned to accurately predict 3D molecular geometries from 2D SMILES strings. A key innovation is the use of Z-matrices as the geometric representation, which the authors show is superior to Cartesian coordinates due to its inherent translational and rotational invariances and relational nature. Furthermore, the study introduces a pseudorehearsal technique during fine-tuning to prevent catastrophic forgetting, allowing the LLM to retain its natural language processing abilities while gaining molecular geometry generation capabilities.

Key Takeaways

1
Fine-tuning LLMs on Z-matrix representations of molecular geometries significantly improves their ability to predict accurate 3D structures from SMILES strings, outperforming Cartesian coordinates.
2
The developed GeomLlama model achieves high accuracy in predicting equilibrium structures and diverse conformers for small organic and drug-like molecules, matching or exceeding specialized deep learning models.
3
A pseudorehearsal strategy, involving mixing natural language data during fine-tuning, effectively mitigates the degradation of the LLM's original language abilities while maintaining strong geometry prediction performance.

Conceptual Flow

HIGH LEVEL

Methodology: Teaching LLMs Molecular Geometry

The study teaches a smart computer program to understand molecule shapes by showing it many examples of molecule names and their 3D building instructions.

Molecule Name

3D Building Instructions

Learn Patterns

Smart Program

Results: Accurate 3D Shapes, Retained Language Skills

The trained program can now draw accurate 3D molecule shapes better than other methods, and it still remembers how to talk like a normal computer program.

Molecule Name

Predict 3D Shape

Accurate 3D Model

Still Understands English

This breakdown was generated by SciGrove. Get the same analysis — intuition, storyboard, peer review, a runnable prototype and a glossary — on any paper you upload or paste a DOI for.