Rowan reposted this
Some problems (protein folding) are a good fit for simulation, while others (lit review) are good for LLMs—the toughest problems, however, span both categories. Our latest Rowan post examines one such case: NMR-based structure elucidation by AI agents. The forward structure-to-NMR-spectrum problem is well-studied and can be done by DFT or ML models. In contrast, the inverse spectrum-to-structure task is hard and typically done by humans, although recent Anthropic work ("Making Claude a Chemist") showed that Claude is decent: https://lnkd.in/gVG_fc48 We imagined that giving an LLM access to spectrum-prediction tools could give it the ability to check its own work and find the correct answer—to test this, we examined cases where NMR spectra had been misassigned in the literature and evaluated models on their ability to return the correct SMILES string from the experimental 13C NMR shieldings. Broadly, our hypothesis appears correct: GPT-5.6 Sol runs using tools have a higher success rate than baseline runs, with increasing returns to effort. On "xhigh" effort, Sol gets 52% of the cases correct with NMR tools but only 21% correct without tools. External tool calls provide a nice way to follow agents' reasoning. Agents often quickly determine the correct functional groups but require multiple rounds of simulation to figure out relative stereochemistry or connectivity, illustrating why simulation helps. Agents using tools also reason for longer and burn more tokens than regular agents, with correspondingly better performance. One interpretation of this is that simulation tools allow agents to test their hypotheses and reason coherently for longer (the "world model" view). We think that combining design and simulation tools with AI agents is the future of computational chemistry, and we're excited to continue benchmarking + building in this space! Read the full blog post here: https://lnkd.in/gwk5iQ4Q