A local LLM turned chemistry prose into lab steps without retraining—but it did not run the experiments
A peer-reviewed benchmark on 110 zeolite procedures found competitive action extraction from an open 12-billion-parameter model. Manual rules, a narrow test domain and no laboratory execution keep the result firmly in data preparation.
The short version
- What happened
- Researchers extracted and expert-labelled 185 zeolite synthesis procedures from 312 papers, using 75 for optimisation and a separate 110-procedure test set.
- Who it affects
- A chemist could spend less time manually transcribing published methods, but a fluent extraction error can still change a temperature, chemical or sequence. Human verification remains part of the workflow.
- What remains unproven
- 110-procedure held-out zeolite test
Keep in mind
110-procedure held-out zeolite test
No laboratory execution
Manual domain-specific post-processing
No unseen-journal deployment
Two closed baselines excluded
Five repeated model runs
Accepted version awaits final editing
Source analysis · 2 linked sources. Primary analysed source date: 29 October 2026.
Keep following the evidence
Join The Impact Brief founding list for selected AI reports, their effect on people and the evidence limits. Read a sample first.
Read the full report · 4 min The evidence, methods, implications and limitations
A structured record, not an automated chemist
An open language model converted published zeolite-synthesis prose into ordered laboratory actions without model fine-tuning, according to a peer-reviewed Nature Communications paper published on 29 October. On a held-out set of 110 procedures, the final Gemma 3 12B pipeline reached an action-sequence similarity of 0.89 ± 0.01, an action-content F-score of 0.84 ± 0.01 and a chemical-information F-score of 0.85 ± 0.01. Each figure was averaged over five runs.
For a materials scientist, the practical promise is a faster way to turn papers into searchable records: additions, heating, stirring, filtration and the chemicals attached to each step. The system did not carry out any synthesis, assess reaction success or prove that following an extracted record is safe. Its output is a literature-data aid that still needs chemical review before anyone treats it as an experimental protocol.[1][2]
The test separated optimisation from evaluation
The team collected 312 scientific articles, extracted 185 synthesis procedures and had human experts annotate their action sequences using a 14-action zeolite vocabulary. Seventy-five procedures were used to choose models, prompts and post-processing rules; the remaining 110 formed a separate test set. Researchers screened 16 open models below 16 billion parameters, selected seven for deeper comparison, and tested 14 action prompts plus six chemical-extraction prompts before choosing Gemma 3 12B with greedy decoding.
Against three extractors trained for other chemistry domains, the new pipeline reported 17% to 52% higher performance across its metrics on zeolite text. That comparison partly tests a domain mismatch: the older systems lacked actions such as crystallisation or sieving. In their own domains, the new method was comparable rather than uniformly superior—for example, it reached 0.82 action F-score on 132 organic-synthesis sentences versus 0.83 for a specialist model. Two other published extractors could not be compared because their code was unavailable.[1][2]
The distinction that matters
What the pipeline actually does
The reported result covers information extraction from papers, not laboratory execution.
Paper
Read an unstructured synthesis paragraph
Identify candidate actions and chemicals
Pipeline
Apply an action vocabulary and post-processing rules
Produce an ordered structured record
Human check
Review ambiguous or inserted steps
Decide whether the record is usable
Manual rules remain inside the ‘training-free’ system
The model itself was not retrained, but the whole pipeline was not effort-free. Researchers manually reviewed errors on the 75-procedure optimisation set and wrote rules to remove false chemicals, split merged actions and add steps implied by parameters. Those rules improved the seven-model average, yet the paper notes that a duration attached to a temperature can be converted into crystallisation when another interpretation is correct. That design judgement may not transfer to a new chemistry field.
The authors released the zeolite data, prompts, results and code. A smaller suggested model can run below 8 GB of graphics memory, while the selected 12B model needs more than 24 GB. Portuguese, Swiss and EU programmes funded the work; one author is at IBM Research Europe, and the authors declared no competing interests. The assessment would strengthen with independently annotated corpora, prospective use by chemists, error rates on unseen journals and evidence that structured records improve research decisions without propagating plausible but unsafe steps.[1][2]
Watch the background, then check the evidence
Illustrative photo · not a video frame
Google DeepMind · 1 min 52 sec · Background explainer
Protein folding explained
YouTube loads only when you choose; playback starts when you press play.
A short introduction to why a protein’s shape matters. It provides background for understanding what AI structure prediction contributes to biological research.
Evidence check: This is the developer’s explanation. Predicting a structure does not by itself establish a treatment’s safety or benefit for patients.
Published 2020-11-30. Source checked 14 October 2026. Check captions on the publisher’s video page.
Explore current researchContinue the story
Read next
Continue exploring laboratory automation: compare the finding and its evidence limits.
Can AI choose the next drug-chemistry experiment?
A peer-reviewed Roche–ETH study used active learning to select 50 new substrates from a 22,253-molecule pool, then tested about 96 reaction conditions for each. A later graph model identified the observed reaction site for all ten prospectively tested substrates—but only within a narrow chemistry workflow, not drug discovery as a whole.
Read the next reportExplore the full source and evidence record
What this means for people
- A chemist could spend less time manually transcribing published methods, but a fluent extraction error can still change a temperature, chemical or sequence. Human verification remains part of the workflow.
Global context
The researchers worked in Portugal and Switzerland and tested English-language chemistry literature. Open code lowers the replication barrier, but terminology, access to papers and laboratory conventions differ across fields, journals and languages.
What the evidence does not yet show
- 110-procedure held-out zeolite test
- No laboratory execution
- Manual domain-specific post-processing
- No unseen-journal deployment
- Two closed baselines excluded
- Five repeated model runs
- Accepted version awaits final editing
What to watch next
- Independent annotation audit
- Prospective chemist workflow study
- Tests in additional chemistry domains and languages
- Safety review of inserted steps
- Impact on data-curation time and downstream decisions
Living evidence record
Impact record IAI-0T7JU20
Evidence stage
Studied
Confidence
Supported
Reporting basis
Source analysis
Independent or research support
Not yet
Record status
Monitoring
Last checked
29 October 2026
Source trail
2 direct sources across 1 source type.
People impact
Documented in this record.
Uncertainty
Limits and next checks are explicit.
Stages describe the evidence available—not whether a technology is good or bad. See the public method.
Related-source reporting disclosure
This record analyses 2 linked source records around the same underlying development. The extra records add method, date or context, but they do not by themselves constitute independent replication of every performance claim or predicted outcome.
Evidence trail
Sources used for this report
Links checked 29 October 2026
Research question, topics and regions
Training-free extraction of structured laboratory actions from chemistry procedures
Topics: Chemistry · Scientific literature · Open models · Data extraction · Laboratory automation
Regions: Portugal · Switzerland · Europe · Global
This report is labelled source analysis. We summarise and analyse source material in our own words; company statements remain attributed claims until independently supported. Translated summaries preserve the meaning of the original source and link back to it. Read our editorial standards.
Reader commentary
What does this mean where you are?
Tell us what you have seen at work, in your community or in everyday life. A question is welcome too. No account is needed; we review notes before publishing them.
Explore commentary across the portal →Published reader notes
0No published reader notes yet. You can start the evidence-led discussion above.
Prefer a private correction or response? Contact the newsroom.