TSBench: physics-grounded reaction-mechanism evaluation

Evidence & verification

Source level

Preprint (not peer-reviewed)
Grounded in a preprint that had not completed peer review at the time the source was checked.

Outcome verification

Author-reported
Outcomes are reported by the team that built the system. The entry is source-checked against the team's own publications; not independently reproduced.

Sources checked

2026-10-17 (UTC)

Reviewed arXiv v1 abstract and metadata. Publication-class field describes the inspected preprint/accepted-manuscript source, not a claim that no journal publication exists. Author claims remain attributed.

Source-checked does not mean independently reproduced. See the Method page for how these labels are assigned.

Sources (1)

Research applicability

Offers chemical-mechanism researchers an evaluation design beyond factual chemistry questions, with a reaction-path consistency failure mode that matters for proposed transition states.

Getting started

Untested editorial guidance: read https://arxiv.org/abs/2609.08503 and the full methods before adaptation; start with a bounded supervised evaluation and inspect artifacts, permissions and failure modes. This review is not an exercised recipe.

Maintenance

Source retrieved 2026-10-17; software maintenance and availability not tested.

License

Article, model, data and software rights require separate inspection; no open-licence claim.

Workflow & human oversight

Resource-level workflow classification unspecified; an instantiated workflow depends on the research task, implementation and oversight. Researchers retain responsibility for validation and safe use.

Workflow level is not an evidence score; higher is not better evidence.

Approach

Agents use structure-editing tools and an automated quantum-chemical pipeline supplies pass/fail judgments. The authors report diagnosis-driven revision experiments and failures where plausible saddle points connect the wrong reactants and products.

Limitations

Abstract-only review of arXiv v1. Quantum-chemical settings, benchmark implementation, model configurations and reaction set were not inspected. No downloadable dataset or executable release is confirmed. Automated checking inside the authors' benchmark is not editorial machine-verification or independent reproduction; transfer to synthesis planning is not demonstrated.

Reproducibility

Primary abstract and metadata read only; no installation, code execution, experiment or independent outcome reproduction.

Adoption requirements

Untested editorial guidance: inspect the full benchmark protocol and artifact availability, establish quantum-chemistry expertise and compute requirements, and validate transition-state/reaction-path checks before comparing agents. Check model/data licensing separately.

Comments

No comments yet.

Add a comment

Comments are held for moderation before appearing. Critical or corrective comments are welcome — especially evidence that an entry overstates what has been verified.