FlamePilot · Agentic Research Directory

FlamePilot

FlamePilot combines literature reading with tool-based combustion simulation and error correction. Its authors report executable cases for all 16 FoamBench-Advanced tasks, but a success rate of 0.438 under the benchmark criterion. The combustion case includes researcher-selected changes and manual mesh refinement. Results describe a supervised simulation copilot, not an independently validated autonomous laboratory.

L3Multi-step tool-using agentic workflow Source Preprint (not peer-reviewed) Outcome Author-reported

Evidence & verification

Source level

Preprint (not peer-reviewed)
Grounded in a preprint that had not completed peer review at the time the source was checked.

Outcome verification

Author-reported
Outcomes are reported by the team that built the system. The entry is source-checked against the team's own publications; not independently reproduced.

Sources checked

2026-10-19 (UTC)

Checked source version: 2601.01357v1. Claims refer to this manuscript snapshot; final journal/proceedings version parity was not verified. Author-reported; independent replication not established in this review.

Source-checked does not mean independently reproduced. See the Method page for how these labels are assigned.

Sources (2)

Research applicability

Documented engineering research workflow, with source-version and evaluation limits retained.

Getting started

Read the primary manuscript and its limitations first. Check implementation access and terms separately; this review did not run an installation, API call to a research system, or experiment.

Maintenance

Source snapshot checked 2026-10-19. Current availability and experimental version parity are separate claims.

License

Research code/data/manuscript terms require separate verification; repository metadata alone is not a reuse clearance.

Workflow & human oversight

L3 applies only to the interactive MILD-combustion simulation workflow. A researcher provides the paper, selects parameter/model changes and manually refines mesh settings; agent code executes the resulting study. Literature extraction, tool execution and log-based repair support researcher-directed simulation. No general researcher-free science claim. Solver executability and agreement with a chosen reference are distinct from physical validation; no universal stopping or safety protocol is certified.

Workflow level is not an evidence score; higher is not better evidence.

Approach

A single agent decomposes tasks, uses filesystem/solver tools and logs for correction, and extracts simulation parameters from literature; researcher gates remain in the combustion case.

Outcomes (as reported by the originating team)

FoamBench-Advanced has 16 cases: author-reported executability 1.0 (16/16), success 0.438 (rounded, consistent with 7/16), and bucketed NMSE score 0.469. Prior-agent comparisons use previously reported benchmark values, not newly rerun baselines.

Limitations

Execution and fidelity differ. In the MILD-combustion example, a researcher selects model/parameter changes and manually refines mesh settings; not fully autonomous experimental science.

Reproducibility

Author-reported; independent replication not established in this review. Documentary review only; no candidate code, model, simulation or experiment was executed. A public repository or result artifact is not proof of replication.

Adoption requirements

Untested suggestion: inspect the pinned sources and validate data, evaluator assumptions, implementation availability and researcher controls before planning a bounded trial. No setup or trial was executed.

Comments

No comments yet.

Add a comment

Comments are held for moderation before appearing. Critical or corrective comments are welcome — especially evidence that an entry overstates what has been verified.