HLER · Agentic Research Directory

HLER

HLER connects dataset-aware economic questions, human selection gates, econometric execution and review-driven revision. Authors report 69 of 79 dataset-aware questions were feasible, compared with 34 of 82 unconstrained questions, and 12 of 14 runs completed. Automated reviewer gains are same-model assessments. The public repository contains working papers and per-study scripts, explicitly excluding the research system; causal validity and independent replication remain unverified.

L3Multi-step tool-using agentic workflow Source Preprint (not peer-reviewed) Outcome Author-reported

Evidence & verification

Source level

Preprint (not peer-reviewed)
Grounded in a preprint that had not completed peer review at the time the source was checked.

Outcome verification

Author-reported
Outcomes are reported by the team that built the system. The entry is source-checked against the team's own publications; not independently reproduced.

Sources checked

2026-10-19 (UTC)

Checked source version: arXiv2603.07444v1;8March2026;body also prints24August2026. Claims refer to this manuscript snapshot; final journal/proceedings version parity was not verified. Author-reported; independent replication not established in this review.

Source-checked does not mean independently reproduced. See the Method page for how these labels are assigned.

Sources (2)

Research applicability

Documented economics research workflow, with source-version and evaluation limits retained.

Getting started

Read the primary manuscript and its limitations first. Check implementation access and terms separately; this review did not run an installation, API call to a research system, or experiment.

Maintenance

Source snapshot checked 2026-10-19. Current availability and experimental version parity are separate claims.

License

Research code/data/manuscript terms require separate verification; repository metadata alone is not a reuse clearance.

Workflow & human oversight

L3 applies only to the dataset-constrained economic-research pipeline. The human principal investigator chooses the question and retains publication approval; dataset audit and author evaluation bound interpretation. Agents execute econometrics and review-driven revision. The public output repository excludes the agent system. Runs can fail to converge; same-model review is not independent causal validation, and multiple-testing/identification limits remain.

Workflow level is not an evidence score; higher is not better evidence.

Approach

Dataset audit/profile constrain candidate questions; human PI selects question and approves publication. Econometric execution, drafting and automated critique feed reanalysis/revision; unsatisfactory questions can be regenerated.

Outcomes (as reported by the originating team)

Three datasets,14runs:69/79dataset-awarequestions feasible versus34/82unconstrained, assessed by two researchers.12/14complete; two convergence failures. Same underlying LLM reviewer scores on12completedruns rise4.8→6.3; these are not independent quality ratings.

Limitations

Observational identification, multiple testing, limited estimator support and small sample remain. APIcost/runtime are historic author reports, not reproduced/current quotes. Manuscript outputs do not prove causal discoveries. Body-date/arXiv-date inconsistency remains unresolved.

Reproducibility

Author-reported; independent replication not established in this review. Documentary review only; no candidate code, model, simulation or experiment was executed. A public repository or result artifact is not proof of replication.

Adoption requirements

Untested suggestion: inspect the pinned sources and validate data, evaluator assumptions, implementation availability and researcher controls before planning a bounded trial. No setup or trial was executed.

Comments

No comments yet.

Add a comment

Comments are held for moderation before appearing. Critical or corrective comments are welcome — especially evidence that an entry overstates what has been verified.