Tool 2026
numguard: numerical edge-case testing with an optional LLM repair agent
Repository-documented testing tool for numerical array functions, combining edge-case inputs, references and metamorphic checks with an optional experimental LLM that suggests specifications or function rewrites.
Workflow level n/a Source: Repository-documented Outcome: Not empirically evaluated here
Research applicability
Helps researchers inspect numerical correctness of scientific or ML array code, including AI-generated implementations.
Getting started
Editorial, untested guidance: read the README, install numguard-ci in an isolated environment, and test one non-sensitive numerical function with a trusted reference before enabling the optional agent.
Maintenance
Source availability checked on access date; future maintenance not established.
License
Licensing and redistribution terms must be checked before reuse; no independent licence audit.
Workflow & human oversight
Resource-level workflow is unspecified. Researchers set objectives, validate assumptions and outputs, and supervise any adoption.
Workflow level is not an evidence score; higher is not better evidence.
Approach
Fixed checks assess outputs against references and dtype limits; the LLM proposes a spec or rewrite rather than deciding correctness. Documentation describes CLI, pytest and CI integration.
Limitations
Partial repository documentation review only; no installation, security audit or outcome reproduction. The experimental agent success rate is unmeasured. Finite cases do not prove correctness; permissive specifications can hide bugs, and real optional backends are not exercised in the stated CI tests.
Reproducibility
Source review only; no code, hardware or claimed outcome reproduced.
Adoption requirements
Python 3.10+, NumPy and click; suitable functions, reference implementations and researcher-reviewed specifications. Optional model access entails API costs and sending code to a provider: review confidentiality and institutional policy first.
Comments
No comments yet.
Add a comment
Comments are held for moderation before appearing. Critical or corrective comments are welcome — especially evidence that an entry overstates what has been verified.