Devotd Github
NewAI agents

isitcredible/research_skills — Paper Evidence Review Agent Skills

A bundle of agent skills that reviews papers claim by claim against their evidence, audits the results, and organizes them into an issue document for humans.

Repositoryisitcredible/research_skills ↗

A bundle of agent skills that reviews papers claim by claim against their evidence, audits the results, and organizes them into an issue document for humans.

GitHub description: Agent skills developed by The Catalogue of Errors Ltd

stars
★ 32
Forks
2
Language
Python
License
MIT
Read original source ↗View on GitHub ↗

isitcredible/research_skills is a bundle of agent skills that reviews a single research paper claim by claim against its supporting evidence. According to the repository description, it was developed by The Catalogue of Errors Ltd, and there is no publicly available information about the latest release. It does more than summarize a paper: it provides a procedure for recording what evidence backs each claim.

The review process cross-checks the paper against its appendix and reproduction materials, and verifies the code against the text. It reruns the reproduction files, and includes a stage in which a separate, fresh agent re-examines the evidence from the start. It then mechanically audits the completeness and traceability of the review results, and organizes the audited output into an issue list and documents for humans to read. Each stage is designed to record what counts as supporting evidence rather than to judge the facts themselves. The center of this repository, therefore, is not a model that makes research judgments on your behalf, but a working procedure that divides up the review process and leaves it behind.

That said, this project is closer to automating documents and procedures than to providing a standalone foundation model or a performance comparison. From the publicly available structure and inspection materials alone, it is hard to verify the reliability of actual paper review results, and judging that requires looking more closely at the output artifacts. It can be viewed as a reference procedure that organizes the criteria for research review, but it should not be interpreted as a tool that guarantees the validity of its results.