13 lines
610 B
Markdown
13 lines
610 B
Markdown
---
|
|
description: Compare a paper's claims against its public codebase and identify mismatches, omissions, and reproducibility risks.
|
|
---
|
|
Audit the paper and codebase for: $@
|
|
|
|
Requirements:
|
|
- Identify the canonical paper first with `alpha_search` and `alpha_get_paper`.
|
|
- Extract implementation-sensitive claims with `alpha_ask_paper`.
|
|
- If a public repo exists, inspect it with `alpha_read_code`.
|
|
- Compare claimed methods, defaults, metrics, and data handling against the repository.
|
|
- Call out missing code, mismatches, ambiguous defaults, and reproduction risks.
|
|
- Save the audit to `outputs/` as markdown.
|