Files
feynman/prompts/audit.md
2026-03-24 09:57:25 -07:00

1.0 KiB

description, args, section, topLevelCli
description args section topLevelCli
Compare a paper's claims against its public codebase and identify mismatches, omissions, and reproducibility risks. <item> Research Workflows true

Audit the paper and codebase for: $@

Derive a short slug from the audit target (lowercase, hyphens, no filler words, ≤5 words). Use this slug for all files in this run.

Requirements:

  • Before starting, outline the audit plan: which paper, which repo, which claims to check. Write the plan to outputs/.plans/<slug>.md. Present the plan to the user and confirm before proceeding.
  • Use the researcher subagent for evidence gathering and the verifier subagent to verify sources and add inline citations when the audit is non-trivial.
  • Compare claimed methods, defaults, metrics, and data handling against the actual code.
  • Call out missing code, mismatches, ambiguous defaults, and reproduction risks.
  • Save exactly one audit artifact to outputs/<slug>-audit.md.
  • End with a Sources section containing paper and repository URLs.