8f8cf2a4a9
- Fresh Astro 5 project with Tailwind v4 and shadcn/ui olive preset - All shadcn components installed (Card, Button, Badge, Separator, etc.) - Homepage with hero, terminal demo, workflows, agents, sources, compute - Full docs system with 24 markdown pages across 5 sections - Sidebar navigation with active state highlighting - Prose styles for markdown content using shadcn color tokens - Dark/light theme toggle with localStorage persistence - Shiki everforest syntax themes for code blocks - 404 page with VT323 font - /docs redirect to installation page - GitHub star count fetch - Earthy green/cream oklch color palette matching TUI theme Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2.6 KiB
title, description, section, order
| title | description | section | order |
|---|---|---|---|
| Source Comparison | Compare multiple sources and produce an agreement/disagreement matrix. | Workflows | 6 |
The source comparison workflow analyzes multiple papers, articles, or documents side by side and produces a structured matrix showing where they agree, disagree, and differ in methodology. It is useful for understanding conflicting results, evaluating competing approaches, and identifying which claims have broad support versus limited evidence.
Usage
From the REPL:
/compare "GPT-4 vs Claude vs Gemini on reasoning benchmarks"
/compare arxiv:2401.12345 arxiv:2402.67890 arxiv:2403.11111
From the CLI:
feynman compare "topic or list of sources"
You can provide a topic and let Feynman find the sources, or list specific papers and documents for a targeted comparison.
How it works
The comparison workflow begins by identifying or retrieving the sources to compare. If you provide a topic, the researcher agents find the most relevant and contrasting papers. If you provide specific IDs or files, they are used directly.
Each source is analyzed independently first: the researcher agents extract claims, results, methodology, and limitations from each document. Then the comparison engine aligns claims across sources -- identifying where two papers make the same claim (agreement), where they report contradictory results (disagreement), and where they measure different things entirely (non-overlapping scope).
The alignment step handles the nuance that papers often measure slightly different quantities or use different evaluation protocols. The comparison explicitly notes when an apparent disagreement might be explained by methodological differences rather than genuine conflicting results.
Output format
The comparison produces:
- Source Summaries -- One-paragraph summary of each source's key contributions
- Agreement Matrix -- Claims supported by multiple sources with citation evidence
- Disagreement Matrix -- Conflicting claims with analysis of why sources diverge
- Methodology Differences -- How the sources differ in approach, data, and evaluation
- Synthesis -- An overall assessment of which claims are well-supported and which remain contested
When to use it
Use /compare when you encounter contradictory results in the literature, when evaluating competing approaches to the same problem, or when you need to understand how different research groups frame the same topic. It is also useful for writing related work sections where you need to accurately characterize the state of debate.