What The Diff
AI PR Review · #19 of 20 in category · #26 of 27 overall
Writes PR descriptions from the diff, sends changelog notifications to stakeholders, and does small /wtd refactors on GitHub and GitLab.
[ Where it fits ]
On the documented evidence, What The Diff suits teams already standardised on GitHub and GitLab.
[ Documented strengths ]
No standard is fully documented as met in public sources.
[ Documented gaps ]
- Multi-dimensional Context. Explicitly diff-only: analyzes the PR diff to write a description; not a bug-finding reviewer.
- Dual-Workflow: Local vs. PR. PR surface only; no IDE, CLI, or pre-commit mode.
- Measurable ROI. Weekly progress report notifications only; no acceptance, DORA, or cost dashboards.
[ Facts ]
- Category
- AI PR Review
- Open source
- No — proprietary
- Pricing
- Free: 25,000 tokens/mo (~10 PRs); Pro $19/mo: 200,000 tokens (~40 PRs). Token-metered (avg PR ~2,300 tokens); no rollover source ↗
- Self-hosted
- No
- Model control
- Fixed vendor model; no BYOK or model choice documented
- Last verified
- 2026-08-11
[ Against the 9 standards ]
Based on public documentation as of 2026-08-11. ✓ documented · ~ partial · ✗ not offered · ? undocumented. Undocumented scores zero — see the methodology.
Explicitly diff-only: analyzes the PR diff to write a description; not a bug-finding reviewer.
No BYOK, but usage is metered in visible tokens with published per-PR averages (~2,300 tokens/PR).
On-demand /wtd comments produce small refactor suggestions in the PR; no review-driven fixes.
Weekly progress report notifications only; no acceptance, DORA, or cost dashboards.
[ What The Diff vs the alternatives ]
[ Closest alternatives ]
[ FAQ ]
Is What The Diff open source?
No. What The Diff is proprietary — you can use it, but you cannot read or fork the review engine.
Can What The Diff be self-hosted?
No. Verified against the vendor's own documentation on 2026-08-11.
How much does What The Diff cost?
Free: 25,000 tokens/mo (~10 PRs); Pro $19/mo: 200,000 tokens (~40 PRs). Token-metered (avg PR ~2,300 tokens); no rollover. Seat price is only part of the bill: What The Diff handles models as fixed vendor model; no byok or model choice documented, which is what usually decides the real monthly cost.
How does What The Diff score against the 9-pillar AI code review standard?
1 out of 9. It fully documents 0 standards, partially documents 2, does not offer 3, and leaves 4 undocumented. The score is coverage of documented capability, not a measure of review quality.
What are the alternatives to What The Diff?
The closest tools in this directory are Graphite, Panto, Sourcery, GitHub Copilot code review. Each is scored against the same 9 standards, so the matrices are directly comparable.
Evaluating What The Diff?
Run it through the two-week trial protocol before you commit a team to it.