Dev.to
7/2/2026

I built a UCP conformance checker where every check has to prove it can catch its own bug
Short summary
Conformance checker for UCP (Universal Commerce Protocol), the open standard for AI agent-driven commerce. Key innovation: kill-rate testing—each check must prove it catches its own injected bug, using official schema validators and spec citations for traceability. Author identified real deviations in Node.js and Python reference implementations; tool available via CLI, web interface, or GitHub Actions CI integration.
- •Kill-rate testing ensures each conformance check actually catches its target defect
- •Uses official schema validators and spec citations for traceability and accuracy
- •Found real deviations in reference implementations; CLI, web, and CI/CD integration available
Generated with AI, which can make mistakes.
Is this a good recommendation for you?



