Live Demo
Watch a real audit
An audit, start to finish
Auditing a real instruction-tuned model against the base it derives from. Replayed at the audit's true timing: start to verdict in under six seconds for a 1.5-billion-parameter model on a single workstation.
Three real reports
- Exit 2 · DetectedOpen the report
Modification detected
A full-precision model audited against its base. Watchman flags the modification, classifies it as instruction tuning, and shows the change concentrated in the attention value and key projections at mid-depth.
- Exit 0 · CleanOpen the report
Clean quantized release
A compressed model audited against its full-precision base using a matched-compression control. Watchman confirms the release is the base plus declared quantization and nothing more.
- Exit 1 · Fails safeOpen the report
Wrong claimed base
A candidate audited against a base it does not derive from. Rather than guess, Watchman returns indeterminate, never a false "clean". The verdict you act on is one the tool can defend.
The AI-BOM attestation
Alongside every report, Watchman emits a CycloneDX-style attestation fragment: the model's identity, its per-file weights identifier, the verified lineage to its base, and the verdict. Merge it into your AI bill of materials; pin it in your model registry. This is the real output of the run above.
loading…
Run it in your own pipeline
# submit an audit: is this candidate what it claims to be?curl -X POST https://watchman.internal.example/v1/audits \-H 'Content-Type: application/json' \-d '{"base":"org/base-model","candidate":"org/candidate-model"}'# → {"id":"aj-1a2b3c4d5e","status":"queued"}# poll for the verdictcurl https://watchman.internal.example/v1/jobs/aj-1a2b3c4d5e# → {"status":"done","exit_code":2,# "result":{"modification_detected":true,"classification":"instruction_tuning"}}# pull the evidencecurl -O https://watchman.internal.example/v1/reports/aj-1a2b3c4d5e.htmlcurl -O https://watchman.internal.example/v1/reports/aj-1a2b3c4d5e.cdx.json# CI gate: exit 0 clean · 2 modification detected · 1 indeterminate