Shepherd · Deployment

Deploy private AI to hardware you own

Shepherd takes a frontier model, compresses it with RAM, certifies its provenance with Watchman, and deploys it to your infrastructure. Your cloud, a Mac Studio, or an air-gapped facility. Your data stays inside the fence.

What it does

One pipeline, model to production

You pick a frontier model. Shepherd handles everything between that choice and a model running on hardware you control.

Compression halves the footprint, so a 31B model fits on a single GPU instance or a Mac Studio. Watchman signs off on provenance before anything reaches production. You get the model, the evidence report, and a deployment that runs where your data already lives.

Every build ships with a CycloneDX AI-BOM attestation confirming the compressed model is your base plus the declared quantization and nothing else, with pass or fail gating against your policy. No separate tooling and no manual validation. Compression and assurance run in the same pipeline.

Enterprise platform

Built for teams shipping models on a schedule

The work does not stop at the first deployment. Shepherd runs the whole lifecycle: compress, certify, ship, and repeat on every release.

01

Pipeline integration

Automated compression triggered on model release. Plug RAM into your existing CI/CD with webhook triggers, CLI tooling, and API access. Compress once, deploy everywhere.

02

Fleet deployment

Roll compressed models across Apple Silicon clusters and on-prem GPU infrastructure from one place.

03

Air-gapped and sovereign

Deploy into environments with no outbound network. The model and the audit stay inside your facility, for organisations that require it.

04

Quality-gated releases

Every build is certified by Watchman before it ships. Models that miss your policy never reach production, and you keep full traceability from source to deployment.

05

Batch and catalogue

Compress a whole model catalogue in one workflow, then export to MLX, GGUF, or a custom target.

06

Support and SLA

Dedicated engineering support and a service-level agreement behind the platform.

Deployment targets

Runs where your data already lives

A compressed model is small enough to change where it can run. Pick the target that matches how your team operates.

Your cloud

AWS, Azure, GCP

A compressed 31B model fits on a single GPU instance. Deploy inside your own VPC or VNet with private endpoints, so traffic never leaves your account.

Your hardware

Apple Silicon

Run compressed models on a Mac Studio, on-prem or at a desk. No cloud, no API keys, no metered costs. Electricity is the running cost.

Sovereign

Air-gapped

Deploy into facilities with no outbound network. The model runs, Watchman audits, and nothing crosses the boundary.

Ready to compress at scale

Talk to our team about running Shepherd in your infrastructure. Compression, provenance, and fleet deployment in one pipeline.

Talk to Us About Enterprise

The free individual edition is being rebuilt on the same engine. Get notified when it ships.