Runs inside your environment
VitalOps is software you install and run yourself, rather than a hosted service. It can run fully air-gapped, and every model change is linked to an evaluation and an approval.
Security controls
Data stays in your environment
The software installs in your cloud account, data centre or air-gapped network. Prompts, outputs, weights and eval sets stay there, and nothing is sent back to us.
Access control
Single sign-on with SAML or OIDC, SCIM provisioning, and role-based access for pools, models and runs.
Audit trail
Each bundle records the run, the eval and who approved it. Audit logs can be exported to your SIEM.
Signed artefacts
Bundles, kernels and device exports are signed and checked before they load. Over-the-air updates roll out in stages.
Secrets
Credentials for model registries, clouds and APIs stay in your secrets manager. We read them at runtime and don't store them.
Our engineers
During sprints our engineers work in your environment under your access policies, and we keep no copies of your data.
What engineering teams ask us
Do you ever see our prompts or weights?
No. The products run in your environment and don't send any data about your usage to us. During sprints our engineers work inside your environment under your access controls.
Can it run with no internet access?
Yes. Air-gapped installs use offline bundles and signed updates, and licence checks work offline.
How do you handle a security report?
Email hello@vitalops.ai with the details. We acknowledge within one working day.
Tell us what you need the model to do
Send us the model, the hardware and your target, whether that's tokens per second, latency, memory or cost. In a 30-minute call we'll tell you whether we think it's doable and roughly what it would take.
- ReviewA free 30-minute call. We look at your model, hardware and target and give you an honest estimate.
- SprintTwo weeks at a fixed fee, on your hardware. If we can't beat your current setup, you don't pay.
- RunWe run Serve and monitoring for you and keep re-tuning as traffic changes, under an agreed SLO.