Back to browse
Velda – Run jobs with serverless GPUs, without container images

Velda – Run jobs with serverless GPUs, without container images

by eagleonhill·May 14, 2026·2 points·2 comments

AI Analysis

●●●BangerBig BrainZero to One

Custom streaming filesystem beats Docker pull times for instant GPU job startup.

Strengths
  • Custom streaming filesystem syncs only necessary bits instead of pulling 5GB images.
  • Mirrors local dev environment exactly, removing YAML manifest and dependency drift pain.
  • Simple 'vrun' prefix workflow integrates directly into existing local scripts.
Weaknesses
  • Requires trusting a proprietary streaming protocol for environment consistency.
  • Unclear how it handles complex system-level dependencies not present in local env.
Target Audience

ML engineers and data scientists running training jobs

Similar To

Modal · RunPod · SkyPilot

Post Description

Almost all cloud job frameworks rely on containers. But building, pushing, and pulling images is slow and forces you to maintain a separate environment from your local dev setup. The maintenance of images is challenging as well: version drift, custom libraries & integrations, complex manifests.

We believe containers create too much overhead during development. We built Velda to let you launch jobs directly in the cloud by mirroring your Velda managed dev-environment, all with just a command prefix. That way, you only need to allocate GPUs when you're running your training jobs, with no change to your workflow.

How it works:

* No manifests or custom libraries: You don't need to rewrite your code or define YAML. Just prefix your command with vrun.

* Zero Restrictions: Use any tool, binary, or library already on your machine.

* Instant Launch: We built a custom streaming file system. Instead of waiting for a 5GB image to pull, we stream only the necessary bits to the cloud instance, allowing jobs to start in seconds after the machine boots.

The core is open source: https://github.com/velda-io/velda and can be deployed on AWS/GCP/Nebius

If you want to try the hosted version, we’re giving free credits for your first GPU jobs: https://cloud.velda.io

Similar Projects

AI/ML●●●Banger

Browser-Native GPU Sharing

Browser-based GPU cluster for LLM inference with HTTP API and SSE broker coordination.

WizardryZero to OneBold Bet
bilekas
121d ago