Show HN: I built a CLI to arbitrage GPU prices across 10 clouds (pypi.org)

Terradev is a BYOAPI Terraform “wrapper” for cross-cloud GPU provisioning and node pooling

pip install terradev-cli

terradev k8s create demo --gpu A100 --count 8 --multi-cloud

A100s may be $3.20/hr on AWS, vs $2.40/hr on Vast.ai, but getting quotes across providers takes hours, there’s heavy tooling required between providers, and the nodes can’t be actively managed as pricing and demand changes day-to-day…

Terradev is a cross-cloud compute-provisioning CLI that works in parallel to quickly spin up optimal instances and pool them in Kubernetes clusters 3-5x faster than sequential workflows.

Nodes from different providers can pool in the same cluster, optimizing for latency, with workloads scheduling across all of them…

Built-in hooks: HF Spaces, Karpenter, vLLM, Ollama, Ray, MLFlow, W&B