Chutes is operated under Chutes Global Corp. The team operates with a decentralized organizational structure and no single central decision-maker. Known contributors include Jon Durbin, along with backend, frontend, and marketing contributors distributed globally. The project is fully open-source, with all code publicly available and actively maintained.
What is Chutes?
Chutes is a serverless AI compute platform that enables users to rapidly deploy, run, and scale AI models without managing infrastructure. It offers an intuitive interface and straightforward API, allowing developers to launch models – including large language models (LLMs), image processors, and audio applications – in seconds.
Chutes automatically scales resources based on demand and provides a built-in playground for quick testing and iteration. The platform is designed for developers, startups, research teams, and SaaS companies seeking to prototype and deploy AI solutions efficiently and at scale.
How Chutes works?
Chutes functions as a decentralized Platform-as-a-Service (PaaS) for AI workloads. A developer-facing API and web interface handle deployment and invocation, while a backend network of GPU miners executes the actual computations. Each deployed model, called a chute, is essentially a FastAPI application running on GPU-accelerated infrastructure, with individual endpoints called cords that each represent a single function or route within the application. The platform currently supports Python only through its SDK. Developers write code using simple decorators, and Chutes handles containerization, GPU selection, scaling, and shutdown automatically. Pre-built templates are available for popular frameworks like vLLM, SGLang, TEI, and Diffusion models. The system supports hardware including NVIDIA H200, B200, and AMD MI300X cards, and all miners must run on bare-metal servers or dedicated VMs managed through Kubernetes.
Security follows the project's core philosophy: don't trust, verify. Every GPU on the network is verified through a custom C/CUDA verification process that performs matrix multiplications seeded by device information and tests that at least 95% of VRAM is available, preventing hardware spoofing. All validator-to-miner traffic is encrypted with GPU-specific keys. Additional security layers include cfsv (filesystem integrity), inspecto (bytecode tampering detection), cllmv (per-token model verification), and envdump (runtime environment snapshots). For workloads requiring the highest data protection, Chutes offers publicly available Trusted Execution Environments (TEE) powered by sek8s, a hardened Kubernetes distribution running inside Intel TDX confidential virtual machines with NVIDIA Protected PCIe encryption. Validators monitor miner performance and rank them based on compute quality, uptime, and response times, while adversarial validation cross-verifies outputs from multiple miners to ensure accuracy.
