RunPod
GPU cloud with on-demand pods and serverless endpoints.
A GPU cloud for training and inference: rent on-demand or spot GPU pods, or deploy autoscaling serverless endpoints (including vLLM templates) that bill per second.
- Vendor
- RunPod
- Category
- Inference & model hosting
- Pricing
- Paid
- Open source
- No
- Platforms
- API, Web
- Launched
- 2022
- Website
- runpod.io
Features
- On-demand GPU pods
- Serverless endpoints
- Per-second billing
Best for
- High volume / low cost
More inference & model hosting
- Ollama — Ollama. Run open models locally with one command.
- vLLM — vLLM project. High-throughput LLM serving engine.
- llama.cpp — ggml. LLM inference in C/C++ on any hardware.
- Amazon Bedrock — AWS. Foundation models on AWS.
- Vertex AI — Google Cloud. Google Cloud’s AI platform.
- LM Studio — Element Labs. Desktop app to discover and run local LLMs.
- Azure AI Foundry — Microsoft. Build and run AI apps on Azure.
- Groq — Groq. Ultra-fast inference on custom LPUs.