Daily A100 SXM 40GB prices per GPU-hour. The shaded period is reconstructed from public archives: the version history of SkyPilot's price catalogs, Internet Archive copies of providers' pricing pages and the open gpu-price-feed project (fewer providers than live data). After that, PetaPrice's own tracking.
Cheapest On-demand A100 SXM 40GB offer at each provider, per GPU-hour. Shorter and greener is cheaper.
Thin vertical line = median across providers ($1.66).
10 providers · 29 configurations
Memory for the weights plus one 32K-token sequence of context, how many GPUs hold it, and what that replica costs at the cheapest in-stock on-demand rate.
| Model | Params | Memory | GPUs | $/hr | $/mo |
|---|---|---|---|---|---|
gpt-oss-20b OpenAI · 20.9B | 20.9B · 3.6B active | 20 GiB | 1 | $0.41 at GPU.ai | $299 |
Gemma 3 27B Google · 27.4B | 27.4B | 28 GiB | 1 | $0.41 at GPU.ai | $299 |
Qwen3-32B Alibaba · 32.8B | 32.8B | 39 GiB | 2 | $0.82 at GPU.ai | $599 |
Llama 3.3 70B Instruct Meta · 70.6B | 70.6B | 76 GiB | 4 | $1.64 at GPU.ai | $1,197 |
gpt-oss-120b OpenAI · 117B | 117B · 5.1B active | 110 GiB | 4 | $1.64 at GPU.ai | $1,197 |
Qwen3-235B-A22B Alibaba · 235B | 235B · 22B active | 225 GiB | 8 | $3.28 at GPU.ai | $2,394 |
DeepSeek-R1 DeepSeek · 684B | 684B · 37B active | 640 GiB | 32 | $13.12 at GPU.ai | $9,578 |
Kimi K3 Moonshot AI · 2.78T | 2.78T · 104B active | 2.53 TiB | 64+ | — | — |
Assumes 90% of each GPU's memory is usable and rounds up to 1, 2, 4, 8… GPUs for tensor parallelism (up to 64). $/hr is the GPU count times the cheapest in-stock on-demand rate per GPU; check that the provider rents instances that large. Serving many requests at once needs more memory for context.
GPUs with similar compute and memory, and their lowest on-demand price right now.
On-demand A100 SXM 40GB prices start at $0.41 per GPU-hour (GPU.ai). The median across 10 providers is $1.82, and the most expensive is $3.48. Running one GPU around the clock costs about $299 per month at the lowest price.
Yes. Spot (interruptible) A100 SXM 40GB capacity starts at $0.49 per GPU-hour, -19% below the cheapest on-demand price. Spot instances can be preempted at any time, so use them for checkpointed training or batch jobs.
At $0.41 per hour and 0.312 PF of dense FP16/BF16, the A100 SXM 40GB costs $1.31 per PFLOP-hour. That ranks 3 of 74 GPUs with on-demand prices on PetaPrice. Figures are datasheet peaks; real utilization is typically 30–60%.
40 GB HBM2 with 1,555 GB/s of memory bandwidth, Ampere architecture (2020), SXM form factor, 400 W. Dense peak: 0.312 PF FP16 / BF16, 0.624 PF INT8, 0.156 PF TF32, 0.0195 PF FP32, 0.0195 PF FP64.
Prices were collected on Nov 11, 2026, 03:01 UTC from provider APIs and public catalogs and refresh about every 2 hours. They are indicative list prices; always confirm on the provider's website before booking.