Intel · Gaudi · 96 GB HBM2e · OAM · 2022
2 providers · 2 configurations · prices as of Nov 10, 2026, 19:01 UTC
Daily Gaudi 2 prices per GPU-hour. The shaded period is reconstructed from public archives: the version history of SkyPilot's price catalogs, Internet Archive copies of providers' pricing pages and the open gpu-price-feed project (fewer providers than live data). After that, PetaPrice's own tracking.
Cheapest On-demand Gaudi 2 offer at each provider, per GPU-hour. Shorter and greener is cheaper.
Thin vertical line = median across providers ($1.10).
2 providers · 2 configurations
Memory for the weights plus one 32K-token sequence of context, how many GPUs hold it, and what that replica costs at the cheapest in-stock on-demand rate.
| Model | Params | Memory | GPUs | $/hr | $/mo |
|---|---|---|---|---|---|
gpt-oss-20b OpenAI · 20.9B | 20.9B · 3.6B active | 20 GiB | 1 | $1.10 at Denvr | $803 |
Gemma 3 27B Google · 27.4B | 27.4B | 28 GiB | 1 | $1.10 at Denvr | $803 |
Qwen3-32B Alibaba · 32.8B | 32.8B | 39 GiB | 1 | $1.10 at Denvr | $803 |
Llama 3.3 70B Instruct Meta · 70.6B | 70.6B | 76 GiB | 1 | $1.10 at Denvr | $803 |
gpt-oss-120b OpenAI · 117B | 117B · 5.1B active | 110 GiB | 2 | $2.20 at Denvr | $1,606 |
Qwen3-235B-A22B Alibaba · 235B | 235B · 22B active | 225 GiB | 4 | $4.40 at Denvr | $3,212 |
DeepSeek-R1 DeepSeek · 684B | 684B · 37B active | 640 GiB | 8 | $8.80 at Denvr | $6,424 |
Kimi K3 Moonshot AI · 2.78T | 2.78T · 104B active | 2.53 TiB | 32 | $35.20 at Denvr | $25,696 |
Assumes 90% of each GPU's memory is usable and rounds up to 1, 2, 4, 8… GPUs for tensor parallelism (up to 64). $/hr is the GPU count times the cheapest in-stock on-demand rate per GPU; check that the provider rents instances that large. Serving many requests at once needs more memory for context.
GPUs with similar compute and memory, and their lowest on-demand price right now.
On-demand Gaudi 2 prices start at $1.10 per GPU-hour (Denvr). The median across 2 providers is $1.16, and the most expensive is $1.21. Running one GPU around the clock costs about $803 per month at the lowest price.
At $1.10 per hour and 0.432 PF of dense FP16/BF16, the Gaudi 2 costs $2.55 per PFLOP-hour. That ranks 38 of 76 GPUs with on-demand prices on PetaPrice. Figures are datasheet peaks; real utilization is typically 30–60%.
96 GB HBM2e with 2,450 GB/s of memory bandwidth, Gaudi architecture (2022), OAM form factor, 600 W. Dense peak: 0.432 PF FP16 / BF16, 0.865 PF FP8, 0.011 PF FP32.
Prices were collected on Nov 10, 2026, 19:01 UTC from provider APIs and public catalogs and refresh about every 2 hours. They are indicative list prices; always confirm on the provider's website before booking.