…
H100 PCIe vs H100 SXM
Cloud rental price, compute per dollar and specs, side by side.
Open in the interactive comparer →
H100 PCIe$1.98lowest on-demand per GPU·h
$2.62 per PFLOP·h · 6 providersH100 SXM$1.66lowest on-demand per GPU·h
$1.68 per PFLOP·h · 28 providersWhat actually differs
- The H100 SXM has 1.3× more dense FP16/BF16 throughput than the H100 PCIe (0.756 PF vs 0.989 PF).
- The H100 SXM has 1.7× more memory bandwidth than the H100 PCIe (2,000 vs 3,350 GB/s), which usually limits LLM token generation. Memory: 80 GB vs 80 GB.
- The H100 SXM is 16% cheaper per hour than the H100 PCIe at the lowest on-demand prices ($1.98 vs $1.66).
- Per unit of compute, the H100 SXM is the better deal: $1.68 vs $2.62 per PFLOP-hour of dense FP16/BF16.
| Spec / price | H100 PCIe | H100 SXM |
|---|---|---|
| Memory | 80 GB HBM2e | 80 GB HBM3 |
| Memory bandwidth | 2,000 GB/s | 3,350 GB/sbetter |
| FP16 / BF16 (dense) | 0.756 PF | 0.989 PFbetter |
| FP8 (dense) | 1.51 PF | 1.98 PFbetter |
| FP4 (dense) | — | — |
| INT8 (dense) | 1.51 PF | 1.98 PFbetter |
| TF32 (dense) | 0.378 PF | 0.495 PFbetter |
| FP32 (dense) | 0.051 PF | 0.067 PFbetter |
| FP64 (dense) | 0.051 PF | 0.067 PFbetter |
| Power | 350 W | 700 W |
| Architecture | Hopper (2022) | Hopper (2022) |
| Lowest on-demand | $1.98 | $1.66better |
| Median on-demand | $2.75better | $3.19 |
| Lowest spot | $2.00 | $0.79better |
| FP16/BF16 $ per PFLOP·h | $2.62 | $1.68better |
| Providers | 6 | 28 |
H100 PCIe vs H100 SXM: questions
Is the H100 PCIe faster than the H100 SXM?
The H100 SXM has 1.3× more dense FP16/BF16 compute than the H100 PCIe. The H100 SXM has 1.7× more memory bandwidth than the H100 PCIe. Real-world speedups depend on the workload: training and prefill scale with compute, while LLM decoding scales mostly with memory bandwidth.
Which is cheaper per FLOP, the H100 PCIe or the H100 SXM?
Right now the H100 SXM is cheaper per unit of compute: $1.68 vs $2.62 per PFLOP-hour at the lowest on-demand prices.
How much does it cost to rent an H100 PCIe vs an H100 SXM for a month?
Running one GPU around the clock at the lowest on-demand price costs about $1,445 per month for the H100 PCIe and $1,212 for the H100 SXM.
Which has more memory, the H100 PCIe or the H100 SXM?
Both have 80 GB of VRAM; the H100 SXM has more bandwidth.