…
H100 SXM vs H200 SXM
Cloud rental price, compute per dollar and specs, side by side.
Open in the interactive comparer →
H100 SXM$1.66lowest on-demand per GPU·h
$1.68 per PFLOP·h · 28 providersH200 SXM$2.10lowest on-demand per GPU·h
$2.12 per PFLOP·h · 22 providersWhat actually differs
- The H100 SXM and H200 SXM have the same dense FP16/BF16 throughput (0.989 PF vs 0.989 PF).
- The H200 SXM has 1.4× more memory bandwidth than the H100 SXM (3,350 vs 4,800 GB/s), which usually limits LLM token generation. Memory: 80 GB vs 141 GB.
- The H100 SXM is 21% cheaper per hour than the H200 SXM at the lowest on-demand prices ($1.66 vs $2.10).
- Per unit of compute, the H100 SXM is the better deal: $1.68 vs $2.12 per PFLOP-hour of dense FP16/BF16.
| Spec / price | H100 SXM | H200 SXM |
|---|---|---|
| Memory | 80 GB HBM3 | 141 GB HBM3ebetter |
| Memory bandwidth | 3,350 GB/s | 4,800 GB/sbetter |
| FP16 / BF16 (dense) | 0.989 PF | 0.989 PF |
| FP8 (dense) | 1.98 PF | 1.98 PF |
| FP4 (dense) | — | — |
| INT8 (dense) | 1.98 PF | 1.98 PF |
| TF32 (dense) | 0.495 PF | 0.495 PF |
| FP32 (dense) | 0.067 PF | 0.067 PF |
| FP64 (dense) | 0.067 PF | 0.067 PF |
| Power | 700 W | 700 W |
| Architecture | Hopper (2022) | Hopper (2024) |
| Lowest on-demand | $1.66better | $2.10 |
| Median on-demand | $3.19better | $3.99 |
| Lowest spot | $0.79 | $0.79 |
| FP16/BF16 $ per PFLOP·h | $1.68better | $2.12 |
| Providers | 28 | 22 |
H100 SXM vs H200 SXM: questions
Is the H100 SXM faster than the H200 SXM?
The H100 SXM and H200 SXM have the same dense FP16/BF16 compute. The H200 SXM has 1.4× more memory bandwidth than the H100 SXM. Real-world speedups depend on the workload: training and prefill scale with compute, while LLM decoding scales mostly with memory bandwidth.
Which is cheaper per FLOP, the H100 SXM or the H200 SXM?
Right now the H100 SXM is cheaper per unit of compute: $1.68 vs $2.12 per PFLOP-hour at the lowest on-demand prices.
How much does it cost to rent an H100 SXM vs an H200 SXM for a month?
Running one GPU around the clock at the lowest on-demand price costs about $1,212 per month for the H100 SXM and $1,533 for the H200 SXM.
Which has more memory, the H100 SXM or the H200 SXM?
The H200 SXM has more memory: 141 GB vs 80 GB.