…
H100 SXM vs B200 SXM
Cloud rental price, compute per dollar and specs, side by side.
Open in the interactive comparer →
H100 SXM$1.82lowest on-demand per GPU·h
$1.83 per PFLOP·h · 30 providersB200 SXM$5.43lowest on-demand per GPU·h
$2.41 per PFLOP·h · 17 providersWhat actually differs
- The B200 SXM has 2.3× more dense FP16/BF16 throughput than the H100 SXM (0.989 PF vs 2.25 PF).
- The B200 SXM has 2.3× more memory bandwidth than the H100 SXM (3,350 vs 7,700 GB/s), which usually limits LLM token generation. Memory: 80 GB vs 180 GB.
- Only the B200 SXM supports FP4.
- The H100 SXM is 67% cheaper per hour than the B200 SXM at the lowest on-demand prices ($1.82 vs $5.43).
- Per unit of compute, the H100 SXM is the better deal: $1.83 vs $2.41 per PFLOP-hour of dense FP16/BF16.
| Spec / price | H100 SXM | B200 SXM |
|---|---|---|
| Memory | 80 GB HBM3 | 180 GB HBM3ebetter |
| Memory bandwidth | 3,350 GB/s | 7,700 GB/sbetter |
| FP16 / BF16 (dense) | 0.989 PF | 2.25 PFbetter |
| FP8 (dense) | 1.98 PF | 4.5 PFbetter |
| FP4 (dense) | — | 9 PF |
| INT8 (dense) | 1.98 PF | 4.5 PFbetter |
| TF32 (dense) | 0.495 PF | 1.1 PFbetter |
| FP32 (dense) | 0.067 PF | 0.075 PFbetter |
| FP64 (dense) | 0.067 PFbetter | 0.037 PF |
| Power | 700 W | 1000 W |
| Architecture | Hopper (2022) | Blackwell (2024) |
| Lowest on-demand | $1.82better | $5.43 |
| Median on-demand | $3.51better | $8.19 |
| Lowest spot | $1.46better | $2.01 |
| FP16/BF16 $ per PFLOP·h | $1.83better | $2.41 |
| Providers | 30 | 17 |
H100 SXM vs B200 SXM: questions
Is the H100 SXM faster than the B200 SXM?
The B200 SXM has 2.3× more dense FP16/BF16 compute than the H100 SXM. The B200 SXM has 2.3× more memory bandwidth than the H100 SXM. Real-world speedups depend on the workload: training and prefill scale with compute, while LLM decoding scales mostly with memory bandwidth.
Which is cheaper per FLOP, the H100 SXM or the B200 SXM?
Right now the H100 SXM is cheaper per unit of compute: $1.83 vs $2.41 per PFLOP-hour at the lowest on-demand prices.
How much does it cost to rent an H100 SXM vs an B200 SXM for a month?
Running one GPU around the clock at the lowest on-demand price costs about $1,325 per month for the H100 SXM and $3,966 for the B200 SXM.
Which has more memory, the H100 SXM or the B200 SXM?
The B200 SXM has more memory: 180 GB vs 80 GB.