…
B200 SXM vs Instinct MI355X
Cloud rental price, compute per dollar and specs, side by side.
Open in the interactive comparer →
B200 SXM$3.74lowest on-demand per GPU·h
$1.66 per PFLOP·h · 15 providers
Instinct MI355X$2.59lowest on-demand per GPU·h
$1.03 per PFLOP·h · 4 providersWhat actually differs
- The Instinct MI355X has 1.1× more dense FP16/BF16 throughput than the B200 SXM (2.25 PF vs 2.52 PF).
- The Instinct MI355X has 1.0× more memory bandwidth than the B200 SXM (7,700 vs 8,000 GB/s), which usually limits LLM token generation. Memory: 180 GB vs 288 GB.
- The Instinct MI355X is 31% cheaper per hour than the B200 SXM at the lowest on-demand prices ($3.74 vs $2.59).
- Per unit of compute, the Instinct MI355X is the better deal: $1.03 vs $1.66 per PFLOP-hour of dense FP16/BF16.
| Spec / price | B200 SXM | Instinct MI355X |
|---|---|---|
| Memory | 180 GB HBM3e | 288 GB HBM3ebetter |
| Memory bandwidth | 7,700 GB/s | 8,000 GB/sbetter |
| FP16 / BF16 (dense) | 2.25 PF | 2.52 PFbetter |
| FP8 (dense) | 4.5 PF | 5.03 PFbetter |
| FP4 (dense) | 9 PF | 10.1 PFbetter |
| INT8 (dense) | 4.5 PF | 5.03 PFbetter |
| TF32 (dense) | 1.1 PF | — |
| FP32 (dense) | 0.075 PF | 0.157 PFbetter |
| FP64 (dense) | 0.037 PF | 0.0786 PFbetter |
| Power | 1000 W | 1400 W |
| Architecture | Blackwell (2024) | CDNA 4 (2025) |
| Lowest on-demand | $3.74 | $2.59better |
| Median on-demand | $6.80 | $2.85better |
| Lowest spot | $0.99better | $2.97 |
| FP16/BF16 $ per PFLOP·h | $1.66 | $1.03better |
| Providers | 15 | 4 |
B200 SXM vs Instinct MI355X: questions
Is the B200 SXM faster than the Instinct MI355X?
The Instinct MI355X has 1.1× more dense FP16/BF16 compute than the B200 SXM. The Instinct MI355X has 1.0× more memory bandwidth than the B200 SXM. Real-world speedups depend on the workload: training and prefill scale with compute, while LLM decoding scales mostly with memory bandwidth.
Which is cheaper per FLOP, the B200 SXM or the Instinct MI355X?
Right now the Instinct MI355X is cheaper per unit of compute: $1.03 vs $1.66 per PFLOP-hour at the lowest on-demand prices.
How much does it cost to rent an B200 SXM vs an Instinct MI355X for a month?
Running one GPU around the clock at the lowest on-demand price costs about $2,730 per month for the B200 SXM and $1,891 for the Instinct MI355X.
Which has more memory, the B200 SXM or the Instinct MI355X?
The Instinct MI355X has more memory: 288 GB vs 180 GB.