…
A100 SXM 80GB vs A100 PCIe 80GB
Cloud rental price, compute per dollar and specs, side by side.
Open in the interactive comparer →
A100 SXM 80GB$0.81lowest on-demand per GPU·h
$2.60 per PFLOP·h · 17 providersA100 PCIe 80GB$1.13lowest on-demand per GPU·h
$3.62 per PFLOP·h · 8 providersWhat actually differs
- The A100 SXM 80GB and A100 PCIe 80GB have the same dense FP16/BF16 throughput (0.312 PF vs 0.312 PF).
- The A100 SXM 80GB has 1.1× more memory bandwidth than the A100 PCIe 80GB (2,039 vs 1,935 GB/s), which usually limits LLM token generation. Memory: 80 GB vs 80 GB.
- The A100 SXM 80GB is 28% cheaper per hour than the A100 PCIe 80GB at the lowest on-demand prices ($0.81 vs $1.13).
- Per unit of compute, the A100 SXM 80GB is the better deal: $2.60 vs $3.62 per PFLOP-hour of dense FP16/BF16.
| Spec / price | A100 SXM 80GB | A100 PCIe 80GB |
|---|---|---|
| Memory | 80 GB HBM2e | 80 GB HBM2e |
| Memory bandwidth | 2,039 GB/sbetter | 1,935 GB/s |
| FP16 / BF16 (dense) | 0.312 PF | 0.312 PF |
| FP8 (dense) | — | — |
| FP4 (dense) | — | — |
| INT8 (dense) | 0.624 PF | 0.624 PF |
| TF32 (dense) | 0.156 PF | 0.156 PF |
| FP32 (dense) | 0.0195 PF | 0.0195 PF |
| FP64 (dense) | 0.0195 PF | 0.0195 PF |
| Power | 400 W | 300 W |
| Architecture | Ampere (2020) | Ampere (2021) |
| Lowest on-demand | $0.81better | $1.13 |
| Median on-demand | $2.35 | $1.51better |
| Lowest spot | $0.90 | $0.21better |
| FP16/BF16 $ per PFLOP·h | $2.60better | $3.62 |
| Providers | 17 | 8 |
A100 SXM 80GB vs A100 PCIe 80GB: questions
Is the A100 SXM 80GB faster than the A100 PCIe 80GB?
The A100 SXM 80GB and A100 PCIe 80GB have the same dense FP16/BF16 compute. The A100 SXM 80GB has 1.1× more memory bandwidth than the A100 PCIe 80GB. Real-world speedups depend on the workload: training and prefill scale with compute, while LLM decoding scales mostly with memory bandwidth.
Which is cheaper per FLOP, the A100 SXM 80GB or the A100 PCIe 80GB?
Right now the A100 SXM 80GB is cheaper per unit of compute: $2.60 vs $3.62 per PFLOP-hour at the lowest on-demand prices.
How much does it cost to rent an A100 SXM 80GB vs an A100 PCIe 80GB for a month?
Running one GPU around the clock at the lowest on-demand price costs about $591 per month for the A100 SXM 80GB and $824 for the A100 PCIe 80GB.
Which has more memory, the A100 SXM 80GB or the A100 PCIe 80GB?
Both have 80 GB of VRAM; the A100 SXM 80GB has more bandwidth.