…
Cloud rental price, compute per dollar and specs, side by side.
Open in the interactive comparer →| Spec / price | RTX A6000 | RTX 6000 Ada |
|---|---|---|
| Memory | 48 GB GDDR6 | 48 GB GDDR6 |
| Memory bandwidth | 768 GB/s | 960 GB/sbetter |
| FP16 / BF16 (dense) | 0.155 PF | 0.364 PFbetter |
| FP8 (dense) | — | 0.729 PF |
| FP4 (dense) | — | — |
| INT8 (dense) | 0.31 PF | 0.729 PFbetter |
| TF32 (dense) | 0.0774 PF | 0.182 PFbetter |
| FP32 (dense) | 0.0387 PF | 0.0911 PFbetter |
| FP64 (dense) | 0.0006 PF | 0.0014 PFbetter |
| Power | 300 W | 300 W |
| Architecture | Ampere (2020) | Ada Lovelace (2022) |
| Lowest on-demand | $0.33better | $0.60 |
| Median on-demand | $0.56better | $0.86 |
| Lowest spot | $0.32better | $0.58 |
| FP16/BF16 $ per PFLOP·h | $2.13 | $1.65better |
| Providers | 11 | 6 |
The RTX 6000 Ada has 2.4× more dense FP16/BF16 compute than the RTX A6000. The RTX 6000 Ada has 1.3× more memory bandwidth than the RTX A6000. Real-world speedups depend on the workload: training and prefill scale with compute, while LLM decoding scales mostly with memory bandwidth.
Right now the RTX 6000 Ada is cheaper per unit of compute: $1.65 vs $2.13 per PFLOP-hour at the lowest on-demand prices.
Running one GPU around the clock at the lowest on-demand price costs about $241 per month for the RTX A6000 and $438 for the RTX 6000 Ada.
Both have 48 GB of VRAM; the RTX 6000 Ada has more bandwidth.