…
Also known as: GPU memory
The GPU's own memory. The model weights, activations and KV cache must fit in it (or be split across GPUs), so VRAM often decides which GPU you can use at all.
Ranked by $ per GB of VRAM per hour at each GPU's lowest on-demand price.