Dense vs. sparse FLOPS

Also known as: 2:4 sparsity, structured sparsity

Vendors often quote tensor throughput with 2:4 structured sparsity, which doubles the headline number. Almost no training or inference uses it, so PetaPrice always shows dense figures.

Best value right now

Ranked by $ per PFLOP-hour of dense FP16 / BF16 at each GPU's lowest on-demand price.

Compare every GPU →

Related terms

FLOPS, TFLOPS, PFLOPSFloating-point operations per second: how much arithmetic a chip can do. 1 TFLOPS is a trillion per second, 1 PFLOPS (PetaFLOPS) is a thousand TFLOPS. PetaPrice shows all compute in PFLOPS.
$ per PFLOP-hourThe price of one GPU-hour divided by the GPU's dense peak PFLOPS at a chosen precision. It shows how much compute a dollar buys, so fast expensive GPUs and slow cheap ones can be compared directly. Lower is better.
Tensor cores / matrix coresUnits that multiply small matrices in one step, where nearly all of a GPU's AI throughput comes from. NVIDIA calls them tensor cores, AMD matrix cores.

Compute

← All terms

…