Also known as: TensorFloat-32
NVIDIA's 19-bit format that runs FP32 matrix math on tensor cores. PyTorch can use it for FP32 matmuls on Ampere and newer.
Ranked by $ per PFLOP-hour of dense TF32 at each GPU's lowest on-demand price.