(
Tensor
Float
32) A proprietary Tensor floating point format supported in NVIDIA GPUs that was introduced with the Ampere architecture in 2020. Optimized for deep learning, TF32 is a variation of FP32 (32-bit floating point). It uses the same 8-bit exponent but only a 10-bit mantissa compared to 23 bits. See
tensor and
deep learning.