AI Term of the Moment

gigawatt


Look Up Another Term


Definition: DPU


(Data Processing Unit) A set of high-speed programmable processors for AI data centers. The DPU system-on-chip (SoC) includes multiple ARM-based CPU cores, high-speed Ethernet (at least 25 Gbps) and a variety of programmable processors known as "acceleration engines." NVIDIA, AMD, Intel and others make DPUs.

DPU processors are not like the GPUs used for training and inference. They are specialized for networking, data transfer, storage and security. According to NVIDIA, a DPU must provide network acceleration, virtualization, software switching, memory-to-memory transfer, traffic shaping, timing, encryption and secure isolation. See NVIDIA.




BlueField DPUs
NVIDIA makes a variety of BlueField-branded DPUs. The "converged accelerator" (bottom) combines DPU and GPU on one card. (Images courtesy of NVIDIA.)