Nvidia
NVIDIA L40S 48GB
Hooper
Unparalleled AI and graphics performance for the data center
Generative AI is fueling transformative change, unlocking a new frontier of opportunities for enterprises across every industry. To transform with AI, enterprises need more compute resources, greater scale, and a broad set of capabilities to meet the demands of an ever-increasing set of diverse and complex workloads.
The NVIDIA L40S GPU is the most powerful universal GPU for the data center, delivering end-to-end acceleration for the next generation of AI-enabled applications—from gen AI, LLM inference, small-model training and fine-tuning to3D graphics, rendering, and video applications.
Specifications
L40S 48GB | |
GPU memory | 48GB GDDR6 |
Memory interface | PCIe Gen4 x16: 64GB/s bidirectional |
Memory bandwidth | 864 GB/s |
NVIDIA Ada Lovelace architecture-based CUDA Cores | 18,176 |
NVIDIA fourth-generation Tensor Cores | 568 |
NVIDIA third-generation RT Cores | 142 |
PF32 TFLOPS | 91.6 TFLOPS |
TF32 Tensor Core TFLOPS | 366 TFLOPS |
FP16 | 733 TFLOPS |
FP8 | 1,466 TFLOPS |
RT Core Performance | 212 TFLOPS |
Display connectors | 4x DisplayPort 1.4a |
Max Power Consumption | 350 W |
Power connector | 16-pin |
Virtual GPU (vGPU) Software Support | YES |
MIG | NO |
Secure Boot With Root of Trust | YES |
NEBS Ready | Level 3 |
NVIDIA NVLink | NO |