About the product
NVIDIA® H100 NVL supercharges large language model inference in mainstream PCIe-based server systems. With increased raw performance, bigger, faster HBM3 memory, and NVIDIA NVLink™ connectivity via bridges, mainstream systems with H100 NVL outperform NVIDIA A100 Tensor Core systems by up to 5X on Llama 2 70B. H100 NVL also includes NVIDIA Enterprise software.
- FP64 -30 teraFLOPS
- FP64 Tensor Core - 60 teraFLOPS
- FP32 - 60 teraFLOPS
- TF32 Tensor Core - 835 teraFLOPS
- BFLOAT16 Tensor Core - 1,671 teraFLOPS
- FP16 Tensor Core - 1,671 teraFLOPS
- FP8 Tensor Core - 3,341 teraFLOPS
- INT8 Tensor Core - 3,341 teraFLOPS
- GPU Memory - 94GB
- GPU Memory Bandwidth - 3.9TB/s
- Decoders 7 NVDEC / 7 JPEG
- Max Thermal Design Power (TDP)- 350-400W (configurable)
- Form Factor - PCIe dual-slot air-cooled
- Interconnect - NVIDIA NVLINK: 600GB/s
- PCIe Gen5 - 128GB/s
- Server Options Partner and NVIDIA
- NVIDIA Enterprise Included
Technical Specifications
| Interfaces/Ports | |
| Host Interface | PCI Express |
| Memory | |
| Standard Memory | 94 GB |
| Memory Technology | HBM3 |
| Miscellaneous | |
| Package Contents |
|
| Platform Supported | PC |
| Processor & Chipset | |
| Chipset Manufacturer | NVIDIA |
| Chipset Model | H100 NVL |
| Technical Information | |
| Multi-GPU Technology | NVLink |
| AI-powered | Yes |
| Physical Characteristics | |
| Form Factor | Plug-in Card |
| Cooler Type | Fan Cooler |
| Slot Space Required | Dual |
| General Information | |
| Product Type | Graphic Card |
| Manufacturer Part Number | NVH100NVLTCGPUKIT |
| Manufacturer Website Address | http://www.pny.com |
| Manufacturer | PNY Technologies |
| Product Name | NVIDIA H100 NVL Graphic Card |
| Brand Name | PNY |
Product compare
Product warranty
Standard manufacturer warranty as applicable
Return policy
15 days return in original condition.
Price guarantee
!00% we are always lower than market price.
Explore branded collections
Our services
-
See moreDesign and build workplace, conference rooms & boardroom
-
See moreManaged IT service, help desks, servers, & networking
-
See moreNext generation devices assess, procure, customization
-
See moreBusiness continuity, security, backup & disaster recovery
-
See moreCloud structure, migration, optimization and security
-
See moreDigitization, data retention, automation, Dev apps
