Dell PowerEdge R760 AI Server | Intel Xeon Platinum 8592+ 64-Core | NVIDIA H100 80GB PCIe | 128GB DDR5
  • 产品分类:服务器
  • 零件编号:Dell PowerEdge R760 AI Server
  • 库存情况:In Stock
  • 状况:全新
  • 产品特色:准备发货
  • 最小订单:1单位
  • 原价:$67,899.00
  • 您的价格: $52,089.00 您节省了 $15,810.00
  • 立即咨询 发送邮件

安心无忧。接受退货。

运送:国际运输的商品可能会受到海关处理和额外费用的影响。 查看详情

配送:如果国际配送需要海关处理,请允许额外的时间。 查看详情

退货:14天内退货。卖家承担退货运费。 查看详情

免费送货。我们接受30天账期的采购订单。无需影响您的信用即可在几秒钟内获得决策。

如果您需要大量Dell PowerEdge R760 AI Server产品,请通过我们的免费电话Whatsapp: (+86) 151-0113-5020联系我们,或在在线聊天中请求报价,我们的销售经理会很快与您联系。

Dell PowerEdge R760 AI Server | Intel Xeon Platinum 8592+ 64-Core | NVIDIA H100 80GB PCIe | 128GB DDR5

Keywords

Dell PowerEdge R760, NVIDIA H100 PCIe, Intel Xeon Platinum 8592+, AI Inference Server, NVMe RAID Storage, High Performance Computing, Enterprise AI Hardware, Buy Dell R760

Description

Accelerate your artificial intelligence and machine learning initiatives with the Dell PowerEdge R760, a high-performance 2U rack server optimized for the most demanding workloads. This configuration is anchored by the 5th Generation Intel Xeon Platinum 8592+ processor. With a staggering 64 cores and 128 threads per socket, this CPU provides the immense serial processing power required to feed data pipelines efficiently. It serves as the perfect host for the star of this build: the NVIDIA H100 PCIe 80GB GPU. Unlike the SXM version, the PCIe form factor offers flexibility and ease of integration while still delivering ground-breaking performance for AI inference and fine-tuning tasks.

Memory bandwidth is critical in keeping the H100 GPU fed with data, and this system utilizes 128GB of next-generation DDR5 memory (4x 32GB). This setup ensures low latency and high throughput, essential for High Performance Computing applications. The storage subsystem is equally robust, featuring two 1.92TB NVMe SSDs configured in RAID 1. This NVMe RAID Storage architecture provides a perfect blend of performance and redundancy, offering nearly 2TB of usable, protected space for your operating system, models, and datasets, ensuring that a single drive failure does not interrupt your critical AI workflows.

Connectivity is handled by a dual-port 10Gb/s LAN interface, providing sufficient bandwidth for data ingestion and management traffic. The R760 chassis is specifically designed with "Smart Flow" cooling technology to manage the thermal output of high-wattage components like the H100 and the 350W+ Platinum processor, ensuring sustained performance without throttling. This Enterprise AI Hardware is built to run 24/7 in data center environments, supported by Dell’s legendary reliability and management tools.

Whether you are deploying Large Language Models (LLMs) for inference, running complex simulations, or managing heavy virtualization stacks, this server offers a scalable foundation. When you Buy Dell R760 configured with the H100, you are securing a future-proof asset capable of handling the rapid advancements in generative AI technology.

Key Features

  • Top-Tier Acceleration: 1x NVIDIA H100 80GB PCIe GPU for dominant AI inference and acceleration.
  • Extreme CPU Core Count: Intel Xeon Platinum 8592+ (64 Cores / 128 Threads, 5th Gen) for massive parallel processing.
  • DDR5 Memory Architecture: 128GB (4x 32GB) DDR5 RAM ensures rapid data access for the CPU and GPU.
  • Resilient Storage: 2x 1.92TB NVMe SSDs in RAID 1 offer speed and data mirroring protection.
  • High-Speed Networking: 2x 10Gb/s LAN ports for fast network integration.
  • Optimized Cooling: Designed with high-performance fans to support high-TDP PCIe GPUs.
  • Expansion Ready: 2U form factor with available PCIe slots for future upgrades.

Configuration

Component Specification
Model Dell PowerEdge R760
GPU Accelerator 1x NVIDIA H100 80GB PCIe Gen5
Processor (CPU) 1x Intel Xeon Platinum 8592+ (64 Cores, 1.9GHz Base, 350W, 5th Gen)
Memory (RAM) 128GB Total (4x 32GB DDR5 ECC RDIMM)
Storage 2x 1.92TB Enterprise NVMe SSD (Configured in RAID 1)
Networking Dual Port 10GbE Network Adapter (Base-T or SFP+)
Form Factor 2U Rackmount

Compatibility

The Dell PowerEdge R760 is a 16th Generation server built on the Intel chipset, supporting 4th and 5th Gen Intel Xeon Scalable processors. It is fully certified for NVIDIA AI Enterprise, ensuring seamless driver and software support for the H100 GPU. Compatible operating systems include Ubuntu Server 22.04 LTS, Red Hat Enterprise Linux 9, and Windows Server 2022. The system supports PCIe Gen5, allowing the H100 to operate at full bandwidth. Note: This chassis is not compatible with AMD EPYC processors (requires model R7625).

Usage Scenarios

This configuration is an ideal AI Inference Node. The NVIDIA H100 PCIe card is powerful enough to serve requests for massive models like Llama 3 or Mixtral in real-time. The 64-core Intel CPU handles the pre-processing of user requests and API management, while the NVMe storage ensures model weights are loaded into VRAM instantly.

It is also well-suited for Scientific Simulation and Research. Applications in physics, chemistry, and genomics that utilize CUDA acceleration will benefit from the double-precision performance of the H100, while the 128GB of system RAM keeps the simulation environment stable.

For Virtual Desktop Infrastructure (VDI) with high-end graphics requirements, this server can support multiple "Power User" profiles. By using NVIDIA vGPU software, the H100 resource can be sliced and shared among data scientists or engineers who need GPU acceleration for their virtual workstations.

Frequently Asked Questions

Q: Can I use an AMD EPYC processor in the R760?
A: No, the "R760" model number specifically designates an Intel-based system. If you require the AMD EPYC 9004 processor mentioned in your options, you would need the **Dell PowerEdge R7625** chassis. The rest of the components (H100, RAM, NVMe) remain compatible with both chassis types.

Q: What is the difference between H100 PCIe and H100 SXM?
A: The PCIe version installed in this server uses a standard expansion slot, making it easier to install, cool, and deploy in standard servers. The SXM version requires a specialized motherboard (like in the Dell XE9680) and offers higher NVLink bandwidth between multiple GPUs, but the PCIe version is sufficient for single-GPU or dual-GPU inference workloads.

Q: Is 128GB of RAM enough for the H100?
A: For many inference tasks, yes. However, if you are doing heavy training or handling extremely large datasets that must reside in system memory before moving to the GPU, you might consider upgrading to 256GB or 512GB. The R760 supports significantly more RAM if needed.

Q: Does this server require special power cables?
A: Yes, with a 350W CPU and a 350W-400W GPU, this server will likely require high-wattage power supplies (1100W or 1400W) and C19/C20 heavy-duty power cables rather than standard C13/C14 cables. Please verify your rack's power distribution unit (PDU) capability.

与此商品相关的产品
浪潮 NF5280M6 AI-Ready 双至强服务器,配备 Tesla L2 GPU,适用于企业工作负载 推荐
浪潮 NF5466M6 双 Intel Xeon 4314 企业存储和计算服务器 推荐
Dell PowerEdge R760xs - 双至强银牌 4410Y 企业配置 推荐
Dell PowerEdge R760xs - 至强金牌 6507P 高性能服务器 推荐
Dell PowerEdge R660 1U 机架服务器 - 双 Xeon Gold 6430、1TB RAM、25GbE 和光纤通道 HBA 推荐
HPE ProLiant DL380 Gen11 2U 机架服务器 |双英特尔至强金牌 6542Y 48 核 | 1TB DDR5 内存 | 2 个 300GB SAS 硬盘 推荐
浪潮 NF8480M5 4U 企业存储服务器 — 24× LFF SAS、四核 Xeon Gold 6248R 高密度平台 推荐
Lenovo ThinkSystem SR850 V3 高性能 4-CPU 服务器,配备 Xeon Gold 6448H 和企业网络 推荐