How do the new ASUS servers address the growing demand for AI training?

Question

Accepted Answer

ASUS Servers Address AI Training Demand with Enhanced Hardware and Design

The new ASUS ESC I8-E11 server is engineered to meet the escalating demand for artificial intelligence training and inference. This server directly supports eight Intel Gaudi® 3 AI OCP Accelerator Module (OAM) mezzanine cards, which are central to its AI processing capabilities. Furthermore, it integrates 24 industry-standard RoCE 200GbE RDMA NICs for each Intel Gaudi 3 accelerator, facilitating high-speed data transfer essential for complex AI workloads.
Optimized for AI Acceleration Hardware

The ESC I8-E11 server is specifically designed to house and leverage the power of Intel Gaudi 3 AI accelerators. By accommodating eight of these OAM mezzanine cards, the server provides a substantial platform for intensive AI computations. The integration of 24 RoCE 200GbE RDMA NICs per accelerator ensures that the massive datasets required for AI model training can be moved efficiently between accelerators, minimizing bottlenecks and maximizing computational throughput.
Advanced Processing and Connectivity

Powered by 5th Gen Intel Xeon processors, the ESC I8-E11 server provides a robust foundation for managing AI workloads. The server's architecture is built to support the high bandwidth and low latency requirements of modern AI training. The inclusion of high-speed RDMA NICs is crucial for distributed training scenarios, where multiple accelerators need to communicate rapidly and effectively.
Efficient and Modular Design

Beyond raw processing power, the ASUS ESC I8-E11 server incorporates a modular design aimed at improving operational efficiency. This approach reduces cable complexity, which in turn shortens assembly times and enhances thermal optimization. Efficient cooling is paramount for sustained high-performance computing tasks like AI training, and the server's design addresses this through improved airflow and heat dissipation.
Power Efficiency for Sustainable Operations

The server features redundant 3000W 80 PLUS® PSUs, ensuring a reliable and sustainable power supply. This high power efficiency is a critical consideration for data centers running demanding AI workloads continuously, contributing to both operational cost savings and environmental responsibility. The combination of powerful hardware and efficient power management allows the ESC I8-E11 to deliver exceptional performance for deep-learning tasks.

Reading history

Hide →

This history is cleared when the page is closed.

How do the new ASUS servers address the growing demand for AI training?

Loading

Was this article helpful?

Helpful

Not helpful

Report an issue

1

0

0

Share with friends