AI Data Center Networking

AI demand is driving hyperscalers, cloud providers, enterprises, governments, and educational institutions to incorporate AI into their business systems to automate operations, generate content and communications, and improve customer service.

AI models are built using carefully crafted data sets during the training stage. Training happens across multiple GPUs spanning tens, hundreds and even thousands of GPUs in a cluster - all connected across a network and constantly exchanging data with each other. After this training stage, the model is essentially complete. During the inference stage, users interact with the model, which can recognize images or generate pictures and text to provide answers to user questions. Training is typically an offline operation, whereas inference is generally online.

Massive AI data sets are creating the need for greater compute power, faster storage, and high-capacity, low-latency networking. Juniper helps meet these requirements in the following ways: 

• Compute: AI/ML compute clusters place heavy requirements on the inter-node network. Lowering job completion time (JCT) is essential, and the network plays a key part in the efficient operation of the cluster. Juniper offers a range of high-performance, non-blocking switches with deep buffer capability and congestion management that, when architected optimally, eliminate any network bottleneck.
• Storage: In AI/ML clusters and high-performance computing, rarely can an entire data set or model be stored on the compute nodes, so a high-performance storage network is required. Juniper QFX Series Switches can be used for IP storage connectivity; they offer full support for Remote Direct Memory Access (RDMA) networking, including Non-Volatile Memory Express/RDMA over Converged Ethernet (NVMe/RoCE) and Network File System (NFS)/RDMA.
• Network: AI training models involve large, intense computations distributed over hundreds or thousands of CPU, GPU, and TPU processors. These computations demand high-capacity, horizontally scalable, and error-free networks. Juniper QFX switches and PTX Series Routers support these large computations within and across data centers with industry-leading switching and routing throughput and data center interconnect (DCI) capabilities.

Juniper high-performance, non-blocking data center switches provide deep buffering and congestion management to eliminate network bottlenecks. To balance traffic loads, we support dynamic load balancing and adaptive routing. For congestion management, Juniper fully supports Data Center Quantized Congestion Notification (DCQCN), Priority Flow Control (PFC), and Explicit Congestion Notification (ECN). Finally, to reduce latency, Juniper uses best-of-breed merchant silicon and custom ASIC architectures that maximize buffers where needed, virtual output queuing (VOQ), and cell-based fabrics within our spine architectures.

Our portfolio includes open, standards-based switches that provide IP-based storage connectivity using NVMe/RoCE or NFS/RDMA (see earlier FAQ). Our IP Storage Networking solution designs can scale from a small four-node configuration to hundreds or thousands of storage nodes.