The NVIDIA-Certified Professional AI Networking (NCP-AIN)

AI workloads, particularly in large-scale training scenarios, are characterized by a small number of high-bandwidth, long-lived flows known as "elephant flows." These flows can dominate network traffic and are prone to causing congestion if not managed effectively.​

Traditional flow-based load balancing mechanisms, such as Equal-Cost Multipath (ECMP), distribute traffic based on flow hashes. However, in AI workloads with low entropy (i.e., limited variability in flow characteristics), ECMP can lead to uneven traffic distribution and congestion on certain paths.​

Adaptive routing techniques, which dynamically adjust paths based on real-time network conditions, are more effective in managing AI traffic patterns and mitigating congestion risks.​

Configuring NVUE to ignore certain underlying Linux files allows administrators to manage specific settings manually or through automation tools like Ansible without NVUE overwriting these configurations. This approach enables the persistent manipulation of settings using both NVUE and flat-file methods, providing flexibility in network management.

Accessing the BlueField DPU Operating System (OS) is possible through rshim , either over PCIe or USB, and via SSH through the OOB interface when in DPU mode.

From the NVIDIA BlueField Software Documentation :

"You can access the BlueField OS through the rshim interface. The rshim module enables host-to-DPU communication either via PCIe (default) or USB."

B. rshim over PCIe : Default when BlueField is installed in a host.

D. rshim over USB : Useful for provisioning or systems without PCIe drivers.

Incorrect Options:

A (NIC mode) : BlueField acts as a transparent NIC; OS access is not available to the host.

C (Redfish) : Redfish is for out-of-band management, not direct OS-level access.

The Local Route Header (LRH) in InfiniBand is termed "local" because it is used exclusively for routing packets within a single subnet. The LRH contains the destination and source Local Identifiers (LIDs), which are unique within a subnet, facilitating efficient routing without the need for global addressing. This design optimizes performance and simplifies routing within localized network segments.​

InfiniBand is a high-performance, low-latency interconnect technology widely used in AI and HPC data centers, supported by NVIDIA’s Quantum InfiniBand switches and adapters. The Local Routing Header (LRH) is a critical component of the InfiniBand packet structure, used to facilitate routing within an InfiniBand fabric. The question asks why the LRH is called a “local header,” which relates to its role in the InfiniBand network architecture.

According to NVIDIA’s official InfiniBand documentation, the LRH is termed “‘local’ because it contains the addressing information necessary for routing packets between nodes within the same InfiniBand subnet.” The LRH includes fields such as the Source Local Identifier (SLID) and Destination Local Identifier (DLID), which are assigned by the subnet manager to identify the source and destination endpoints within the local subnet. These identifiers enable switches to forward packets efficiently within the subnet without requiring global routing information, distinguishing the LRH from the Global Routing Header (GRH), which is used for inter-subnet routing.

Exact Extract from NVIDIA Documentation:

“The Local Routing Header (LRH) is used for routing InfiniBand packets within a single subnet. It contains the Source LID (SLID) and Destination LID (DLID), which are assigned by the subnet manager to identify the source and destination nodes in the local subnet. The LRH is called a ‘local header’ because it facilitates intra-subnet routing, enabling switches to forward packets based on LID-based forwarding tables.”

— NVIDIA InfiniBand Architecture Guide

This extract confirms that option A is the correct answer, as the LRH’s primary function is to route traffic between nodes within the local subnet, leveraging LID-based addressing. The term “local” reflects its scope, which is limited to a single InfiniBand subnet managed by a subnet manager.

RoCE Adaptive Routing is a key feature of NVIDIA Spectrum-X that ensures high performance and resiliency in the network, even in the event of a link failure. This technology dynamically reroutes traffic to the least congested and operational paths, effectively mitigating the impact of link failures. By continuously evaluating the network's egress queue loads and receiving status notifications from neighboring switches, Spectrum-X can adaptively select optimal paths for data transmission. This ensures that the network maintains high throughput and low latency, crucial for AI workloads, even when certain links are down.​

Reference Extracts from NVIDIA Documentation:

"Spectrum-X employs global adaptive routing to quickly reroute traffic during link failures, minimizing disruptions and preserving optimal storage fabric utilization."​

"RoCE Adaptive Routing avoids congestion by dynamically routing large AI flows away from congestion points. This approach improves network resource utilization, leaf/spine efficiency, and performance."​

The Network Traffic Map in NVIDIA's Unified Fabric Manager (UFM) provides a visual representation of the network topology and traffic flows, which is particularly useful for identifying congestion points, verifying network configurations, and optimizing workload distribution.

However, when troubleshooting a single node's hardware failure, the Network Traffic Map is less effective, as it focuses on network-level issues rather than individual hardware components.​

To identify the active Subnet Manager (SM) node in an InfiniBand fabric, the correct command sequence is:

sminfo

Displays general information about the active SM in the fabric, including its LID .

smpquery ND <</b> LID >

Resolves the Node Description (ND) at the given LID, revealing the exact hostname or label of the SM server.

From the InfiniBand Tools Guide:

"The sminfo utility provides the LID of the master SM. Use smpquery ND <</b> LID > to resolve the node name hosting the SM."

This two-step approach is standard for locating and validating the SM identity in fabric diagnostics.

Incorrect Options:

B (Nl) is an invalid query type.

C and D do not identify SMs.