Which link connects GPUs directly at very high bandwidth inside a server?
Why A is the answer
NVIDIA NVLink
NVLink is NVIDIA's high-bandwidth GPU interconnect.
In detail
- NVLink joins GPUs directly at high bandwidth inside a server.
- NVLink works inside a system. Networks join servers.
Use case
An illustrative scenario, not a real incident.
Four GPUs in one server exchange gradients constantly. NVLink carries that traffic far faster than a general-purpose bus.
See it in different ways
flowchart TD A["GPUs in one server"] -->|"NVLink and NVSwitch"| B["Scale up"] B --> C["Server"] C -->|"InfiniBand or Ethernet"| D["Scale out to a cluster"]
mindmap
root((AI cluster))
Compute
GPU nodes
NVLink
Fabric
InfiniBand
Ethernet
Storage
High throughput
Management
Out-of-band networkmindmap
root(("GPU traffic"))
n1["Inside a server"]
n2["NVLink"]
n3["Between servers"]
n4["InfiniBand"]
n5["Ethernet with RoCE"]Key point: NVLink joins GPUs directly.
Why the other options are wrong
- B. NVIDIA BlueField
- BlueField is a DPU.
- C. InfiniBand HDR
- InfiniBand connects servers.
- D. Spectrum Ethernet
- Ethernet connects servers.