Rising component costs may adjust prices on selected items without prior notice. Supply constraints may add shipping time — we’ll notify you if affected. OEM costs and supply tightening — contact us to secure stock and pricing. For projects or bulk orders, choose “Request for Quotation” on any item.
Call our specialists(65) 6978 3502 Email our sales teamsales@sourceit.com.sg

AI & Workstations

No NVLink Bridge on RTX PRO 6000 Blackwell: Does That Make Multi-GPU AI Harder?

Only for some workloads. The NVIDIA RTX PRO 6000 Blackwell has no NVLink bridge. NVIDIA's specifications list none, Lenovo's spec sheets state that NVLink is not supported, and even SourceIT's NVLink Bridge listings note that the bridge is not for RTX PRO Blackwell or RTX Ada cards. Multiple cards talk to each other over PCIe 5.0 instead. That's about 63 GB/s in each direction per x16 slot in theory, and about 46 GB/s one way was measured between two RTX PRO 6000 cards. If each GPU runs its own job, or your model fits in one card's 96 GB, the missing bridge makes little difference. If you split one large model across several cards and they have to exchange data in every layer, PCIe becomes the limit. At that point an NVLink-connected platform is the better tool.

How fast are the links between GPUs?

Link Bandwidth Notes
NVLink bridge, RTX A6000 (Ampere, the last pro desktop card with one) "Up to 112 GB/s" per NVIDIA Two cards only
PCIe 5.0 x16 (theoretical) About 63 GB/s per direction Per slot, after encoding overhead
2x RTX PRO 6000, PCIe peer-to-peer (measured) 45.85 GB/s one way, 89.93 GB/s both ways Latency 0.53 µs with P2P, 12.68 µs without
2x RTX PRO 6000 Max-Q, NCCL all-reduce, P2P off (measured) 30.97 GB/s bus bandwidth at 64 MiB Threadripper PRO 9965WX, WRX90 board
NVLink-C2C (GB300 CPU to GPU) 450 GB/s per direction 900 GB/s total; one GPU per GB300
NVLink 5 (HGX B300, GB300 NVL72) 900 GB/s per direction per GPU 1.8 TB/s bidirectional per GPU

Source: NVIDIA NVLink bridges page and HGX / GB300 NVL72 pages (fetched 6 Nov 2026); Level1Techs forum measurements (p2pBandwidthLatencyTest, 17 Jul 2025; NCCL tests, 12 Dec 2025). PCIe figure is our calculation from the PCIe 5.0 signalling rate.

Why doesn't the RTX PRO 6000 have NVLink?

NVIDIA removed it from workstation cards a generation earlier. The RTX A6000 (2020) was the last professional desktop card with a bridge, and the RTX 6000 Ada datasheet states "NVLink: No". When the Ada generation launched in September 2022, TechPowerUp reported Jensen Huang explaining that NVIDIA wanted the chip area and I/O for other things, including more AI processing, and that peer-to-peer over PCIe Gen 5 was now "sufficiently fast that it was a better tradeoff". Blackwell RTX PRO cards continue that approach. NVLink now lives in NVIDIA's data-centre systems, where it links eight GPUs in HGX servers and 72 in a GB300 NVL72 rack.

How do RTX PRO 6000 cards talk to each other without it?

Through PCIe peer-to-peer (P2P), where one GPU reads or writes another's memory directly over the PCIe fabric without copying through system RAM. On RTX PRO 6000 cards, P2P works on bare-metal Linux according to user reports, with the latency gain shown above. It isn't always plug-and-play, though:

  • Firmware and kernel settings matter. Level1Techs users found NCCL hung with P2P enabled on a WRX90 board until IOMMU was disabled or set to passthrough with ACS turned off. Another user on TRX50 reported page faults and crashes.
  • Virtualisation can block it. An NVIDIA forum report (March 2026) says the card does not advertise PCIe ATS, which blocks ESXi's P2P path for passed-through GPUs.
  • There's no NVIDIA support statement for workstation P2P that we could find, so validate it on your own platform.
  • GeForce is different. An NVIDIA forum moderator wrote in March 2025 that P2P "is not supported" on GeForce RTX 50-series cards. Our RTX PRO 6000 vs RTX 5090 post covers that comparison.

NVIDIA's own multi-GPU PCIe design shows where this is heading. Its RTX PRO Server reference design routes GPU-to-GPU traffic through ConnectX-8 SuperNICs with built-in PCIe Gen6 switches, which NVIDIA says give "up to 2x higher NCCL all-to-all performance" (vendor claim).

Which workloads don't care about NVLink?

  • One model per GPU. Running separate copies of a model, or separate users, on each card scales well because the cards barely talk. Helix measured two four-GPU replicas at 2.03 times the throughput of one, and Exxact reported 96.1% scaling for two-GPU data-parallel LoRA fine-tuning.
  • Models that fit in 96 GB. A single RTX PRO 6000 holds gpt-oss-120b (about 65 GB) or Llama 3.3 70B at FP8 (about 71 GB) with no splitting at all. See who actually needs 96 GB.
  • GPU rendering. Renderers such as Redshift split frames or buckets between cards. Puget measured three Max-Q cards cutting a Redshift frame from about 60 to 24 seconds. Each card still needs the whole scene in its own memory, because Redshift does not combine VRAM.
  • Sharing one card. MIG splits a single card into up to four isolated instances, so no inter-GPU link is involved.

Where does PCIe start to hurt?

When one model is split across cards and they synchronise constantly. Tensor parallelism divides each layer across GPUs and combines the partial results with an all-reduce in every layer, so link bandwidth and latency land directly on response time. The evidence is mixed at two to four cards and clear at eight:

  • Two to four cards are workable. vLLM's documentation recommends pipeline parallelism when GPUs lack NVLink, but CloudRift and Helix both measured tensor parallelism doing better than pipeline parallelism on RTX PRO 6000 systems. Test both on your model.
  • Expert parallelism over PCIe can collapse. On four cards running Qwen3.5-397B, a vLLM forum user measured 50.5 tokens per second with four-way tensor parallelism but only 1.4 to 2.6 with expert parallelism, which they called "catastrophic on PCIe".
  • Moving KV cache between cards is costly. A disaggregated prefill/decode setup on two RTX PRO 6000 cards had a mean time to first token of 3,290 ms, against 125 ms for plain two-way tensor parallelism.
  • At eight GPUs, NVLink pulls well ahead. CloudRift ran GLM-4.6 at FP8 with eight-way tensor parallelism and found H100 systems "nearly 3x" and H200 "almost 4x" the throughput of eight PCIe-bound RTX PRO 6000 cards.
  • Some software requires NVLink outright. Epic's in-camera VFX hardware guide says that for nDisplay multi-GPU on one PC "every graphics card must support NVLink".
Without NVLink, the question isn't whether your GPUs can talk. It's how often your workload makes them.

How do you get the best from a PCIe multi-GPU build?

  • Give every card a full x16 Gen5 slot. Four cards need 64 lanes, which means a Threadripper PRO or Xeon workstation platform with 128 Gen5 lanes, not a desktop CPU.
  • Use the Max-Q for more than one card. NVIDIA states support for up to four per system. See Workstation vs Max-Q vs Server Edition.
  • Test P2P before production. Run NVIDIA's p2pBandwidthLatencyTest and nccl-tests after setting BIOS and kernel options for IOMMU and ACS.
  • Benchmark more than one inference engine. Helix saw a 7.8 times throughput difference between engines on the same eight RTX PRO 6000 cards.

Our four-card, 384 GB workstation post covers power and cooling for that build, and two RTX PRO 6000 cards vs one DGX Station compares the split approach with a single large GPU.

When should you move to an NVLink platform?

Consider it when your largest model, with its context, no longer fits comfortably in two to four 96 GB cards; when you need tensor parallelism across eight GPUs; or when latency-sensitive serving of large mixture-of-experts models is the main job. There are three routes:

  • DGX Station GB300: avoids splitting rather than speeding it up. One Blackwell Ultra GPU has 252 GB of HBM3e and reaches 496 GB of Grace memory over NVLink-C2C, 748 GB coherent in total.
  • HGX B300: eight GPUs on NVLink at 1.8 TB/s each, with 2.1 TB of HBM in one server.
  • GB300 NVL72: 72 GPUs in one NVLink domain at 130 TB/s aggregate.

Our explainers on PCIe 6.0 vs NVLink and why GB300 needs NVLink compare the links, and from RTX PRO 6000 to GB300 NVL72 maps the whole path.

Buying in Singapore

For multi-GPU workstations, SourceIT lists the RTX PRO 6000 Blackwell Max-Q (S$29,100, listed 6 Nov 2026) here and the Workstation Edition (S$29,100) here; prices change, so ask for a current quotation. If you still run RTX A6000 or A5000 pairs, the 2-slot NVLink Bridge (S$331.20) is listed for those cards only. For an NVLink-class step up, GB300 workstations such as the HP ZGX Fury G1n and Dell Pro Max with GB300 are price on request in our NVIDIA DGX collection. HGX and NVL72 systems aren't listed; ask us to source them. Use Request for Quotation on the product page, call (65) 6978 3502, email Sales@sourceit.com.sg or use our contact page.

Frequently asked questions

Does the RTX PRO 6000 Blackwell support NVLink? No. NVIDIA's specifications list no NVLink for it, and Lenovo's spec sheets state it is not supported. The RTX A6000 was the last professional desktop card with an NVLink bridge.

Can two RTX PRO 6000 cards share one 192 GB memory pool? No. Each card keeps its own 96 GB. Software such as vLLM splits a model across the cards and exchanges data over PCIe, which is slower than either card's own memory.

Does PCIe peer-to-peer work on RTX PRO 6000? User reports show it working on bare-metal Linux, about 46 GB/s one way between two cards, often after IOMMU and ACS changes. A forum report says it is blocked under ESXi passthrough. We found no NVIDIA support statement for workstations.

Is tensor parallelism or pipeline parallelism better without NVLink? It depends on the model and engine. vLLM's documentation suggests pipeline parallelism without NVLink, but published RTX PRO 6000 tests found tensor parallelism faster at two to four cards. Test both.

When does NVLink become worth paying for? When one model must be split across many GPUs and they synchronise every layer, especially at eight GPUs. One published test found NVLink-connected H100 and H200 systems 3 to 4 times faster than eight PCIe RTX PRO 6000 cards on the same model.

SourceIT Approved

SourceIT Approved

Researched and verified by the SourceIT team for Singapore buyers.

Share This Article
Facebook

More from our blog


← Older Post Newer Post →