The boring way to run Deepseek V4 Flash-0731 130-150 tks - 16x5060ti 16GB over 2 PLX88096 switches

• UEFI boot enabled; CSM disabled.
• Secure Boot disabled. The locally built EFI application and patched NVIDIA modules are unsigned.
• Above 4G Decoding enabled.
• MMIO High Granularity set to 1024G.
• MMIO High Base set around 56T.
• SR-IOV disabled on this machine.
• intel_iommu=off pci=realloc=on,hpmmioprefsize=512G in GRUB;
• NVreg_EnableResizableBar=1 for the NVIDIA module;
• Sets size code 14 → 16 GiB BAR1 on each of the 16 GPUs
• Temporarily disables PCI memory decoding and clears the old BAR1 address so Linux can reallocate it.
• PLX switch ACS control register: For every PLX/PEX bridge, writes: ECAP_ACS+0x6.w = 0000

After that, a little vibe coding to make custom all-reduce work within each PLX cluster and make DSpark work for pipeline parallel.

For tensor parallel 8, pipeline parallel 2:

500k context available. Around 4000 pp up to 500k context, tg 100-150 (Averaging 140 in DeepSeek Harness)

For tensor parallel 4, pipeline parallel 4:

Full 1M context available. Around 7000 pp up to 500k context, tg 80

Paid 0.6 x RTX6000 Pro for the whole setup.