Tags: clusters
2 posts
- Interconnect Choices for Multi-Node Inference: Ethernet vs RoCE vs InfiniBand
Measured performance of three interconnect options for tensor-parallel inference on a two-node 8-GPU cluster, and when InfiniBand is worth the premium.
- Two DGX Sparks Linked: How Large a Model Can a Desktop Cluster Run?
Measured model scale and throughput for two DGX Spark units linked into a small cluster, under tensor and pipeline parallelism.