Optimizing Network Topology for Collective Communications
A general, highly scalable algorithmic framework is proposed to synthesize a network topology and schedule optimized for a given collective operation run on a network. The approach tailors efficient designs for distributed systems, demonstrating significant performance benefits even for large-scale operations.