Efficient all-to-all broadcast algorithm in torus networks

An all-to-all broadcast is a collective communication operation that every node communicates the same message to every other node in the system. We first present a novel but extremely simple algorithm for all-to-all broadcast communication with efficient hardware communication support in wormhole-switched torus networks. Then on the basic all-to-all broadcast algorithm, show how to improve the algorithm to reduce the completion time, and extend it for all-to-all broadcast with variable lengths of the messages and acknowledged all-to-all broadcast for reliable communication.