A Reconfigurable Optical Network for Distributed Deep Learning

We propose a reconfigurable optical network to accelerate distributed deep learning. The optical network reconfigures the topology to adapt different all-reduce algorithms and models. We demonstrate the performance improvement with a 32-node prototype.