Optical AllReduce: Ready to Eliminate Intra-DC In-cast Vulnerability for Deep Learning Training

We present an in-network optical AllReduce that eliminates in-cast problems in distributed training. Physical-layer experiments and large-scale evaluations verify the advantages of maximum $20 \times$ bandwidth compression, $50 \%$ equipment savings, and $22 \times$ faster communications in training.