A Quantitative Study of Deep Learning Training on Heterogeneous Supercomputers

The following topics are dealt with: parallel processing; storage management; learning (artificial intelligence); resource allocation; scheduling; computer centres; multiprocessing systems; graphics processing units; neural nets; message passing.